US7548343B2 - Color enhancement method and system - Google Patents

Color enhancement method and system Download PDF

Info

Publication number
US7548343B2
US7548343B2 US11/262,142 US26214205A US7548343B2 US 7548343 B2 US7548343 B2 US 7548343B2 US 26214205 A US26214205 A US 26214205A US 7548343 B2 US7548343 B2 US 7548343B2
Authority
US
United States
Prior art keywords
color
colors
sensitive
values
memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US11/262,142
Other versions
US20070097461A1 (en
Inventor
Yee Seung Ng
Hwai-Tzuu Tai
Chung-Hui Kuo
Dmitri Anatolyevich Gusev
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Eastman Kodak Co
Original Assignee
Eastman Kodak Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eastman Kodak Co filed Critical Eastman Kodak Co
Priority to US11/262,142 priority Critical patent/US7548343B2/en
Assigned to EASTMAN KODAK COMPANY reassignment EASTMAN KODAK COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GUSEV, DMITRI A., KUO, CHUNG-HUI, NG, YEE S., TAI, HWAI-TZUU
Priority to JP2008538029A priority patent/JP2009514409A/en
Priority to EP06826923A priority patent/EP1941325B1/en
Priority to PCT/US2006/042092 priority patent/WO2007053472A1/en
Publication of US20070097461A1 publication Critical patent/US20070097461A1/en
Application granted granted Critical
Publication of US7548343B2 publication Critical patent/US7548343B2/en
Assigned to CITICORP NORTH AMERICA, INC., AS AGENT reassignment CITICORP NORTH AMERICA, INC., AS AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EASTMAN KODAK COMPANY, PAKON, INC.
Assigned to WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT reassignment WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT PATENT SECURITY AGREEMENT Assignors: EASTMAN KODAK COMPANY, PAKON, INC.
Assigned to PAKON, INC., EASTMAN KODAK COMPANY reassignment PAKON, INC. RELEASE OF SECURITY INTEREST IN PATENTS Assignors: CITICORP NORTH AMERICA, INC., AS SENIOR DIP AGENT, WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT
Assigned to JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE reassignment JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE INTELLECTUAL PROPERTY SECURITY AGREEMENT (FIRST LIEN) Assignors: CREO MANUFACTURING AMERICA LLC, EASTMAN KODAK COMPANY, FAR EAST DEVELOPMENT LTD., FPC INC., KODAK (NEAR EAST), INC., KODAK AMERICAS, LTD., KODAK AVIATION LEASING LLC, KODAK IMAGING NETWORK, INC., KODAK PHILIPPINES, LTD., KODAK PORTUGUESA LIMITED, KODAK REALTY, INC., LASER-PACIFIC MEDIA CORPORATION, NPEC INC., PAKON, INC., QUALEX INC.
Assigned to BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT reassignment BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT INTELLECTUAL PROPERTY SECURITY AGREEMENT (SECOND LIEN) Assignors: CREO MANUFACTURING AMERICA LLC, EASTMAN KODAK COMPANY, FAR EAST DEVELOPMENT LTD., FPC INC., KODAK (NEAR EAST), INC., KODAK AMERICAS, LTD., KODAK AVIATION LEASING LLC, KODAK IMAGING NETWORK, INC., KODAK PHILIPPINES, LTD., KODAK PORTUGUESA LIMITED, KODAK REALTY, INC., LASER-PACIFIC MEDIA CORPORATION, NPEC INC., PAKON, INC., QUALEX INC.
Assigned to BANK OF AMERICA N.A., AS AGENT reassignment BANK OF AMERICA N.A., AS AGENT INTELLECTUAL PROPERTY SECURITY AGREEMENT (ABL) Assignors: CREO MANUFACTURING AMERICA LLC, EASTMAN KODAK COMPANY, FAR EAST DEVELOPMENT LTD., FPC INC., KODAK (NEAR EAST), INC., KODAK AMERICAS, LTD., KODAK AVIATION LEASING LLC, KODAK IMAGING NETWORK, INC., KODAK PHILIPPINES, LTD., KODAK PORTUGUESA LIMITED, KODAK REALTY, INC., LASER-PACIFIC MEDIA CORPORATION, NPEC INC., PAKON, INC., QUALEX INC.
Assigned to KODAK (NEAR EAST), INC., LASER PACIFIC MEDIA CORPORATION, QUALEX, INC., KODAK PHILIPPINES, LTD., KODAK AVIATION LEASING LLC, FPC, INC., KODAK AMERICAS, LTD., PAKON, INC., FAR EAST DEVELOPMENT LTD., KODAK PORTUGUESA LIMITED, EASTMAN KODAK COMPANY, CREO MANUFACTURING AMERICA LLC, KODAK REALTY, INC., NPEC, INC., KODAK IMAGING NETWORK, INC. reassignment KODAK (NEAR EAST), INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Assigned to EASTMAN KODAK COMPANY, KODAK PORTUGUESA LIMITED, KODAK (NEAR EAST), INC., FAR EAST DEVELOPMENT LTD., KODAK PHILIPPINES, LTD., KODAK AVIATION LEASING LLC, CREO MANUFACTURING AMERICA LLC, QUALEX, INC., NPEC, INC., KODAK AMERICAS, LTD., LASER PACIFIC MEDIA CORPORATION, PAKON, INC., KODAK REALTY, INC., PFC, INC., KODAK IMAGING NETWORK, INC. reassignment EASTMAN KODAK COMPANY RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Assigned to KODAK (NEAR EAST) INC., KODAK AMERICAS LTD., QUALEX INC., KODAK PHILIPPINES LTD., LASER PACIFIC MEDIA CORPORATION, NPEC INC., FPC INC., KODAK REALTY INC., EASTMAN KODAK COMPANY, FAR EAST DEVELOPMENT LTD. reassignment KODAK (NEAR EAST) INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: BARCLAYS BANK PLC
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/603Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
    • H04N1/6033Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer using test pattern analysis
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/01Apparatus for electrographic processes using a charge pattern for producing multicoloured copies
    • G03G15/0142Structure of complete machines
    • G03G15/0178Structure of complete machines using more than one reusable electrographic recording member, e.g. one for every monocolour image
    • G03G15/0194Structure of complete machines using more than one reusable electrographic recording member, e.g. one for every monocolour image primary transfer to the final recording medium
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/50Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control
    • G03G15/5062Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control by measuring the characteristics of an image on the copy material
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G2215/00Apparatus for electrophotographic processes
    • G03G2215/00025Machine control, e.g. regulating different parts of the machine
    • G03G2215/00029Image density detection
    • G03G2215/00063Colour
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G2215/00Apparatus for electrophotographic processes
    • G03G2215/00025Machine control, e.g. regulating different parts of the machine
    • G03G2215/00029Image density detection
    • G03G2215/00067Image density detection on recording medium

Definitions

  • the invention relates to electrographic printers and apparatus thereof. More specifically, the invention is directed to processes and apparatus for enhancing color in digital color reproduction systems.
  • Electrographic printers use a developer mixing apparatus and related processes for mixing the developer or toner used during the printing process.
  • the four-color electrophographic printers for example, employ the four color toners, cyan, magenta, yellow and black (CMYK) used in the printing process to form a color image.
  • CYK magenta, yellow and black
  • electrophotographic printer is intended to encompass electrophotographic printers and copiers that employ dry toner developed on an electrophotographic receiver element, as well as ionographic printers and copiers that do not rely upon an electrophotographic receiver
  • Digital color reproduction printing systems typically include digital front-end processors, digital color printer, and post finishing systems (e.g., UV coating system, glosser system, laminator system, and etc). It reproduces original pleasing color onto substrates (such as paper).
  • the digital front-end processors take input electronic files (such as postscript command files) composed of images from other input devices (e.g., a scanner, a digital camera) together with its own internal other function processors (e.g., raster image processor, image positioning processor, image manipulation processor, color processor, image storage processor, substrate processor, and etc) to rasterizing input electronic file to become proper image bitmaps for printer to print.
  • the printer e.g., an electrographic printer
  • the post-finishing system puts finishing touch on the prints such as protection, glossing, and binding etc.
  • color toner images are made sequentially in a plurality of color imaging modules arranged in tandem, and the toner images are successively electrostatically transferred to a receiver member adhered to a transport web moving through the modules.
  • Commercial machines of this type typically employ intermediate transfer members in the respective modules for the transfer to the receiver member of individual color separation toner images.
  • each color separation toner image is directly transferred to a receiver member.
  • Electrostatographic printers having multicolor capability are known to also provide an additional toner depositing assembly for depositing clear toner.
  • the provision of a clear toner overcoat to a color print is desirable for providing protection of the print from fingerprints and reducing certain visual artifacts.
  • a clear toner overcoat will add cost and may reduce color gamut of the print; thus, it is desirable to provide for operator/user selection to determine whether or not a clear toner overcoat will be applied to the entire print.
  • U.S. Pat. No. 5,234,783 issued on Aug. 10, 1993, in the name of Yee S.
  • Ng Ng
  • a layer that varies inversely according to heights of the toner stacks may be used instead as a compromise approach to establishing even toner stack heights.
  • the respective color toners are deposited one upon the other at respective locations on the receiver member and the height of a respective color toner stack is the sum of the toner contributions of each respective color and provides the print with a more even or uniform gloss.
  • the inverse masks, the pre-fusing conditions, and the belt fuser set points can be optimized based on receiver member types to maximize the color gamut. However, due to the significant change in the color gamut, new color profiles will need to be built for each receiver member used to obtain the desired color.
  • Color shift is quite common in electrophographic printing systems during long printing projects runs.
  • the system environment can change when components, such as the fuser roller, change their operational characteristics over time.
  • linearization processes are used to re-calibrate the printer system to its correct status so that digital front-end processors are more independent from printer behavior change.
  • the linearization process alone cannot fully correct the whole color reproduction system variability. If the resultant colors especially memory sensitive colors were incorrectly shifted (for example, red shift or green shift), they would be poorly perceived and unacceptable. These are important colors that are very visible to customers. It is important to make corrections and adjustments to recreate the desired perceived memory colors.
  • the present invention overcomes this shortcoming by correcting the imbalances that can occur in printing colors such as process-sensitive colors in a color reproduction printing system.
  • the apparatus and related method describe correcting color with customer adjustable weights among process-sensitive colors desired by individual customers.
  • the following invention solves the current problems with representation of process-sensitive colors, such as memory sensitive colors, neutral colors, black and primary colors in a wide variety of situations.
  • the invention is in the field of color reproduction printing systems, which include digital front-end processors, color printers and post-finishing system such as UV coater, glosser, laminator, and etc. More specifically, the invention relates to an automatic correction and enhancement of the representation of process-sensitive colors, such as memory sensitive colors, neutral colors, black and primary colors on a substrate that process through the color reproduction system by adjusting shifted colors back to their target colors.
  • process-sensitive colors such as memory sensitive colors, neutral colors, black and primary colors
  • FIG. 1 is a schematic illustration of an electrophotographic print engine or printer apparatus, having a plurality of printing assemblies or modules that may be used in accordance with the present invention.
  • FIGS. 2A and 2B are schematic illustrations of a representative printing assembly or module used in the print engine apparatus of FIG. 1 showing additional details.
  • FIG. 3A is a flow chart illustration of a process steps according to one aspect of the invention.
  • FIG. 3B is an illustration of loading different 1-D correction processes into a printer according to the invention illustrated in FIG. 3A .
  • FIG. 3C is an illustration of loading different 1-D correction processes into a printer according to the invention illustrated in FIG. 3A .
  • FIG. 4 is a schematic representation of a process that characterizes the color shift of desired printing system and current printing system.
  • FIG. 5A is a schematic representation of a process according to FIG. 3 of the invention.
  • FIG. 5B is an example of weights assigning to different controlled color set.
  • FIG. 6A is a flow chart illustration of process steps according to another aspect of the invention.
  • FIG. 6B An illustration of loading 3D corrections according to the invention described in FIG. 4A .
  • FIG. 7 is a LAB to CMYK color transformation in a four-color printer, also called a backward transform from printing process point of view.
  • FIG. 8 is a CMYK to LAB color transformation in a four-color printer, also called a forward transform from printing process point of view.
  • FIGS. 9A & 9B is block diagram of the color correction process of the first embodiment in the printing process.
  • FIG. 10 is a block diagram of the color correction process of second embodiment in the printing process.
  • FIG. 11 is a three B-spline basis function illustration in accordance with this invention.
  • FIG. 12 is an illustration of a 1-D correction curve in accordance with this invention.
  • FIG. 1 is a side elevational view schematically showing portions of an electrophotographic print engine or printer apparatus 10 suitable for printing multicolor toner images on receiver members.
  • a plurality of colors may be combined on a single receiver member using electrographic printers.
  • the term “electrographic printer,” is intended to encompass electrophotographic printers and copiers that employ dry toner developed on an electrographic receiver element, as well as ionographic printers and copiers that do not rely upon an electrographic receiver.
  • the color electrophographic printer shown in FIG. 1 employs a plurality of color toner modules (represented for reference only in FIG. 1 as M 1 -M 5 ), such as the CMYK toner system, in conjunction with printing on a substrate that travels along a transport web 11 .
  • Each of the modules generates a single-color toner image for transfer to a receiver member successively moved through the modules.
  • the modules can also be used to provide a clear toner overcoat as described in co-pending application Ser. No. 11/155,268.
  • Each receiver member during a single pass by the modules, can have transferred in registration thereto, for a plurality of single-color toner images to form a multicolor image with a clear toner overcoat or other desired application.
  • the term multicolor implies that in an image formed on the receiver member has combinations of subsets of primary colors combined to form other colors on the receiver member, at various locations on the receiver member.
  • the primary colors participate to form process colors in at least some of the subsets, wherein each of the primary colors may be combined with one more of the other primary colors at a particular location on the receiver member to form a color different than the specific color toners combined at that location.
  • FIG. 2A shows a Logic and Control Unit (LCU) 12 including one or more computers acting in response to signals from various sensors associated with the apparatus and provide timing and control signals to the respective components to control the various components and process control parameters of the apparatus in accordance with methods well known by those skilled in the arts.
  • Printer 10 includes a controller or logic and control unit (LCU) 12 , preferably a digital computer or microprocessor operating according to a stored program for sequentially actuating the workstations within printer 10 , effecting overall control of printer 10 and its various subsystems.
  • LCU 12 also is programmed to provide closed-loop control of printer 10 in response to signals from various sensors and encoders. Aspects of process control are described in U.S. Pat. No. 6,121,986 incorporated herein by this reference.
  • the LCU 12 includes a microprocessor and suitable tables and control software which is executable by the LCU 12 .
  • the control software is preferably stored in memory associated with the LCU 12 .
  • Sensors associated with the fusing and glossing assemblies provide appropriate signals to the LCU 12 when the glosser is integrated with the printing apparatus.
  • the glosser can have separate controls providing control over temperature of the glossing roller and the downstream cooling of the fusing belt and control of glossing nip pressure.
  • the LCU 12 issues command and control signals that adjust the heat and/or pressure within fusing nip (not shown) so as to reduce image artifacts which are attributable to and/or are the result of release fluid disposed upon and/or impregnating a receiver member that is subsequently processed by/through a finishing device such as a glossing assembly (not shown). Additional elements provided for control may be assembled about the various module elements, such as for example a meter 14 for measuring the uniform electrostatic charge and a meter 16 for measuring the post-exposure color within a patch area of an image area on the printed surface.
  • FIG. 2B shows a representative color-printing module.
  • Each color-printing module 20 of the printer apparatus includes a plurality of electrophotographic imaging subsystems for producing a respective single-color toned image. Included in each module is a primary charging subsystem 22 for uniformly electrostatically charging a surface 24 of a photoconductive imaging member 26 , shown in the form of an imaging cylinder.
  • an exposure subsystem 28 for image modulation of the uniform electrostatic charge by exposing the photoconductive imaging member to form a latent electrostatic color separation image in the respective color
  • a development subsystem 30 for toning the exposed photoconductive imaging member with toner of the respective color
  • an intermediate transfer member 32 for transferring the respective color separation image from the photoconductive imaging member through a transfer nip 34 to the surface 36 of the intermediate transfer member 32 , and through a second transfer nip 38 from the intermediate transfer member to a receiver member (receiver member 40 shown prior to entry into the second transfer nip 38 .
  • receiver member 42 shown subsequent to the transfer of the toned color separation image after receiving the respective toned color separation images 44 in superposition to form a composite multicolor image thereon.
  • An electrostatic field provided to a backup roller 46 from a power source 48 effects transfer to the receiver member.
  • All the modules are substantially identical to the above-described module. Some of the modules transfer a type of pigmented toner and others non-pigmented toner, such as a clear toner or some other transfer material or a combination of pigmented and non-pigmented toner.
  • the photoconductive imaging member 26 can alternatively have the form of an endless web, and the intermediate transfer member 32 may also be an endless web, although it is preferred to be a compliant roller of a well-known type.
  • the exposure device may include a Light Emitting Diode (LED) writer or laser writer or other electro-optical or optical recording element.
  • Charging device 22 can be any suitable device for producing uniform pre-exposure potential on photoconductive imaging member 26 , the charging device including, for example, any type of corona charger or roller charger.
  • a cleaning device may be associated with the surface 24 of the photoconductive image recording member, and another cleaning device may be associated with the surface 36 of the intermediate transfer member after respective transfer of the toned images.
  • Still other forms of electrostatographic recording apparatus may be used to form the multicolor image, and such apparatus need not have the color assemblies arranged in a tandem form as described herein.
  • the electrostatic image is developed, preferably using the well known discharged area development technique, by application of pigmented marking particles to the latent image bearing photoconductive drum by the respective exposure subsystem 28 , which development subsystem 30 can employ Small Particle Dry (SPD) developers.
  • a suitable voltage to develop the respective latent image, electrically biases each of the development assemblies.
  • the voltage may be supplied by a power supply or by individual power supplies (not illustrated).
  • the respective developer is a two-component developer that includes toner marking particles and magnetic carrier particles.
  • Each color development assembly has a particular color of pigmented toner marking particles associated respectively therewith for toning.
  • each of the modules, M 1 through M 4 creates a different color marking particle image on the respective photographic drum.
  • the developer may be a single-component developer. It is also contemplated that the color toners may each be associated with a liquid developer. As will be discussed further below, a clear toner development assembly may be substituted for one of the pigmented developer assemblies so that the fifth module operates in similar manner to that of the other modules which deposits pigmented toner; however, the development assembly of the clear toner module has toner particles associated respectively therewith that are similar to the toner marking particles of the color development assemblies but without the pigmented material incorporated within the toner.
  • the color printer can employ four different colorants (cyan, magenta, yellow, black), three different colorants (red, green, blue), or multiple colorants (cyan, magenta, yellow, black, red, green, blue) to form variety of colors.
  • These colorants represent CMYK colors, RGB colors or multiple colors in device-dependent color space. This means that color generated or displayed within these spaces are directly linked to a specific printer, ink, media, reproduction process or combination thereof.
  • the RGB space of one manufacture monitor may be different than that in the RGB space of another manufacture monitor.
  • the CMYK space of one manufacture-printing device may be different from the CMYK space of another manufacture-printing device.
  • These CMYK, RGB, or multiple colors may be characterized by its lightness, saturation, and hue.
  • CIELAB device-independent color space
  • LAB response wherein the “L” represents the lightness of the color, the “a” represents the location of the color on a spectrum from red to green, and the “b” represents the location of the color on a spectrum from yellow to blue.
  • the “a” and “b” taken together represent the saturation and hue of the color.
  • L* a* b* will also be used to refer to individual coordinates of the LAB color system.
  • the color printing system needs to be calibrated and characterized for accurate color reproduction. These include setup of the printer to the specification for each color separation and printed large number of test patches to construct proper color transformation.
  • the color transformation that characterizes the printing system maps color between device-dependent color and device-independent color. For example, it transforms the device independent color system LAB data, defined above, into CMYK data, for example as shown in FIG. 7 , and vice versa, for example as shown in FIG. 8 .
  • the color transforms are stored in a look-up table (LUT) format, in general, for easy access in processing color data.
  • the International Color Consortium (ICC) color profile which characterizes the printing system, contains multiple color transformation tables in LUT form.
  • FIG. 3A describes an embodiment of the color enhancement method and system.
  • the process-sensitive automatic color correction is performed in the device-dependent color space as shown in the process steps of FIG. 3A , 301 , 302 , 303 , 304 , 305 , 306 , and 320 .
  • the select control color set 301 can include all the process-sensitive colors and image dependent color patches.
  • Process sensitive colors include the memory sensitive colors such as flesh tone colors, blue sky colors, green foliage colors as well as neutral colors, and primary colors. The process sensitive colors of interest are selected and used as the target colors for adjusting the color reproduction printing system. These control colors should be in the LAB color specification.
  • the target CMYK colorant set is generated to use for the color transformation of the ICC profile for a specific substrate represented by ⁇ L a b i ⁇ CMYK i ⁇ .
  • This ⁇ L a b ⁇ color set was prepared or transformed through the backward color transformation shown in FIG. 7 and discussed later in conjunction to step 701 .
  • This ⁇ CMYK ⁇ colorant set is the target color specification, also known as a target color also sometimes referred to as a reference color or a desired color or even as the “aim”.
  • the following table from the Kuang reference discussed above is an example of the memory sensitive data that could be used.
  • the target CMYK colorant is printed as shown in step 303 .
  • the target color set is printed on a substrate along with any required post-processing such as with a gloss finishing system.
  • the post-finishing printed control printed target CMYK colorant set is measured in the 304 measurement step using a measurement device such as a colorimeter, spectrophotometer or flat bed scanner.
  • a measurement device such as a colorimeter, spectrophotometer or flat bed scanner.
  • a measurement device such as a colorimeter, spectrophotometer or flat bed scanner.
  • color measurement devices that could also be used if they are capable of generating a new set of ⁇ L′ a′ b′ ⁇ .
  • There differences between the original ⁇ L a b ⁇ color set and the new ⁇ L′a′b′ ⁇ color set of each selected color can be caused by the color shifts or color deviations due to printing system variations or even due to the viewers perception. The larger the color deviations, the larger the differences in perceived color.
  • the new ⁇ L′a′b′ ⁇ color set is color transformed to ⁇ C′M′Y′K′ ⁇ colorant representation through the forward color transform 801 of the printer shown in FIG. 8 and discussed later in conjunction to step 801 .
  • the new ⁇ C′M′Y′K′ ⁇ colorant set is generated in 305 .
  • Both colorant sets ⁇ CMYK ⁇ and ⁇ C′M′Y′K′ ⁇ are from the original control colors and these represent the color deviations in device dependent CMYK color space before and after printing, including the post-finishing process.
  • step 306 the differences between the original and the post-processing colorant set are minimized using a mathematical regression method with specific enhancement steps.
  • This step using different weighted factors that are applied to the two colorant sets to minimize the color differences between the original and the new CMYK colorant while balancing the capabilities of the printer and post finishing device through the use of the pre-defined weighted values for each different color that is to be adjusted, as shown in FIG. 3A .
  • Four 1-D correction curves are generated at the end of 306 step and the color correction can be performed through the adjustment of 1-D curve on each separation (i.e.; C′->C; M′->M; Y′->Y; K′->K) independently.
  • the 1-D color corrections are loaded into printer in step 320 which adjust the color shifts back to its target color. These adjustment will not impact the rasterized image data output from the digital front end. The whole color reproduction printing system will then be re-calibrated to reproduce correct process-sensitive colors.
  • the weights are assigned to each color according to individual preferences on the control color set (or on the evaluated images) (as illustrated in FIG. 5B as example).
  • the accuracy of local mapping around the emphasized color can be improved. For example, emphasizing more (giving more weights on those flesh tone colors) on flesh tone area if the evaluating image is a portrait image. Other memory colors correction can be less emphasized.
  • an enhancement step is introduced, as will be discussed below in relation to FIGS. 4 and 5 . The enhancement is to perform K->K′ regression first.
  • This two-step regression process maintains the black colorant of the original color transformation created in LAB->CMYK backward color transformation and minimize the color differences between the original and the new CMYK colorant in the 1-D color correction process. More detailed data flow diagram is illustrated in FIG. 5A .
  • FIG. 3B describes the first of two different 1-D correction processes to accomplish the step of loading the corrections, before printing them with a writing device 310 , as described in 320 step of FIG. 3A .
  • step 320 A four 1-D correction curves that generated at step 306 are loaded into printer in the process step 307 . These loaded values are used to replace the original characteristic curves in the printer. During this step it is important to remember that the original characteristic curves will be lost if they are not saved somewhere else in the printer.
  • steps 308 and 309 of FIG. 3C that uses differential 1-D correction for each separation to readjust color back to its target color.
  • FIG. 3C step 320 B illustrates how the difference 1-D curve can be alternately generated using differential 1-D correction curves.
  • a 1-D curve of ⁇ C, ⁇ M, ⁇ Y, ⁇ K is generated from the original and new correction curves (C′->C; M′->M; Y′->Y; K′->K).
  • the set of ⁇ C, ⁇ M, ⁇ Y, ⁇ K difference curves are further estimated to generate projected basis coefficients for each color, for example, a three-basis function such as a B-spline function having a low, medium, high content distribution.
  • a B-spline function that can be used to accomplish this step is illustrated in FIG. 11 .
  • step 309 After the B-spline coefficients for each separation color are generated they are loaded in step 309 into writing device 310 .
  • the original 1-D curves (C 0 ,M 0 ,Y 0 ,K 0 ) are adjusted by the difference values ⁇ C, ⁇ M, ⁇ Y, ⁇ K that were re-constructed from the projected basis coefficients to the modified 1-D curve.
  • Other basis functions besides a B-spline basis function can be used as long as it produces the accuracy necessary.
  • FIG. 9A & FIG. 9B show color adjustment modules 901 , 902 corresponding to each of the two methods described in FIGS. 3A and 3B and 3 A and 3 C respectively.
  • the loading 1-D color adjustment steps 307 and 309 are shown at 920 and 930 of FIGS. 9A and 9B respectively.
  • FIG. 9A and FIG. 9B show the input image file 900 , including the original colorant set being processed by the front end processors 910 including RIP, color processor and other function processors before the corrected colorant sets are entered into the color modules 901 , 902 located in the LCU 12 before they are printed by the writing device 310 .
  • the color adjustment module is independent of digital front-end processors 910 . The image data will not need to be re-rasterized after the corrected colorant sets are generated.
  • FIG. 4 is a schematic representation of the first embodiment for the perceived difference among all selected color patches, such as 401 , 402 , 403 , and 404 , is illustrated in FIG. 5A .
  • the Desired Printing System 405 is the state of a printing system at the time of generating the associated ICC profiles, which characterize color printers.
  • the Current Printing System 406 represents the current state of that system which is assumed to be different from 405 . Based on the prior information characterized in the ICC profile, the set of target color(s) 407 , in the device independent space CIELAB can be readily obtained.
  • the current system 406 prints the selected patches 401 ⁇ 404 , their colors can then be measured, resulting in the measured colorant set in L* a* b* space 408 .
  • the color difference associated each color patch can be computed based on 407 and 408 .
  • FIG. 5A shows a two-step process where the corrected K is determined first before CMY is corrected.
  • a one-step process could achieve a similar result by extending the weighting coefficients to the K channel, as indicated by the dashed line in FIG. 5A , during the minimization process.
  • the schematic shown in FIG. 5 is the process diagram and data flow for correcting the colorant composition for the first embodiment of the invention. As is shown, the weight coefficient given the K table could be anything including the highest weight.
  • the first step in the correction process shown in FIG. 5A is to identify the mapping between K and K′ to achieve a unique solution (as was shown in step 306 before) before proceeding with the following CMY->C′M′Y′ correction steps.
  • the state of the current printing system is characterized by the measured color sets 501 , 502 , 503 and 504 .
  • current commercial printing generally four colorants are used individually or simultaneously to represent the desired color in Lab representation. Since the desired printing system is represented by the existing color transforms or the associated ICC profile that characterize the system, the new colorant combinations, ⁇ C′M′Y′K′ ⁇ , can be computed under certain constraints as indicated in 505 , 506 and 507 .
  • the optimization procedures with various constraints accordingly, 505 , 506 and 507 is to modify the combination CMYK colorants to achieve the intended color Lab value measured in ⁇ E color errors, which could be defined as ( ⁇ L ⁇ 2+ ⁇ a ⁇ 2+ ⁇ b ⁇ 2) ⁇ (0.5) based on the color transforms in the selected ICC profile or LUT.
  • ⁇ E color errors which could be defined as ( ⁇ L ⁇ 2+ ⁇ a ⁇ 2+ ⁇ b ⁇ 2) ⁇ (0.5) based on the color transforms in the selected ICC profile or LUT.
  • an optimization routine is performed under the constraint that C, M and Y colorant values are approximately zero, and results in a new set of ⁇ K′ ⁇ .
  • C, M and Y colorant values are approximately zero, and results in a new set of ⁇ K′ ⁇ .
  • a black K-correction algorithm 511 is designed to compute and generate the mapping function from K to K′ based on black ramp color 402 and 501 .
  • This updated K′ component will then be fed into the optimization procedure 506 as the constraint in the K component where the color set 502 and 503 usually contains all four CMYK colorants.
  • the resulted C′M′Y′ values are more accurately achieved in the color set 502 , 503 .
  • the constraint optimization procedure 507 is to confine K to be zero because CMY ramp contains no K components.
  • the CMY correction regression algorithm 512 is responsible to compute and generate the desired three CMY 1-D mapping functions to achieve C->C′, M->M′ and Y->Y′ based on the assigned weighting coefficients (illustrated in FIG. 5B ) between the new colorant set for neutral colors 513 , the set for memory-sensitive colors 514 and the set for CMY colors 510 (see the corresponding steps in FIG. 4 which include 401 , 403 and 404 ). These four 1-D correction curves are fed through color adjustment module 901 in the printer. In a similar manner additional colors can be mapped.
  • CMYKF where F is the fifth color
  • this method is not limited to a four color system and can work in conjunction with a plurality of colors and finishing systems.
  • FIG. 6A shows a flow chart representing another embodiment of the color enhancement method and system.
  • the process-sensitive color correction is performed in the device-independent LAB color space instead of the device-dependent LAB color space described in the prior examples.
  • Color corrections are made in the process steps 601 , 602 , 603 , 604 as shown in FIG. 6 . All of these steps, except steps 605 and 606 , are described above as the process steps 301 , 302 , 303 , 304 of FIG. 3A .
  • the target colors ⁇ L a b ⁇ and the measured new colors ⁇ L′a′b′ ⁇ are generated from the original control colorant set and have a regression applied to the resultant data in step 606 .
  • different weights are assigned to each color according to individual preferences on the control color set (or on the evaluated images) as discussed above.
  • the regression constructs a 3 ⁇ 3 mapping model from ⁇ L′a′b′ ⁇ to ⁇ L a b ⁇ at the end of step 606 .
  • the constructed 3 ⁇ 3 mapping model can be represented in 3-D LUT form.
  • the 3-D LUT correction table is loaded into the writing device 610 in step 630 for color correction as further illustrated in FIG.
  • mapping model the localized L′a′b′->L a b mapping model or the global L′a′b′->L a b mapping model can be constructed and used.
  • localized L′a′b′->L a b mapping only the targeted regional LAB spaces are affected and other regional LAB spaces are unaffected.
  • global L′A′B′->LAB mapping the whole LAB space is affected.
  • the L′a′b′->Lab mapping look-up table (LUT) is loaded in the color processing data flow step 607 of FIG. 6B or described again in RIP/color processor 1001 of FIG. 10 .
  • This embodiment has a different color correction process compared with the first embodiment.
  • the color correction data flow of the second embodiment is illustrated in FIG. 10 .
  • the memory color correction process step 1004 represents the new colorant set corrections and is interfaced with the color processor 1001 in the digital front-end processors 1000 .
  • the 3-D correction LUT is loaded into color processor 1001 and carried out by color correction processor 1006 .
  • the color processor 1001 also includes the color transforms 1005 which converts the device-dependent CMYK color space values to device-independent LAB color space values and other color transforms 1007 which convert device-independent LAB color space values to device-dependent CMYK color space values and 3-D correction color is performed in device-independent LAB color space using the correction processor 1006 .

Abstract

An apparatus and method for calibrating a multi-color imaging system are provided. Color values are measured for each of the different color patches, and compared to target process-sensitive colors color values, representing a weight-adjusted memory color. An error value is calculated. The error value represents a deviation of the measured color values from the target color values. The input values for each colorant then are independently adjusted to reduce the error value to a predetermined degree.

Description

FIELD OF THE INVENTION
The invention relates to electrographic printers and apparatus thereof. More specifically, the invention is directed to processes and apparatus for enhancing color in digital color reproduction systems.
BACKGROUND
Electrographic printers use a developer mixing apparatus and related processes for mixing the developer or toner used during the printing process. The four-color electrophographic printers, for example, employ the four color toners, cyan, magenta, yellow and black (CMYK) used in the printing process to form a color image. The term “electrographic printer,” is intended to encompass electrophotographic printers and copiers that employ dry toner developed on an electrophotographic receiver element, as well as ionographic printers and copiers that do not rely upon an electrophotographic receiver
Digital color reproduction printing systems typically include digital front-end processors, digital color printer, and post finishing systems (e.g., UV coating system, glosser system, laminator system, and etc). It reproduces original pleasing color onto substrates (such as paper). The digital front-end processors take input electronic files (such as postscript command files) composed of images from other input devices (e.g., a scanner, a digital camera) together with its own internal other function processors (e.g., raster image processor, image positioning processor, image manipulation processor, color processor, image storage processor, substrate processor, and etc) to rasterizing input electronic file to become proper image bitmaps for printer to print. An operator may be assisted to set up parameters such as layout, font, color, paper, post-finishing, and etc among those digital font-end processors. The printer (e.g., an electrographic printer) takes rasterized bitmap and renders the bitmap into a form that can control the printing process from the exposure device to writing the image onto paper. The post-finishing system puts finishing touch on the prints such as protection, glossing, and binding etc.
In an electrophotographic modular printing machine of known type, for example, the NexPress 2100 printer manufactured by NexPress Solutions, Inc., of Rochester, N.Y., color toner images are made sequentially in a plurality of color imaging modules arranged in tandem, and the toner images are successively electrostatically transferred to a receiver member adhered to a transport web moving through the modules. Commercial machines of this type typically employ intermediate transfer members in the respective modules for the transfer to the receiver member of individual color separation toner images. Of course, in other electrostatographic printers, each color separation toner image is directly transferred to a receiver member.
Electrostatographic printers having multicolor capability are known to also provide an additional toner depositing assembly for depositing clear toner. The provision of a clear toner overcoat to a color print is desirable for providing protection of the print from fingerprints and reducing certain visual artifacts. However, a clear toner overcoat will add cost and may reduce color gamut of the print; thus, it is desirable to provide for operator/user selection to determine whether or not a clear toner overcoat will be applied to the entire print. In U.S. Pat. No. 5,234,783, issued on Aug. 10, 1993, in the name of Yee S. Ng, it is noted that in lieu of providing a uniform layer of clear toner, a layer that varies inversely according to heights of the toner stacks may be used instead as a compromise approach to establishing even toner stack heights. As is known, the respective color toners are deposited one upon the other at respective locations on the receiver member and the height of a respective color toner stack is the sum of the toner contributions of each respective color and provides the print with a more even or uniform gloss.
In U.S. patent application Ser. No. 11/062,972, filed on Feb. 22, 2005, in the names of Yee S. Ng et al., a method is disclosed of forming a print having a multicolor image supported on a receiver member wherein a multicolor toner image is formed on the receiver member by toners of at least three different colors of toner pigments which form various combinations of color at different pixel locations on the receiver member to form the multicolor toner image thereon; forming a clear toner overcoat upon the multicolor toner image, the clear toner overcoat being deposited as an inverse mask; pre-fusing the multicolor toner image and clear toner overcoat to the receiver member to at least tack the toners forming the multicolor toner image and the clear toner overcoat; and subjecting the clear toner overcoat and the multicolor toner image to heat and pressure using a belt fuser to provide an improved color gamut and gloss to the image. The inverse masks, the pre-fusing conditions, and the belt fuser set points can be optimized based on receiver member types to maximize the color gamut. However, due to the significant change in the color gamut, new color profiles will need to be built for each receiver member used to obtain the desired color.
Color shift is quite common in electrophographic printing systems during long printing projects runs. The system environment can change when components, such as the fuser roller, change their operational characteristics over time. Typically linearization processes are used to re-calibrate the printer system to its correct status so that digital front-end processors are more independent from printer behavior change. However, in the whole color reproduction printing system, which includes both printer and post finishing system (e.g., UV coater, glosser, and etc), the linearization process alone cannot fully correct the whole color reproduction system variability. If the resultant colors especially memory sensitive colors were incorrectly shifted (for example, red shift or green shift), they would be poorly perceived and unacceptable. These are important colors that are very visible to customers. It is important to make corrections and adjustments to recreate the desired perceived memory colors. [Ref: A psychophysical study on the influence factors of color preferences in photographic color reproduction; Proceeding of SPIE-IS&T, vol. 5668]
Previously the “tweaking of color” has been performed manually. However, a manual “color tweaking” process is tedious and only addresses some specific colors that customers are very sensitive to when they view their prints. This invention anticipates this problem and can overcome this shortcoming of previous printing systems by weighting the important process-sensitive colors in such a way that includes all important memory sensitive colors in an automated process that takes into account all-important process-sensitive colors and dynamically adjusts the system to the desired parameters.
The present invention overcomes this shortcoming by correcting the imbalances that can occur in printing colors such as process-sensitive colors in a color reproduction printing system. The apparatus and related method describe correcting color with customer adjustable weights among process-sensitive colors desired by individual customers. The following invention solves the current problems with representation of process-sensitive colors, such as memory sensitive colors, neutral colors, black and primary colors in a wide variety of situations.
SUMMARY OF THE INVENTION
The invention is in the field of color reproduction printing systems, which include digital front-end processors, color printers and post-finishing system such as UV coater, glosser, laminator, and etc. More specifically, the invention relates to an automatic correction and enhancement of the representation of process-sensitive colors, such as memory sensitive colors, neutral colors, black and primary colors on a substrate that process through the color reproduction system by adjusting shifted colors back to their target colors.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic illustration of an electrophotographic print engine or printer apparatus, having a plurality of printing assemblies or modules that may be used in accordance with the present invention.
FIGS. 2A and 2B are schematic illustrations of a representative printing assembly or module used in the print engine apparatus of FIG. 1 showing additional details.
FIG. 3A is a flow chart illustration of a process steps according to one aspect of the invention.
FIG. 3B is an illustration of loading different 1-D correction processes into a printer according to the invention illustrated in FIG. 3A.
FIG. 3C is an illustration of loading different 1-D correction processes into a printer according to the invention illustrated in FIG. 3A.
FIG. 4 is a schematic representation of a process that characterizes the color shift of desired printing system and current printing system.
FIG. 5A is a schematic representation of a process according to FIG. 3 of the invention.
FIG. 5B is an example of weights assigning to different controlled color set.
FIG. 6A is a flow chart illustration of process steps according to another aspect of the invention.
FIG. 6B An illustration of loading 3D corrections according to the invention described in FIG. 4A.
FIG. 7 is a LAB to CMYK color transformation in a four-color printer, also called a backward transform from printing process point of view.
FIG. 8 is a CMYK to LAB color transformation in a four-color printer, also called a forward transform from printing process point of view.
FIGS. 9A & 9B is block diagram of the color correction process of the first embodiment in the printing process.
FIG. 10 is a block diagram of the color correction process of second embodiment in the printing process.
FIG. 11 is a three B-spline basis function illustration in accordance with this invention.
FIG. 12 is an illustration of a 1-D correction curve in accordance with this invention.
DETAILED DESCRIPTION
FIG. 1 is a side elevational view schematically showing portions of an electrophotographic print engine or printer apparatus 10 suitable for printing multicolor toner images on receiver members. A plurality of colors may be combined on a single receiver member using electrographic printers. The term “electrographic printer,” is intended to encompass electrophotographic printers and copiers that employ dry toner developed on an electrographic receiver element, as well as ionographic printers and copiers that do not rely upon an electrographic receiver. The color electrophographic printer shown in FIG. 1 employs a plurality of color toner modules (represented for reference only in FIG. 1 as M1-M5), such as the CMYK toner system, in conjunction with printing on a substrate that travels along a transport web 11. Each of the modules generates a single-color toner image for transfer to a receiver member successively moved through the modules. The modules can also be used to provide a clear toner overcoat as described in co-pending application Ser. No. 11/155,268. Each receiver member, during a single pass by the modules, can have transferred in registration thereto, for a plurality of single-color toner images to form a multicolor image with a clear toner overcoat or other desired application. As used herein, the term multicolor implies that in an image formed on the receiver member has combinations of subsets of primary colors combined to form other colors on the receiver member, at various locations on the receiver member. The primary colors participate to form process colors in at least some of the subsets, wherein each of the primary colors may be combined with one more of the other primary colors at a particular location on the receiver member to form a color different than the specific color toners combined at that location.
FIG. 2A shows a Logic and Control Unit (LCU) 12 including one or more computers acting in response to signals from various sensors associated with the apparatus and provide timing and control signals to the respective components to control the various components and process control parameters of the apparatus in accordance with methods well known by those skilled in the arts. Printer 10 includes a controller or logic and control unit (LCU) 12, preferably a digital computer or microprocessor operating according to a stored program for sequentially actuating the workstations within printer 10, effecting overall control of printer 10 and its various subsystems. LCU 12 also is programmed to provide closed-loop control of printer 10 in response to signals from various sensors and encoders. Aspects of process control are described in U.S. Pat. No. 6,121,986 incorporated herein by this reference.
The LCU 12 includes a microprocessor and suitable tables and control software which is executable by the LCU 12. The control software is preferably stored in memory associated with the LCU 12. Sensors associated with the fusing and glossing assemblies provide appropriate signals to the LCU 12 when the glosser is integrated with the printing apparatus. In any event, the glosser can have separate controls providing control over temperature of the glossing roller and the downstream cooling of the fusing belt and control of glossing nip pressure. In response to the sensors, the LCU 12 issues command and control signals that adjust the heat and/or pressure within fusing nip (not shown) so as to reduce image artifacts which are attributable to and/or are the result of release fluid disposed upon and/or impregnating a receiver member that is subsequently processed by/through a finishing device such as a glossing assembly (not shown). Additional elements provided for control may be assembled about the various module elements, such as for example a meter 14 for measuring the uniform electrostatic charge and a meter 16 for measuring the post-exposure color within a patch area of an image area on the printed surface.
FIG. 2B shows a representative color-printing module. Each color-printing module 20 of the printer apparatus includes a plurality of electrophotographic imaging subsystems for producing a respective single-color toned image. Included in each module is a primary charging subsystem 22 for uniformly electrostatically charging a surface 24 of a photoconductive imaging member 26, shown in the form of an imaging cylinder. Also included is an exposure subsystem 28 for image modulation of the uniform electrostatic charge by exposing the photoconductive imaging member to form a latent electrostatic color separation image in the respective color; a development subsystem 30 for toning the exposed photoconductive imaging member with toner of the respective color; an intermediate transfer member 32 for transferring the respective color separation image from the photoconductive imaging member through a transfer nip 34 to the surface 36 of the intermediate transfer member 32, and through a second transfer nip 38 from the intermediate transfer member to a receiver member (receiver member 40 shown prior to entry into the second transfer nip 38. Also shown is receiver member 42, shown subsequent to the transfer of the toned color separation image after receiving the respective toned color separation images 44 in superposition to form a composite multicolor image thereon. An electrostatic field provided to a backup roller 46 from a power source 48 effects transfer to the receiver member. All the modules are substantially identical to the above-described module. Some of the modules transfer a type of pigmented toner and others non-pigmented toner, such as a clear toner or some other transfer material or a combination of pigmented and non-pigmented toner.
In an alternative embodiment, the photoconductive imaging member 26 can alternatively have the form of an endless web, and the intermediate transfer member 32 may also be an endless web, although it is preferred to be a compliant roller of a well-known type. The exposure device may include a Light Emitting Diode (LED) writer or laser writer or other electro-optical or optical recording element. Charging device 22 can be any suitable device for producing uniform pre-exposure potential on photoconductive imaging member 26, the charging device including, for example, any type of corona charger or roller charger. A cleaning device may be associated with the surface 24 of the photoconductive image recording member, and another cleaning device may be associated with the surface 36 of the intermediate transfer member after respective transfer of the toned images. Still other forms of electrostatographic recording apparatus may be used to form the multicolor image, and such apparatus need not have the color assemblies arranged in a tandem form as described herein.
The electrostatic image is developed, preferably using the well known discharged area development technique, by application of pigmented marking particles to the latent image bearing photoconductive drum by the respective exposure subsystem 28, which development subsystem 30 can employ Small Particle Dry (SPD) developers. A suitable voltage, to develop the respective latent image, electrically biases each of the development assemblies. The voltage may be supplied by a power supply or by individual power supplies (not illustrated). Preferably, the respective developer is a two-component developer that includes toner marking particles and magnetic carrier particles. Each color development assembly has a particular color of pigmented toner marking particles associated respectively therewith for toning. Thus, each of the modules, M1 through M4, creates a different color marking particle image on the respective photographic drum. Alternatively, the developer may be a single-component developer. It is also contemplated that the color toners may each be associated with a liquid developer. As will be discussed further below, a clear toner development assembly may be substituted for one of the pigmented developer assemblies so that the fifth module operates in similar manner to that of the other modules which deposits pigmented toner; however, the development assembly of the clear toner module has toner particles associated respectively therewith that are similar to the toner marking particles of the color development assemblies but without the pigmented material incorporated within the toner.
As indicated above, the color printer can employ four different colorants (cyan, magenta, yellow, black), three different colorants (red, green, blue), or multiple colorants (cyan, magenta, yellow, black, red, green, blue) to form variety of colors. These colorants represent CMYK colors, RGB colors or multiple colors in device-dependent color space. This means that color generated or displayed within these spaces are directly linked to a specific printer, ink, media, reproduction process or combination thereof. The RGB space of one manufacture monitor may be different than that in the RGB space of another manufacture monitor. The CMYK space of one manufacture-printing device may be different from the CMYK space of another manufacture-printing device. These CMYK, RGB, or multiple colors may be characterized by its lightness, saturation, and hue. One commonly used color measurement system is the device-independent color space CIELAB also known as the LAB response wherein the “L” represents the lightness of the color, the “a” represents the location of the color on a spectrum from red to green, and the “b” represents the location of the color on a spectrum from yellow to blue. The “a” and “b” taken together represent the saturation and hue of the color. Note that the notation L* a* b* will also be used to refer to individual coordinates of the LAB color system.
The color printing system needs to be calibrated and characterized for accurate color reproduction. These include setup of the printer to the specification for each color separation and printed large number of test patches to construct proper color transformation. The color transformation that characterizes the printing system maps color between device-dependent color and device-independent color. For example, it transforms the device independent color system LAB data, defined above, into CMYK data, for example as shown in FIG. 7, and vice versa, for example as shown in FIG. 8. The color transforms are stored in a look-up table (LUT) format, in general, for easy access in processing color data. The International Color Consortium (ICC) color profile, which characterizes the printing system, contains multiple color transformation tables in LUT form.
FIG. 3A describes an embodiment of the color enhancement method and system. The process-sensitive automatic color correction is performed in the device-dependent color space as shown in the process steps of FIG. 3A, 301, 302, 303, 304, 305, 306, and 320. One skilled in the art would understand that all the steps involved could be programmed to occur automatically or combined with suitable operator interface controls. The select control color set 301 can include all the process-sensitive colors and image dependent color patches. Process sensitive colors include the memory sensitive colors such as flesh tone colors, blue sky colors, green foliage colors as well as neutral colors, and primary colors. The process sensitive colors of interest are selected and used as the target colors for adjusting the color reproduction printing system. These control colors should be in the LAB color specification. Next, in process step 302, the target CMYK colorant set is generated to use for the color transformation of the ICC profile for a specific substrate represented by {L a bi}→{CMYKi}. This {L a b} color set was prepared or transformed through the backward color transformation shown in FIG. 7 and discussed later in conjunction to step 701. This {CMYK} colorant set is the target color specification, also known as a target color also sometimes referred to as a reference color or a desired color or even as the “aim”. The following table from the Kuang reference discussed above is an example of the memory sensitive data that could be used.
Category L* a* b*
Caucasian Skin Indoor w/Flash 56 22 29
Caucasian Skin Indoor w/o Flash 64 27 38
Caucasian Skin Outdoor 72 20 20
Caucasian 64 27 38
Asian 74 12 22
Indian 55 23 30
African 40 18 29
Sky (desert) 50 −2 −46
Sky (grass) 54 −2 −44
Sky (snow) 61 −4 −43
Grass (field) 49 −33 51
Grass (golf) 59 −31 41
Grass (house) 42 −30 42
Next the target CMYK colorant is printed as shown in step 303. The target color set is printed on a substrate along with any required post-processing such as with a gloss finishing system.
Next the post-finishing printed control printed target CMYK colorant set is measured in the 304 measurement step using a measurement device such as a colorimeter, spectrophotometer or flat bed scanner. One skilled in the art would understand that there are other color measurement devices that could also be used if they are capable of generating a new set of {L′ a′ b′}. There differences between the original {L a b} color set and the new {L′a′b′} color set of each selected color can be caused by the color shifts or color deviations due to printing system variations or even due to the viewers perception. The larger the color deviations, the larger the differences in perceived color. The new {L′a′b′} color set is color transformed to {C′M′Y′K′} colorant representation through the forward color transform 801 of the printer shown in FIG. 8 and discussed later in conjunction to step 801. The new {C′M′Y′K′} colorant set is generated in 305. Both colorant sets {CMYK} and {C′M′Y′K′} are from the original control colors and these represent the color deviations in device dependent CMYK color space before and after printing, including the post-finishing process.
Now in step 306, the differences between the original and the post-processing colorant set are minimized using a mathematical regression method with specific enhancement steps. This step using different weighted factors that are applied to the two colorant sets to minimize the color differences between the original and the new CMYK colorant while balancing the capabilities of the printer and post finishing device through the use of the pre-defined weighted values for each different color that is to be adjusted, as shown in FIG. 3A. Four 1-D correction curves are generated at the end of 306 step and the color correction can be performed through the adjustment of 1-D curve on each separation (i.e.; C′->C; M′->M; Y′->Y; K′->K) independently. The 1-D color corrections are loaded into printer in step 320 which adjust the color shifts back to its target color. These adjustment will not impact the rasterized image data output from the digital front end. The whole color reproduction printing system will then be re-calibrated to reproduce correct process-sensitive colors.
In the regression process of the 306 step, the weights are assigned to each color according to individual preferences on the control color set (or on the evaluated images) (as illustrated in FIG. 5B as example). In this sense, the accuracy of local mapping around the emphasized color can be improved. For example, emphasizing more (giving more weights on those flesh tone colors) on flesh tone area if the evaluating image is a portrait image. Other memory colors correction can be less emphasized. Furthermore, to construct more accurate mapping between {CMYK} and {C′M′Y′K′} data sets in the regression process, an enhancement step is introduced, as will be discussed below in relation to FIGS. 4 and 5. The enhancement is to perform K->K′ regression first. This fixes the black replacement choices between {CMYK} and {C′M′Y′K′} so that {CMY} and {C′M′Y′} mapping can be more accurately achieved. This two-step regression process maintains the black colorant of the original color transformation created in LAB->CMYK backward color transformation and minimize the color differences between the original and the new CMYK colorant in the 1-D color correction process. More detailed data flow diagram is illustrated in FIG. 5A.
FIG. 3B describes the first of two different 1-D correction processes to accomplish the step of loading the corrections, before printing them with a writing device 310, as described in 320 step of FIG. 3A. In step 320A, four 1-D correction curves that generated at step 306 are loaded into printer in the process step 307. These loaded values are used to replace the original characteristic curves in the printer. During this step it is important to remember that the original characteristic curves will be lost if they are not saved somewhere else in the printer. However, there is another means described in steps 308 and 309 of FIG. 3C that uses differential 1-D correction for each separation to readjust color back to its target color.
FIG. 3C step 320B illustrates how the difference 1-D curve can be alternately generated using differential 1-D correction curves. A 1-D curve of ΔC, ΔM, ΔY, ΔK is generated from the original and new correction curves (C′->C; M′->M; Y′->Y; K′->K). The set of ΔC, ΔM, ΔY, ΔK difference curves are further estimated to generate projected basis coefficients for each color, for example, a three-basis function such as a B-spline function having a low, medium, high content distribution. A B-spline function that can be used to accomplish this step is illustrated in FIG. 11. After the B-spline coefficients for each separation color are generated they are loaded in step 309 into writing device 310. During the step 308 the original 1-D curves (C0,M0,Y0,K0) are adjusted by the difference values ΔC, ΔM, ΔY, ΔK that were re-constructed from the projected basis coefficients to the modified 1-D curve. Other basis functions besides a B-spline basis function can be used as long as it produces the accuracy necessary.
FIG. 9A & FIG. 9B show color adjustment modules 901, 902 corresponding to each of the two methods described in FIGS. 3A and 3B and 3A and 3C respectively. The loading 1-D color adjustment steps 307 and 309 are shown at 920 and 930 of FIGS. 9A and 9B respectively. FIG. 9A and FIG. 9B show the input image file 900, including the original colorant set being processed by the front end processors 910 including RIP, color processor and other function processors before the corrected colorant sets are entered into the color modules 901, 902 located in the LCU 12 before they are printed by the writing device 310. As is shown by FIGS. 9A and 9B, the color adjustment module is independent of digital front-end processors 910. The image data will not need to be re-rasterized after the corrected colorant sets are generated.
FIG. 4 is a schematic representation of the first embodiment for the perceived difference among all selected color patches, such as 401, 402, 403, and 404, is illustrated in FIG. 5A. The Desired Printing System 405 is the state of a printing system at the time of generating the associated ICC profiles, which characterize color printers. The Current Printing System 406 represents the current state of that system which is assumed to be different from 405. Based on the prior information characterized in the ICC profile, the set of target color(s) 407, in the device independent space CIELAB can be readily obtained. After the current system 406 prints the selected patches 401˜404, their colors can then be measured, resulting in the measured colorant set in L* a* b* space 408. Hence, the color difference associated each color patch can be computed based on 407 and 408.
FIG. 5A shows a two-step process where the corrected K is determined first before CMY is corrected. A one-step process could achieve a similar result by extending the weighting coefficients to the K channel, as indicated by the dashed line in FIG. 5A, during the minimization process. The schematic shown in FIG. 5 is the process diagram and data flow for correcting the colorant composition for the first embodiment of the invention. As is shown, the weight coefficient given the K table could be anything including the highest weight. The first step in the correction process shown in FIG. 5A is to identify the mapping between K and K′ to achieve a unique solution (as was shown in step 306 before) before proceeding with the following CMY->C′M′Y′ correction steps. The state of the current printing system is characterized by the measured color sets 501, 502, 503 and 504. In current commercial printing generally four colorants are used individually or simultaneously to represent the desired color in Lab representation. Since the desired printing system is represented by the existing color transforms or the associated ICC profile that characterize the system, the new colorant combinations, {C′M′Y′K′}, can be computed under certain constraints as indicated in 505, 506 and 507. The optimization procedures with various constraints accordingly, 505, 506 and 507, is to modify the combination CMYK colorants to achieve the intended color Lab value measured in ΔE color errors, which could be defined as (ΔL^2+Δa^2+Δb^2)^(0.5) based on the color transforms in the selected ICC profile or LUT. In 505, because only K colorant is present in achieving black ramp color 501, an optimization routine is performed under the constraint that C, M and Y colorant values are approximately zero, and results in a new set of {K′}. One skilled in the art would understand that other criteria could be used to determine what to minimize.
Therefore, a black K-correction algorithm 511 is designed to compute and generate the mapping function from K to K′ based on black ramp color 402 and 501. This updated K′ component will then be fed into the optimization procedure 506 as the constraint in the K component where the color set 502 and 503 usually contains all four CMYK colorants. The resulted C′M′Y′ values are more accurately achieved in the color set 502, 503. At last, the constraint optimization procedure 507 is to confine K to be zero because CMY ramp contains no K components. After completing optimization procedures 505, 506 and 507, the CMY correction regression algorithm 512, is responsible to compute and generate the desired three CMY 1-D mapping functions to achieve C->C′, M->M′ and Y->Y′ based on the assigned weighting coefficients (illustrated in FIG. 5B) between the new colorant set for neutral colors 513, the set for memory-sensitive colors 514 and the set for CMY colors 510 (see the corresponding steps in FIG. 4 which include 401, 403 and 404). These four 1-D correction curves are fed through color adjustment module 901 in the printer. In a similar manner additional colors can be mapped. For example a five color system with the colors CMYKF (where F is the fifth color) can be corrected in the same manner as described above. It would be clear to one skilled in the art that this method is not limited to a four color system and can work in conjunction with a plurality of colors and finishing systems.
FIG. 6A shows a flow chart representing another embodiment of the color enhancement method and system. In this embodiment the process-sensitive color correction is performed in the device-independent LAB color space instead of the device-dependent LAB color space described in the prior examples. Color corrections are made in the process steps 601, 602, 603, 604 as shown in FIG. 6. All of these steps, except steps 605 and 606, are described above as the process steps 301, 302, 303, 304 of FIG. 3A. In the new step 605, two sets of colors in device-independent color space representation, the target colors {L a b} and the measured new colors {L′a′b′} are generated from the original control colorant set and have a regression applied to the resultant data in step 606. Then in the 606 step, different weights are assigned to each color according to individual preferences on the control color set (or on the evaluated images) as discussed above. The regression constructs a 3×3 mapping model from {L′a′b′} to {L a b} at the end of step 606. The constructed 3×3 mapping model can be represented in 3-D LUT form. The 3-D LUT correction table is loaded into the writing device 610 in step 630 for color correction as further illustrated in FIG. 6B. During the regression process, two different mapping models, the localized L′a′b′->L a b mapping model or the global L′a′b′->L a b mapping model can be constructed and used. In localized L′a′b′->L a b mapping, only the targeted regional LAB spaces are affected and other regional LAB spaces are unaffected. In global L′A′B′->LAB mapping, the whole LAB space is affected.
After the 3-D correction values are generated, the L′a′b′->Lab mapping look-up table (LUT) is loaded in the color processing data flow step 607 of FIG. 6B or described again in RIP/color processor 1001 of FIG. 10. This embodiment has a different color correction process compared with the first embodiment. The color correction data flow of the second embodiment is illustrated in FIG. 10. The memory color correction process step 1004 represents the new colorant set corrections and is interfaced with the color processor 1001 in the digital front-end processors 1000. The 3-D correction LUT is loaded into color processor 1001 and carried out by color correction processor 1006. The color processor 1001 also includes the color transforms 1005 which converts the device-dependent CMYK color space values to device-independent LAB color space values and other color transforms 1007 which convert device-independent LAB color space values to device-dependent CMYK color space values and 3-D correction color is performed in device-independent LAB color space using the correction processor 1006.
Both of the embodiments discussed above-described color correction processes to automatically correct process-sensitive colors, such as memory sensitive colors, using the steps discussed in conjunction with FIGS. 4 and 5. All or some of these steps can be stored in the printer's LCU memory. It would be clear to one skilled in the art that some of these steps could be replaced with suitable operator interactive controls.
The claims should not be read as limited to the described order or elements unless stated to that effect. In addition, use of the term “means” in any claim is intended to invoke 35 U.S.C. §112, paragraph 6, and any claim without the word “means” is not so intended.
Although the invention has been described and illustrated with reference to specific illustrative embodiments thereof, it is not intended that the invention be limited to those illustrative embodiments. Those skilled in the art will recognize that variations and modifications can be made without departing from the true scope and spirit of the invention as defined by the claims that follow. It is therefore intended to include within the invention all such variations and modifications as fall within the scope of the appended claims and equivalents thereof.

Claims (20)

1. A method for recalibrating a multi-color imaging system wherein the imaging system is capable of outputting corrections by including weight-adjusted coefficients on process-sensitive memory color colors based on selected input target color values, the method comprising:
a. forming selected input target process-sensitive color combinations, wherein one or more of the process-sensitive color combinations includes at least two different colors including a human sensitive memory color; measuring color values for each of the different color combinations of process-sensitive colors;
b. comparing each of the measured color values to values corresponding to the input target color values that represent a desired condition of the imaging system;
c. calculating an error value that represents a deviation of the measured color values from the input target color values;
d. assigning weight-adjusting coefficients on one or more of the input target color values to reduce the error value to a predetermined degree, wherein the adjustment of the input target color values for one of the colors is performed independently of the adjustment of the input target color values for others of the colors and continued as needed to make all the corrections needed to match the input target process-sensitive color combinations; and
e. further assigning weight-adjusting coefficients on one or more of the input target color values comprising the human sensitive memory color to reduce the error value to a predetermined degree, wherein the weight adjustment of the input target color values for one of the colors is performed independently of the weight adjustment of the input target color values for others of the colors such that error values for the human sensitive memory color are less than the other error values and continued as needed to make all the corrections needed to match the target color sensitive color combinations weight coefficients.
2. The method of claim 1, wherein the forming step includes forming one or more of the process-sensitive color combinations by a combination of at least three of the different colors starting with black.
3. The method of claim 1, further comprising a two step process including first performing the comparing, calculating and weight-adjusting step for the color black (K) and then doing the same for the other colors (CMY).
4. A method for recalibrating a multi-color imaging system wherein the imaging system is capable of outputting corrections by including weight-adjusted coefficients on both process-sensitive and memory-sensitive colors without intervention based on selected input target color values, method comprising:
a. Selecting an original process-sensitive color set of process-sensitive colors in LAB color space;
b. Generating a first process-sensitive target colorant set of target process-sensitive colors in CMYK space and a second memory-sensitive target colorant set of memory-sensitive colors [colorant set] in CMYK space;
c. Printing the target process-sensitive and memory-sensitive colorant set in CMYK space for a specific substrate using an applicable post finishing system;
d. Measuring a printed process-sensitive and a print memory-sensitive colorant set with a measurement device to obtain L′A′B′ data set;
e. Generating a new target process-sensitive and memory-sensitive colorant set in C′M′Y′K′ space though a color transform using the measured L′A′B′ data set;
f. Minimizing the color differences between the original color set of colors (CMYK) and the new target colorant set (C′M′Y′K′) by applying a regression on each of the two sets using assigned weighted coefficients for both the different process-sensitive and memory-sensitive colors such that the error values for the memory-sensitive colors are less than the other error values; and
g. Loading the corrections resulted from minimization process into the printer.
5. The method of claim 4, further comprising fixing the weighted coefficient for one separation color first and then applying the weighted coefficients for the other separation colors.
6. The method of claim 4, further comprising fixing the weighted coefficient for first process-sensitive target and then applying a weighted group coefficient for one or more groups, the groups including memory sensitive colors, neutral colors, black, and primary colors.
7. The method of claim 5, wherein the weighted coefficient for at least two colors is the same.
8. The method of claim 5, further comprising generating a 1-D correction curve for one of the separations colors.
9. The method of claim 5, further comprising generating a 3-D correction curve for one of the separation colors.
10. The method of claim 5, further comprising generating four 1-D correction curves, one for each of the separation colors CMYK.
11. The method of claim 10, further comprising generating four differential 1-D correction curves from the four 1-D correction curves, one for each of the separation colors CMYK and from the original printer curves and then generating the associated correction coefficients for that separation color by projecting each differential 1-D curve to a three basis function resulting in a low, medium and high value.
12. A method for recalibrating a multi-color imaging system wherein the imaging system is capable of outputting corrections by including weight-adjusted coefficients on color sensitive colon, with suitable operator interactive controls, based on selected input target color values, the method comprising:
a. Selecting an original color set of color sensitive colors in LAB color space;
b. Generating a target color sensitive colorant set in CMYK space;
c. Printing the target color sensitive colorant set in CMYK space for a specific substrate using an applicable post finishing system;
d. Measuring the printed color -sensitive colorant set with a measurement device to obtain L′A′B′ data set;
e. Generating a new target color -sensitive colorant set in C′M′Y′K′ space though a color transform using the measured L′A′B′ data set;
f. Minimizing the color differences between the original color set of color sensitive colors (CMYK) and the new target color sensitive colorant set (C′M′Y′K′) by applying a regression on the two sets using assigning weighted coefficients the different color sensitive colors such that error values for the memory-sensitive colors are less than the other error values;
g. Loading the corrections resulted from minimizing process into the printer.
13. The method of claim 4, further comprising fixing the weighted coefficient for one separation color first and then applying the weighted coefficients for the other separation colors in the minimizing process.
14. The method of claim 12, further comprising fixing the weighted coefficient for first group and then applying a weighted group coefficient for one or more groups, the groups including memory sensitive colors, neutral colors, black, and primary colors.
15. The method of claim 13, wherein the weighted coefficient for at least two colors is the same.
16. The method of claim 13, further comprising generating a 1-D correction curve for one of the separation colors.
17. The method of claim 13, further comprising generating a 3-D correction curve for one of the separation colors.
18. The method of claim 5, further comprising generating four 1-D correction curves, one for each of the separation colors CMYK.
19. The method of claim 18, further comprising generating four differential 1-D correction curves from the four 1-D correction curves, one for each of the separation colors CMYK and from the original printer curves and then generating the associated correction coefficients for that separation color by projecting each differential 1-D curve to a three basis function resulting in a low, medium and high value.
20. A computer readable medium encoded with a computer program arranged such that, upon execution of the computer program, a processor performs a method for recalibrating a multi-color imaging system, the imaging system configured to correct output colors based on corresponding input target color values, the method comprising:
forming target color sensitive color combinations, wherein one or more of the color sensitive color combinations includes at least two different colors, including a human sensitive memory color;
measuring color values for each of the different color combinations of color sensitive colors;
comparing each of the measured color values to corresponding to the input target color values that represent a desired condition of the imaging system;
calculating an error value that represents a deviation of the measured color values from the input target color values comprising an error value for each measured color including an error value for the human sensitive memory color; and
assigning weight-adjusting coefficients on one or more of the input target color values to reduce the error value to a predetermined degree, wherein the weight adjustment of the input target color values for one of the colors is performed independently of the weight adjustment of the input target color values for others of the colors such that error values for the human sensitive memory color are less than the other error values and continued as needed to make all the corrections needed to match the target color sensitive color combinations.
US11/262,142 2005-10-28 2005-10-28 Color enhancement method and system Expired - Fee Related US7548343B2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US11/262,142 US7548343B2 (en) 2005-10-28 2005-10-28 Color enhancement method and system
JP2008538029A JP2009514409A (en) 2005-10-28 2006-10-27 Color enhancement method and color enhancement system
EP06826923A EP1941325B1 (en) 2005-10-28 2006-10-27 Color enhancement method and system
PCT/US2006/042092 WO2007053472A1 (en) 2005-10-28 2006-10-27 Color enhancement method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11/262,142 US7548343B2 (en) 2005-10-28 2005-10-28 Color enhancement method and system

Publications (2)

Publication Number Publication Date
US20070097461A1 US20070097461A1 (en) 2007-05-03
US7548343B2 true US7548343B2 (en) 2009-06-16

Family

ID=37776606

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/262,142 Expired - Fee Related US7548343B2 (en) 2005-10-28 2005-10-28 Color enhancement method and system

Country Status (4)

Country Link
US (1) US7548343B2 (en)
EP (1) EP1941325B1 (en)
JP (1) JP2009514409A (en)
WO (1) WO2007053472A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070109564A1 (en) * 2005-11-14 2007-05-17 Kabushiki Kaisha Toshiba Apparatus and method for reproducing original colors in an image forming apparatus
US20110299143A1 (en) * 2010-06-04 2011-12-08 Alessi Paula J Color transform insensitive to process variability
US20120099121A1 (en) * 2010-10-21 2012-04-26 Young No Methods for generating an inverse mask
US8564861B2 (en) 2010-11-30 2013-10-22 Eastman Kodak Company Providing calibration data for printer
US10183497B2 (en) 2015-01-30 2019-01-22 Hewlett-Packard Development Company, L.P. Color correction in printing systems

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4415318B2 (en) * 2004-04-27 2010-02-17 富士フイルム株式会社 Color image color misregistration correction method and color image imaging apparatus
JP4591337B2 (en) * 2005-12-16 2010-12-01 富士ゼロックス株式会社 Image processing device
US7777915B2 (en) * 2006-06-15 2010-08-17 Eastman Kodak Company Image control system and method
US7643175B2 (en) * 2006-12-14 2010-01-05 Eastman Kodak Company Color print enhancement system with conversion of PCS encoded picture into photographic process confined PCS and correction for finish
US7869087B2 (en) * 2007-03-31 2011-01-11 Xerox Corporation Color printer characterization or calibration to correct for spatial non-uniformity
US7880928B2 (en) * 2007-12-21 2011-02-01 Xerox Corporation Color image process controls methods and systems
US20090213392A1 (en) * 2007-12-28 2009-08-27 Seiko Epson Corporation Printing control device, printing system and printing control program
US7872776B2 (en) * 2008-05-27 2011-01-18 Xerox Corporation Methods, systems and apparatus to control hue variation for multiple marking engine printing systems
JP2009294309A (en) * 2008-06-03 2009-12-17 Canon Inc Image forming apparatus, control method for the same, program and storage medium
EP2254000A3 (en) * 2009-05-22 2012-05-16 Ricoh Company, Ltd. Image forming apparatus with image color measuring unit and image forming method
US8390882B2 (en) * 2009-08-07 2013-03-05 Xerox Corporation Systems and methods for estimating the color of coated prints
US8593693B2 (en) * 2009-11-12 2013-11-26 Ricoh Production Print Solutions LLC Outputting gray color values in color-managed CMYK to CMYK color conversions based on input gray color values
JP2011237722A (en) * 2010-05-13 2011-11-24 Ricoh Co Ltd Controller, image formation apparatus and control method
JP5505907B2 (en) * 2011-08-25 2014-05-28 シャープ株式会社 Image forming apparatus and processing unit
WO2019022699A1 (en) 2017-07-24 2019-01-31 Hewlett-Packard Development Company, L.P. Colorant vector calibration

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5185661A (en) 1991-09-19 1993-02-09 Eastman Kodak Company Input scanner color mapping and input/output color gamut transformation
US5234783A (en) 1991-12-16 1993-08-10 Eastman Kodak Company Method of selectively glossing toner images
US5363318A (en) 1992-03-23 1994-11-08 Eastman Kodak Company Method and apparatus for adaptive color characterization and calibration
US5384601A (en) 1992-08-25 1995-01-24 Matsushita Electric Industrial Co., Ltd. Color adjustment apparatus for automatically changing colors
JPH07222013A (en) 1994-02-04 1995-08-18 Fuji Xerox Co Ltd Color image forming device
WO1995022866A1 (en) 1994-02-16 1995-08-24 Apple Computer, Inc. Subjectively pleasing color gamut mapping in a color computer graphics system
US5781206A (en) 1995-05-01 1998-07-14 Minnesota Mining And Manufacturing Company Apparatus and method for recalibrating a multi-color imaging system
US5818960A (en) 1991-06-18 1998-10-06 Eastman Kodak Company Characterization calibration
US6121986A (en) 1997-12-29 2000-09-19 Eastman Kodak Company Process control for electrophotographic recording
US6243133B1 (en) 1997-03-07 2001-06-05 Eastman Kodak Company Method for automatic scene balance of digital images
US6278805B1 (en) 1999-05-13 2001-08-21 Eastman Kodak Company System for composing color transforms using class information
US6480299B1 (en) 1997-11-25 2002-11-12 University Technology Corporation Color printer characterization using optimization theory and neural networks
US6791716B1 (en) 2000-02-18 2004-09-14 Eastmas Kodak Company Color image reproduction of scenes with preferential color mapping
US20040227964A1 (en) * 2002-12-18 2004-11-18 Makoto Fujino Memory color adjustment of image
US20070071315A1 (en) * 2005-09-29 2007-03-29 Juan Uroz Color target layout

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818960A (en) 1991-06-18 1998-10-06 Eastman Kodak Company Characterization calibration
US5185661A (en) 1991-09-19 1993-02-09 Eastman Kodak Company Input scanner color mapping and input/output color gamut transformation
US5234783A (en) 1991-12-16 1993-08-10 Eastman Kodak Company Method of selectively glossing toner images
US5363318A (en) 1992-03-23 1994-11-08 Eastman Kodak Company Method and apparatus for adaptive color characterization and calibration
US5384601A (en) 1992-08-25 1995-01-24 Matsushita Electric Industrial Co., Ltd. Color adjustment apparatus for automatically changing colors
JPH07222013A (en) 1994-02-04 1995-08-18 Fuji Xerox Co Ltd Color image forming device
WO1995022866A1 (en) 1994-02-16 1995-08-24 Apple Computer, Inc. Subjectively pleasing color gamut mapping in a color computer graphics system
US6027201A (en) * 1995-05-01 2000-02-22 Minnesota Mining And Manufacturing Company Recalibrating a multi-color imaging system
US5781206A (en) 1995-05-01 1998-07-14 Minnesota Mining And Manufacturing Company Apparatus and method for recalibrating a multi-color imaging system
USRE38180E1 (en) 1995-05-01 2003-07-15 Kodak Polychrome Graphics, Llc Recalibrating a multi-color imaging system
US6243133B1 (en) 1997-03-07 2001-06-05 Eastman Kodak Company Method for automatic scene balance of digital images
US6480299B1 (en) 1997-11-25 2002-11-12 University Technology Corporation Color printer characterization using optimization theory and neural networks
US6121986A (en) 1997-12-29 2000-09-19 Eastman Kodak Company Process control for electrophotographic recording
US6278805B1 (en) 1999-05-13 2001-08-21 Eastman Kodak Company System for composing color transforms using class information
US6791716B1 (en) 2000-02-18 2004-09-14 Eastmas Kodak Company Color image reproduction of scenes with preferential color mapping
US20040227964A1 (en) * 2002-12-18 2004-11-18 Makoto Fujino Memory color adjustment of image
US20070071315A1 (en) * 2005-09-29 2007-03-29 Juan Uroz Color target layout

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Jiangtao Kuang, Xiaoyun Jiang, Shuxue Quan, Andrew Chiu; A psychophysical study on the influence factors of color preference in photographic color reproduction; Proceeding of SPIE-IS&T, vol. 5668, Jan. 17, 2005.
Maya R. Gupta; Custom Color Enhancements by Statistical Learning; University of Washington, Dept. of Electrical Engineering; Seattle, WA 98195, Sep. 2005.
Yee Seung Ng; U.S. Appl. No. 11/062,972; Method and Apparatus For Electrostatographic Printing With Enhanced Color Gamut; Filed Feb. 22, 2005.
Yee Seung Ng; U.S. Appl. No. 11/155,268; Method and Apparatus for Electrostatographic Printing With Generic Color Profiles and Inverse Masks Based on Receiver Member Characteristics; Filed Jun. 17, 2005.
Zuemei Zhang and David H. Brainard; Bayesian color correction method for non-colorimetric digital image sensors; Agilent Technologies Laboratories; Dept. of Psychology, University of Pennsylvania, Nov. 9, 2004.

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070109564A1 (en) * 2005-11-14 2007-05-17 Kabushiki Kaisha Toshiba Apparatus and method for reproducing original colors in an image forming apparatus
US20110299143A1 (en) * 2010-06-04 2011-12-08 Alessi Paula J Color transform insensitive to process variability
US8427722B2 (en) * 2010-06-04 2013-04-23 Eastman Kodak Company Color transform insensitive to process variability
US20120099121A1 (en) * 2010-10-21 2012-04-26 Young No Methods for generating an inverse mask
US8520275B2 (en) * 2010-10-21 2013-08-27 Eastman Kodak Company Methods for generating an inverse mask
US8564861B2 (en) 2010-11-30 2013-10-22 Eastman Kodak Company Providing calibration data for printer
US10183497B2 (en) 2015-01-30 2019-01-22 Hewlett-Packard Development Company, L.P. Color correction in printing systems

Also Published As

Publication number Publication date
WO2007053472A1 (en) 2007-05-10
US20070097461A1 (en) 2007-05-03
EP1941325B1 (en) 2012-07-18
JP2009514409A (en) 2009-04-02
EP1941325A1 (en) 2008-07-09

Similar Documents

Publication Publication Date Title
US7548343B2 (en) Color enhancement method and system
US7643175B2 (en) Color print enhancement system with conversion of PCS encoded picture into photographic process confined PCS and correction for finish
KR100544557B1 (en) Iamge forming apparatus and adjustment method of the same
EP1398674B1 (en) Color image forming apparatus and control method therefor
US7340208B2 (en) Method and apparatus for electrostatographic printing with generic color profiles and inverse masks based on receiver member characteristics
EP2597522B1 (en) Color image forming apparatus and method for controlling color image forming apparatus
US7324240B2 (en) Color correction method with transparent toner insignia images
US7599634B2 (en) Subjective and objective universal substrate printer ICC profile selection
US9008527B2 (en) Method for calibrating specialty color toner
US20100054769A1 (en) Method and apparatus for controlling color in multicolor marking platform
US10885405B2 (en) Correcting cross-track errors in a linear printhead
US11126107B2 (en) Printer with cross-track position error correction
JP5520970B2 (en) Method for reducing roughness in printed images
US11138482B2 (en) Printer with in-track position error correction
US20210073601A1 (en) Correcting in-track errors in a linear printhead
JP4536970B2 (en) Color image forming apparatus and color image control method
JP4630938B2 (en) Color image forming apparatus and color image control method
JP4311734B2 (en) Color correction apparatus and color image forming apparatus color correction method
CN114342346A (en) Correcting in-track errors in a linear printhead
JP2005140861A (en) Chromaticity stabilization control method, gradation stabilization control method, and image forming apparatus
JPH04240871A (en) Method and device for color correction of color printer

Legal Events

Date Code Title Description
AS Assignment

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NG, YEE S.;TAI, HWAI-TZUU;KUO, CHUNG-HUI;AND OTHERS;REEL/FRAME:017165/0756

Effective date: 20051027

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: CITICORP NORTH AMERICA, INC., AS AGENT, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:028201/0420

Effective date: 20120215

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT, MINNESOTA

Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:030122/0235

Effective date: 20130322

Owner name: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT,

Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:030122/0235

Effective date: 20130322

AS Assignment

Owner name: BANK OF AMERICA N.A., AS AGENT, MASSACHUSETTS

Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (ABL);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031162/0117

Effective date: 20130903

Owner name: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT, NEW YORK

Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (SECOND LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031159/0001

Effective date: 20130903

Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE, DELAWARE

Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (FIRST LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031158/0001

Effective date: 20130903

Owner name: PAKON, INC., NEW YORK

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNORS:CITICORP NORTH AMERICA, INC., AS SENIOR DIP AGENT;WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT;REEL/FRAME:031157/0451

Effective date: 20130903

Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE, DELA

Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (FIRST LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031158/0001

Effective date: 20130903

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNORS:CITICORP NORTH AMERICA, INC., AS SENIOR DIP AGENT;WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT;REEL/FRAME:031157/0451

Effective date: 20130903

Owner name: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT, NEW YO

Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (SECOND LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031159/0001

Effective date: 20130903

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: KODAK PHILIPPINES, LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: LASER PACIFIC MEDIA CORPORATION, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: PAKON, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: QUALEX, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: FPC, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: KODAK IMAGING NETWORK, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: KODAK REALTY, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: KODAK (NEAR EAST), INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: KODAK AVIATION LEASING LLC, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: CREO MANUFACTURING AMERICA LLC, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: KODAK AMERICAS, LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: NPEC, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: KODAK PORTUGUESA LIMITED, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:050239/0001

Effective date: 20190617

AS Assignment

Owner name: NPEC, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: PFC, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: QUALEX, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK (NEAR EAST), INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK PORTUGUESA LIMITED, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: PAKON, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: CREO MANUFACTURING AMERICA LLC, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: LASER PACIFIC MEDIA CORPORATION, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK IMAGING NETWORK, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK AVIATION LEASING LLC, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK PHILIPPINES, LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK AMERICAS, LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: KODAK REALTY, INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049901/0001

Effective date: 20190617

AS Assignment

Owner name: QUALEX INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: KODAK PHILIPPINES LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: NPEC INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: KODAK REALTY INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: KODAK AMERICAS LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: KODAK (NEAR EAST) INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: LASER PACIFIC MEDIA CORPORATION, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: FPC INC., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: EASTMAN KODAK COMPANY, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001

Effective date: 20170202

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20210616