US20080111896A1 - Automatic white balance system and automatic white balance control method - Google Patents

Automatic white balance system and automatic white balance control method Download PDF

Info

Publication number
US20080111896A1
US20080111896A1 US11/939,179 US93917907A US2008111896A1 US 20080111896 A1 US20080111896 A1 US 20080111896A1 US 93917907 A US93917907 A US 93917907A US 2008111896 A1 US2008111896 A1 US 2008111896A1
Authority
US
United States
Prior art keywords
white
balance
white balance
signal
gain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US11/939,179
Other versions
US7864222B2 (en
Inventor
Akira Yoshino
Keiichiro Yanagida
Noriko Matsuo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Assigned to KABUSHIKI KAISHA TOSHIBA reassignment KABUSHIKI KAISHA TOSHIBA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MATSUO, NORIKO, YANAGIDA, KEIICHIRO, YOSHINO, AKIRA
Publication of US20080111896A1 publication Critical patent/US20080111896A1/en
Application granted granted Critical
Publication of US7864222B2 publication Critical patent/US7864222B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control

Definitions

  • This invention relates to an automatic white balance system.
  • the image taken by a digital camera has color tones conforming to the characteristics of the CCD or CMOS image sensor elements. To make the color tones conform to the characteristic of the human eye, various image correcting processes are carried out in the system.
  • a white balance adjustment is such that, for example, red and blue are adjusted with respect to white to correct the white when an incandescent electric lamp or a fluorescent lamp is used as a light source, with white from the sun as a light source being a reference.
  • the white balance adjustment is generally made in an automatic white balance system (hereinafter, referred to as an AWB system) (for example, refer to Jpn. Pat. Appln. KOKAI Publication No. 4-304093).
  • the white balance adjustment is made by feeding back the white balance adjustment gain calculated on the basis of the YUV signal in the system.
  • a color separation and synchronization unit color-separates the image signal of the captured image into a red, a green, and a blue signal and synchronizes them and, on the basis of these signals, generates the YUV signal.
  • the color separation and synchronization unit When whether a white balance adjustment is needed is judged on the basis of the YUV signal generated exclusively for the color judgment unit, the color separation and synchronization unit is provided for the color judgment unit only. However, since the color separation and synchronization unit uses a line memory, the circuit size of the automatic white balance system increases considerably.
  • a color judgment is made using the YUV signal white-balance adjusted by a feedback process without providing the color separation and synchronization unit exclusively for the color judgment unit.
  • a color judgment is made on the basis of the white-balance-adjusted YUV signal influenced by the white balance adjustment gain. Accordingly, there is a possibility that a normal color judgment cannot be made, depending on photographing conditions.
  • an automatic white balance system comprising: a first multiplier which outputs a white-balance-adjusted image signal; a color separation and synchronization unit which has a line memory for generating a white-balance-adjusted YUV signal from the white-balance-adjusted image signal; a color judgment unit which judges whether or not a white balance adjustment is needed; a white balance adjustment gain computation unit which calculates a white balance adjustment gain on the basis of the result of the judgment at the color judgment unit and the white-balance-adjusted YUV signal; a reciprocal computation unit which outputs the reciprocal transformation value of the white balance adjustment gain; and a second multiplier which multiplies the white-balance-adjusted YUV signal by the reciprocal transformation value.
  • an automatic white balance control method comprising: multiplying a first white-balance-unadjusted image signal by a first white balance adjustment gain to generate a first white-balance-adjusted image signal; generating a white-balance-adjusted YUV signal from the first white-balance-adjusted image signal; subjecting the first white balance adjustment gain to a reciprocal transformation process to calculate a reciprocal transformation value; multiplying the white-balance-adjusted YUV signal by the reciprocal transformation value to calculate a white-balance-unadjusted YUV signal; judging on the basis of the white-balance-unadjusted YUV signal whether to subject the white-balance-adjusted YUV signal to a white balance adjustment; if it is judged that a white balance adjustment is to be made, calculating a second white balance adjustment gain from the white-balance-adjusted YUV signal;
  • FIG. 1 is a block diagram of an automatic white balance system according to an embodiment of the invention
  • FIG. 2 is a block diagram of another automatic white balance system according to the embodiment of the invention.
  • FIG. 3 is a diagram showing the output (reciprocal transformation value) with respect to the input (white balance adjustment gain);
  • FIG. 4 is a block diagram of an embodiment of a hardware circuit applied to the reciprocal transformation unit
  • FIG. 5 is a diagram showing the output with respect to the input when the hardware circuit is used
  • FIG. 6 is a flowchart to help explain the processing performed by the software applied to the reciprocal transformation unit
  • FIG. 7 is a block diagram of the reciprocal transformation unit caused to execute the software.
  • FIG. 8 schematically shows the processing timing for automatic white balance.
  • An embodiment of the invention relates to an automatic white balance system (AWB system).
  • the embodiment is characterized by comprising a reciprocal computation unit for calculating the reciprocal of a white balance adjustment gain and a multiplier for multiplying the reciprocal transformation value by a white-balance-adjusted YUV signal.
  • a white-balance-unadjusted YUV signal can be generated by multiplying the white-balance-adjusted YUV signal by the reciprocal transformation value of the white balance adjustment gain.
  • FIG. 1 is a block diagram showing the configuration of an AWB system according to an embodiment of the invention. To simplify the explanation, only the principal part is shown in the embodiment.
  • An image sensor 1 outputs an image signal.
  • the image sensor 1 is, for example, a single-plate area image sensor.
  • the area of the image sensor 1 is composed of an effective pixel area and a blanking area around the effective pixel area. Of the input image signals, the signals of the effective pixel area are to be subjected to a white balance adjustment.
  • the image signals are composed of red (R), green (G), and blue (B) color signals.
  • the image sensor 1 is, for example, composed of a CCD or COS sensor. Each element of the sensor, that is, each pixel, is set so as to react to only one of red (R), green (G), and blue (B) with a color filter having an arrangement pattern of, for example, the Bayer type.
  • a main processor 9 includes an AWB gain multiplier (first multiplier) 2 and a color separation and synchronization unit 3 .
  • the AWB gain multiplier 2 multiplies an image signal by a white balance adjustment gain, thereby adjusting the white balance of the captured image. Therefore, the AWB gain multiplier 2 generates an image signal multiplied by the white balance adjustment gain, that is, a white-balance-adjusted image signal.
  • An image signal is input via the AWB gain multiplier 2 to the color separation and synchronization unit 3 , which separates the input image signal into a red (R), a green (G), and a blue (B) component. On the basis of the separated signal components, the color separation and synchronization unit 3 generates a YUV signal.
  • the YUV signal is generated from the white-balance-adjusted image signal multiplied by the white balance adjustment gain, it is a YUV signal after a white balance adjustment (hereinafter, referred to as a WB-adjusted YUV signal).
  • the YUV signal is composed of a luminance (Y) signal representing the luminance of the image, a U signal subtracted the luminance signal from the blue component, and a V signal subtracted the luminance signal from the red component.
  • the color separation and synchronization unit 3 includes a line memory 3 A.
  • the line memory 3 stores several lines of signal data, that is, as much signal data as several times the number of effective pixels in the horizontal direction of the image sensor.
  • the WB-adjusted YUV signal generated by the color separation and synchronization unit 3 is output to a white balance adjustment gain computation unit 5 and a multiplier (second multiplier) 7 .
  • a color judgment unit 4 judges on the basis of the YUV signal whether the captured image includes an area needing a white balance adjustment and outputs the result of the judgment to the white balance adjustment gain computation unit 5 .
  • the white balance adjustment gain computation unit 5 calculates a white balance adjustment gain on the basis of the result of the judgment at the color judgment unit 4 and the WB-adjusted YUV signal from the color separation and synchronization unit 3 .
  • the white balance adjustment gain computation unit includes a UV signal integration unit 5 A and an RB gain computation unit 5 B.
  • the UV signal integration unit 5 A integrates a UV signal representing changes in the hue and chroma in the YUV signal.
  • the RB gain computation unit 5 B calculates a red component gain (R gain) and a blue component gain (B gain) on the basis of the result of the calculation at the UV signal integration unit 5 A.
  • the white balance adjustment gain computation unit 5 calculates a white balance adjustment gain on the basis of the results of calculating the R gain and the B gain and outputs the resulting gain.
  • the white balance adjustment gain computation unit 5 may have the same configuration as shown in FIG. 2 .
  • an RB gain computation unit 51 B calculates an R gain and a B gain on the basis of the WB-adjusted YUV signal and an RB gain signal integration unit 51 A integrates the R gain and the B gain and calculates a white balance adjustment gain on the basis of the result.
  • the white balance adjustment gain calculated by the white balance adjustment gain computation unit 5 is fed back to the AWB gain multiplier 2 and, at the same time, output to the reciprocal computation unit 6 .
  • the reciprocal computation unit 6 calculates the reciprocal transformation value of the input white balance adjustment gain.
  • the reciprocal transformation performed by the reciprocal computation unit 6 is the process of giving a reciprocal transformation value 1/G if the white balance adjustment gain is G.
  • the calculated reciprocal transformation value is output to the multiplier 7 .
  • the reciprocal transformation value may be a value obtained by multiplying 1/G by an arbitrary constant.
  • the multiplier 7 multiplies the WB-adjusted YUV signal output from the color separation and synchronization unit 3 by the reciprocal transformation value output from the reciprocal computation unit 6 , thereby generating a YUV signal before a white balance adjustment (hereinafter, referred to as a WB-unadjusted YUV signal). Then, the WB-unadjusted YUV signal generated as a result of calculation at the multiplier 7 is output to the color judgment unit 4 .
  • An output image adjustment circuit 8 subjects the WB-adjusted YUV signal processed by the automatic white balance system to a pixel skipping process according to the output size to be adapted to the image display on the display unit (not shown), the parallel/serial output converting process of converting the signals output in parallel from the main processor 9 into a serial output signal, and an image compression process, such as a JPEG compression process. Then, the signal processed at the output image adjustment circuit 8 is output as an image signal of the selected output type to an external unit, such as a display unit (not shown) or a storage unit (not shown).
  • an external unit such as a display unit (not shown) or a storage unit (not shown).
  • the automatic white balance system of the embodiment is characterized by having the reciprocal computation unit 6 and the multiplier 7 .
  • the WB-unadjusted YUV signal should be used to judge whether to make a white balance adjustment.
  • the WB-unadjusted YUV signal is obtained as a result of the multiplier 7 multiplying the WB-adjusted YUV signal output from the color separation and synchronization unit 3 by the value resulting from the reciprocal transformation of the white balance adjustment gain at the reciprocal computation unit 6 .
  • the reciprocal computation unit 6 and second multiplier 7 can generate a WB-unadjusted YUV signal for color judgment at the color judgment unit 4 without providing the color separation and synchronization unit 3 including the large-circuit-sized line memory 3 A for color judgment only.
  • the reciprocal computation unit 6 performs the reciprocal transformation of the white balance adjustment gain.
  • the reciprocal transformation value is the output of FIG. 3 with respect to the white balance adjustment gain as the input value.
  • a read-only memory is provided in the reciprocal computation unit 6 of FIG. 1 .
  • a ROM table which shows the relationship between the input value corresponding to the white balance adjustment gain and the output value obtained as a result of the reciprocal transformation of the input value is stored in the ROM.
  • the white balance adjustment gain treated as a feedback gain is such that, for example, 1 ⁇ 4 to 4 times an arbitrary reference value is used as a gain setting range.
  • the setting range of the white balance adjustment gain as the input value shown in FIG. 3 is set in the ROM table in such a manner that 1 ⁇ 4 times an arbitrary reference value of R is used as the minimum value X 1 and 4 times the arbitrary reference value is used as the maximum value X 2 .
  • Each input value in the setting range is stored in the ROM.
  • each input value is subjected to reciprocal transformation and the value resulting from the reciprocal transformation is stored in the ROM.
  • the reciprocal transformation value as an output value is the maximum value Y 1 when the white balance adjustment gain as the input value is the minimum value X 1 and the minimum value Y 2 when the white balance adjustment gain is the maximum value X 2 .
  • a value smaller than the minimum value X 1 of the white balance adjustment gain is outside the setting range. Therefore, when a value smaller than the minimum value X 1 is input, for example, setting is done in the ROM table so that the maximum value Y 1 of the reciprocal transformation value may be output. Moreover, a value larger than the maximum value X 2 of the input value is also outside the setting range. In this case, for example, setting is done in the ROM table so that the minimum value Y 2 of the reciprocal transformation value may be output.
  • the reciprocal computation unit using the ROM refers to the ROM table and outputs the reciprocal transformation value of the white balance adjustment gain as the input value. This makes it possible to obtain the reciprocal transformation value of the white balance adjustment gain.
  • the reciprocal computation unit 6 may be composed of a hardware circuit as shown in FIG. 4 .
  • the calculation of the reciprocal transformation value by the ROM enables high-accuracy reciprocal transformation.
  • a larger-capacity ROM has to be used, resulting in a larger circuit size.
  • the reciprocal of the white balance adjustment gain as the input value is calculated by collinear approximation.
  • the reciprocal is calculated using the ROM table. In the area from X 3 to X 2 , the gain is approximated using a plurality of approximate lines.
  • the hardware circuit of FIG. 4 includes a collinear approximation unit 6 A, a ROM 6 B, and a selector unit 6 C.
  • the white balance adjustment gain as the input value is input to the collinear approximation unit 6 A, ROM 6 B, and selector unit 6 C.
  • the setting range of the white balance adjustment gain as the input value and the setting range of the reciprocal transformation value as the output value are the same as those in the ROM.
  • the collinear approximation unit 6 A and ROM 6 B output a reciprocal transformation value on the basis of the input white balance adjustment gain, respectively.
  • the selector unit 6 C selects the reciprocal transformation value corresponding to the input white balance adjustment gain from the reciprocal transformation values obtained from the collinear approximation unit 6 A and ROM 6 B. For example, in the case of an input value smaller than X 1 or an input value larger than X 3 , the output value of the collinear unit 6 A is selected by the selector unit 6 C. If the input value is in the range of X 1 to X 3 , the output of the ROM 6 B is selected by the selector unit 6 C.
  • the reciprocal transformation value selected by the selector unit 6 C is output to the multiplier 7 .
  • the hardware circuit can output the reciprocal transformation value of the input white balance adjustment gain.
  • the reciprocal transformation process of the white balance adjustment gain can be carried out by software.
  • FIG. 6 is a flowchart to help explain a reciprocal transformation process by software.
  • FIG. 7 is a block diagram of the reciprocal computation unit 6 for executing the software.
  • the reciprocal computation unit 6 includes a computation unit 6 D and a control unit 6 E.
  • the white balance adjustment gain as the input value is input to the computation unit 6 D.
  • the control unit 6 E has the software that calculates a reciprocal transformation value as an output value for the input value.
  • the control unit 6 E causes the computation unit 6 D to perform reciprocal transformation described below.
  • the white balance adjustment gain is input to the reciprocal computation unit 6 and the computation unit 6 D receives the input value (ST 1 ).
  • control unit 6 E causes the computation unit 6 D to perform the reciprocal transformation of the input white balance adjustment gain (ST 2 ).
  • the reciprocal transformation value calculated by the reciprocal transformation is output from the computation unit 6 D to the multiplier 7 , which completes the software computation process (ST 3 ).
  • the reciprocal transformation value of the white balance adjustment gain can be calculated by software.
  • FIG. 8 schematically shows the timing for the processing of the automatic white balance system according to the embodiment.
  • Areas 10 A, 20 A, and 30 A in FIG. 8 correspond to the periods in which the signals of the effective pixel area of the image sensor 1 are input to the corresponding processing units (hereinafter, referred to as the effective pixel periods).
  • Areas 10 B, 20 B, and 30 B correspond to the periods in which the signals of the blanking areas are input to the corresponding processing units (hereinafter, referred to as the blanking periods).
  • one frame of image signal output from the image sensor 1 is input to the main processor 9 .
  • the main processor 9 chiefly processes the individual pixels in the image signal of the effective pixel area of the image sensor 1 .
  • the AWB gain multiplier 2 multiplies the image signal by the white balance adjustment gain.
  • the image signal multiplied by the white balance adjustment gain is output to the color separation and synchronization unit 3 .
  • the image signal is input to the color separation and synchronization unit 3 , which color-separates the image signal, synchronizes the separated signals, and converts the resulting signals into a YUV signal.
  • the YUV signal is obtained from the image signal multiplied by the white balance adjustment gain, it is a white-balance-adjusted YUV signal.
  • the WB-adjusted YUV signal is output to the white balance adjustment gain computation unit 5 , multiplier 7 , and output image adjustment circuit 8 .
  • the WB-adjusted YUV signal is delayed for a delay time of Ta since the input of one frame of image signal for the processing in the main processor 9 .
  • the WB-adjusted YUV signal output to the output image adjustment circuit 8 is subjected to a pixel skipping process, a parallel/serial output converting process, an image compression process, and other processes at the output image adjustment circuit 8 .
  • the input one frame of WB-adjusted YUV signal is delayed for a delay time of Tb and converted into a selected image signal (external output signal), which is then output to an external unit.
  • the WB-adjusted YUV signal output to the white balance adjustment gain computation unit 5 is input to the UV signal integration unit 5 A of the white balance adjustment gain computation unit 5 . Then, if the color judgment unit 4 has judged on the basis of the WB-unadjusted YUV signal that the target pixel needs a white balance adjustment, the U signal and V signal in the WB-adjusted YUV signal are integrated by the UV signal integration unit 5 A. Since a color judgment on the basis of the WB-unadjusted YUV signal is performed on all of the pixels in the effective pixel area, the judgment is made in synchronization with the effective pixel period 10 A of the WB-unadjusted YUV signal. Moreover, the integrated UV value calculated by the UV signal integration unit 5 A is delayed from the color judgment period by the computation process and then output.
  • the R gain and B gain are calculated by the RB gain computation unit 5 B.
  • the white balance adjustment gain is calculated.
  • the white balance adjustment gain is output to the reciprocal computation unit 6 .
  • the gain is fed back to the AWB gain multiplier 2 .
  • the white balance adjustment gain fed back to the AWB gain multiplier 2 is updated during a blanking period before the image signal of the next frame is input to the main processor 9 and the updated gain is input to the AWB gain multiplier 2 . That is, the white balance adjustment gain is such that a gain calculated for the image signal of one frame is reflected in the image signal of the next one frame in such a manner that the next image signal is multiplied by the gain of the preceding image signal.
  • the R gain and B gain are calculated from the WB-adjusted YUV signal input to the RB gain computation unit 51 B.
  • the computation result is integrated at the RB gain signal integration unit 51 A. On the basis of the integration result, the white balance adjustment gain is calculated.
  • the white balance adjustment gain output to the reciprocal transformation unit 6 is subjected to any one of the reciprocal transformation process on the ROM or hardware circuit, or by software at the reciprocal transformation unit 6 . Then, the reciprocal transformation value corresponding to the white balance adjustment gain is output to the multiplier 7 .
  • the WB-adjusted YUV signal output from the color separation and synchronization unit 3 is multiplied by the reciprocal transformation value at the multiplier 7 . Since the WB-adjusted YUV signal is a YUV signal multiplied by the white balance adjustment gain corresponding to the preceding image signal, a white-balance-unadjusted YUV signal is generated by further multiplying the WB-adjusted YUV signal by the reciprocal transformation value. The WB-unadjusted YUV signal is output to the color judgment unit 4 .
  • the WB-unadjusted YUV signal is delayed by a reciprocal transformation process for a delay time of Tc since the input of one frame of the WB-adjusted YUV signal and the resulting signal is input to the color judgment unit 4 .
  • a YUV signal before a white balance adjustment can be reproduced.
  • the color judgment unit 4 judges whether the target pixel (image signal) is to be subjected to a white balance adjustment.
  • the reciprocal computation unit 6 and the second multiplier 7 can generate a white-balance-unadjusted YUV signal for a color judgment at the color judgment unit 4 without providing the color separation and synchronization unit 3 including the large-circuit-sized line memory 3 A for a color judgment only.

Abstract

An automatic white balance system according to an embodiment of the invention comprises a color separation and synchronization unit which has a line memory for generating a white-balance-adjusted YUV signal, a color judgment unit which judges whether or not a white balance adjustment is needed, a white balance adjustment gain computation unit which calculates a white balance adjustment gain on the basis of the result of the judgment at the color judgment unit and the white-balance-adjusted YUV signal, a reciprocal computation unit which outputs the reciprocal transformation value of the white balance adjustment gain, and a second multiplier which multiplies the white-balance-adjusted YUV signal by the reciprocal transformation value.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is based upon and claims the benefit of priority from prior Japanese Patent Application No. 2006-308255, filed Nov. 14, 2006, the entire contents of which are incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • This invention relates to an automatic white balance system.
  • 2. Description of the Related Art
  • In recent years, demand for digital cameras has been growing.
  • The image taken by a digital camera has color tones conforming to the characteristics of the CCD or CMOS image sensor elements. To make the color tones conform to the characteristic of the human eye, various image correcting processes are carried out in the system.
  • In the image correcting processes, a white balance adjustment is such that, for example, red and blue are adjusted with respect to white to correct the white when an incandescent electric lamp or a fluorescent lamp is used as a light source, with white from the sun as a light source being a reference. Then, the white balance adjustment is generally made in an automatic white balance system (hereinafter, referred to as an AWB system) (for example, refer to Jpn. Pat. Appln. KOKAI Publication No. 4-304093).
  • In the AWB system, whether the white balance of the captured image has to be adjusted is judged at a color judgment unit on the basis of the YUV signal. The white balance adjustment is made by feeding back the white balance adjustment gain calculated on the basis of the YUV signal in the system. A color separation and synchronization unit color-separates the image signal of the captured image into a red, a green, and a blue signal and synchronizes them and, on the basis of these signals, generates the YUV signal.
  • When whether a white balance adjustment is needed is judged on the basis of the YUV signal generated exclusively for the color judgment unit, the color separation and synchronization unit is provided for the color judgment unit only. However, since the color separation and synchronization unit uses a line memory, the circuit size of the automatic white balance system increases considerably.
  • To solve this problem, a color judgment is made using the YUV signal white-balance adjusted by a feedback process without providing the color separation and synchronization unit exclusively for the color judgment unit. In this case, however, a color judgment is made on the basis of the white-balance-adjusted YUV signal influenced by the white balance adjustment gain. Accordingly, there is a possibility that a normal color judgment cannot be made, depending on photographing conditions.
  • BRIEF SUMMARY OF THE INVENTION
  • According to an aspect of the invention, there is provided an automatic white balance system comprising: a first multiplier which outputs a white-balance-adjusted image signal; a color separation and synchronization unit which has a line memory for generating a white-balance-adjusted YUV signal from the white-balance-adjusted image signal; a color judgment unit which judges whether or not a white balance adjustment is needed; a white balance adjustment gain computation unit which calculates a white balance adjustment gain on the basis of the result of the judgment at the color judgment unit and the white-balance-adjusted YUV signal; a reciprocal computation unit which outputs the reciprocal transformation value of the white balance adjustment gain; and a second multiplier which multiplies the white-balance-adjusted YUV signal by the reciprocal transformation value.
  • According to another aspect of the invention, there is provided an automatic white balance control method comprising: multiplying a first white-balance-unadjusted image signal by a first white balance adjustment gain to generate a first white-balance-adjusted image signal; generating a white-balance-adjusted YUV signal from the first white-balance-adjusted image signal; subjecting the first white balance adjustment gain to a reciprocal transformation process to calculate a reciprocal transformation value; multiplying the white-balance-adjusted YUV signal by the reciprocal transformation value to calculate a white-balance-unadjusted YUV signal; judging on the basis of the white-balance-unadjusted YUV signal whether to subject the white-balance-adjusted YUV signal to a white balance adjustment; if it is judged that a white balance adjustment is to be made, calculating a second white balance adjustment gain from the white-balance-adjusted YUV signal; and multiplying a second white-balance-unadjusted image signal input after the first white-balance-unadjusted image by the second white balance adjustment gain to generate a second white-balance-adjusted image signal.
  • BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING
  • FIG. 1 is a block diagram of an automatic white balance system according to an embodiment of the invention;
  • FIG. 2 is a block diagram of another automatic white balance system according to the embodiment of the invention;
  • FIG. 3 is a diagram showing the output (reciprocal transformation value) with respect to the input (white balance adjustment gain);
  • FIG. 4 is a block diagram of an embodiment of a hardware circuit applied to the reciprocal transformation unit;
  • FIG. 5 is a diagram showing the output with respect to the input when the hardware circuit is used;
  • FIG. 6 is a flowchart to help explain the processing performed by the software applied to the reciprocal transformation unit;
  • FIG. 7 is a block diagram of the reciprocal transformation unit caused to execute the software; and
  • FIG. 8 schematically shows the processing timing for automatic white balance.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Hereinafter, referring to the accompanying drawings, embodiments of the invention will be explained in detail.
  • 1. Outline
  • An embodiment of the invention relates to an automatic white balance system (AWB system). The embodiment is characterized by comprising a reciprocal computation unit for calculating the reciprocal of a white balance adjustment gain and a multiplier for multiplying the reciprocal transformation value by a white-balance-adjusted YUV signal.
  • It is desirable that whether a white balance adjustment is needed should be judged by a color judgment unit on the basis of a white-balance-unadjusted YUV signal.
  • In the embodiment of the invention, a white-balance-unadjusted YUV signal can be generated by multiplying the white-balance-adjusted YUV signal by the reciprocal transformation value of the white balance adjustment gain.
  • Accordingly, there is no need to provide a color separation and synchronization unit with a line memory of a large circuit size exclusively for the color judgment unit. Therefore, the increase of the circuit size of the AWB system can be suppressed. Moreover, since whether a white balance adjustment is needed can be judged on the basis of a white-balance-unadjusted YUV signal, a proper white balance adjustment can be made.
  • 2. Embodiments
  • (A) Configuration
  • FIG. 1 is a block diagram showing the configuration of an AWB system according to an embodiment of the invention. To simplify the explanation, only the principal part is shown in the embodiment.
  • An image sensor 1 outputs an image signal. The image sensor 1 is, for example, a single-plate area image sensor. The area of the image sensor 1 is composed of an effective pixel area and a blanking area around the effective pixel area. Of the input image signals, the signals of the effective pixel area are to be subjected to a white balance adjustment. The image signals are composed of red (R), green (G), and blue (B) color signals. The image sensor 1 is, for example, composed of a CCD or COS sensor. Each element of the sensor, that is, each pixel, is set so as to react to only one of red (R), green (G), and blue (B) with a color filter having an arrangement pattern of, for example, the Bayer type.
  • A main processor 9 includes an AWB gain multiplier (first multiplier) 2 and a color separation and synchronization unit 3. The AWB gain multiplier 2 multiplies an image signal by a white balance adjustment gain, thereby adjusting the white balance of the captured image. Therefore, the AWB gain multiplier 2 generates an image signal multiplied by the white balance adjustment gain, that is, a white-balance-adjusted image signal.
  • An image signal is input via the AWB gain multiplier 2 to the color separation and synchronization unit 3, which separates the input image signal into a red (R), a green (G), and a blue (B) component. On the basis of the separated signal components, the color separation and synchronization unit 3 generates a YUV signal.
  • Since the YUV signal is generated from the white-balance-adjusted image signal multiplied by the white balance adjustment gain, it is a YUV signal after a white balance adjustment (hereinafter, referred to as a WB-adjusted YUV signal). The YUV signal is composed of a luminance (Y) signal representing the luminance of the image, a U signal subtracted the luminance signal from the blue component, and a V signal subtracted the luminance signal from the red component. Moreover, the color separation and synchronization unit 3 includes a line memory 3A. The line memory 3 stores several lines of signal data, that is, as much signal data as several times the number of effective pixels in the horizontal direction of the image sensor.
  • The WB-adjusted YUV signal generated by the color separation and synchronization unit 3 is output to a white balance adjustment gain computation unit 5 and a multiplier (second multiplier) 7.
  • A color judgment unit 4 judges on the basis of the YUV signal whether the captured image includes an area needing a white balance adjustment and outputs the result of the judgment to the white balance adjustment gain computation unit 5.
  • The white balance adjustment gain computation unit 5 calculates a white balance adjustment gain on the basis of the result of the judgment at the color judgment unit 4 and the WB-adjusted YUV signal from the color separation and synchronization unit 3.
  • The white balance adjustment gain computation unit includes a UV signal integration unit 5A and an RB gain computation unit 5B.
  • When the color judgment unit 4 judged that the white balance adjustment was necessary, the UV signal integration unit 5A integrates a UV signal representing changes in the hue and chroma in the YUV signal.
  • The RB gain computation unit 5B calculates a red component gain (R gain) and a blue component gain (B gain) on the basis of the result of the calculation at the UV signal integration unit 5A. The white balance adjustment gain computation unit 5 calculates a white balance adjustment gain on the basis of the results of calculating the R gain and the B gain and outputs the resulting gain.
  • The white balance adjustment gain computation unit 5 may have the same configuration as shown in FIG. 2. In this case, an RB gain computation unit 51B calculates an R gain and a B gain on the basis of the WB-adjusted YUV signal and an RB gain signal integration unit 51A integrates the R gain and the B gain and calculates a white balance adjustment gain on the basis of the result.
  • The white balance adjustment gain calculated by the white balance adjustment gain computation unit 5 is fed back to the AWB gain multiplier 2 and, at the same time, output to the reciprocal computation unit 6.
  • The reciprocal computation unit 6 calculates the reciprocal transformation value of the input white balance adjustment gain. The reciprocal transformation performed by the reciprocal computation unit 6 is the process of giving a reciprocal transformation value 1/G if the white balance adjustment gain is G. The calculated reciprocal transformation value is output to the multiplier 7. The reciprocal transformation value may be a value obtained by multiplying 1/G by an arbitrary constant.
  • The multiplier 7 multiplies the WB-adjusted YUV signal output from the color separation and synchronization unit 3 by the reciprocal transformation value output from the reciprocal computation unit 6, thereby generating a YUV signal before a white balance adjustment (hereinafter, referred to as a WB-unadjusted YUV signal). Then, the WB-unadjusted YUV signal generated as a result of calculation at the multiplier 7 is output to the color judgment unit 4.
  • An output image adjustment circuit 8 subjects the WB-adjusted YUV signal processed by the automatic white balance system to a pixel skipping process according to the output size to be adapted to the image display on the display unit (not shown), the parallel/serial output converting process of converting the signals output in parallel from the main processor 9 into a serial output signal, and an image compression process, such as a JPEG compression process. Then, the signal processed at the output image adjustment circuit 8 is output as an image signal of the selected output type to an external unit, such as a display unit (not shown) or a storage unit (not shown).
  • The automatic white balance system of the embodiment is characterized by having the reciprocal computation unit 6 and the multiplier 7.
  • In the color judgment unit 4, it is desirable that the WB-unadjusted YUV signal should be used to judge whether to make a white balance adjustment.
  • In the embodiment, the WB-unadjusted YUV signal is obtained as a result of the multiplier 7 multiplying the WB-adjusted YUV signal output from the color separation and synchronization unit 3 by the value resulting from the reciprocal transformation of the white balance adjustment gain at the reciprocal computation unit 6.
  • Therefore, the reciprocal computation unit 6 and second multiplier 7 can generate a WB-unadjusted YUV signal for color judgment at the color judgment unit 4 without providing the color separation and synchronization unit 3 including the large-circuit-sized line memory 3A for color judgment only.
  • Accordingly, the increase of the circuit size of the automatic white balance system can be suppressed.
  • Moreover, since a color judgment can be made on the basis of the WB-unadjusted YUV signal, a proper white balance adjustment can be made.
  • (B) Configuration of the Reciprocal Computation Unit
  • As described above, to generate a white-balance-unadjusted YUV signal, the reciprocal computation unit 6 performs the reciprocal transformation of the white balance adjustment gain. The reciprocal transformation value is the output of FIG. 3 with respect to the white balance adjustment gain as the input value.
  • Hereinafter, the configuration of the reciprocal computation unit 6 for performing the reciprocal transformation of the input value and a method of calculating the reciprocal transformation value will be explained.
  • (1) ROM
  • Hereinafter, a reciprocal transformation process by a ROM will be explained.
  • As an example of the reciprocal transformation unit, a read-only memory (ROM) is provided in the reciprocal computation unit 6 of FIG. 1.
  • In this case, a ROM table which shows the relationship between the input value corresponding to the white balance adjustment gain and the output value obtained as a result of the reciprocal transformation of the input value is stored in the ROM.
  • The white balance adjustment gain treated as a feedback gain is such that, for example, ¼ to 4 times an arbitrary reference value is used as a gain setting range.
  • Similarly, the setting range of the white balance adjustment gain as the input value shown in FIG. 3 is set in the ROM table in such a manner that ¼ times an arbitrary reference value of R is used as the minimum value X1 and 4 times the arbitrary reference value is used as the maximum value X2. Each input value in the setting range is stored in the ROM. In the setting range of X1 to X2, each input value is subjected to reciprocal transformation and the value resulting from the reciprocal transformation is stored in the ROM.
  • Therefore, the reciprocal transformation value as an output value is the maximum value Y1 when the white balance adjustment gain as the input value is the minimum value X1 and the minimum value Y2 when the white balance adjustment gain is the maximum value X2.
  • A value smaller than the minimum value X1 of the white balance adjustment gain is outside the setting range. Therefore, when a value smaller than the minimum value X1 is input, for example, setting is done in the ROM table so that the maximum value Y1 of the reciprocal transformation value may be output. Moreover, a value larger than the maximum value X2 of the input value is also outside the setting range. In this case, for example, setting is done in the ROM table so that the minimum value Y2 of the reciprocal transformation value may be output.
  • As described above, the reciprocal computation unit using the ROM refers to the ROM table and outputs the reciprocal transformation value of the white balance adjustment gain as the input value. This makes it possible to obtain the reciprocal transformation value of the white balance adjustment gain.
  • (2) Hardware Circuit
  • The reciprocal computation unit 6 may be composed of a hardware circuit as shown in FIG. 4.
  • The calculation of the reciprocal transformation value by the ROM enables high-accuracy reciprocal transformation. However, as the amount of data in the ROM table becomes larger, a larger-capacity ROM has to be used, resulting in a larger circuit size.
  • Accordingly, in an area where the amount of change in the output value is small, such as in the range of 0 to X1 or X3 to X2 shown in FIG. 5, the reciprocal of the white balance adjustment gain as the input value is calculated by collinear approximation. Moreover, in an area where the amount of change in the output value is large, such as in the range of X1 to X3, the reciprocal is calculated using the ROM table. In the area from X3 to X2, the gain is approximated using a plurality of approximate lines.
  • As described above, getting the reciprocal transformation values using collinear approximation and the ROM table makes it possible to prevent the circuit size from increasing, while keeping the accuracy of the reciprocal transformation.
  • Hereinafter, the configuration and operation of the hardware circuit shown in FIG. 4 will be explained.
  • The hardware circuit of FIG. 4 includes a collinear approximation unit 6A, a ROM 6B, and a selector unit 6C.
  • The white balance adjustment gain as the input value is input to the collinear approximation unit 6A, ROM 6B, and selector unit 6C. The setting range of the white balance adjustment gain as the input value and the setting range of the reciprocal transformation value as the output value are the same as those in the ROM.
  • The collinear approximation unit 6A and ROM 6B output a reciprocal transformation value on the basis of the input white balance adjustment gain, respectively.
  • The selector unit 6C selects the reciprocal transformation value corresponding to the input white balance adjustment gain from the reciprocal transformation values obtained from the collinear approximation unit 6A and ROM 6B. For example, in the case of an input value smaller than X1 or an input value larger than X3, the output value of the collinear unit 6A is selected by the selector unit 6C. If the input value is in the range of X1 to X3, the output of the ROM 6B is selected by the selector unit 6C.
  • The reciprocal transformation value selected by the selector unit 6C is output to the multiplier 7.
  • As described above, the hardware circuit can output the reciprocal transformation value of the input white balance adjustment gain.
  • (3) Software
  • The reciprocal transformation process of the white balance adjustment gain can be carried out by software.
  • FIG. 6 is a flowchart to help explain a reciprocal transformation process by software. FIG. 7 is a block diagram of the reciprocal computation unit 6 for executing the software.
  • The reciprocal computation unit 6 includes a computation unit 6D and a control unit 6E.
  • The white balance adjustment gain as the input value is input to the computation unit 6D.
  • The control unit 6E has the software that calculates a reciprocal transformation value as an output value for the input value. The control unit 6E causes the computation unit 6D to perform reciprocal transformation described below.
  • First, the white balance adjustment gain is input to the reciprocal computation unit 6 and the computation unit 6D receives the input value (ST1).
  • Next, the control unit 6E causes the computation unit 6D to perform the reciprocal transformation of the input white balance adjustment gain (ST2).
  • Thereafter, the reciprocal transformation value calculated by the reciprocal transformation is output from the computation unit 6D to the multiplier 7, which completes the software computation process (ST3).
  • By the above steps, the reciprocal transformation value of the white balance adjustment gain can be calculated by software.
  • (C) Operation
  • Hereinafter, referring to FIG. 8, the operation of the AWB system will be explained. FIG. 8 schematically shows the timing for the processing of the automatic white balance system according to the embodiment. Areas 10A, 20A, and 30A in FIG. 8 correspond to the periods in which the signals of the effective pixel area of the image sensor 1 are input to the corresponding processing units (hereinafter, referred to as the effective pixel periods). Areas 10B, 20B, and 30B correspond to the periods in which the signals of the blanking areas are input to the corresponding processing units (hereinafter, referred to as the blanking periods).
  • First, one frame of image signal output from the image sensor 1 is input to the main processor 9. Of the input image signals, the main processor 9 chiefly processes the individual pixels in the image signal of the effective pixel area of the image sensor 1. The AWB gain multiplier 2 multiplies the image signal by the white balance adjustment gain. Thereafter, the image signal multiplied by the white balance adjustment gain is output to the color separation and synchronization unit 3. The image signal is input to the color separation and synchronization unit 3, which color-separates the image signal, synchronizes the separated signals, and converts the resulting signals into a YUV signal. At this time, since the YUV signal is obtained from the image signal multiplied by the white balance adjustment gain, it is a white-balance-adjusted YUV signal. The WB-adjusted YUV signal is output to the white balance adjustment gain computation unit 5, multiplier 7, and output image adjustment circuit 8. The WB-adjusted YUV signal is delayed for a delay time of Ta since the input of one frame of image signal for the processing in the main processor 9.
  • The WB-adjusted YUV signal output to the output image adjustment circuit 8 is subjected to a pixel skipping process, a parallel/serial output converting process, an image compression process, and other processes at the output image adjustment circuit 8. By these processes, the input one frame of WB-adjusted YUV signal is delayed for a delay time of Tb and converted into a selected image signal (external output signal), which is then output to an external unit.
  • On the other hand, the WB-adjusted YUV signal output to the white balance adjustment gain computation unit 5 is input to the UV signal integration unit 5A of the white balance adjustment gain computation unit 5. Then, if the color judgment unit 4 has judged on the basis of the WB-unadjusted YUV signal that the target pixel needs a white balance adjustment, the U signal and V signal in the WB-adjusted YUV signal are integrated by the UV signal integration unit 5A. Since a color judgment on the basis of the WB-unadjusted YUV signal is performed on all of the pixels in the effective pixel area, the judgment is made in synchronization with the effective pixel period 10A of the WB-unadjusted YUV signal. Moreover, the integrated UV value calculated by the UV signal integration unit 5A is delayed from the color judgment period by the computation process and then output.
  • On the result of the calculation at the UV signal integration unit 5A, the R gain and B gain are calculated by the RB gain computation unit 5B. On the basis of the resulting value, the white balance adjustment gain is calculated. The white balance adjustment gain is output to the reciprocal computation unit 6. Moreover, at the same time, the gain is fed back to the AWB gain multiplier 2.
  • The white balance adjustment gain fed back to the AWB gain multiplier 2 is updated during a blanking period before the image signal of the next frame is input to the main processor 9 and the updated gain is input to the AWB gain multiplier 2. That is, the white balance adjustment gain is such that a gain calculated for the image signal of one frame is reflected in the image signal of the next one frame in such a manner that the next image signal is multiplied by the gain of the preceding image signal.
  • In the configuration of the white balance adjustment gain computation unit of FIG. 2, the R gain and B gain are calculated from the WB-adjusted YUV signal input to the RB gain computation unit 51B. The computation result is integrated at the RB gain signal integration unit 51A. On the basis of the integration result, the white balance adjustment gain is calculated.
  • The white balance adjustment gain output to the reciprocal transformation unit 6 is subjected to any one of the reciprocal transformation process on the ROM or hardware circuit, or by software at the reciprocal transformation unit 6. Then, the reciprocal transformation value corresponding to the white balance adjustment gain is output to the multiplier 7.
  • Then, the WB-adjusted YUV signal output from the color separation and synchronization unit 3 is multiplied by the reciprocal transformation value at the multiplier 7. Since the WB-adjusted YUV signal is a YUV signal multiplied by the white balance adjustment gain corresponding to the preceding image signal, a white-balance-unadjusted YUV signal is generated by further multiplying the WB-adjusted YUV signal by the reciprocal transformation value. The WB-unadjusted YUV signal is output to the color judgment unit 4. The WB-unadjusted YUV signal is delayed by a reciprocal transformation process for a delay time of Tc since the input of one frame of the WB-adjusted YUV signal and the resulting signal is input to the color judgment unit 4.
  • The above processes are carried out repeatedly each time the image sensor 1 outputs one frame of image signal sequentially.
  • As described above, with the embodiment, a YUV signal before a white balance adjustment can be reproduced. On the basis of the YUV signal, the color judgment unit 4 judges whether the target pixel (image signal) is to be subjected to a white balance adjustment.
  • Therefore, the reciprocal computation unit 6 and the second multiplier 7 can generate a white-balance-unadjusted YUV signal for a color judgment at the color judgment unit 4 without providing the color separation and synchronization unit 3 including the large-circuit-sized line memory 3A for a color judgment only.
  • Accordingly, the increase of the circuit size of the automatic white balance system can be suppressed.
  • Moreover, since color judgment can be made on the basis of the white-balance-unadjusted YUV signal, a proper white balance adjustment can be made.
  • Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

Claims (20)

1. An automatic white balance system comprising:
a first multiplier which outputs a white-balance-adjusted image signal;
a color separation and synchronization unit which has a line memory for generating a white-balance-adjusted YUV signal from the white-balance-adjusted image signal;
a color judgment unit which judges whether or not a white balance adjustment is needed;
a white balance adjustment gain computation unit which calculates a white balance adjustment gain on the basis of the result of the judgment at the color judgment unit and the white-balance-adjusted YUV signal;
a reciprocal computation unit which outputs the reciprocal transformation value of the white balance adjustment gain; and
a second multiplier which multiplies the white-balance-adjusted YUV signal by the reciprocal transformation value.
2. The automatic white balance system according to claim 1, wherein the second multiplier generates a white-balance-unadjusted YUV signal, and
the color judgment unit makes a judgment on the basis of the white-balance-unadjusted YUV signal.
3. The automatic white balance system according to claim 1, wherein the reciprocal computation unit has a ROM which stores a ROM table that shows the relationship between the white balance adjustment gain and its reciprocal transformation value.
4. The automatic white balance system according to claim 3, wherein, if a reference value of the white balance adjustment gain is shown R, the white balance adjustment gain is defined in the range from ¼×R to 4×R and a reciprocal transformation value is calculated in the setting range.
5. The automatic white balance system according to claim 1, wherein the reciprocal computation unit includes a collinear approximation unit which subjects the reciprocal transformation value of the white balance adjustment gain to collinear approximation, a ROM which stores a ROM table that shows the relationship between the white balance adjustment gain and its reciprocal transformation value, and a selector unit which selects either the reciprocal transformation value calculated from the collinear approximation unit or the reciprocal transformation value calculated from the ROM according to the input of the white balance adjustment gain.
6. The automatic white balance system according to claim 5, wherein a output of the collinear approximation unit corresponds to the reciprocal transformation value in an area where the amount of change in the reciprocal transformation value is small, and
a output of the ROM table corresponds to the reciprocal transformation value in an area where the amount of change in the reciprocal transformation value is large.
7. The automatic white balance system according to claim 1, wherein the reciprocal computation unit has a control unit and a computation unit, and
the control unit causes the computation unit to receive a white balance adjustment gain, calculate the reciprocal of the white balance adjustment gain, and output the reciprocal of the white balance adjustment gain.
8. The automatic white balance system according to claim 1, wherein the white balance adjustment gain computation unit includes a UV signal integration unit which calculates the integrated values of a U signal and a V signal in the input white-balance-adjusted YUV signal and the RB gain computation unit which calculates a red component gain and a blue component gain on the basis of the UV signal integrated value.
9. The automatic white balance system according to claim 1, wherein the white balance adjustment gain computation unit includes an RB gain computation unit which calculates a red component gain and a blue component gain on the basis of the input white-balance-adjusted YUV signal, and an RB gain signal integration unit which integrates the red component gain and the blue component gain.
10. The automatic white balance system according to claim 1, further comprising: an image sensor which outputs a white-balance-unadjusted image signal.
11. The automatic white balance system according to claim 10, wherein the image sensor includes an effective pixel area which is to be subjected to a white balance adjustment and a blanking area around the effective pixel area which is not to be subjected to a white balance adjustment.
12. The automatic white balance system according to claim 10, wherein the image sensor is a single-plate area image sensor.
13. The automatic white balance system according to claim 10, wherein the color judgment unit makes a judgment in synchronization with the period in which the white-balance-unadjusted YUV signal corresponding to the effective pixel area is input.
14. The automatic white balance system according to claim 10, wherein the first multiplier multiplies the white balance adjustment gain by the white-balance-unadjusted image signal, thereby calculating the white-balance-adjusted image signal.
15. The automatic white balance system according to claim 10, wherein the white balance adjustment gain generated from white-balance-unadjusted image signal input from the image sensor is reflected in a image signal input after the white-balance-unadjusted image signal.
16. The automatic white balance system according to claim 1, further comprising: an output image adjustment circuit which subjects the white-balance-adjusted YUV signal to a converting process to generate an external output signal.
17. The automatic white balance system according to claim 1, wherein the output image adjustment circuit subjects the input white-balance-adjusted YUV signal to a pixel skipping process.
18. The automatic white balance system according to claim 1, wherein the output image adjustment circuit subjects the input white-balance-adjusted YUV signal to a parallel/serial converting process.
19. The automatic white balance system according to claim 1, wherein the output image adjustment circuit subjects the input white-balance-adjusted YUV signal to an image compression process.
20. An automatic white balance control method comprising:
multiplying a first white-balance-unadjusted image signal by a first white balance adjustment gain to generate a first white-balance-adjusted image signal;
generating a white-balance-adjusted YUV signal from the first white-balance-adjusted image signal;
subjecting the first white balance adjustment gain to a reciprocal transformation process to calculate a reciprocal transformation value;
multiplying the white-balance-adjusted YUV signal by the reciprocal transformation value to calculate a white-balance-unadjusted YUV signal;
judging on the basis of the white-balance-unadjusted YUV signal whether to subject the white-balance-adjusted YUV signal to a white balance adjustment;
if it is judged that a white balance adjustment is to be made, calculating a second white balance adjustment gain from the white-balance-adjusted YUV signal; and
multiplying a second white-balance-unadjusted image signal input after the first white-balance-unadjusted image signal by the second white balance adjustment gain to generate a second white-balance-adjusted image signal.
US11/939,179 2006-11-14 2007-11-13 Automatic white balance system and automatic white balance control method Expired - Fee Related US7864222B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006308255A JP2008124928A (en) 2006-11-14 2006-11-14 Auto white balance system
JP2006-308255 2006-11-14

Publications (2)

Publication Number Publication Date
US20080111896A1 true US20080111896A1 (en) 2008-05-15
US7864222B2 US7864222B2 (en) 2011-01-04

Family

ID=39368825

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/939,179 Expired - Fee Related US7864222B2 (en) 2006-11-14 2007-11-13 Automatic white balance system and automatic white balance control method

Country Status (3)

Country Link
US (1) US7864222B2 (en)
JP (1) JP2008124928A (en)
CN (1) CN101287136B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080239156A1 (en) * 2007-03-28 2008-10-02 Hitachi Kokusai Electric Inc. Image pickup apparatus
WO2012094201A2 (en) * 2011-01-06 2012-07-12 Intel Corporation System, method and computer program product for color processing of point-of-interest color
CN103856768A (en) * 2012-12-04 2014-06-11 三星泰科威株式会社 Apparatus, method, and program for processing image
US9253460B1 (en) 2014-09-17 2016-02-02 SZ DJI Technology Co., Ltd. Automatic white balancing system and method
US9307214B1 (en) * 2014-12-19 2016-04-05 Omnivision Technologies, Inc. Automatic white balance methods and systems for electronic cameras
US9307215B1 (en) * 2014-12-19 2016-04-05 Omnivision Technologies, Inc. Automatic white balance methods and systems for electronic cameras

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5064947B2 (en) * 2007-09-11 2012-10-31 キヤノン株式会社 Image processing apparatus and method, and imaging apparatus
JP2011239067A (en) 2010-05-07 2011-11-24 Toshiba Corp Image processor
JP5631714B2 (en) * 2010-12-10 2014-11-26 株式会社東芝 Auto white balance adjustment system
JP5818668B2 (en) * 2011-12-16 2015-11-18 株式会社東芝 Auto white balance adjustment system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5298979A (en) * 1990-12-31 1994-03-29 Samsung Electronics Co., Ltd. Automatic digital white-balancing circuit utilizing memory addresses to determine where white-balance correction is necessary
US5398058A (en) * 1991-07-15 1995-03-14 Canon Kabushiki Kaisha Color image pickup device having color temperature converting filters
US20050162532A1 (en) * 2004-01-26 2005-07-28 Tetsuya Toyoda Image sensing apparatus
US6958773B1 (en) * 1999-07-15 2005-10-25 Pentax Corporation White balance control amount calculating device
US20060290957A1 (en) * 2005-02-18 2006-12-28 Samsung Electronics Co., Ltd. Apparatus, medium, and method with automatic white balance control
US7511739B2 (en) * 2001-06-19 2009-03-31 Sanyo Electric Co., Ltd. Image combining apparatus for combining multiple exposure based on luminance properties
US7684122B2 (en) * 2006-09-26 2010-03-23 Olympus Imaging Corp. Zoom lens and imaging system using the same

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2754672B2 (en) * 1989-03-03 1998-05-20 ソニー株式会社 Gamma correction circuit
JP3624604B2 (en) * 1996-12-28 2005-03-02 株式会社ニコン Color reproduction correction apparatus and correction method for imaging apparatus
JPH1169221A (en) * 1997-08-19 1999-03-09 Nec Corp Camera system
JP3631022B2 (en) * 1997-12-25 2005-03-23 キヤノン株式会社 Imaging apparatus and signal processing apparatus
US6437833B1 (en) * 1998-11-18 2002-08-20 Kabushiki Kaisha Toshiba Automatic white balance adjusting circuit in color image display
JP3896438B2 (en) * 1999-04-12 2007-03-22 富士フイルム株式会社 Digital camera and auto white balance control method
JP2001128191A (en) * 1999-08-18 2001-05-11 Fuji Photo Film Co Ltd Method and device for processing image and recording medium
JP2001112020A (en) * 1999-09-28 2001-04-20 Umax Data Systems Inc Light source selection and color digital imaging device ricoverable after shot
JP2001189945A (en) * 1999-12-28 2001-07-10 Sony Corp Image pickup device
JP2001008226A (en) * 2000-01-01 2001-01-12 Hitachi Ltd Display device using color picture tube having automatic white balance adjustment circuit
JP2000358253A (en) * 2000-01-01 2000-12-26 Hitachi Ltd Display using color picture tube provided with automatic white balance adjusting circuit
JP4051196B2 (en) * 2001-11-08 2008-02-20 オリンパス株式会社 Noise reduction system, noise reduction method, noise reduction program, and electronic camera
JP4304093B2 (en) 2004-02-19 2009-07-29 富士フイルム株式会社 Chemically amplified resist composition for immersion process and pattern forming method using the same

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5298979A (en) * 1990-12-31 1994-03-29 Samsung Electronics Co., Ltd. Automatic digital white-balancing circuit utilizing memory addresses to determine where white-balance correction is necessary
US5398058A (en) * 1991-07-15 1995-03-14 Canon Kabushiki Kaisha Color image pickup device having color temperature converting filters
US6958773B1 (en) * 1999-07-15 2005-10-25 Pentax Corporation White balance control amount calculating device
US7511739B2 (en) * 2001-06-19 2009-03-31 Sanyo Electric Co., Ltd. Image combining apparatus for combining multiple exposure based on luminance properties
US20050162532A1 (en) * 2004-01-26 2005-07-28 Tetsuya Toyoda Image sensing apparatus
US20060290957A1 (en) * 2005-02-18 2006-12-28 Samsung Electronics Co., Ltd. Apparatus, medium, and method with automatic white balance control
US7684122B2 (en) * 2006-09-26 2010-03-23 Olympus Imaging Corp. Zoom lens and imaging system using the same

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080239156A1 (en) * 2007-03-28 2008-10-02 Hitachi Kokusai Electric Inc. Image pickup apparatus
US8194151B2 (en) * 2007-03-28 2012-06-05 Hitachi Kokusai Electric Inc. Image pickup apparatus
CN103444188A (en) * 2011-01-06 2013-12-11 英特尔公司 System, method and computer program product for color processing of point-of-interest color
US20120176395A1 (en) * 2011-01-06 2012-07-12 Ya-Ti Peng System, method and computer program product for color processing of point-of-interest color
WO2012094201A3 (en) * 2011-01-06 2012-10-26 Intel Corporation System, method and computer program product for color processing of point-of-interest color
US8493402B2 (en) * 2011-01-06 2013-07-23 Intel Corporation System, method and computer program product for color processing of point-of-interest color
WO2012094201A2 (en) * 2011-01-06 2012-07-12 Intel Corporation System, method and computer program product for color processing of point-of-interest color
CN103856768A (en) * 2012-12-04 2014-06-11 三星泰科威株式会社 Apparatus, method, and program for processing image
US9253460B1 (en) 2014-09-17 2016-02-02 SZ DJI Technology Co., Ltd. Automatic white balancing system and method
WO2016041162A1 (en) * 2014-09-17 2016-03-24 SZ DJI Technology Co., Ltd. Automatic white balancing system and method
US9743059B2 (en) 2014-09-17 2017-08-22 SZ DJI Technology Co., Ltd. Automatic white balancing system and method
US9743058B2 (en) 2014-09-17 2017-08-22 SZ DJI Technology Co., Ltd. Automatic white balancing system and method
US9307214B1 (en) * 2014-12-19 2016-04-05 Omnivision Technologies, Inc. Automatic white balance methods and systems for electronic cameras
US9307215B1 (en) * 2014-12-19 2016-04-05 Omnivision Technologies, Inc. Automatic white balance methods and systems for electronic cameras

Also Published As

Publication number Publication date
US7864222B2 (en) 2011-01-04
CN101287136B (en) 2010-06-23
JP2008124928A (en) 2008-05-29
CN101287136A (en) 2008-10-15

Similar Documents

Publication Publication Date Title
US7864222B2 (en) Automatic white balance system and automatic white balance control method
KR100513342B1 (en) An apparatus for automatical digital white balance
JP5818668B2 (en) Auto white balance adjustment system
US7030913B2 (en) White balance control apparatus and method, and image pickup apparatus
US8614751B2 (en) Image processing apparatus and image processing method
KR101352440B1 (en) Image processing apparatus, image processing method, and recording medium
US8243164B2 (en) Method, apparatus, and system for selecting pixels for automatic white balance processing
US7479991B2 (en) Digital camera, and signal processing method and signal processing apparatus for the same
WO2007058126A1 (en) Image processing system and image processing program
CN107534759B (en) Image pickup apparatus, image pickup method, and computer-readable medium
US8810681B2 (en) Image processing apparatus and image processing method
EP1489852B1 (en) Method and apparatus for white balancing images
JP2010114667A (en) Automatic white balance adjustment system
US7667748B2 (en) Method and apparatus of defective pixel correction for a solid-state imaging device
JP2002290988A (en) Imaging device
JPH11313338A (en) Signal processor and photographing signal processing method
US8885062B2 (en) Auto white balance adjustment system, auto white balance adjustment method, and camera module
JP2010154478A (en) Compound-eye imaging apparatus and method for generating combined image thereof
KR101137611B1 (en) System and method for effectively performing an image data transformation procedure
US7512266B2 (en) Method and device for luminance correction
JP6886026B2 (en) Imaging device
JP2002271825A (en) Color matching method, color matching system, and television camera used for them
JP2009017301A (en) Signal processing apparatus
JP6649176B2 (en) Image processing apparatus and image processing method
JP2017225036A (en) Imaging device and image processing method

Legal Events

Date Code Title Description
AS Assignment

Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YOSHINO, AKIRA;YANAGIDA, KEIICHIRO;MATSUO, NORIKO;REEL/FRAME:020421/0232;SIGNING DATES FROM 20071122 TO 20071127

Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YOSHINO, AKIRA;YANAGIDA, KEIICHIRO;MATSUO, NORIKO;SIGNING DATES FROM 20071122 TO 20071127;REEL/FRAME:020421/0232

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20190104