CA1231436A - Priority masking techniques for video special effects - Google Patents

Priority masking techniques for video special effects

Info

Publication number
CA1231436A
CA1231436A CA000473580A CA473580A CA1231436A CA 1231436 A CA1231436 A CA 1231436A CA 000473580 A CA000473580 A CA 000473580A CA 473580 A CA473580 A CA 473580A CA 1231436 A CA1231436 A CA 1231436A
Authority
CA
Canada
Prior art keywords
area
segment
enhancement
priority
conversion signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired
Application number
CA000473580A
Other languages
French (fr)
Inventor
Ralph Weinger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
COLOR SYSTEMS Tech Inc
Cerulean Colorization LLC
Original Assignee
COLOR SYSTEMS Tech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=24604132&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CA1231436(A) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by COLOR SYSTEMS Tech Inc filed Critical COLOR SYSTEMS Tech Inc
Application granted granted Critical
Publication of CA1231436A publication Critical patent/CA1231436A/en
Expired legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/43Conversion of monochrome picture signals to colour picture signals for colour picture display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/74Circuits for processing colour signals for obtaining special effects

Abstract

ABSTRACT OF THE DISCLOSURE
Method and apparatus for priority masking of video enhancement areas of a video picture. A first enhancement conversion formula is generated for enhancing a first segment of the video picture according to the first generated enhancement conversion formula. Similarly, a second enhancement formula for enhancing a second segment of the video picture according to the second enhancement conversion formula is generated. Priority of one conversion formula over the other in the area of overlap of the two segments is established by combining the first and second enhancement conversion formulas in a manner to produce the composite enhancement conversion formula in which one of the first and second enhancement conversion formulas has a degree of priority over the other enhancement conversion formula in the area of the video picture in which the overlapping occurs. The video picture is thus modified according to the composite enhancement conversion formula.
When more than two segments having their individual enhancement conversion formulas, the composite enhancement conversion formula is established such that, in the area of common overlap of the three segments, one of the first, second, and third enhancement conversion formulas has a first degree of priority over the other two, and one of the other two enhancement conversion formulas has a second degree of priority over the other one thereof. In a preferred embodiment, the enhancement modification and conversion is the colorization of a black and white or an undesirably colored video picture.

Description

I I

PRIORITY MASKING TUITIONS FOR VIDEO SPE~IaL_~EFECTS

BACKGROUND OF THE INVENTION
Eye by Dti~
This invention relate to the field of video special effects, and more particularly, to a method and means for creating and establishing priority among a plurality of masks affecting the nature of a video picture.
grief Pesc~iptiQn ho Prick Art Masking techniques are known in which certain picture segments, known as masked areas, are modified or enhanced in accordance with a specified condition refer d to herein as a conversion formula. Each conversion formula is operative within the boundaries of its masked area, and when two masked area overlap the area of the picture in which overlapping occurs is affected by the conversion formula of both segments combined. This combination of conversion formulas in the area of overlapping segments may be used to advantage to obtain interesting patterns or effect. It can, however, be deleterious to the overall enhancement scheme, especially when the enhancement effect it that of coloring previously black and white pictures or modifying the coloring of a previously colored picture.
The degrading effects of the combining of conversion formulas can ye appreciated from the fact that, due to the li~ht~emitting nature of the phosphor on the face of a picture tube, light emitted prom the same aria of the picture tube produced by video signals repre~entinq two different colors mixes according to a sopor additive ~3~36 process. For example, if two masks overlap and in the overlapped area, one displays a green color and the other displays a red color in a prescribed proportion to the green, then when the two color are visually mixed on the face of a color picture tube or screen, the resultant color would be yellow. Since neither color substantially dominates the other and since a yellow color is strikingly different than either red or green if two objects are close together having red and green coloring, respectively, and the picture segments in which the respective color conversion formulas are operative overlap, the undesirable yellow hue will result In certain systems, such as those that use a computerized "color tablet to appoint a group of pixels in lo one solid color, the problem is avoided by not allowing any picture segments, or masks to overlap. Accordingly, when one object moves into another, the colonizer technician reshapes the area of pixels and effectively manually prioritizes the colors of all areas of the picture.
Alternatively, the computer in such a system can store characteristics of each pixel and make educated judgments as to changing positions ox object shapes so as to ~electronlcallyn follow a moving object In either case, however t when the system is confronted with one object I moving into the other, or encounters the close proximity of two differently colored objects a system operating in the manner just described becomes extremely slow in the coloring process because the colonizer technician must carefully draw a large number of masked arias on the color tablet in precise relationship to the outlines of each object.
In prior art systems which operate on the basis of establishing a color conversion formula in which different colors are chosen on the basis of the luminance level of the picture within a prescribed area, a similar problem is encountered but of considerably less degree A system which uses gray levels of the luminance signal for establishing colonization formulas will, knurls, often encounter object that are closely positioned nor move relative Jo otter objects, such that tube segment& or masks, within which color conversion formulas are active, overlap. The net colonization formula in the area of mask overlap it thus Rome combination of the colonization formulas contributing in that area of overlap.
One such system using the gray level for establishing color conversion formulas can be wound in my U.S. Potent 4,149,185 issued April 10, 1979. In accordance with the system described in U.S. Patent 4,149,185, the outputs of a plurality of multipliers are summed together to produce the picture components Y, R-Y, and B-Y, such components being combined to form a composite color video signal or RUB video signal for display on a monitor. Each of the three components has its separately summed multipliers, and each multiplier has as its two inputs a color conversion formula and a mask signal which enables the color con-version formula to be active only within a prescribed massed area of the picture.
Each multiplier receives it mask signal input from a mask generator, and each mask generator it operated totally independent of other mask venerators, Accordingly, although each separate color conversion furl is affected by its associated multiplier or particular donated aria ox the picture, nevertheless the independency ox the mask generator and the standard summation technique used in summing the outputs of the multipliers result in a weighted colonization formula for picture element of the same video 30 level in any area where any two or more masks overlap, tube weight of each color in the area of overlap being dependent upon the strength of that color according o the dolor conversion formula it represent As set forth in my prior U.S. Patent 4,14g,185, one of the most important advantages over the ~pixella~ed"
colonization technique is that, since gray levels are assigned specific colors, the movement of a colored object, or its proximity to other colored objects, does not result in any deleterious effects for so long as each gray level is to maintain its assigned color. When two masks overlap, however, there are occasions when problems arise if the same video gray level is assigned different colors for the two overlapping masks. While this is less of a problem with systems in accordance with my prior U.S. Patent 4,149,185 than that of systems using colored pixel groups, there is nevertheless an established need for eliminating the problem of color-mixing in areas of the video picture at which two or more masks overlap. The present invention fulfills this need BRIEF DESCRIPTION OF THE INVENTION
The aforementioned deficiencies of the prior art are overcome by the present invention by the provision of a method and apparatus for priority masking of video enhancement areas of a video picture.
For the purposes of this description, and by way of example only and not intended to represent any limitation thereof, the enhancement characteristic of concern will be that of colonizing areas of a video picture. In this sense Ucolorizing" and any form of the term is to ye understood to mean either adding color to a previously all black and white picture or modifying the color of a previously colored picture in full or in part It should be understood, however, that video enhancement using the priority masking techniques ox the subject application can involve other picture parameters other than color.
For example a variety of special effects such as wiping, split-screen, super imposition keying, graphics, and the like are merely signal additions or alterations of existing video signals and may by employed under the - s control of a mask generator so that the special effect is operative or active only within a prescribed area on the screen.
Similarly, a variety of video image processors are standard equipment in video studios an example being that of the Micro time Model ~100 video image processor. Such processors are incline devices and provide variable control over such electrical parameters as video gain chrominance gain, hue and setup, as well as control over the amount of horizontal detail, vertical detail and noise reduction desired. If combined with a mask generator so that the processor is only enabled or effective within the area defined by the mask generator and if more than one mask is used at any one time, then the priority masking techniques of the present invention can beneficially apply.
Although the example to be discussed in this description is that of coloring a picture, so as to appreciate the wide scope of application for the present invention, one might consider a simplified example of a moving image passing horizontally across a screen where a group of buildings, or the like, are spaced horizontally across the screen A special equity can be generated wherein the moving object is to appear to be positioned in front of some of the buildings and behind others. This can be accomplished by keying a downstream signal adder based upon the gray level in the picture. To permit the moving object to pass in between, for example, two different buildings of the same gray level r the masking technique according to the subject application might by employed. In I such a case, in the area of overlap between one such mask which is to enable the downstream adder and an adjacent mask which is to disable the downstream adder, priority may be given to the keying formula of the building or object that is to be in the foreground.

I

or the purposes of this description, the term apri~rity~ is intended to mean having preference or perorate in position on the video monitor screen to all other element effective a such position the superiorly need not be, and is often not, absolute. That 15, the priority of any one mask may have any value between 1 and +1, the value I represent in absolute priority, the value O
representing no priority having no effect on the video picture, and the value -1 reprinting a negative priority essentially making the effects of all other masks more effective. In the latter example, a value of -1 for one mask can double the effects ox all other masks operative in the same picture area It is further reiterated that my prior U.S. Patent 4,149,185 is to be considered as representing a prior art colonization process and apparatus which can beneficially use the improvement according to the subject application.
In my prior patent, an apparatus is disclosed for the conversion of black and white video signals to color video signals in which the black and white video signal is processed through a luminance MY) channel and two color information ROY and B-Y) channels, the apparatus providing means for modifying the video signal in each channel in accordance with one or more operator-determined transfer function.
Each channel further provides means for further modifying the video signal as a function of area signals generated by separate sources. For each of the channels, a plurality of function generators may provide the signal conversion, while another plurality of multipliers set positional or area boundaries within which each color conversion formula from each function venerator is to be operative. Importantly, the outputs of the multipliers, then representing color conversion formulas for separate but possibly overlapping areas, are summed together without any contributing color conversion formula having any priority in areas of the video picture in which overlapping occurs.

In the interest of consistency, in this de~criptionr where appropriate for ease of understanding and continuity, the term "mask" is equivalent to a specified segment of the video picture, and the term "area" is more generic and may refer to an entire picture, a picture segment, or fraction of a picture in which two or more segments overlap. Moreover, a color conversion formula will generally refer to that signal derived from a function generator which produces an output signal based upon an input black and white or color corrected signal.
composite luminance color conversion formula would refer to the video component resulting from the summing of all luminance function generators affected by the associated multipliers. Similarly, the R-Y and B-Y composite color conversion formulas would represent the summation of all R-Y
and B-Y function generators, respectively, affected by the associated multipliers. Finally, the composite color video signal will refer to the encoded or combined I, R-Y and B-Y
signals, the composite color video signal being appropriate or applying to a color video monitor, If desired an encoder may be used to produce an RUB signal for use with monitors equipped to handle RUB components.
Using the invention of my prior U.S. Patent as a basis, the individually produced mask signals r which define the aforementioned masked segments independent of one another, may be routed to a priority assignment device according to the present invention In the priority assignment device, each mask signal is operated on by a mask processor to produce a prioritized mask signal as an output and a further priority function as an input to the next mask processor in line The first mentioned mask processor has the highest priority and has Al as an input priority factor, The second mask processor then operates on the second mask signal to produce the second prioritized mask signal subject to the first mask signal and a second priority factor as an input to the third mask processor, and the number of mask processors is limited only by the design of the system and the wishes of the colonizer technician With the arrangement just described, a series of prioritized mask signal outputs are generated, one for each input mask signal, the priority assignment device having established priority among the mask outputs as contrasted with the independent character of the mask input signals.
While an order of priority is established in the priority assignment device, a number of options are available to the colonizer technician so as to make the system guile flexible and applicable to a wide variety of colonization needs. More specifically, a switching network may be employed if desired, the function of the switching network being that of ordering the separate non-prioritized mask signals according to a desired schedule of priority.
Thus, any mask signal may be assigned any mask priority.
This may be important in video pictures wherein moving objects vary from one side or the screen to the other or when severe camera zooming techniques are employed so that, for one scene a preestablished smaller mask signal may have a high priority prior to movement or zoom, and a larger mask might be preferred as Hun the higher priority after movement or zoom. In any event, the flexibility of the sty them is greatly enhanced by the provision of such a switching network.
Furthermore, each mask processor may be provided with a control switch for affecting either the transfer of the mask signal through the mask processor or of the mask signal as a priority factor to the next mask processor. For example, a control switch may be associated with each mask processor so as to bypass the mask processor for that particular mask signal As a result the mask signal passes through the processor without alteration, while the priority function is left unaltered so that mask processors of lessor priority will still be effected by the bypassed mask signal As another function adding to flexibility of the system, another control switch can be associated with each mask processor to allow pus of the overall priority factor through the priority assignment device without contribution by that mask signal In other word, that selected mask processor will prioritize the mask I gnat applied, but the priority factor passe on to the mask processor of lever priority will have no contribution of the selected mask signal In this way any mask can be precluded from affecting any mask of lesser priority.
The switching functions lust described within the priority assignment device may, if de trod, be jet to past all mask signal through the priority assignment device with a gain of I and with no priorities established whatsoever.
Finally, as an improvement over tube byway invention, each mask generator can produce a mask with soft edges, meaning that the colonization formula that it enabled by the mask it gradually enabled from a 0 value up to the full value of the color conversion formula internally Of the mask.
The invention therefore relates to an apparatus for priority enhancement modifying of a specified area of a video picture, the apparatus comprising means for generating a first area enhancement conversion signal, means for enhancement converting a first segment of the video picture according to the first area enhancement conversion signal, means for generating a second area enhancement conversion signal, means for enhancement converting a second segment of the video picture according to the second area enhancement conversion signal, the second segment, at least in part, overlapping at least a part of the first segment, means for combining the first and second area enhancement conversion signals in a manner to produce a composite enhancement conversion signal in which one of the first and second area enhancement conversion signals has a degree of priority over the other '~2~3~3 -pa-of the area enhancenlent conversion signal in the area of the video picture in which the segment overlapping occurs, and means or modifying the video picture according to the composite enhancement conversion signal.
The invention further relates to a method or priority enhancement modifying a specified area of a video picture. This method is comprised of the steps of generating a first area enhancement conversion signal for enhancement converting a first segment of the video picture according to the first area enhancement conversion signal, generating a second area enhancement conversion signal for enhancement converting a second segment of the video picture according to the second area enhancement conversion signal, the second segment, at least in par, overlapping at least a part of the I first segment, combining the first an second area enhance-mint conversion signals in manner to produce a composite enhancement conversion signal in josh one of the first and second area enhancement conversion signals has a degree of priority over the other ox -the area enhancement conversion signals in the area of the video picture in which the segment overlapping occurs, and enhancement modifying the video picture according to the composite enhancement conversion signal.
The invention further relates to the apparatus and method wherein the enhancement is color.
Lo Other Avon ayes and impovem~nts o'er thy basic 8y8tem just described Jill be evident by reference Jo the attached drawing in which:
Figure 1 is a Blake diagram ox a colonization scheme to produce a composite dolor video signal f rum a Luke and whit video input signal coring to my prior ITS Patent 4,149,1~5, with ~mpl~ym~nt ox the switching network and priority a~sigmnent device improvement according to the present ~nventlon~

I
-9b-FIGURE 2 it partial view of the prior art portion of FIGURE 1 with an expanded and more detailed view of the priority assignment device;
FIGURE 3 it a representation of a video picture in which object of different video level are teen, and in which a mask around one of the displayed objects is shown;

FIGURE 4 shows a similar view to that of FIGURE 3 with the addition of another object and, wit the addition of second mask, the creation of an overlapping mask situation;
FIGURE 5 shows a simulated video picture with a specific colonization problem incorporating two overlapping masks solved by the invention according to the present invention; and FIGURE 6 shows graphically the effects of soft edge masking.
DETAILED DESCRIPTION OF THE PREFERR~p~ Em FIGURE 1 is a modified version of FIGURE 1 from my aforementioned U.S. Patent 4~1~9,185. As with my earlier patent the throughput function of the system shown in FIGURE 1 is to receive a black and white video input signal, separate it into various components, process the separate component and combine the processed components in a color video encoder to provide a color video output signal. Since difference colonization technique are required for different areas of the picture to be modified, one or more area masks are generated and certain junctions for modifying the input signal are operative only within the masked areas The novel improvement according to the present invention concerns a priority assignment device for interrelating the masks produced, in such a way as to give priority in areas of mask overlap. A video input signal is shown in FIGURE 1 as a blank and white input signal on line 30. It is to be understood that the input signal could be a precolor~d video input whose coloration is to be altered and the invention works equally well with such input sunless The video input signal is routed to a qenlo~k sync generator 79 to provide system sync, and to an amplifier 40 of conventional design which may provide overall video level and setup A signal corrector 42 may provide video enhancement and/or initial overall transformation of the ~3:~3~

black and white signal, and is also an optional circuit block of conventional design The processed output of signal corrector 42 is supplied to a number of functional generators 50-S~ and 57 which independently operate on the input video signal to provide a specified video transformation function for either the entire picture area (through function generator 50) or within certain specified masked areas of the picture (through function generators 51 52, and 57).
The outputs from function generators 51, Andy 57 are routed, respectively, to multipliers 53-55. A second input to each multiplier is a video mask signal, each multiplier 53-55 receiving a different one of mask signals Ml through My from area mask generators 81-83. Multipliers S3-55 pass their respective input signals, with a multiplication factor of between zero and one within the respective masked area and inhibit multiply by zero) passage of their input signals outside the mask area The outputs of the function generator 50 and multipliers 53-55 I are then summed in summing amplifier 56 to produce the luminance or I" signal.
The processed signal through signal corrector 42 may optionally pass through a color corrector device 44.
This device provides a rough, or gross color inversion to the two color path which ultimately produce the R-Y and B-Y
signals It should be noted that the color correction device 44, being primarily a coloring circultg is applied only to the color channels that produce R-Y and B-Y, and is not applied to the luminance path that produces the Y
signal.
Function generators 60-62 and 67, while operating on the input signal to provide the ultimate R-Y signal, function in the same manner as that described in connection with the luminance path involving function generators 50-52 and 57~ Similarly, multipliers 63-65 and summing amplifier 66 are comparable in function to multipliers 53-55 and summing amplifier 56~

3.

The third channel involving functioll generators 70-72 and 77, multipliers 73-75, and summing amplifier 76 likewise function together to form the s-Y signal.
Color video encoder 78, of conventional design, then combines the Y, R-Y, and B-Y sunnily to produce a conventional color video signal (composite or RUB) on line I
The flexibility of the system described to this point is well documented in my prior U.S. Patent ~,149,185, and program storage and control unit 97 contributes substantially to the realization of such extreme flexibility. erroneous is made to the discussion of the selection of breakpoints video segment creation, video segment inversion, and the like in that document. on IRE
1, herein, program storage and control 97 is shown to haze a pair of multilane outputs aye and 1~7b. This indicates that gain or function control over the color conversion formulas can be affected or altered either at the function generators themselves or at the multipliers fed by the junction generators, or the combination of the two.
As shown in FIGURE 1, a genlock sync generator 79 provides common synchronization to the color video encoder 78 and the mask generator 81-83. As is common in the art, when video processors require synchronization, a genlock sync generator may be used to sample a video input signal and develop composite or non composite sync to render the various components of the system time compatible. In the development of masks used with this invention, of course, such synchronization ox the mask generators is essential.
The wanner in which mask synchronization it accomplished is well within the knowledge of the skilled worker and will not be discussed in detail here It is sufficient to stave that ~11 of the masks generated in mask generators 81~8~ are synchronously compatible with the outputs of the corresponding function generators which produce color conversion formulas to be operative within the masked Lo areas . Again the general masking technique is fully explained in my prior U.S. patent.
Having the basic masking process in mind, the manner of color correcting and/or generating using the arrangement of FIGURE 1 has proven to be effective as an operable system However, from FIGURE 1 it can be seen that the outputs of multipliers 63~65~ for example, are summed together in summing amplifier 66, thereby resulting in some contribution to the R-Y signal from the respective function generators through multipliers 63-65. That is, in any area of overlap of masks Men the video picture at the area of common overlap and of the same video level will be affected by the color conversion formulas representing each masked area. Of course, the R-Y signal may have any range of voltages throughout the system, at the discretion of the designer. If desired the R-Y level can be maintained within a specified voltage range, requiring factoring or other limiting of the outputs of multipliers 63-65 or the summation thereof in summing amplifier 66. In either case, for best control over the McCoy the summation is arithmetic and algebraic, and the area of the picture in which the three masks or any two of them, overlap will be modified by such summation of the color conversion formulas effective in that area of overlap As a result of the aforementioned summing of formulas in the are ox mask overlap, if the ~olorization technician desires to change the color conversion formula operative within a first mask in order to effect a desirable change in the non overlapped portion of the picture within that first mask, necessarily the area of that first mask that is overlapped by one or more other masks will also be affected. As a result, one or more of the other formulas operative in other masks must be changed to accommodate, and this may undesirably change colors in the non-overlapped area of the said other masks. Alternatively, a redesign of the mask boundaries may be necessary to prevent the I

overlapping from occurring, and this may be difficult under certain conditions. The circuitry of priority assignment device 203 eliminates these problems associated with mask overlapping.
It should also be recalled from my prior patent that in the preferred embodiments, each colorizati3n formula contains a series ox terms each of whir produce a predetermined color for a corresponding predetermined gray level of the original picture. It should be readily apparent, then, that even when two masks overlap, if none of the terms of one colonization formula within one of the masks is the same as one of the terms in the other mask, then there is no conflict between the two masks. In this case, no priority is needed. That is, one colonization formula in one mask will specify certain colors for the different video levels contained therein. The same analysis applies to the second mask in the same manner, and thus it it obvious that the only time two overlapping masks are in conflict is when each of the overlapping masks is functionally prepared to color that common gray level its own predetermined color. The results, ox course, is a mixture of the colonization hues from the two mask formulas. Sometimes this is desirable and sometime it is not. The present invention considers the case when it is not, This would be especially troublesome if one object of a particular gray level in a scene moved across another object of a different color, but of the same gray level.
Assuming the mask for the moving object is a furriest mask, and the mask for the stationary object is a "second mask, then, although both the moving and stationary objects have the same gray level, the mixture of the two color formulas when the moving object passes in front of the fixed object would be avoided if the "first" mask had priority over the 35 "second" mask, In this example, of course, the first mask would have to have very close boundaries to the moving I

object when passing in front of the stationary one, but the example of a need for priority masking is clearly seen.
Other examples of application of a priority masking technique will be discussed later in connection with FIGURES
5 and I
Switching network AYE receives the mask signals Ml,M2,Mn and merely routes them through to any of an equivalent number of output lines, but in an order desk red by the colonization operator. Network 206B operates similarly on the outputs of priority assignment device ~03.
Switching networks are off-the-shel items, sometimes referred to as routing twitchers, and may even be implemented with passive mechanical wish. The importance of such a switching network, however, may be realized by the moving object example just discussed. It is conceivable ox course, that the moving object may have dominance over a stationary object of equal video level in one part of the picture and then move behind a similar stationary object, also of the same video level, in another I part of the picture. The function of the switching networks AYE and 206B is thus to assign the relative mask priorities between all the masks, and this can be done by computer manually or under program control. Alternatively, instead of merely witching the inputs and outputs to priority assignment 203 a -witching network can be incorporated within device 203 by merely reassigning the priority of the function blocks therein without rerouting the inputs and outputs to the function blocks. This will be better understood when the priority assignment device 203 is discussed in connection with FIGURE 2.
Finally control signals on the individual lines of multiple cable 204 from an operator's control panel permit bypassing of any mask through device 203 without attachment of any priority thereto. In a somewhat complementary manner, a set of control signals from the operator control panel may be applied through cable 205 to exclude any mask . .

I

from having any priority effects on masks of lesser priority. The priority bypass and priority exclude functions will be discussed thoroughly in connection with FIGURE 2.
Turning now to FIGURE 2, there is shown a more detailed drawing showing a portion of the circuit of FIGURE
1 which creates the R-Y and B-Y signals and generates the area masks. Before analyzing the manner in which priority is established for each mask it is important to recognize that the mask priority assignment device 203 is operative on the mask itself and is not directly involved in the colonization formula produced by function generators 50-52, 57, etc. That is, each function generator generates a color conversion formula that presets a condition for the Y
(luminance channel, the R-Y (red minus luminance) charnel, the B-Y (blue minus luminance) channel/ and indirectly by the mathematical manipulation of color video encoder 78 FOGGIER 1) a G (green) channel, the G signal being derived from the basic formula G Y-B-R as it common knowledge in the art.
Accordingly, the video signal passing through the circuit of FIGURE 2 is twice multiplied, namely first in accordance with the associated function generator for example furl) and secondly in accordance with the area mask multiplier (for example multiplier 63)~ The inputs from each multiplier 63-55 and function generator 60 to summing amplifier 66 is processed according to known methods by normalizing the four input signals such that the overall multiplication factor contributed by the different elements in the chain has a maximum value of 1. It can thus be seen that the invention herein lies not in the choosing of colors within each mask, but rather in the establishment of an order of priority for the different masks within the areas of overlap between them and the priority assignment device effectively becomes the normalizing function for the summation of the masks at the inputs to the separate summing amplifiers 56, 56, 76.

~3~L~3~

In the following discussion the three components Y, R-Y, and B-Y are selected for discussion purposes o'er, it is to be understood that other three-component systems, (such as RUB systems Y, It Q systems; or the like) could beneficially use the present invention.
Without priority assignment device 203, the circuit ox FIGURE 2 would merely pass on aye mask I My My to its associated multiplier. In view of the fact that the function generators shown in FIGURE 1 are grouped into luminance, R-Y, and s-Y channels, the discussion of FIGURE 2 will use the R-Y channel as exemplary, and it will be understood that the luminance and B-Y channels follow with a similar analysis. In this light, without priority assignment device 203, the area mask My would be applied to multiplier 63, mask My to multiplier 64, and My to multiplier 65.
However with device ~03 operative, the area masks Ml, My, My are assigned values in accordance with an order of priority to produce corresponding prioritized masks Ml', My', and Mel. As has been emphasized above, the priority is established only in the areas of mask overlap. Mask Ml is applied over line 108 to the input of an operational amplifier 103, a multiplier 101, and a bypass switch 105.
In the condition shown in FIGURE 2, the bypass switch is shown thrown to the non-bypass position. A signal level Al is shown to be applied on line 107 to the second input of multiplier 101, to another multiplier 111, and to one contact of a switch 109 which will be referred to herein as an "exclude switch The individual component s of priority assignment device 203 are off-the-shelf items with standard adjustments made to accomplish the desired transfer functions. Thus, multipliers 101 and 111 merely pass the input signals through to the output with a straight analog multiplication and since the mask values can range from zero to one, the maximum output of bypass switch 105, designated Ml' on line 106 has the same maximum value of one.

~Z3~ I

An analog implementation of the invention will be discussed in connection with FIGURE JO however, a digital version would be apparent to the skilled artisan once he or she become familiar with the concepts jet forth in this description That is functionally arranged microprocessor flow charts can be readily structured so a to enable the invention to be practiced using custom designed digital circuitry or equivalent microprocessor software control with computers available in a variety of different architectures.
The analog version was chosen as a preferred embodiment for discussion because it it considered the best mode contemplated in terms of simplicity, ease of implementation, and flexibility of certain operational functions.
The circuit components of device 203 so far discussed represent the highest priority section, and a similar section is shown by the interconnection of multipliers 121, 131, operational amplifier 123~ bypass switch 125~ and exclude switch 129. The latte~-mentioned components operate on the My mask, and the internal interconnections for the My section are the same as that for the Ml section, with the Cole exception being that the second input to multipliers 121 and 131 is not a multiplying factor +1, but rather is the output of multiplier 111 on line 113 from the I section With the switches thrown to the positions shown in FIGURE 2, the mask Ml, being multiplied in multiplier 101 by the factor outputted through bypass switch 105 as mask Ml' on line 106. Thus, thy formula Ml' - Ml it established by the Ml section r Operational amplifier 103 is configured to provide an output (1-~1), and this signal, being multiplied by *l in multiplier 111, is the signal present on line 113.
In the My section, then, multiplier 1~1 has as its two inputs the mask My and the value 1) on line 113~
The output of bypass switch 1~5~ on line 126, consequently has the formula My ' - I ~l-Ml).

Since the input to multiplier 131 from exclude switch 129 is (1-M2~, and the second input to multiplier 131, on line 113, is ~l-Ml), the output of multiplier 131 on line 133 produces the formula tl-M2~tl-Ml).
This analysis can be extended through any number of priority sections of device 203, such that the output from the My section 141 produces the formula My' = Mn(l-Mn_l) ...(l-M23(1-Ml). the Nprioritlzed~ set of masks Mali, My', My' are the new mask values applied to multipliers 63-65, and an order of priority has now been established between the series of masks.
For example, as explained earlier, each mask can have any value between zero and one in the area of the video picture within its established boundaries created by the area mask venerators 81-83. This would permit application of a colonization formula in the area of the mask on a video picture in a manner similar to the effect commonly seen in television broadcasting, in which the isolated face of a performer is gradually faded in or out or dissolved r the intensity of the superimposition of the face of the performer being proportional to the magnitude of the masked video segment mixed with the full picture video signal. A
applied in the instant case, rather than a separate video picture being added to the designated area of the full video picture, a colonization formula is developed for adding, or subtracting, from the preexisting black and white luminance level" The same mixing concept is involved, however, and the priority assignment device 203 of the present invention can be applied in the area of special effects for merging several masked video segments in an array of overlapping superimposition Ed picture segments.
In any event, since MU = Ml, the full value of Ml appears as the multiplication factor in multiplier 63. If Ml = I then the value (l-Ml) sent to multiplier 121 in the next section in priority, the My section, would have as one of its inputs, on line 113, the value 0. Since, as of explained earlier, the (l-Ml) value appears in each formula of masks ox lesser priority, all masks M2'...Mn' would have the value 0 as well. Thus, in the area of overlap between the Ml mask and any other mask, the color conversion formula enabled by mask My would be fully effective and all of the color conversion formulas associated with all other masks Gould be deleted It should be noted that in areas outside the boundaries of mask My Ml has the value 0. Accordingly, in a situation where a pair of masks My and My overlap, the value (l-Ml~ becomes I and mask My has full priority over mask I without any priority effects contributed by mask Ml.
Since any mask can have values other than 1, the flexibility of the system becomes more apparent by assuming the mask I to have a value of 0.7~ In such a case, the value (l-Ml) has the value 0~3, and that value is applied to multiplier 121 to produce the formula for mask My' - 0.3M2, Obviously, an infinite number of combinations of priorities can be established when considering the priority effects generated in device 203 and the fact that outside any area of one mask prioritite6 are maintained as to the other masks having overlapping areas To add even further to the flexibility of the system, the priority bypass switches 105~ 125, can ye thrown to the down position shown in FIGURE 2, in which case the mask associated with that switch is passed through the device 203 without alteration. However, the input mask Ml, for example, still passes through operational amplifier 103 to provide as an input to multipliers 121 and 131 the value I ~l-Ml)o The same applies to the I section, such that for any section not having its priority bypass switch thrown, the priority effects of the masks of higher priority still, nevertheless, apply. If the priority bypass switch of mask My (not shown) was not thrown to the bypass pOSitiOIl, the third section of device 203 would still produce the Formula ~13'=M3(1-M2)~1-Ml) as before independent of the positions of bypass switches 105, 125.

I

The priority exclude switches 109, 1~9 remove the priority effects of the associated mask from the mask formulas of those of lesser priority. For example, if switch 109 is thrown to the let and switch 129 is thrown to the right, then multiplier 131 would receive as inputs the value I from switch 1~9 and the value (l~Ml~ on line 113.
The multiplier 131 thus outputs the formula ll~Ml). This results in the formula for mask My' snot shown) to have the relationship My' = M3(1 Ml), the formerly contributing factor (1-M2) being "excluded from the mask formulas in sections of lesser priority A alluded to earlier in the discussion of FIGURE
1, the importance of switching networks AYE and 206B can now be appreciated. Since priority assignment device 203 is merely an operational unit independent of the character of any particular mask, the mask applied to line 108 has the highest priority, the mask applied to line 128 the next highest priority, and so forth. As also mentioned; a simplistic approach to changing the order of priorities of Ml, My, My would be merely to change corresponding inputs and outputs of priority assignment device 203 as between the different mask signal. waving now analyzed the inner workings of device 2n3, it can be obserY~d that an approach using fewer switching elements and signal lines can be I implemented by judiciously rerouting thy source terminals marked no in FIGURE 1, and the exit terminals, marked "Y"
in FIRE I For example, if Al and X3 were exchanged and Ye and Ye were exchanged, simultaneously, then the order of priority would be altered to give mask My the highest priority, My the next highest, Ml the next highest, etc.
The formula for mask My' would then be Mel = My, end the formula for mask I would be Ml' - Ml(l-~2)(1-M3).
Since thy implementation of an operably switching network 206 would be obvious to the skilled worker, details are not oared in this discussion, and the design of same can be left to any skilled technician.

I
In FIGURES 3 and 4, a hypothetical application of the present invention is illustrated FIGURE 3 shows three objects 151, 153l and 154 on a video monitor havifig a background 155. The objects and background have different video levels associated with them, the object 151 having a video level VL4, object 153 having a video level VL2, object 154 having a video level Ill, and the background 155 having a video level VL3. As with my prior invention in Patent Mow ~,149,185, a mask 156 is created to roughly encompass the object 151~ A portion of the created mask 156 includes a piece of object 153. A specified color conversion formula is created within mask 156, and using the segmented video level technique explained in my prior patent, only the object 151 will be colored according to the associated color conversion formula. The piece of object 153 within mask 156 will not be colored r since its video level, VL2, does not lie within the amplitude segment to which the color conversion formula applies FIGURE 3 thus represents a typical colonization example that would be performed by the prior art.
FIGURE 4 is similar to that of FIGURE 3, with the addition of a further background object 159 having a video level VL4, the same as that of object 151~ If object 151 is to be red in color, and the background object 159 is to be green, it would be expected, using prior art techniques, that the area of overlap between mask 156 outlining object 151 and mask 157 outlining the background object lS9 would result in a yellowish color in the area 158 of object 151.
The present invention can be used to effectively carve out a segment from background object 159 and color it in accordance with the video level VL4 within mask 156. The same video level, VL4, within mask 157 would have a green formulation, but due to the priority of mask 15S over mask 157, as would be the case if mask 15S was substituted for mask Ml in FIGURE 2, a factor in the mask My formula is (l-Ml) = I As a result, the area 158 of object 151 would r -I

be non affected by the colonization of the lesser priority mask 157. of course, since both object 151 and background ox jet 159 are of the same video level, a close fix of mask 156 around object 151 within the video level VL4 of mask 157 would be necessary, It will be observed, however, that a close fit is not necessary where the two objects 151 and 15 do not overlap (i.e. at the top portion of area 158).
An alternate application of the present invention can be appreciated by reference to FIGURE 5 in which three video levels are shown in regions 171-174, the video level in region 171 being the same as that of 174. Let it be assumed that region 171/ although the same video level as 174~ is to by colored differently than region 174.
Referencing FIGURES 1 and 2, the non-ma~ked function generators 50, 60 and 70 are adjusted so that video level VL3 has a certain color character. wince the entire picture area is affected regions 171 and 17~ will have the save color character. Next, mask A is set to apply a colonization formula only for the video level Ill. That it, the colonization formula controlled by mask A adds no colonization terms for video levels VL2 and VL3~ Finally, mask B enables a coloration formula which sets the color characteristics ox video level Al and VL2, coloring video level Ill the same as that of mask A. Again t region 174 is unaffected by mask By using the concepts of the present invention, mask B is set to brave a priority over mask A so as not to double-color region 172.
without priority, the piece of region 172 within mask B would be double-colored r and r to avoid this it would be necessary to conform the left edge of mask B precisely to the irregular left edge of region 173. This would be a time-consuming task, and in the event of a moving object represented by regions 172 and/or 173 would require an operator to meticulously draw the left edge ox mask B for each frame of the scene, Assigning a priority to mask By however, eliminates both the problem of outlining the left I
edge of mask B to an irregular outline and to account for any movement of the line of discontinuity between regions 172 and 173, provided what that line of discontinuity remains within the masked regions shown.
Of course, minor circuit tolerances in the creation of the two separate colonization formulas for masks A and B
to color region 172 with the same color for video level Ill can exist and might not be possible to eliminate entirely This may cause a slight observable discoloration at the transition between masks A and B in region 172. Such an effect can be eliminated by giving the edges of mask B a soft-edged or blurred character.
Soft-edged masking techniques are known in the art and are used extensively in standard television broadcasting. Basically, a hard-edged mask causes an abrupt change in the combined mask signal and background signal.
By smoothing, in time, the mask edges, the full amplitude mask will rise and fall, in time, at a prescribed rate. If mask B in FIGURE 5 were soft-edged, then the slight discoloration at the transition between masks A and B would be such that the edge would be invisible. Since mask ha a priority over mask A, and following along the picture left to right in FIGURE 5, as mask B's left edge is approached, a gentle transition between the effects of the colonization formula in mask A and that ox mask B would be produced.
This is illustrated in FIGURE 6, where mask A his the Ye My', mask B has the value My and the left edge of mask B
is represented by the curved line 162 showing a gradual rise from a 0 level to a I level. Observing from FIGURE 2 and the associated description what mask My' = M2(1 Ml) and Ml =
Ml', these mathematical relationships produce the curve shown at 1~1 in FIGURE 6, the latter-mentioned curve being complementary to the curve 162 and symmetrical about line 163 at which the juxtaposed masks are equal in magnitude.
It can be seen that well to the right of the left of mask B
there it no contribution from mask My' t and the transition I

will be absolutely invisible. The illustration example of FIGURES 5 and 6 suggests a technique which eliminates the need to follow exact edges or movements of edges that remain within their prescribed mask areas Accurate edge coloring is thus accomplished without the operator following the exact edge.
Using the concepts of the invention described herein, it would be obvious that other specialized masking situations would arise in which the priority effects lo possible with the present invention could be implemented to a great benefit. Both ease of creating the masks, as exemplified in the situation discussed in connection with FIGURE I and lower cost in terms of saving time no having to readjust previously fixed color formulas due to the interrelationships between colonization formulas as in a non-priority system are realized.
It must also be appreciated that mask generation can be implemented by analog devices or digital devices with or without the masks being defined by discrete pixel units.
moreover virtually every control function and mathematical function can be performed by a computer under control ox intelligent software. Similarly, thy switching network AYE and B and the bypass and exclude switches 105, 109, 126, 129 can be as simple as conventional mechanical devices or as complex as microprocessor controlled electronic switches available in a variety of functional configurations silicon chip sizes, and packaging, The need for mask priority as discussed in this de Croatian is not suggestive that the blending of video effects at the mask edges is undesirable. Rather, this invention should be considered as a novel video special effect that is just one of many effects that the operator has at his or her option. When it is beneficial that the enhancement effects art to have an order of prorate that us should be available to the operator, and when no priority or the interesting effects ox a negative priority would I I
I
benefit, that choice should also be avaliahle. The embodiment of the invention described heroin yards these choices.
What has been presented in the foregoing are preferred emhodlments of the present invention, and it is clear that modifications and variations will be apparent to those skilled in the art and yet remain within the scope of the present invention. Accordingly, the present invention is to be limited only by the scope of the claims appended hereto.

I

Claims (40)

1. A method for priority enhancement modifying a specified area of a video picture, comprising the steps of:
generating a first area enhancement conversion signal for enhancing a first segment of said video picture according to said first area enhancement conversion signal;
generating a second area enhancement conversion signal for enhancing a second segment of said video picture according to said second area enhancement conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
combining said first and second area enhancement conersion signals in a manner to produce a composite enhancement conversion signal in which a selected one of said first and second area enhancement conversion signals has a degree of priority over the other of said area enhancement conversion signals in the area of said video picture in which said segment overlapping occurs; and enhancement modifying said first and second video picture segments according to said composite enhancement conversion signal, while enhancement modifying said area of said video picture in which said segment overlapping occurs in accordance with said selected enhancement conversion signal relative to the nonselected enhancement conversion signal in proportion to said degree of priority.
2. The method as Claimed in Claim 1, including the step of:
generating a third area enhancement conversion signal for enhancing a third segment of said video picture according to said third area enhancement conversion signal, said third segment, at least in part, overlapping at least a part of the first segment overlapped by said second segment;
and wherein said combining step combines said first, second, and third area enhancement conversion signals in a manner to produce a composite enhancement conversion signal in which, in the area of common overlap of the three segments, one of said first, second, and third area enhancement conversion signals has a first degree of priority over the other two, and one of said other two area enhancement conversion signals has a second degree of priority over the other one of said other two area enhancement conversion signals.
3 The method as claimed in Claim 2, wherein said first degree of priority dominates over said second degree of priority.
4. The method as claimed in Claim 3, wherein, in any area of overlap between said first, second, and third segments, outside said area of common overlap, the same relative degree of priority is maintained.
5. The method as claimed in Claim 4, including the step of selectably enhancement modifying any of said picture segments according to its corresponding area enhancement conversion signal without any priority effects for the selected segment.
6. The method as claimed in Claim 5, wherein said step of selectably enhancement modifying any of said picture elements is performed without diminishing the priority effects said selected segment has on segments having area enhancement conversion signals of lesser priority.
7. The method as claimed in Claim 5, wherein said step of combining combines all area enhancement conversion signals for all picture segments, including those of said selected segments, maintaining said degrees of priority for all area enhancement conversion signals except those of said selected segments.
8. The method as claimed in Claim 1, including the step of selectably enhancement modifying said second segment of said video picture in the absence of any priority by said first enhancement conversion signal, in said area of segment overlapping.
9. The method as claimed in Claim 2, including the step of selectably eliminating the priority effects of any area enhancement conversion signal in segments having area enhancement conversion signals of lesser priority.
10. The method as claimed in Claim 9, wherein said step of selectably eliminating the priority effects of any area enhancement conversion signal is performed without affecting any priority effects in segments having area enhancement conversion signals of higher priority.
11. The method as claimed in Claim 9, wherein said step of combining combines all area enhancement conversion signals for all picture segments, including those of selected segments whose area enhancement conversion signal priorities have been eliminated, maintaining said degrees of priority for all area enhancement conversion signals except those whose priority effects have been eliminated.
12. An apparatus for priority enhancement modifying a specified area of a video picture, comprising:
means for generating a first area enhancement conversion signal;
means for enhancing a first segment of said video picture according to said first area enhancement conversion signal;
means for generating a second area enhancement conversion signal;

means for enhancing a second segment of said video picture according to said second area enhancement conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
means for combining said first and second area enhancement conversion signals in a manner to produce a composite enhancement conversion signal in which one ofsaid first and second area enhancement conversion signals has a degree of priority over the other of said area enhancement conversion signals in the area of said video picture in which said segment overlapping occurs; and means for enhancement modifying said first and second video picture segments according to said composite enhancement conversion signal, while enhancement modifying said area of said video picture in which said segment overlapping occurs in accordance with said selected, enhancement conversion signal relative to the nonselected enhancement conversion signal in proportion to said degree of priority.
13. The apparatus as claimed in Claim 12, including:
means for generating a third area enhancement conversion signal;
means for enhancing a third segment of said video picture according to said third area enhancement conversion signal, said third segment, at least in part, overlapping at least a part of the first segment overlapped by said second segment; and wherein said means for combining combines said first, second, and third area conversion signals in a manner to produce a composite enhancement conversion signal in which, in the area of common overlap of the three segments, one of said first, second, and third area enhancement conversion signals has a first decree of priority over the other two, and one of said other two area enhancement conversion signals has a second degree of priority over the other one of said other two area enhancement conversion signals.
14. The apparatus as claimed in Claim 13, wherein said first degree of priority dominates over said second degree of priority.
15. The apparatus as claimed in Claim 14, wherein said combining means is operative, in any area of overlap between said first, second, and third segments, outside said area of common overlap, to maintain the same relative degree of priority.
16. The apparatus as claimed in Claim 15, including means for selectably enhancement modifying any of said picture segments according to its corresponding area enhancement conversion signal without any priority effects for the selected segment.
17. The apparatus as claimed in Claim 16, wherein said means for selectably enhancement modifying any of said picture elements is operative without diminishing the priority effects said selected segment has on segments having area enhancement conversion signals of lesser priority.
18. The apparatus as claimed in Claim 15, wherein said combining means includes means for combining all area enhancement conversion signals for all picture segments, including those of said selected segments, while maintaining said degrees of priority for all area enhancement conversion signals except those of said selected segments.
19. The apparatus as claimed in Claim 12, including means for selectably enhancement modifying said second segment of said video picture in the absence of any priority by said first area enhancement conversion signal, in said area of segment overlapping.
20. The apparatus as claimed in Claim 13, including means for selectable eliminating the priority effects of any area enhancement conversion signal in segments having area enhancement conversion signals of lesser priority.
21. The apparatus as claimed in Claim 20, wherein said means for selectable eliminating the priority effects of any area enhancement conversion signal is operative without affecting any priority effects in segments having area enhancement conversion signals of higher priority.
22. The apparatus as claimed in Claim 20, wherein said means for combining includes means for combining all area enhancement conversion signals for all picture segments, including those of selected segments whose area enhancement conversion signal priorities have been eliminated, while maintaining said degrees of priority for all area enhancement conversion signals except those whose priority effects have been eliminated.
23. An apparatus for priority enhancement modifying a specified area of a video picture comprising:
means for generating a first area enhancement conversion signal for enhancing a first segment of said video picture according to said first area enhancement conversion signal;
means for generating a second area enhancement conversion signal for enhancing a second segment of said video picture according to said second area enhancement conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
a first mask generating means for generating a first electronic picture segment mask within which said first area enhancement conversion signal is to be operative;

a second mask generating means for generating a second electronic picture segment mask within which said second area enhancement conversion signal is to be operative;
means for coupling respective area enhancement conversion signal generating means and said first and second mask generating means to produce respective first and second area enhancement conversion signals operative only within the boundaries of the respective electronic picture segment mask;
summing means for summing the masked first and second area enhancement conversion signals to produce a composite enhancement conversion signal;
priority generating means coupled between said first and second mask generating means and said combining means for setting a degree of priority of one of said first and second area enhancement conversion signals over the other of said area enhancement conversion signals in the area of said video picture in which said overlapping occurs;
and means for enhancement modifying said video picture according to said composite enhancement conversion signal.
24. A method for priority enhancement modifying a specified area of a video picture, comprising the steps of:
generating a first area enhancement conversion signal for enhancing a first segment of said video picture according to said first area enhancement conversion signal;
generating a second area enhancement conversion signal for enhancing a second segment of said video picture according to said second area enhancement conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
generating a first electronic picture segment mask within which said first area enhancement conversion signal is to be operative;

generating a second electronic picture segment mask within which said second area enhancement conversion signal is to be operative;
enabling respective first and second area enhancement conversion signals only within the boundaries of their respective electronic picture segment mask;
summing the masked first and second area enhancement conversion signals to produce a composite enhancement conversion signal;
setting a degree of priority of one of said first and second area enhancement conversion signals over the other of said area enhancement conversion signals in the area of said video picture in which said overlapping occurs;
and enhancement modifying said video picture according to said composite enhancement conversion signal.
25. A method for priority color modifying a specified area of a video picture, comprising the steps of:
generating a first area color conversion signal for color converting a first segment of said video picture according to said first area color conversion signal;
generating a second area color conversion signal for color converting a second segment of said video picture according to said second area color conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
combining said first and second area color conversion signals in a manner to produce a composite color conversion signal in which one of said first and second area color conversion signals has a degree of priority over the other of said area color conversion signals in the area of said video picture in which said segment overlapping occurs;
and color modifying said video picture according to said composure color conversion signal.
26. The method as claimed in Claim 25, including the step of:
generating a third area color conversion signal for color converting a third segment of said video picture according to said third area color conversion signal, said third segment, at least in part, overlapping at least a part of the first segment overlapped by said second segment; and wherein said combining step combines said first, second, and third area color conversion signals in a manner to produce a composite color conversion signal in which, in the area of common overlap of the three segments, one of said first, second, and third area color conversion signals has a first degree of priority over the other two, and one of said other two area color conversion signals has a second degree of priority over the other one of said other two area color conversion signals.
27. The method as claimed in Claim 26, wherein said step of combining combines all area color conversion signals for all picture segments, including those of said selected segments, maintaining said degrees of priority for all area color conversion signals except those of said selected segments.
28 The method as claimed in Claim 25,including the step of selectably color modifying said second segment of said video picture in the absence of any priority by said first area color conversion signal, in said area of segment overlapping.
29. The method as claimed in Claim 26, including the step of selectably eliminating the priority effects of any area color conversion signal in segments having area color conversion signals of lesser priority.
30. An apparatus for priority color modifying a specified area of a video picture, comprising means for generating a first area color conversion signal;
means for color converting a first segment of said video picture according to said first area color conversion signal;
means for generating a second area color conversion signal;
means for color converting a second segment of said video picture according to said second area color conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
means for combining said first and second area color conversion signals in a manner to produce a composite color conversion signal in which one of said first and second area color conversion signals has a degree of priority over the other of said area color conversion signals in the area of said video picture in which said segment overlapping occurs; and means for modifying said video picture according to said composite color conversion signal.
31. the apparatus as claimed in Claim 30, including:
means for generating a third area color conversion signal;
means for color converting a third segment of said video picture according to said third area color conversion signal, said third segment, at least in part, overlapping at least a part of the first segment overlapped by said second segment; and wherein said means for combining combines said first, second, and third area color conversion iguanas in a manner to produce a composite color conversion signal in which, in the area of common overlap of the three segments, one of said first, second, and third area color conversion signals has a first degree of priority over the other two, and one of said other two area color conversion signals has a second degree of priority over the other one of said other two area color conversion signals.
32. The apparatus as claimed in Claim 31, wherein said combining means includes means for combining all area color conversion signals for all picture segments, including those of said selected segments, while maintaining said degrees of priority for all color conversion signals except those of said selected segments.
33. The apparatus as claimed in Claim 30, including means for selectably color modifying said second segment of said video picture in the absence of any priority by said first area color conversion signal, in said area of segment overlapping.
34. The apparatus as claimed in Claim 33, including means for selectably eliminating the priority effects of any area color conversion signal in segments having area color conversion signals of lesser priority.
35. An apparatus for priority color modifying a specified area of a video picture, comprising:
means for generating a first area color conversion signal for color converting a first segment of said video picture according to said first area color conversion signal;
means for generating a second area color conversion signal for color converting a second segment of said video picture according to said second area color conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;

a first mask generating means for generating a first electronic picture segment mask within which said first area color conversion signal is to be operative;
a second mask generating means for generating a second electronic picture segment mask within which said second area color conversion signal is to be operative;
means for coupling respective area color conversion signal generating means and said first and second mask generating means to produce respective first and second area color conversion signals present only within the boundaries of the respective electronic picture segment mask;
summing means for summing the masked first and second area color conversion signals to produce a composite color conversion signal;
means for color modifying said video picture according to said composite color conversion signal; and priority generating means coupled between said first and second mask generating means and said combining means for setting a degree of priority of one of said first and second area color conversion signals over the other of said area color conversion signals in the area of said video picture in which said overlapping occurs.
36. A method of priority color modifying a specified area of a video picture, comprising:
generating a first area color conversion signal for color converting a first segment of said video picture according to said first area color conversion signal;
generating a second area color conversion signal for color converting a second segment of said video picture according to said second area color conversion signal, said second segment, at least in part, overlapping at least a part of said first segment;
generating a first electronic picture segment mask within which said first area color conversion signal is to be operative;

generating a second electronic picture segment mask within which said second area color conversion signal is to be operative;
enabling respective first and second area color conversion signals only within the boundries of their respective electronic picture segment mask;
summing the masked first and second area color conversion signals to produce a composite color conversion signal;
setting a degree of priority of one of said first and second area color conversion signals over the other of said area color conversion signals in the area of said video picture in which said overlapping occurs; and color modifying said video picture according to said composite color conversion signal.
37. A method for priority enhancement modifying a specified area of a video picture, comprising the steps of:
generating a first area enhancement conversion signal for enhancing a first segment of said video picture according to said first area enhancement conversion signal;
generating a second area enhancement conversion signal for enhancing a second segment of said video picture according to said second area enhancement conversion signal, said second segment segment at least in part, overlapping at least a part of said first segment;
generating a first electronic picture segment mask defining said first segment and having a value M1 within the boundaries of said first mask and the value (0) outside the boundaries of said mask;
multiplying said first electronic picture segment mask by a factor (1);
generating a second electronic picture segment mask defining said second picture segment and having a value M2 within the boundaries of said second mask, and a value (0) outside the boundaries of said second mask;

multiplying said second electronic picture segment mask by the factor (1-M1);
summing the masked first and second area enhancement conversion signals to produce a composite enhancement conversion signal; and enhancement modifying said video picture according to said composite enhancement conversion signal;
wherein M1 and M2 have any value between 0 and 1.
38. The method as claimed in Claim 37, including the steps of:
generating n additional area enhancement conversion signals for enhancing n segments of said video picture according to said n area enhancement conversion signals;
generating n additional electronic picture segment masks defining respective n picture segments and having a value Mn within the boundaries of said n mask and having a value (0) outside the boundaries of said n mask;
multiplying said n electronic picture segment mask by a factor (1-Mn-1)...(1-M1); and wherein said summing step includes summing said n area enhancement conversion signals along with said first and second area enhancement conversion signals, and wherein Mn-1 has any value between 0 and 1.
39. Apparatus for priority enhancement modifying a specified area of a video picture, comprising:
means for generating a first area enhancement conversion signal for enhancing a first segment of said video picture according to said first area enhancement conversion signal;
means for generating a second area enhancement conversion signal for enhancing a second segment of said video picture according to said second area enhancement conversion signal, said second segment segment at least in part, overlapping at least a part of said first segment;

means for generating a first electronic picture segment mask defining said first segment and having a value M1 within the boundaries of said first mask and the value (0) outside the boundaries of said mask;
means for multiplying said first electronic picture segment mask by a factor (1);
means for generating a second electronic picture segment mask defining said second picture segment and having a value M2 within the boundaries of said second mask, and a value (0) outside the boundaries of said second mask;
means for multiplying said second electronic picture segment mask by the factor (1-M1);
summing means for summing the masked first and second area enhancement conversion signals to produce a composite enhancement conversion signal; and means for enhancement modifying said video picture according to said composite enhancement conversion signal;
wherein M1 and M2 have any value between 0 and 1.
40. The apparatus as claimed in Claim 39, including:
means for generating n additional area enhancement conversion signals for enhancing n segments of said video picture according to said n area enhancement conversion signals;
means for generating n additional electronic picture segment masks defining respective n picture segments and having a value Mn within the boundaries of said n mask and having a value (0) outside the boundaries of said n mask;
means for multiplying said n electronic picture segment mask by a factor (1-Mn-1)...(1 M1); and wherein said summing means includes means for summing said n area enhancement conversion signals along with said first and second area enhancement conversion signals, and wherein Mn-1 has any value between 0 and 1.
CA000473580A 1984-09-10 1985-02-05 Priority masking techniques for video special effects Expired CA1231436A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US06/649,276 US4642676A (en) 1984-09-10 1984-09-10 Priority masking techniques for video special effects
US649,276 1984-09-10

Publications (1)

Publication Number Publication Date
CA1231436A true CA1231436A (en) 1988-01-12

Family

ID=24604132

Family Applications (1)

Application Number Title Priority Date Filing Date
CA000473580A Expired CA1231436A (en) 1984-09-10 1985-02-05 Priority masking techniques for video special effects

Country Status (2)

Country Link
US (1) US4642676A (en)
CA (1) CA1231436A (en)

Families Citing this family (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8396328B2 (en) 2001-05-04 2013-03-12 Legend3D, Inc. Minimal artifact image sequence depth enhancement system and method
US7907793B1 (en) 2001-05-04 2011-03-15 Legend Films Inc. Image sequence depth enhancement system and method
US4755870A (en) * 1983-07-11 1988-07-05 Colorization Inc. Coloring a black and white signal using motion detection
US5125041A (en) * 1985-08-05 1992-06-23 Canon Kabushiki Kaisha Still image processing method for blurring an image background and producing a visual flowing effect
EP0220007B1 (en) * 1985-10-07 1993-12-22 Yamaha Corporation Synchronizing circuit for a video disc playback device
US4875097A (en) * 1986-10-24 1989-10-17 The Grass Valley Group, Inc. Perspective processing of a video signal
BR8807374A (en) * 1987-02-18 1990-03-20 David M Geshwind PROCESS TO GENERATE AN INFORMATION SIGN, PROCESS TO COLORIZE AN INFORMATION SIGN IN BLACK AND WHITE, PROCESS TO GENERATE OUTLINING INFORMATION, PROCESS TO COLORIZE A SEQUENCE OF BLACK AND WHITE IMAGE FRAMES, PROCESS TO GENERATE AN INTENSIVE COLOR IMAGE, AND PRODUCT
BE1007777A3 (en) * 1993-11-23 1995-10-17 Philips Electronics Nv Non-linear signal.
US6263101B1 (en) 1995-09-01 2001-07-17 Cerulean Colorization Llc Filtering in picture colorization
US6049628A (en) * 1995-09-01 2000-04-11 Cerulean Colorization Llc Polygon reshaping in picture colorization
US5912994A (en) * 1995-10-27 1999-06-15 Cerulean Colorization Llc Methods for defining mask of substantially color-homogeneous regions of digitized picture stock
US5875040A (en) * 1995-12-04 1999-02-23 Eastman Kodak Company Gradient based method for providing values for unknown pixels in a digital image
KR100200603B1 (en) * 1996-07-25 1999-06-15 윤종용 Color correction device
US6025829A (en) * 1996-10-28 2000-02-15 Welch Allyn, Inc. Image generator for video display
US6128001A (en) * 1997-04-04 2000-10-03 Avid Technology, Inc. Methods and apparatus for changing a color of an image
US6351557B1 (en) 1998-04-03 2002-02-26 Avid Technology, Inc. Method and apparatus for color manipulation
US6847373B1 (en) 1999-04-16 2005-01-25 Avid Technology, Inc. Natural color matching in a video editing system
US6552731B1 (en) 1999-04-16 2003-04-22 Avid Technology, Inc. Multi-tone representation of a digital image on a digital nonlinear editing system
US6571255B1 (en) 1999-04-16 2003-05-27 Robert Gonsalves Modification of media with common attributes on a digital nonlinear editing system
US6417891B1 (en) 1999-04-16 2002-07-09 Avid Technology, Inc. Color modification on a digital nonlinear editing system
US6928187B2 (en) * 2000-04-07 2005-08-09 Avid Technology, Inc. Secondary color modification of a digital image
US6477271B1 (en) 2000-04-07 2002-11-05 Avid Technology, Inc. Secondary color modification of a digital image
US6894796B1 (en) 2000-05-12 2005-05-17 International Business Machines Corporation Method, system, and logic for selecting line work and control data for a pixel from multiple objects of line work data provided for the pixel
US6850338B1 (en) 2000-05-12 2005-02-01 International Business Machines Corporation Method, system, program, and data structure for generating raster objects
US6449328B1 (en) 2000-05-15 2002-09-10 International Business Machines Corporation Method and apparatus for shifting data from registers
US7394568B1 (en) 2000-05-15 2008-07-01 Infoprint Solutions Company Llc Method, system, and logic for selecting pixel data from multiple objects
US6961134B1 (en) 2000-05-15 2005-11-01 International Business Machines Corporation Method, system, and logic using multiplexers to select data for pixels from multiple objects
US6804411B1 (en) 2000-05-15 2004-10-12 International Business Machines Corporation Method, system, and program for decompressing and aligning line work data from multiple objects
US6678009B2 (en) * 2001-02-27 2004-01-13 Matsushita Electric Industrial Co., Ltd. Adjustable video display window
US8897596B1 (en) 2001-05-04 2014-11-25 Legend3D, Inc. System and method for rapid image sequence depth enhancement with translucent elements
US9286941B2 (en) 2001-05-04 2016-03-15 Legend3D, Inc. Image sequence enhancement and motion picture project management system
US9031383B2 (en) 2001-05-04 2015-05-12 Legend3D, Inc. Motion picture project management system
MXPA03010039A (en) 2001-05-04 2004-12-06 Legend Films Llc Image sequence enhancement system and method.
US8401336B2 (en) 2001-05-04 2013-03-19 Legend3D, Inc. System and method for rapid image sequence depth enhancement with augmented computer-generated elements
KR100587143B1 (en) 2004-05-06 2006-06-08 매그나칩 반도체 유한회사 Method for edge detection of image signal
US8730232B2 (en) 2011-02-01 2014-05-20 Legend3D, Inc. Director-style based 2D to 3D movie conversion system and method
US9282321B2 (en) 2011-02-17 2016-03-08 Legend3D, Inc. 3D model multi-reviewer system
US9113130B2 (en) 2012-02-06 2015-08-18 Legend3D, Inc. Multi-stage production pipeline system
US9407904B2 (en) 2013-05-01 2016-08-02 Legend3D, Inc. Method for creating 3D virtual reality from 2D images
US9241147B2 (en) 2013-05-01 2016-01-19 Legend3D, Inc. External depth map transformation method for conversion of two-dimensional images to stereoscopic images
US9288476B2 (en) 2011-02-17 2016-03-15 Legend3D, Inc. System and method for real-time depth modification of stereo images of a virtual reality environment
US9007365B2 (en) 2012-11-27 2015-04-14 Legend3D, Inc. Line depth augmentation system and method for conversion of 2D images to 3D images
US9547937B2 (en) 2012-11-30 2017-01-17 Legend3D, Inc. Three-dimensional annotation system and method
US9007404B2 (en) 2013-03-15 2015-04-14 Legend3D, Inc. Tilt-based look around effect image enhancement method
US9438878B2 (en) 2013-05-01 2016-09-06 Legend3D, Inc. Method of converting 2D video to 3D video using 3D object models
US9609307B1 (en) 2015-09-17 2017-03-28 Legend3D, Inc. Method of converting 2D video to 3D video using machine learning

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2144935C3 (en) * 1970-09-09 1975-10-02 Hitachi, Ltd., Tokio Color display device
JPS5326534A (en) * 1976-08-25 1978-03-11 Hitachi Ltd Vi deo display device
US4149185A (en) * 1977-03-04 1979-04-10 Ralph Weinger Apparatus and method for animated conversion of black and white video to color
US4204207A (en) * 1977-08-30 1980-05-20 Harris Corporation Video display of images with video enhancements thereto
US4356511A (en) * 1978-05-23 1982-10-26 Sony Corporation Digital soft-edge video special effects generator
US4357624A (en) * 1979-05-15 1982-11-02 Combined Logic Company Interactive video production system
GB2063616B (en) * 1979-11-16 1984-06-20 Quantel Ltd Multiple picture image manipulation
US4420770A (en) * 1982-04-05 1983-12-13 Thomson-Csf Broadcast, Inc. Video background generation system
US4509043A (en) * 1982-04-12 1985-04-02 Tektronix, Inc. Method and apparatus for displaying images

Also Published As

Publication number Publication date
US4642676A (en) 1987-02-10

Similar Documents

Publication Publication Date Title
CA1231436A (en) Priority masking techniques for video special effects
US7027105B2 (en) Method and apparatus for changing brightness of image
US4580158A (en) Video signal combining system
US4525736A (en) Selective color modification
EP0716541B1 (en) A video mixing apparatus
WO1998042142A1 (en) Color correction device, color correction method, picture processing device, and picture processing method
KR20050119452A (en) Color signal processing apparatus and method of using the same
WO2003015391A2 (en) Method for independently controlling hue or saturation of individual colors in a real time digital video image
WO1995010160A1 (en) Method and apparatus for decoding colour video signals for display
US4954881A (en) Method and apparatus for correcting video color signals
JPH07222053A (en) Method and apparatus for digital video processing
US5027213A (en) Video signal mixer system
EP0260998B1 (en) Improvements in and relating to the processing of video image signals
US7671871B2 (en) Graphical user interface for color correction using curves
KR100553950B1 (en) Color compensating circuit and image display device having the same
US4953008A (en) Method and apparatus for uniform saturation, hue and luminance correction
US4809070A (en) Method and apparatus for adding texturing highlights to a video signal
SU930749A1 (en) Device for correcting for signal of colour television image in conditional colours
JPS6223176Y2 (en)
JPH033028Y2 (en)
JP2003162275A (en) On-screen display circuit
US5319448A (en) Method and apparatus for correcting color reproduction
EP0570805A1 (en) Improved method for adjusting the luminance of a color signal
USRE32544E (en) Selective color modification
JPH0715743A (en) Method for separating foreground picture signal from combined picture signal

Legal Events

Date Code Title Description
MKEX Expiry