CA2020372C - Optical reconstruction filter for color mosaic displays - Google Patents
Optical reconstruction filter for color mosaic displays Download PDFInfo
- Publication number
- CA2020372C CA2020372C CA002020372A CA2020372A CA2020372C CA 2020372 C CA2020372 C CA 2020372C CA 002020372 A CA002020372 A CA 002020372A CA 2020372 A CA2020372 A CA 2020372A CA 2020372 C CA2020372 C CA 2020372C
- Authority
- CA
- Canada
- Prior art keywords
- matrix display
- diffraction grating
- color
- image
- pixels
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133504—Diffusing, scattering, diffracting elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/18—Diffraction gratings
- G02B5/1842—Gratings for image generation
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F2201/00—Constructional arrangements not provided for in groups G02F1/00 - G02F7/00
- G02F2201/30—Constructional arrangements not provided for in groups G02F1/00 - G02F7/00 grating
- G02F2201/305—Constructional arrangements not provided for in groups G02F1/00 - G02F7/00 grating diffraction grating
Abstract
An optical reconstruction filter in the form of a phase diffraction grating (that is, a diffractive diffuser) placed between a flat panel liquid crystal color matrix display and a viewer to optically filter flat panel images and present a higher quality image to the viewer.
Description
E~ v' r-~ ~ :J :;
PATENT
OPTICAL RECONSTRUCTION FILTER FOR COLOR
MOSAIC DISPLAYS
BACKGROUND AND SUMMARY OF THE INVENTION
Field of the Invention This invention is directed to the area of optical reconstruction filters for color mosaic (matrix) displays in general and for flat panel liquid crystal displays in particular. The invention is directed to optically filter flat panel images, i.e., particularly to interpolating sampled image data shown on color mosaic displays using a phase diffraction grating in order to present a higher quality image to the viewer.
Hackcrround The use of flat panel color matrix displays is increasing rapidly. These displays have regular structures of color pixels, as for example is shown in Figure 1, which are used to create the color image. An existing problem is that the dotted and discontinuous appearance of images shown on color mosaic displays is not desirable and needs improvement. That is, the underlying grid structure results in objectionable visual artifacts commonly referred to as sampling noise. Examples of sampling noise are pixel edges and gaps. These artifacts cause flat panel color matrix a Ana rs'5 ~d ~ c:~l a rd displays to have noticeably lower image quality than CRTs, rendering them inadequate for many situations.
This problem of visible dot structure in color matrix displays can be viewed as a two-dimensional image processing situation, which can be understood more easily by comparing it to its one-dimensional analog as shown in Figure 3. Segment 3a of Figure 3 shows an ideal signal (image) which is to be processed. An initial filter, the anti-aliasing filter, 3b, is used at the outset to limit the bandwidth of the ideal signal to frequencies the processing system can handle.
Frequencies that are too high result in spurious noise and moire patterns.
The cutoff frequency of the anti-aliasing filter is determined, by sampling theory, to be at one-half of the frequency the system uses to sample the incoming signal. The system in tho two-dimensional case consists of an image generator and color matrix display device. This cutoff frequency is commonly referred to as the Nyquist frequency. The output of the anti-aliasing filter is the actual signal (image) to be entered into the system, as shown at section 3c. The signal (imago) is then digitized through an A/D
converter (image generator), shown at section 3d, and is ready to be transferred to the rest of the system:
PATENT
OPTICAL RECONSTRUCTION FILTER FOR COLOR
MOSAIC DISPLAYS
BACKGROUND AND SUMMARY OF THE INVENTION
Field of the Invention This invention is directed to the area of optical reconstruction filters for color mosaic (matrix) displays in general and for flat panel liquid crystal displays in particular. The invention is directed to optically filter flat panel images, i.e., particularly to interpolating sampled image data shown on color mosaic displays using a phase diffraction grating in order to present a higher quality image to the viewer.
Hackcrround The use of flat panel color matrix displays is increasing rapidly. These displays have regular structures of color pixels, as for example is shown in Figure 1, which are used to create the color image. An existing problem is that the dotted and discontinuous appearance of images shown on color mosaic displays is not desirable and needs improvement. That is, the underlying grid structure results in objectionable visual artifacts commonly referred to as sampling noise. Examples of sampling noise are pixel edges and gaps. These artifacts cause flat panel color matrix a Ana rs'5 ~d ~ c:~l a rd displays to have noticeably lower image quality than CRTs, rendering them inadequate for many situations.
This problem of visible dot structure in color matrix displays can be viewed as a two-dimensional image processing situation, which can be understood more easily by comparing it to its one-dimensional analog as shown in Figure 3. Segment 3a of Figure 3 shows an ideal signal (image) which is to be processed. An initial filter, the anti-aliasing filter, 3b, is used at the outset to limit the bandwidth of the ideal signal to frequencies the processing system can handle.
Frequencies that are too high result in spurious noise and moire patterns.
The cutoff frequency of the anti-aliasing filter is determined, by sampling theory, to be at one-half of the frequency the system uses to sample the incoming signal. The system in tho two-dimensional case consists of an image generator and color matrix display device. This cutoff frequency is commonly referred to as the Nyquist frequency. The output of the anti-aliasing filter is the actual signal (image) to be entered into the system, as shown at section 3c. The signal (imago) is then digitized through an A/D
converter (image generator), shown at section 3d, and is ready to be transferred to the rest of the system:
i .64159-1158 At the other end of the system, the digital signal (image) passes through a D/A converter, shown at section 3e.
The output waveform of the D/A, shown at section 3f, is a signal (image), with undesirable high frequency noise present.
The noise is due to the underlying sampling grid and results from an incomplete reconstruction process. To complete the process, the signal is passed through another filter, the reconstruction filter, shown at section 3g, with its cutoff again determined by the Nyquist criterion. At this point, assuming ideal filtration has been accomplished, the output shape shown at section 3h, is identical to the system input at section 3c.
In the image processing case, just as for the one-dimensional signal, a reconstruction filter is needed to make the output identical to the system input.
This invention solves problems evident in the prior art. All color matrix displays, intentionally or not, have relied on one of two types of optical reconstruction filters;
1) the eye itself with its associated low pass filter characteristics, or 2) a diffuse or scattering, optical surface.
The eye as a reconstruction filter does not work satisfactorily for current flat panel display resolutions. For example, present color matrix displays typically have pixels 6 to 8 miles across. Human factors experiments have determined these pixel sizes result in sampling grids all too easily seen by the eye. The frequency content of the color matrix display structure, the display sampling grid, is clearly well within the bandpass characteristics of human vision. The eye cannot filter out spatial frequencies this low at typical viewing distances. The resolution of color matrix displays must increase significantly before the eye alone will be a ,64159-1158 sufficient low pass filter. This, however, is the reconstruction filter most often used for color matrix display applications.
Some color matrix display applications have used a diffuse scattering surface to eliminate sampling grid artifacts. A diffuse surface scatters the light, giving it optical low pass filter characteristics. The ~;,s;~~,-.~;~c3 ~~ci~~:~J
more scattering the surface accomplishes, the more diffuse the filter, and the more it smooths the image.
A common example is the diffuse picture glass frequently placed over photographs to reduce specular reflections.
Some optical low pass filtering results as well. Sudden luminance changes are attenuated giving the image a softer, smoother look. But, while eliminating specular reflection and while softening the image, these filters exhibit strong diffuse reflections of ambient light.
The more a filter diffuses, the more light is reflected over a wider range of viewing angles.
In display applications, even small amounts of reflected ambient light are objectionable. In higher ambients the diffuse reflections wash out the image altogether, rendering it unviewable. To get the amount of diffusion needed to eliminate the sampling noise of present color matrix display technology, the reflections become unacceptable, especially for cockpit display applications.
Another drawback of diffuse filters is that their passband characteristics are not tailorable over direction. The cutoff frequency is the same in all directions. For typical color matrix displays, whose underlying grid structure is not circularly symmetric, a filter with passband characteristics tailorable over direction is extremely desirable. Otherwise, the full frequency capability of the color matrix display is not _5_ ~~ ,~
taken to full advantage. Too much filtering will be exerted in some directions and/or too little will be exerted in others. Ideally, the low pass profile will exhibit characteristics determined directly by the color matrix display's own two-dimensional frequency capability.
S ~ mater of the Invention The invention is a diffraction grating filter with defined spatial frequency passband characteristics, used to eliminate noise generated by color matrix dot structure.
The invention uses sampling theory to determine the frequency capability of the particular display.
This is found by determining the Nyquist boundaries in two dimensions covering the surface of the display. The invention applies these two-dimensional boundaries to define the extent of traditional interpolation functions. Finally, the invention physically embodies these interpolation functions in the form of a phase diffraction grating in conjunction with the filter characteristics of the eye. The phase diffraction grating (may be a binary step type) is then applied over the surface of a color mosaic display to alter the point spread function of each pixel.
Subsequently, the luminance contained in each sample is distributed as a function of the distance from the sample point as defined by the interpolation ~~~:~-~~'' function. Accordingly, information contained in each sample is added with information of surrounding samples of like primary hue to provide continuous luminance functions for each primary color. A higher fidelity representation of the desired output signal results.
Continuity of the image function can be made through 1st, 2nd and higher order derivatives, depending on which interpolation function is selected to be embodied in the diffraction grating. Recognizing the lattice structure of each primary color is a key element of this invention. It can be applied to color mosaic patterns in general, including stripe, diagonal, delta, and quad pixel patterns.
That is, the invention provides continuity of the luminance functions of each primary hue on a color mosaic display in order to improve the image quality of sampled images. In the invention, a diffraction grating used as an optical reconstruction filter for color matrix displays, uses the phenomenon of diffraction to filter the image, instead of using scattering. The diffraction grating breaks each pixel image up into the various diffraction orders as it passes through the grating. These orders can be made to overlap and fall off in intensity, as shown in Figure 5. The diffracted pixels overlap and cause interpolation among the pixels of like color, getting rid of the high spatial frequency grid noise. The exact interpolation function used is _7_ iy 'r1 ;~'. .; i %x~ r~
Y I ~~ 'J~ » Fd determined by the position and intensity of the diffracted orders, which is, in turn, determined by the geometry and period of the diffraction grating structure, and the refractive index of the material.
Using the diffraction grating as a reconstruction filter is very advantageous for display applications. By using diffraction instead of scattering, reflections from the filter are specular instead of diffuse. These reflections still need to be handled, but they are easier to manage than diffuse reflections. Specular reflections can be cut down to less than 0.5~ with standard optical anti-reflection coatings. Destructive interference techniques can be used to cut the reflections down even further.
In addition, the diffraction grating can be tailored to give the desired passband characteristics and interpolation functions. The passband characteristics of the filter need not be constant over direction. The almost infinite range of order intensities and positioning gives the designer freedom to choose the best interpolation functions for the job.
Figura 12 shows some common interpolation functions, all of which would smooth the flat panel images. The surface profile of the diffraction grating can be designed to create these interpolation functions. This allows the reconstruction filter to be tailored to the exact structure of the color matrix display.
'64159-1158 The invention is easily incorporated into the color matrix display structure. The filter is etched in glass and can be bonded to the front of the panel or even made in the flat panel substrate glass. An example of the structure of the flat panel color matrix display together with the diffraction grating reconstruction filter proximate in front of it is shown in Figure 18.
In accordance with the present invention, there is provided an improved color matrix display apparatus which uses a diffraction grating reconstruction filter to reduce image artifacts, the apparatus comprising: a colour matrix display, the matrix display having a viewing face and comprising a regular structure of pixels which are selectively energized to create an image, the colour matrix display including major axes of a pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixels pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, whereby the diffracted pixels overlap and cause interpolation among the pixels to improve the image.
In accordance with the present invention, there is further provided an improved flat panel color matrix display apparatus which is used with a diffraction grating reconstruction filter to reduce flat panel image artifacts, the apparatus comprising: a flat panel color matrix display, the matrix display having a viewing face and comprising a regular structure of color pixels which are selectively energized to create an image, the matrix display including major axes of pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called image sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said color matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixel pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, wherein the diffraction grating reconstruction filter is separated from the flat panel color matrix display by a spacing "t" and selected according to the extent of interpolation desired, and whereby the diffracted pixels overlap and cause interpolation among the pixels thereby minimizing the image sampling noise and improving the image.
In accordance with the present invention, there is further provided a flat panel liquid crystal color matrix display stack assembly including an optical reconstruction filter in the form of a diffraction grating, the flat panel stack assembly comprising in combination: backlight means;
first polarizer mean; a two-dimensional liquid crystal display means; second polarizer means; and a diffractive diffuser spaced from said liquid crystal display by a spacing distance t so that an image of a point on said liquid crystal display is thereby diffractively diffused, wherein the spacing distance t is selected according to the desired extent of interpolation based on the distance between pixels of the same color.
In accordance with the present invention, there is further provided a method for designing a diffraction grating 9a optical reconstruction filter for a color matrix display comprising the steps: providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise; specifying each primary color lattice in the display; determining Nyquist boundaries in two-dimensions;
applying the Nyquist boundaries to define the extent of traditional interpolation functions; embodying the interpolation functions in the form of a phase diffraction grating; and applying the phase diffraction grating over the surface of the color matrix display to alter a point spread function of each pixel.
In accordance with the present invention, there is further provided a method for designing a diffraction grating optical reconstruction filter for a color matrix display comprising the steps: providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors, said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise; determining a lattice as defined by at least one primary color; determining a spatial frequency pattern of the lattice by taking a Fourier Transform;
determining Nyquist boundaries by, circumscribing a region having a region shape by drawing a ray from a reference point to each nearest neighbour point, drawing a perpendicular bisector line at a midpoint of each ray, said rays together forming a collection of perpendicular bisectors, the region circumscribed being the maximum frequency capability of the color matrix display, the collection of perpendicular bisectors comprising the Nyquist boundaries; selecting a one dimensional 9b interpolation waveform; making the one dimensional waveform into a two dimensional waveform by rotating the one dimensional waveform through two dimensions and adjusting relative extent of the one dimensional waveform in accordance with the shape of the region circumscribed by the Nyquist boundaries thereby defining a desired point spread function of the grating in combination with a human eye having an impact characteristic;
making the grating have the point spread function minus the impact of the human eye; and, placing the grating over the panel at a distance t from the panel.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 shows a portion of a color matrix display including the individual pixels used to create an image on the display. The pixel pattern shown is the RGB delta matrix pattern.
Figure 2 illustrates the problem of sampling noise on color matrix displays. The figure shows two images, one using the diagonal pixel pattern, the other using a quad-green pixel pattern. Each of these images is anti-aliased. Discrete pixels can still be distinguished, as well as the gaps between pixels.
A reconstruction filter is needed to eliminate these grid structure artifacts.
Figure 3 shows the analogy between the signal processing model and the image processing model, showing how a low pass reconstruction filter is needed between the display and the eye.
Figure 4 illustrates how the point image on a flat panel is spread out by the diffraction grating.
Figure 5 shows how the original square pixel luminance is spread out and smoothed by diffraction. As 9c b ;y ~ .r ..) ; ;,~ ::~
'1 ~,~ :J 9 ~J
more orders are used, the resulting diffracted pixel becomes smoother.
Figure 6A illustrates how light breaks up into orders after passing through a diffraction grating where p=order no.
Figure 6B illustrates a diffraction pattern of light through a two-dimensional diffraction grating where p,q=order no.
Figure 7 is a photograph of a laser beam passing through a diffraction grating and breaking up into orders. x=100 lines/mm, y=100 lines/mm.
Figure 8 shows a diagonal matrix pattern with the red primary lattice structure superimposed.
Figure 9 shows the spatial sampling array for a single primary color on the diagonal matrix pixel pattern.
Figure 10 illustrates the spatial frequency array for a single primary color on the diagonal matrix pixel pattern, and the corresponding Nyquist boundaries.
Figure il shows the ideal low pass transfer function for the diagonal pixel pattern, corresponding to the Nyquist boundaries of Figure 10.
Figure 12 waveforms a through f shows some common interpolation waveforms. The sinc waveform is the ideal, giving perfect reconstruction, but it is difficult to obtain. Figure 12 waveforms g, h and i show resulting interpolations. Thus, waveforms g, h and ~~~~:~~~' a i show examples of signal reconstruction using the ideal sinc function, and the triangle and pulse function.
Figure 13A gives an example of a one dimensional reconstruction of a single primary signal using the triangle interpolation function. The higher order interpolation functions give better reconstruction.
Figure 13B shows the ideal two-dimensional interpolation function, the sinc function. Since this function is difficult to obtain, the lower order interpolation functions such as cubic B-spline or gaussian are usually used.
Figure 14 shows a close-up of the surface profile for one embodiment of the invention, a phase diffraction grating designed for the RGBY quad pixel arrangement.
Figure 15 illustrates the resultant pixel luminance profile when a cubic B-spline interpolation function is applied to a diagonal color mosaic pixel, showing tha relative length to width ratio.
Figure 16 is a picture of a diffraction grating reconstruction filter used over a color matrix display.
This illustrates how the filter causes the individual pixel luminances to spread and smooth together, interpolating the image.
Figure 17 shows a process for making a diffraction grating with dichromated gelatin.
Figure 18 shows an example of flat panel color matrix display together with a diffraction grating reconstruction filter in front of it.
Figure 19 is a representation of a grating fabricated with the 100 line/mm mask, and Figure 20 shows the pattern created when a laser beam is passed through the grating.
DETAILED DESCRIPTION
This invention is an optical reconstruction filter made by using a diffraction grating. The diffraction grating reconstruction filter is placed between the flat panel and the eye, as shown in Figure 4. This filter interpolates between data points of like color and acts as a reconstruction filter for images to be displayed on the color matrix display. The cutoff frequencies of the filter are determined by the color matrix display sampling structure of the color matrix display.
The result of applying this reconstruction filter is an output image identical to the system input, free of sampling grid artifacts.
As described earlier, the invention is a diffraction grating, with defined spatial frequency passband characteristics, to be used as a reconstruction filter for color matrix displays, especially liquid crystal including active matrix liquid crystal flat panel color matrix displays such as is described in United States Patent 4,840,460 assigned to the same assignee. The invention interpolates among luminance values stored at each pixel site and, in concert with the low pass characteristics of the eye, renders a continuous image in the domain of each primary color. In other words, a diffraction grating filter is used to reduce flat panel image artifacts such as gaps, staircasing and color aliasing. This filter which is placed over a flat display panel of hundreds of pixels, smooths and precisely spreads the luminance profile of each pixel. The diffraction grating has several characteristics which make it useful for display applications including a first that the light spread 12a ti :~i ~~: ~ ;.J ': :~.d function is variable over direction, and a second that the non-scattering reflection characteristics make reflections easier to control.
Referring now to Figure 6A there is shown a diffraction grating 10, herein also referred to as a diffractive diffuser. The diffractive diffuser uses the phenomenon of diffraction, which is incident light breaking up into "orders" after passing through a periodic edge 11 of the diffraction grating. The zero, first and second orders are shown in the figure. The image passing straight through the filter is called the zero order. The images on either side of the zero order are the +1 and the -1 order. The next images on either side are the +2 and the -2 order. The angular relation 12 is shown in the form sin °'p= ~ where p = order number and x = the grating interval.
In Figure 6B there is shown a two dimensional diffraction grating 20 having grating intervals x and y. For a two dimensional grating the diffraction pattern of light from the incident light beam is two dimensional as shown on plane 21. The letters p and q represent the order numbers in the two dimensions x and y. In actual case more than two or three orders may be used giving much smoother final image.
Figure 7 is a photograph of a two dimensional diffraction pattern produced by a laser beam passing i l y~ '? ~~ ~~ ri b' >~J ~~~ C.' '°~,. f J
through a diffraction grating and breaking up into orders where x = 100 lines/mm and y=100 lines/mm.
The position and intensity of the various orders are determined by the geometry and period of the diffraction grating structure and the index variation of the material. In the case of the flat panel pixel image, the grating will be made such that the orders overlap and fall off in intensity, creating an image much more gaussian than the original "step" image of the pixel, as shown in Figure 5a-e. These diffracted pixels will overlap and cause interpolation between pixels. The characteristics of a diffraction grating can be designed to be a function of direction, so the light spread function can be tailored to the flat panel pixel pattern.
Referring now to Figure 5 where I represents intensity, and particularly to Figure 5a there is illustrated the original pixel image having an intensity represented by height Io and horizontal dimensions from -a to +a. The diffracted pixel orders change pixel luminance profile. Figures 5b, 5c and 5d illustrate the zero order, +1 and -1 orders and the +2 and -2 orders, respectively. Figure 5b illustrates the zero order with a~ intensity of 2Io/5 and dimensions from -a to +a.
Figure 5c illustrates the +1 and -1 orders and shows an intensity of Io/5 with horizontal dimension of 3a (that is from -3/2a to +3/2a). Figure 5d illustrates r,'a ;a n l.~ ~~ ~ i~~ ",) ~~ l) the +2 and -2 orders and shows an intensity of Io/10 and dimensions of 4a. As relative intensity and position of diffracted order changes, the final pixel image changes. Figure 5e illustrates the diffracted pixel image. In actual case, more than two orders may be used giving much smoother final image.
There are several different types of diffraction gratings. These include amplitude or phase types, and transmissive or reflective types. There are several manufacturing techniques, including holographic, ruled, and photolithographic. For the flat panel diffractive diffuser of this invention, a phase transmission grating is preferred because it has the highest transmission. It may be a binary step type. In a phase grating, the active diffractive material is transparent, with thickness variation across the surface. Figure 4 is illustrative of how the image of a point on the flat image panel 30 gets spread out by a diffraction grating 31. The grating 31 will be positioned in front of the panel 30 as shown in Figure 4, with the viewer 32 looking at the diffracted image.
a two axis grating will be used. The axes of the grating is preferably oriented to the major axes of the flat panel pixel pattern. The profile of the grating in X and y is determined such that the luminance of same color pixels is interpolated in each direction. The distance between same color pixels is s"7 ~t , : ~~
a ~~ ~ 1'd ::% ;i !~J
usually not the same in both axes. This distance is also different for different pixel layouts, such as the diagonal layouts versus the quad layouts. The grating profile is therefore tailored to a panel with a specific pixel size, spacing and layout. In one embodiment the grating is designed specifically for the Hosiden 6.7 mil diagonal mosaic panel.
It will be seen from Figure 4 that a spacing or distance "t" is shown between flat panel 30 and diffraction grating 31. By controlling the spacing "t"
the extent of interpolation desired can easily be obtained.
The diffraction grating 31 is effective to spread out the luminance profile of each pixel, interpolating between same color pixel images. In designing the diffraction grating surface profile, the final pixel luminance is a design factor. It has been determined that the actual shape of the interpolation function is not as critical as the amount of interpolation used to smooth out the flat panel image.
Far example, if the interpolation function spans several pixels, colors of individual pixels will blend together more effectively with neighboring pixels to alleviate a common complaint of liquid crystal flat panel displays that they show an objectionable amount of color bonding on misconvergence.
A current problem of the prior art is that pixel size and patterns result in a pointillist or dotted presentation of the image. Using any of a linear or gaussian or cubic B-spline shape for interpolation can eliminate or minimize the dotted appearance and produce a significant advance in the quality of the image. Care must be exercised so as to not introduce too much interpolation otherwise excessive blurring or defocussing will be perceived. Fortunately, the extent of the interpolation can easily be controlled by altering the spacing between the diffraction grating 31 and the display panel 30.
Figure 1 shows the individual red, green, and blue pixels of a typical color matrix display. Figure 2 illustrates the pixel structure artifacts which can occur from this type of discrete image display system.
Jagged transitions, on what are intended to be smooth lines detract from positional accuracy and, in the case of moving symbology, lines appear to move in a jumpy, discrete fashion. Ideally, the flat panel color matrix display would paint smoothly shaped symbols, which move in a smooth, analog manner and exhibit color purity.
Tha diffraction grating, used as an optical reconstruction filter, is used to obtain this smooth image on a color matrix display. The manner in which the diffraction grating is used as a reconstruction i i? tit i.~ ~~~ ~a filter for color matrix displays is explained in the following paragraphs.
Determining the desired spatial frequency passband characteristics of the reconstruction filter is key, and begins with recognizing the underlying lattice structure of the color matrix display to be used. For example, Figure 8 shows a diagonal matrix pattern with the red primary lattice structure superimposed. This lattice structure determines the spatial sampling array of the primary color, as shown in Figure 9. For the diagonal matrix pixel pattern, the spatial sampling array for all three primary colors is the same.
The spatial frequency lattice of the color matrix display is determined next. This is found by taking the Fourier transform of the spatial sampling array. Nyquist theory is used to determine the bandpass characteristics of the reconstruction filter. Nyquist sampling theory states that the maximum frequency which can be displayed on a color matrix display, without creating aliasing, is one half of the sampling frequency. The boundaries for maximum displayable frequencies therefore fall midway between the lattice points of the spatial frequency array. These boundaries, called the Nyquist boundaries, are shown in Figure 10 for the diagonal matrix pattern. The Nyquist boundaries define the maximum frequency capability of the color mosaic in all directions. Therefore, the i ~~ ~~w'~ '' ~w transfer function of the ideal bandpass filter for the diagonal pattern is as shown in Figure il.
The next step is to determine the interpolation function to be used, with the extent of interpolation defined by the Nyquist boundaries. Figure 12 shows some possible interpolation functions which give acceptable results. The triangle function is one of the simplest, whereas some of the other functions, such as the cubic B-spline, give more accurate results. Figure 13A gives an example of a one-dimensional reconstruction using the triangle function. The higher order interpolations give better reconstruction of the signal. Ideally the sinc function (of the form sin(x)/x) would be used, as shown in Figure 13B.
Thus, a number of interpolation waveforms are possible as is shown in Figure 12, waveforms a, b, c, d, a and f. Resulting interpolations are shown in Figure 12, waveforms g, h and i. Given that the expanse of the diffracted pattern can be changed at will by the distance of the grating from the panel, it is decided what shape would offer the best overall performance.
Based on theory and practice, a three dimensional cubic B-spline (or a close approximation to it) has been selected as the target shape, see Figure 12e. Over the proper interpolation distance, it connects each sample to its neighbors smoothly by ensuring continuity through the first and second derivatives. In this two-i 6'? .%~ r~ si rJ .
c-r dimensional case the ratio of the long versus the short axis is determined by the diagonal pixel pattern itself.
Once the desired interpolation function has been chosen, the diffraction grating optical reconstruction filter is then designed to create the corresponding point spread function (PSF). The PSF of the diffraction grating is determined by the position and intensity of the various diffracted orders. The position and intensity of the diffracted orders is determined by the surface profile of the diffraction grating. The equations which relate the position and intensity of diffracted orders to the surface profile of a diffraction grating are standard diffraction equations. of primary significance to the invention is that the surface profile of the grating controls the resulting PSF of the grating. By manipulating the surface profile, the PSF is varied and can be tailored to deliver the desired interpolation function. There are several ways of accomplishing this, including empirical, simulated annealing, or holographic techniques.
Figure 14 shows one embodiment of the invention, a phase diffraction grating designed for the RGBY quad pixel arrangement. The interpolation function which was chosen for this application approximates the cubic B-spline, as shown in Figura 15.
L : E 7 !:u ~ , .r'.
, i .~.~ ..:J
C ~l t~ °.; ~.:, ~ ,:., Figure 15 shows the intensity profile of a pixel from a diagonal color mosaic display after it has undergone a cubic B-spline interpolation. This may also be described as the resultant pixel luminance profile when cubic B-spline interpolation is applied to diagonal color mosaic pattern. Thus in Figure 15 there is shown the original pixel size 40, the size of oa=1.414 pixels and of Ob=2.12 pixels. The figure also shows the ratio of diagonal color mosaic - ~a - 1.414/2.12. The orientation of the ~b interpolation function can also be changed if desired.
Figure 16 shows this grating over a panel and illustrates the interpolation and resulting smoothing of the sampled image.
The diffraction grating reconstruction filter can be used for any of the pixel patterns used With color matrix displays. In each case, by tailoring the filter to the lattice structure as explained above, the full frequency capability of each particular pattern is used. Frequencies beyond this capability are eliminated. The result is enhanced image quality on color matrix displays.
In Figure 8 there is shown the major axes a and b and the separation between same color pixels R, G, and B of diagonal color mosaic pattern. In this figure the interpolation function is oriented along the plus and minus 45 degree axes of the diagonal mosaic pattern.
i ..,-~ , ; ,~,r ~..~ .~
'J .J g ,~
The separation between adjacent R pixels is shown to be da-axis = ~ (1 pixel)Z + (1 pixel= = 1.414 pixels.
On the other axis the separation between R pixels the separation is shown to be db-axis = ~ (1.5 pixels)a + (1.5 pixels)== 2.12 pixels.
The orientation of the interpolation function can also be changed to test questions about preferred axes of orientation of the target image. In the case of static characters, for example, which are predominately rendered with vertical and horizontal strokes, it may be desirable to orient the interpolation function vertically and horizontally rather than along the plus and minus 45 degree axes of the diagonal mosaic pattern (Figure 8). Though this extreme is not preferred, this and intermediate orientations can be evaluated by rotating the diffraction grating about an axis normal to the display surface.
In order to determine the surface profile of the diffraction grating, it is necessary to know exactly how this profile controls the diffraction pattern. In deteraining the diffraction pattern of a particular grating, two factors need to be determined: 1) the lateral spacing of the orders, and 2) the light intensity (or relative efficiency) of the orders.
The lateral spacing of the orders is quite easy w to determine. According to diffraction theory, the diffraction angle (the angle a diffracted order makes i ,.: > S .'~ :. ..r ~. t :a Ed ~ f .,; J ~ ,. ;.
V i~ a td with respect to normal), «p , is given by the following equation:
sin «p =
(1) where p is the order number, a is the wavelength, and X is the grating period in the x direction (see Figure 6A). The case of a viewer looking at a diffracted image is shown in Figure 4. Using Equation 1, the distance of an order from normal is determined to be x = ~ (2) - X
where t is the distance between the flat panel and the diffraction grating. This is easily extended to the two dimensional case, where the location of the orders is given by x = ~ a~
X , and y = Y , ( 3 ) where q is the order number, and Y is the grating period in the y direction. The distance between any two adjacent orders is therefore given by order spacing = X , or Y . (4) These equations can be used to estimate the range of grating frequencies necessary for flat panel applications. Assume a wavelength of 550 mm, and a 1 mm space between panel and grating. For a panel with a 6 mil pixel size, we can assume an approximate order a z~,.;a,~,"~,js~
f ,~ r...~ ~ _y .: ~~
spacing of 1-6 mils (we will want to move the 1st order image 1 - 6 mils away from the zero order image).
Inserting these numbers into Equation 4, the grating period will need to range from 3.6 to 22 x 10-3mm, giving a frequency range of 45 - 275 cycles/mm. The exact frequency is determined by the design of precisely how far the orders are to be moved.
In order to find the intensity of each of the orders a mathematical derivation of the Fraunhofer (far field) diffraction order efficiency for a two-dimensional grating has been derived. The efficiency, np~q, or relative intensity of each order is approximately:
nP~q I y fX fye C2xi (~ + ~) - i w(x,Y)J dx dy, 2 (5) where w(x,y) is the phase shift introduced by passage through the grating, and is given by w(x.Y) = 2x (no-nl) s(x,Y) (6) a where no is the refractive index of the surrounding medium (usually air, no = 1), and nl is the refractive index of the grating material, and s(x,y) is the function which describes the surface profile of the diffraction grating.
One process for fabricating a diffraction grating with dichromated gelatin using photolithographic techniques is illustrated in Figure 17. A layer of photoresist material, such as dichromated gelatin, is s ri i~ n 'J ~ Y.J :l C.) < .-d spun or otherwise deposited onto a glass substrate.
Then through a mask the photoresist material is exposed with uv light. The areas which have been exposed are washed away with water, leaving a surface profile of dichromated gelatin. In one example the mask used to prepare gratings has 100 lines/mm in both the x and y directions. Figure 18 shows the flat panel structure 41 and how the diffraction grating reconstruction filter (diffuser) 42 can be placed. The diffraction diffuser 42 here takes the form of a thin glass substrate, with a phase relief structure deposited upon it, placed over the last polarizes 43 in the flat panel stack. Beneath polarizes 43 is an upper substrate color filter 44, a common electrode 45, a spacer 46, the liquid crystal material 47 and the flat panel display 48 on the lower substrate 49. Polarizes 50 may be positioned beneath the lower substrate 49. Backlighting 51 is provided. A
magnified section 52 of the diffuser 42 is shown in the balloon 53.
7~ drawing of a photograph of a grating fabricated with the 100 line/mm mask is shown in Figure 19. The circles are "wells" where the dichromated gelatin has been removed. Figure 20 shows the pattern created when a laser beam is passed through the grating. a large throw distance was used to spread out the orders and illustrate their relative efficiencies.
For flat panel use the diffraction grating is closely i ~~:~;~f~'~',l'~
spaced to the panel so that the orders are all overlapping.
Thus, the present invention has entailed how one goes about specifying the filter requirements for a diffraction grating to operate as an optical reconstruction filter, when a particular flat panel liquid crystal color mosaic pattern is given. There is specified a method of determining filter cutoff requirements given any pixel pattern on the color matrix display; and there is specified the filter cutoff requirements in terms of each primary color lattice in the mosaic. The present invention is of a design to permit maximum use of available color mosaic spatial frequency capacity.
i
The output waveform of the D/A, shown at section 3f, is a signal (image), with undesirable high frequency noise present.
The noise is due to the underlying sampling grid and results from an incomplete reconstruction process. To complete the process, the signal is passed through another filter, the reconstruction filter, shown at section 3g, with its cutoff again determined by the Nyquist criterion. At this point, assuming ideal filtration has been accomplished, the output shape shown at section 3h, is identical to the system input at section 3c.
In the image processing case, just as for the one-dimensional signal, a reconstruction filter is needed to make the output identical to the system input.
This invention solves problems evident in the prior art. All color matrix displays, intentionally or not, have relied on one of two types of optical reconstruction filters;
1) the eye itself with its associated low pass filter characteristics, or 2) a diffuse or scattering, optical surface.
The eye as a reconstruction filter does not work satisfactorily for current flat panel display resolutions. For example, present color matrix displays typically have pixels 6 to 8 miles across. Human factors experiments have determined these pixel sizes result in sampling grids all too easily seen by the eye. The frequency content of the color matrix display structure, the display sampling grid, is clearly well within the bandpass characteristics of human vision. The eye cannot filter out spatial frequencies this low at typical viewing distances. The resolution of color matrix displays must increase significantly before the eye alone will be a ,64159-1158 sufficient low pass filter. This, however, is the reconstruction filter most often used for color matrix display applications.
Some color matrix display applications have used a diffuse scattering surface to eliminate sampling grid artifacts. A diffuse surface scatters the light, giving it optical low pass filter characteristics. The ~;,s;~~,-.~;~c3 ~~ci~~:~J
more scattering the surface accomplishes, the more diffuse the filter, and the more it smooths the image.
A common example is the diffuse picture glass frequently placed over photographs to reduce specular reflections.
Some optical low pass filtering results as well. Sudden luminance changes are attenuated giving the image a softer, smoother look. But, while eliminating specular reflection and while softening the image, these filters exhibit strong diffuse reflections of ambient light.
The more a filter diffuses, the more light is reflected over a wider range of viewing angles.
In display applications, even small amounts of reflected ambient light are objectionable. In higher ambients the diffuse reflections wash out the image altogether, rendering it unviewable. To get the amount of diffusion needed to eliminate the sampling noise of present color matrix display technology, the reflections become unacceptable, especially for cockpit display applications.
Another drawback of diffuse filters is that their passband characteristics are not tailorable over direction. The cutoff frequency is the same in all directions. For typical color matrix displays, whose underlying grid structure is not circularly symmetric, a filter with passband characteristics tailorable over direction is extremely desirable. Otherwise, the full frequency capability of the color matrix display is not _5_ ~~ ,~
taken to full advantage. Too much filtering will be exerted in some directions and/or too little will be exerted in others. Ideally, the low pass profile will exhibit characteristics determined directly by the color matrix display's own two-dimensional frequency capability.
S ~ mater of the Invention The invention is a diffraction grating filter with defined spatial frequency passband characteristics, used to eliminate noise generated by color matrix dot structure.
The invention uses sampling theory to determine the frequency capability of the particular display.
This is found by determining the Nyquist boundaries in two dimensions covering the surface of the display. The invention applies these two-dimensional boundaries to define the extent of traditional interpolation functions. Finally, the invention physically embodies these interpolation functions in the form of a phase diffraction grating in conjunction with the filter characteristics of the eye. The phase diffraction grating (may be a binary step type) is then applied over the surface of a color mosaic display to alter the point spread function of each pixel.
Subsequently, the luminance contained in each sample is distributed as a function of the distance from the sample point as defined by the interpolation ~~~:~-~~'' function. Accordingly, information contained in each sample is added with information of surrounding samples of like primary hue to provide continuous luminance functions for each primary color. A higher fidelity representation of the desired output signal results.
Continuity of the image function can be made through 1st, 2nd and higher order derivatives, depending on which interpolation function is selected to be embodied in the diffraction grating. Recognizing the lattice structure of each primary color is a key element of this invention. It can be applied to color mosaic patterns in general, including stripe, diagonal, delta, and quad pixel patterns.
That is, the invention provides continuity of the luminance functions of each primary hue on a color mosaic display in order to improve the image quality of sampled images. In the invention, a diffraction grating used as an optical reconstruction filter for color matrix displays, uses the phenomenon of diffraction to filter the image, instead of using scattering. The diffraction grating breaks each pixel image up into the various diffraction orders as it passes through the grating. These orders can be made to overlap and fall off in intensity, as shown in Figure 5. The diffracted pixels overlap and cause interpolation among the pixels of like color, getting rid of the high spatial frequency grid noise. The exact interpolation function used is _7_ iy 'r1 ;~'. .; i %x~ r~
Y I ~~ 'J~ » Fd determined by the position and intensity of the diffracted orders, which is, in turn, determined by the geometry and period of the diffraction grating structure, and the refractive index of the material.
Using the diffraction grating as a reconstruction filter is very advantageous for display applications. By using diffraction instead of scattering, reflections from the filter are specular instead of diffuse. These reflections still need to be handled, but they are easier to manage than diffuse reflections. Specular reflections can be cut down to less than 0.5~ with standard optical anti-reflection coatings. Destructive interference techniques can be used to cut the reflections down even further.
In addition, the diffraction grating can be tailored to give the desired passband characteristics and interpolation functions. The passband characteristics of the filter need not be constant over direction. The almost infinite range of order intensities and positioning gives the designer freedom to choose the best interpolation functions for the job.
Figura 12 shows some common interpolation functions, all of which would smooth the flat panel images. The surface profile of the diffraction grating can be designed to create these interpolation functions. This allows the reconstruction filter to be tailored to the exact structure of the color matrix display.
'64159-1158 The invention is easily incorporated into the color matrix display structure. The filter is etched in glass and can be bonded to the front of the panel or even made in the flat panel substrate glass. An example of the structure of the flat panel color matrix display together with the diffraction grating reconstruction filter proximate in front of it is shown in Figure 18.
In accordance with the present invention, there is provided an improved color matrix display apparatus which uses a diffraction grating reconstruction filter to reduce image artifacts, the apparatus comprising: a colour matrix display, the matrix display having a viewing face and comprising a regular structure of pixels which are selectively energized to create an image, the colour matrix display including major axes of a pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixels pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, whereby the diffracted pixels overlap and cause interpolation among the pixels to improve the image.
In accordance with the present invention, there is further provided an improved flat panel color matrix display apparatus which is used with a diffraction grating reconstruction filter to reduce flat panel image artifacts, the apparatus comprising: a flat panel color matrix display, the matrix display having a viewing face and comprising a regular structure of color pixels which are selectively energized to create an image, the matrix display including major axes of pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called image sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said color matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixel pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, wherein the diffraction grating reconstruction filter is separated from the flat panel color matrix display by a spacing "t" and selected according to the extent of interpolation desired, and whereby the diffracted pixels overlap and cause interpolation among the pixels thereby minimizing the image sampling noise and improving the image.
In accordance with the present invention, there is further provided a flat panel liquid crystal color matrix display stack assembly including an optical reconstruction filter in the form of a diffraction grating, the flat panel stack assembly comprising in combination: backlight means;
first polarizer mean; a two-dimensional liquid crystal display means; second polarizer means; and a diffractive diffuser spaced from said liquid crystal display by a spacing distance t so that an image of a point on said liquid crystal display is thereby diffractively diffused, wherein the spacing distance t is selected according to the desired extent of interpolation based on the distance between pixels of the same color.
In accordance with the present invention, there is further provided a method for designing a diffraction grating 9a optical reconstruction filter for a color matrix display comprising the steps: providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise; specifying each primary color lattice in the display; determining Nyquist boundaries in two-dimensions;
applying the Nyquist boundaries to define the extent of traditional interpolation functions; embodying the interpolation functions in the form of a phase diffraction grating; and applying the phase diffraction grating over the surface of the color matrix display to alter a point spread function of each pixel.
In accordance with the present invention, there is further provided a method for designing a diffraction grating optical reconstruction filter for a color matrix display comprising the steps: providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors, said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise; determining a lattice as defined by at least one primary color; determining a spatial frequency pattern of the lattice by taking a Fourier Transform;
determining Nyquist boundaries by, circumscribing a region having a region shape by drawing a ray from a reference point to each nearest neighbour point, drawing a perpendicular bisector line at a midpoint of each ray, said rays together forming a collection of perpendicular bisectors, the region circumscribed being the maximum frequency capability of the color matrix display, the collection of perpendicular bisectors comprising the Nyquist boundaries; selecting a one dimensional 9b interpolation waveform; making the one dimensional waveform into a two dimensional waveform by rotating the one dimensional waveform through two dimensions and adjusting relative extent of the one dimensional waveform in accordance with the shape of the region circumscribed by the Nyquist boundaries thereby defining a desired point spread function of the grating in combination with a human eye having an impact characteristic;
making the grating have the point spread function minus the impact of the human eye; and, placing the grating over the panel at a distance t from the panel.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 shows a portion of a color matrix display including the individual pixels used to create an image on the display. The pixel pattern shown is the RGB delta matrix pattern.
Figure 2 illustrates the problem of sampling noise on color matrix displays. The figure shows two images, one using the diagonal pixel pattern, the other using a quad-green pixel pattern. Each of these images is anti-aliased. Discrete pixels can still be distinguished, as well as the gaps between pixels.
A reconstruction filter is needed to eliminate these grid structure artifacts.
Figure 3 shows the analogy between the signal processing model and the image processing model, showing how a low pass reconstruction filter is needed between the display and the eye.
Figure 4 illustrates how the point image on a flat panel is spread out by the diffraction grating.
Figure 5 shows how the original square pixel luminance is spread out and smoothed by diffraction. As 9c b ;y ~ .r ..) ; ;,~ ::~
'1 ~,~ :J 9 ~J
more orders are used, the resulting diffracted pixel becomes smoother.
Figure 6A illustrates how light breaks up into orders after passing through a diffraction grating where p=order no.
Figure 6B illustrates a diffraction pattern of light through a two-dimensional diffraction grating where p,q=order no.
Figure 7 is a photograph of a laser beam passing through a diffraction grating and breaking up into orders. x=100 lines/mm, y=100 lines/mm.
Figure 8 shows a diagonal matrix pattern with the red primary lattice structure superimposed.
Figure 9 shows the spatial sampling array for a single primary color on the diagonal matrix pixel pattern.
Figure 10 illustrates the spatial frequency array for a single primary color on the diagonal matrix pixel pattern, and the corresponding Nyquist boundaries.
Figure il shows the ideal low pass transfer function for the diagonal pixel pattern, corresponding to the Nyquist boundaries of Figure 10.
Figure 12 waveforms a through f shows some common interpolation waveforms. The sinc waveform is the ideal, giving perfect reconstruction, but it is difficult to obtain. Figure 12 waveforms g, h and i show resulting interpolations. Thus, waveforms g, h and ~~~~:~~~' a i show examples of signal reconstruction using the ideal sinc function, and the triangle and pulse function.
Figure 13A gives an example of a one dimensional reconstruction of a single primary signal using the triangle interpolation function. The higher order interpolation functions give better reconstruction.
Figure 13B shows the ideal two-dimensional interpolation function, the sinc function. Since this function is difficult to obtain, the lower order interpolation functions such as cubic B-spline or gaussian are usually used.
Figure 14 shows a close-up of the surface profile for one embodiment of the invention, a phase diffraction grating designed for the RGBY quad pixel arrangement.
Figure 15 illustrates the resultant pixel luminance profile when a cubic B-spline interpolation function is applied to a diagonal color mosaic pixel, showing tha relative length to width ratio.
Figure 16 is a picture of a diffraction grating reconstruction filter used over a color matrix display.
This illustrates how the filter causes the individual pixel luminances to spread and smooth together, interpolating the image.
Figure 17 shows a process for making a diffraction grating with dichromated gelatin.
Figure 18 shows an example of flat panel color matrix display together with a diffraction grating reconstruction filter in front of it.
Figure 19 is a representation of a grating fabricated with the 100 line/mm mask, and Figure 20 shows the pattern created when a laser beam is passed through the grating.
DETAILED DESCRIPTION
This invention is an optical reconstruction filter made by using a diffraction grating. The diffraction grating reconstruction filter is placed between the flat panel and the eye, as shown in Figure 4. This filter interpolates between data points of like color and acts as a reconstruction filter for images to be displayed on the color matrix display. The cutoff frequencies of the filter are determined by the color matrix display sampling structure of the color matrix display.
The result of applying this reconstruction filter is an output image identical to the system input, free of sampling grid artifacts.
As described earlier, the invention is a diffraction grating, with defined spatial frequency passband characteristics, to be used as a reconstruction filter for color matrix displays, especially liquid crystal including active matrix liquid crystal flat panel color matrix displays such as is described in United States Patent 4,840,460 assigned to the same assignee. The invention interpolates among luminance values stored at each pixel site and, in concert with the low pass characteristics of the eye, renders a continuous image in the domain of each primary color. In other words, a diffraction grating filter is used to reduce flat panel image artifacts such as gaps, staircasing and color aliasing. This filter which is placed over a flat display panel of hundreds of pixels, smooths and precisely spreads the luminance profile of each pixel. The diffraction grating has several characteristics which make it useful for display applications including a first that the light spread 12a ti :~i ~~: ~ ;.J ': :~.d function is variable over direction, and a second that the non-scattering reflection characteristics make reflections easier to control.
Referring now to Figure 6A there is shown a diffraction grating 10, herein also referred to as a diffractive diffuser. The diffractive diffuser uses the phenomenon of diffraction, which is incident light breaking up into "orders" after passing through a periodic edge 11 of the diffraction grating. The zero, first and second orders are shown in the figure. The image passing straight through the filter is called the zero order. The images on either side of the zero order are the +1 and the -1 order. The next images on either side are the +2 and the -2 order. The angular relation 12 is shown in the form sin °'p= ~ where p = order number and x = the grating interval.
In Figure 6B there is shown a two dimensional diffraction grating 20 having grating intervals x and y. For a two dimensional grating the diffraction pattern of light from the incident light beam is two dimensional as shown on plane 21. The letters p and q represent the order numbers in the two dimensions x and y. In actual case more than two or three orders may be used giving much smoother final image.
Figure 7 is a photograph of a two dimensional diffraction pattern produced by a laser beam passing i l y~ '? ~~ ~~ ri b' >~J ~~~ C.' '°~,. f J
through a diffraction grating and breaking up into orders where x = 100 lines/mm and y=100 lines/mm.
The position and intensity of the various orders are determined by the geometry and period of the diffraction grating structure and the index variation of the material. In the case of the flat panel pixel image, the grating will be made such that the orders overlap and fall off in intensity, creating an image much more gaussian than the original "step" image of the pixel, as shown in Figure 5a-e. These diffracted pixels will overlap and cause interpolation between pixels. The characteristics of a diffraction grating can be designed to be a function of direction, so the light spread function can be tailored to the flat panel pixel pattern.
Referring now to Figure 5 where I represents intensity, and particularly to Figure 5a there is illustrated the original pixel image having an intensity represented by height Io and horizontal dimensions from -a to +a. The diffracted pixel orders change pixel luminance profile. Figures 5b, 5c and 5d illustrate the zero order, +1 and -1 orders and the +2 and -2 orders, respectively. Figure 5b illustrates the zero order with a~ intensity of 2Io/5 and dimensions from -a to +a.
Figure 5c illustrates the +1 and -1 orders and shows an intensity of Io/5 with horizontal dimension of 3a (that is from -3/2a to +3/2a). Figure 5d illustrates r,'a ;a n l.~ ~~ ~ i~~ ",) ~~ l) the +2 and -2 orders and shows an intensity of Io/10 and dimensions of 4a. As relative intensity and position of diffracted order changes, the final pixel image changes. Figure 5e illustrates the diffracted pixel image. In actual case, more than two orders may be used giving much smoother final image.
There are several different types of diffraction gratings. These include amplitude or phase types, and transmissive or reflective types. There are several manufacturing techniques, including holographic, ruled, and photolithographic. For the flat panel diffractive diffuser of this invention, a phase transmission grating is preferred because it has the highest transmission. It may be a binary step type. In a phase grating, the active diffractive material is transparent, with thickness variation across the surface. Figure 4 is illustrative of how the image of a point on the flat image panel 30 gets spread out by a diffraction grating 31. The grating 31 will be positioned in front of the panel 30 as shown in Figure 4, with the viewer 32 looking at the diffracted image.
a two axis grating will be used. The axes of the grating is preferably oriented to the major axes of the flat panel pixel pattern. The profile of the grating in X and y is determined such that the luminance of same color pixels is interpolated in each direction. The distance between same color pixels is s"7 ~t , : ~~
a ~~ ~ 1'd ::% ;i !~J
usually not the same in both axes. This distance is also different for different pixel layouts, such as the diagonal layouts versus the quad layouts. The grating profile is therefore tailored to a panel with a specific pixel size, spacing and layout. In one embodiment the grating is designed specifically for the Hosiden 6.7 mil diagonal mosaic panel.
It will be seen from Figure 4 that a spacing or distance "t" is shown between flat panel 30 and diffraction grating 31. By controlling the spacing "t"
the extent of interpolation desired can easily be obtained.
The diffraction grating 31 is effective to spread out the luminance profile of each pixel, interpolating between same color pixel images. In designing the diffraction grating surface profile, the final pixel luminance is a design factor. It has been determined that the actual shape of the interpolation function is not as critical as the amount of interpolation used to smooth out the flat panel image.
Far example, if the interpolation function spans several pixels, colors of individual pixels will blend together more effectively with neighboring pixels to alleviate a common complaint of liquid crystal flat panel displays that they show an objectionable amount of color bonding on misconvergence.
A current problem of the prior art is that pixel size and patterns result in a pointillist or dotted presentation of the image. Using any of a linear or gaussian or cubic B-spline shape for interpolation can eliminate or minimize the dotted appearance and produce a significant advance in the quality of the image. Care must be exercised so as to not introduce too much interpolation otherwise excessive blurring or defocussing will be perceived. Fortunately, the extent of the interpolation can easily be controlled by altering the spacing between the diffraction grating 31 and the display panel 30.
Figure 1 shows the individual red, green, and blue pixels of a typical color matrix display. Figure 2 illustrates the pixel structure artifacts which can occur from this type of discrete image display system.
Jagged transitions, on what are intended to be smooth lines detract from positional accuracy and, in the case of moving symbology, lines appear to move in a jumpy, discrete fashion. Ideally, the flat panel color matrix display would paint smoothly shaped symbols, which move in a smooth, analog manner and exhibit color purity.
Tha diffraction grating, used as an optical reconstruction filter, is used to obtain this smooth image on a color matrix display. The manner in which the diffraction grating is used as a reconstruction i i? tit i.~ ~~~ ~a filter for color matrix displays is explained in the following paragraphs.
Determining the desired spatial frequency passband characteristics of the reconstruction filter is key, and begins with recognizing the underlying lattice structure of the color matrix display to be used. For example, Figure 8 shows a diagonal matrix pattern with the red primary lattice structure superimposed. This lattice structure determines the spatial sampling array of the primary color, as shown in Figure 9. For the diagonal matrix pixel pattern, the spatial sampling array for all three primary colors is the same.
The spatial frequency lattice of the color matrix display is determined next. This is found by taking the Fourier transform of the spatial sampling array. Nyquist theory is used to determine the bandpass characteristics of the reconstruction filter. Nyquist sampling theory states that the maximum frequency which can be displayed on a color matrix display, without creating aliasing, is one half of the sampling frequency. The boundaries for maximum displayable frequencies therefore fall midway between the lattice points of the spatial frequency array. These boundaries, called the Nyquist boundaries, are shown in Figure 10 for the diagonal matrix pattern. The Nyquist boundaries define the maximum frequency capability of the color mosaic in all directions. Therefore, the i ~~ ~~w'~ '' ~w transfer function of the ideal bandpass filter for the diagonal pattern is as shown in Figure il.
The next step is to determine the interpolation function to be used, with the extent of interpolation defined by the Nyquist boundaries. Figure 12 shows some possible interpolation functions which give acceptable results. The triangle function is one of the simplest, whereas some of the other functions, such as the cubic B-spline, give more accurate results. Figure 13A gives an example of a one-dimensional reconstruction using the triangle function. The higher order interpolations give better reconstruction of the signal. Ideally the sinc function (of the form sin(x)/x) would be used, as shown in Figure 13B.
Thus, a number of interpolation waveforms are possible as is shown in Figure 12, waveforms a, b, c, d, a and f. Resulting interpolations are shown in Figure 12, waveforms g, h and i. Given that the expanse of the diffracted pattern can be changed at will by the distance of the grating from the panel, it is decided what shape would offer the best overall performance.
Based on theory and practice, a three dimensional cubic B-spline (or a close approximation to it) has been selected as the target shape, see Figure 12e. Over the proper interpolation distance, it connects each sample to its neighbors smoothly by ensuring continuity through the first and second derivatives. In this two-i 6'? .%~ r~ si rJ .
c-r dimensional case the ratio of the long versus the short axis is determined by the diagonal pixel pattern itself.
Once the desired interpolation function has been chosen, the diffraction grating optical reconstruction filter is then designed to create the corresponding point spread function (PSF). The PSF of the diffraction grating is determined by the position and intensity of the various diffracted orders. The position and intensity of the diffracted orders is determined by the surface profile of the diffraction grating. The equations which relate the position and intensity of diffracted orders to the surface profile of a diffraction grating are standard diffraction equations. of primary significance to the invention is that the surface profile of the grating controls the resulting PSF of the grating. By manipulating the surface profile, the PSF is varied and can be tailored to deliver the desired interpolation function. There are several ways of accomplishing this, including empirical, simulated annealing, or holographic techniques.
Figure 14 shows one embodiment of the invention, a phase diffraction grating designed for the RGBY quad pixel arrangement. The interpolation function which was chosen for this application approximates the cubic B-spline, as shown in Figura 15.
L : E 7 !:u ~ , .r'.
, i .~.~ ..:J
C ~l t~ °.; ~.:, ~ ,:., Figure 15 shows the intensity profile of a pixel from a diagonal color mosaic display after it has undergone a cubic B-spline interpolation. This may also be described as the resultant pixel luminance profile when cubic B-spline interpolation is applied to diagonal color mosaic pattern. Thus in Figure 15 there is shown the original pixel size 40, the size of oa=1.414 pixels and of Ob=2.12 pixels. The figure also shows the ratio of diagonal color mosaic - ~a - 1.414/2.12. The orientation of the ~b interpolation function can also be changed if desired.
Figure 16 shows this grating over a panel and illustrates the interpolation and resulting smoothing of the sampled image.
The diffraction grating reconstruction filter can be used for any of the pixel patterns used With color matrix displays. In each case, by tailoring the filter to the lattice structure as explained above, the full frequency capability of each particular pattern is used. Frequencies beyond this capability are eliminated. The result is enhanced image quality on color matrix displays.
In Figure 8 there is shown the major axes a and b and the separation between same color pixels R, G, and B of diagonal color mosaic pattern. In this figure the interpolation function is oriented along the plus and minus 45 degree axes of the diagonal mosaic pattern.
i ..,-~ , ; ,~,r ~..~ .~
'J .J g ,~
The separation between adjacent R pixels is shown to be da-axis = ~ (1 pixel)Z + (1 pixel= = 1.414 pixels.
On the other axis the separation between R pixels the separation is shown to be db-axis = ~ (1.5 pixels)a + (1.5 pixels)== 2.12 pixels.
The orientation of the interpolation function can also be changed to test questions about preferred axes of orientation of the target image. In the case of static characters, for example, which are predominately rendered with vertical and horizontal strokes, it may be desirable to orient the interpolation function vertically and horizontally rather than along the plus and minus 45 degree axes of the diagonal mosaic pattern (Figure 8). Though this extreme is not preferred, this and intermediate orientations can be evaluated by rotating the diffraction grating about an axis normal to the display surface.
In order to determine the surface profile of the diffraction grating, it is necessary to know exactly how this profile controls the diffraction pattern. In deteraining the diffraction pattern of a particular grating, two factors need to be determined: 1) the lateral spacing of the orders, and 2) the light intensity (or relative efficiency) of the orders.
The lateral spacing of the orders is quite easy w to determine. According to diffraction theory, the diffraction angle (the angle a diffracted order makes i ,.: > S .'~ :. ..r ~. t :a Ed ~ f .,; J ~ ,. ;.
V i~ a td with respect to normal), «p , is given by the following equation:
sin «p =
(1) where p is the order number, a is the wavelength, and X is the grating period in the x direction (see Figure 6A). The case of a viewer looking at a diffracted image is shown in Figure 4. Using Equation 1, the distance of an order from normal is determined to be x = ~ (2) - X
where t is the distance between the flat panel and the diffraction grating. This is easily extended to the two dimensional case, where the location of the orders is given by x = ~ a~
X , and y = Y , ( 3 ) where q is the order number, and Y is the grating period in the y direction. The distance between any two adjacent orders is therefore given by order spacing = X , or Y . (4) These equations can be used to estimate the range of grating frequencies necessary for flat panel applications. Assume a wavelength of 550 mm, and a 1 mm space between panel and grating. For a panel with a 6 mil pixel size, we can assume an approximate order a z~,.;a,~,"~,js~
f ,~ r...~ ~ _y .: ~~
spacing of 1-6 mils (we will want to move the 1st order image 1 - 6 mils away from the zero order image).
Inserting these numbers into Equation 4, the grating period will need to range from 3.6 to 22 x 10-3mm, giving a frequency range of 45 - 275 cycles/mm. The exact frequency is determined by the design of precisely how far the orders are to be moved.
In order to find the intensity of each of the orders a mathematical derivation of the Fraunhofer (far field) diffraction order efficiency for a two-dimensional grating has been derived. The efficiency, np~q, or relative intensity of each order is approximately:
nP~q I y fX fye C2xi (~ + ~) - i w(x,Y)J dx dy, 2 (5) where w(x,y) is the phase shift introduced by passage through the grating, and is given by w(x.Y) = 2x (no-nl) s(x,Y) (6) a where no is the refractive index of the surrounding medium (usually air, no = 1), and nl is the refractive index of the grating material, and s(x,y) is the function which describes the surface profile of the diffraction grating.
One process for fabricating a diffraction grating with dichromated gelatin using photolithographic techniques is illustrated in Figure 17. A layer of photoresist material, such as dichromated gelatin, is s ri i~ n 'J ~ Y.J :l C.) < .-d spun or otherwise deposited onto a glass substrate.
Then through a mask the photoresist material is exposed with uv light. The areas which have been exposed are washed away with water, leaving a surface profile of dichromated gelatin. In one example the mask used to prepare gratings has 100 lines/mm in both the x and y directions. Figure 18 shows the flat panel structure 41 and how the diffraction grating reconstruction filter (diffuser) 42 can be placed. The diffraction diffuser 42 here takes the form of a thin glass substrate, with a phase relief structure deposited upon it, placed over the last polarizes 43 in the flat panel stack. Beneath polarizes 43 is an upper substrate color filter 44, a common electrode 45, a spacer 46, the liquid crystal material 47 and the flat panel display 48 on the lower substrate 49. Polarizes 50 may be positioned beneath the lower substrate 49. Backlighting 51 is provided. A
magnified section 52 of the diffuser 42 is shown in the balloon 53.
7~ drawing of a photograph of a grating fabricated with the 100 line/mm mask is shown in Figure 19. The circles are "wells" where the dichromated gelatin has been removed. Figure 20 shows the pattern created when a laser beam is passed through the grating. a large throw distance was used to spread out the orders and illustrate their relative efficiencies.
For flat panel use the diffraction grating is closely i ~~:~;~f~'~',l'~
spaced to the panel so that the orders are all overlapping.
Thus, the present invention has entailed how one goes about specifying the filter requirements for a diffraction grating to operate as an optical reconstruction filter, when a particular flat panel liquid crystal color mosaic pattern is given. There is specified a method of determining filter cutoff requirements given any pixel pattern on the color matrix display; and there is specified the filter cutoff requirements in terms of each primary color lattice in the mosaic. The present invention is of a design to permit maximum use of available color mosaic spatial frequency capacity.
i
Claims (22)
1. An improved color matrix display apparatus which uses a diffraction grating reconstruction filter to reduce image artifacts, the apparatus comprising:
a colour matrix display, the matrix display having a viewing face and comprising a regular structure of pixels which are selectively energized to create an image, the colour matrix display including major axes of a pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixels pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, whereby the diffracted pixels overlap and cause interpolation among the pixels to improve the image.
a colour matrix display, the matrix display having a viewing face and comprising a regular structure of pixels which are selectively energized to create an image, the colour matrix display including major axes of a pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixels pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, whereby the diffracted pixels overlap and cause interpolation among the pixels to improve the image.
2. The apparatus according to claim 1 in which the color matrix display is of a type selected from the group consisting of liquid crystal, plasma panels, electroluminescent, and vacuum fluorescent displays.
3. The apparatus according to claim 1 in which the color matrix display is a flat panel liquid crystal color matrix display.
4. The apparatus according to claim 3 in which the color matrix display is an active matrix liquid crystal display.
5. The apparatus according to claim 3 in which there are major axes of pixel pattern for same color pixels.
6. The apparatus according to claim 5 in which said major axes for same color pixels is a diagonal matrix pattern.
7. The apparatus according to claim 5 in which the axes of said two-dimensional diffraction grating are oriented to the major axes of the flat panel pixel pattern.
8. The apparatus according to claim 6 in which the axes of said two-dimensional diffraction grating are oriented to the diagonal major axes of the flat panel pixel pattern.
9. The apparatus according to claim 1 in which the diffraction grating is a phase transmission grating.
10. The apparatus according to claim 9 in which the phase transmission grating is a binary step type.
11. The apparatus according to claim 1 in which the diffraction grating has a point spread function defined by the primary color's lattice structure of the color matrix display.
12. The apparatus according to claim 1 in which said two-dimensional diffraction grating reconstruction filter and said matrix display viewing face have a spacing "t" therebetween, the controlling of the spacing allowing the extent of interpolation desired to be obtained.
13. The apparatus according to claim 3 in which said liquid crystal display comprises a glass substrate and in which said two-dimensional diffraction grating is embedded as an integral component of said liquid crystal color matrix display glass substrate.
14. The apparatus according to claim 3 in which said grating is juxtaposed the surface of said liquid crystal color matrix display.
15. An improved flat panel color matrix display apparatus which is used with a diffraction grating reconstruction filter to reduce flat panel image artifacts, the apparatus comprising:
a flat panel color matrix display, the matrix display having a viewing face and comprising a regular structure of color pixels which are selectively energized to create an image, the matrix display including major axes of pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called image sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said color matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixel pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, wherein the diffraction grating reconstruction filter is separated from the flat panel color matrix display by a spacing "t" and selected according to the extent of interpolation desired, and whereby the diffracted pixels overlap and cause interpolation among the pixels thereby minimizing the image sampling noise and improving the image.
a flat panel color matrix display, the matrix display having a viewing face and comprising a regular structure of color pixels which are selectively energized to create an image, the matrix display including major axes of pixel pattern for same color pixels, and the color matrix display unfortunately being subject to an inherent underlying grid structure which results in objectionable visual artifacts called image sampling noise which lowers image quality; and a two-dimensional diffraction grating reconstruction filter positioned proximate and in front of said color matrix display viewing face which uses the phenomenon of diffraction to filter the image, the diffraction grating being oriented to the major axes of the pixel pattern and breaking each pixel image up into various diffraction orders in two-dimensions as it passes through the grating, wherein the diffraction grating reconstruction filter is separated from the flat panel color matrix display by a spacing "t" and selected according to the extent of interpolation desired, and whereby the diffracted pixels overlap and cause interpolation among the pixels thereby minimizing the image sampling noise and improving the image.
16. The apparatus according to claim 15 in which the matrix display is a liquid crystal display.
17. The apparatus according to claim 15 in which said major axes for same color pixels is a diagonal matrix pattern.
18. The apparatus according to claim 17 in which the axes of said two-dimensional diffraction grating are oriented to the diagonal major axes of the flat panel pixel pattern.
19. A flat panel liquid crystal color matrix display stack assembly including an optical reconstruction filter in the form of a diffraction grating, the flat panel stack assembly comprising in combination:
backlight means;
first polarizer mean;
a two-dimensional liquid crystal display means;
second polarizer means; and a diffractive diffuser spaced from said liquid crystal display by a spacing distance t so that an image of a point on said liquid crystal display is thereby diffractively diffused, wherein the spacing distance t is selected according to the desired extent of interpolation based on the distance between pixels of the same color.
backlight means;
first polarizer mean;
a two-dimensional liquid crystal display means;
second polarizer means; and a diffractive diffuser spaced from said liquid crystal display by a spacing distance t so that an image of a point on said liquid crystal display is thereby diffractively diffused, wherein the spacing distance t is selected according to the desired extent of interpolation based on the distance between pixels of the same color.
20. The assembly according to claim 19 in which the diffractive diffuser is a diffraction grating reconstruction filter the diffraction grating breaking each liquid crystal pixel image up into various diffraction orders as it passes through the grating whereby the diffracted pixels overlap and cause interpolation among the pixels.
21. A method for designing a diffraction grating optical reconstruction filter for a color matrix display comprising the steps:
providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise;
specifying each primary color lattice in the display;
determining Nyquist boundaries in two-dimensions;
applying the Nyquist boundaries to define the extent of traditional interpolation functions;
embodying the interpolation functions in the form of a phase diffraction grating; and applying the phase diffraction grating over the surface of the color matrix display to alter a point spread function of each pixel.
providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise;
specifying each primary color lattice in the display;
determining Nyquist boundaries in two-dimensions;
applying the Nyquist boundaries to define the extent of traditional interpolation functions;
embodying the interpolation functions in the form of a phase diffraction grating; and applying the phase diffraction grating over the surface of the color matrix display to alter a point spread function of each pixel.
22. A method for designing a diffraction grating optical reconstruction filter for a color matrix display comprising the steps:
providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors, said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise;
determining a lattice as defined by at least one primary color;
determining a spatial frequency pattern of the lattice by taking a Fourier Transform;
determining Nyquist boundaries by, circumscribing a region having a region shape by drawing a ray from a reference point to each nearest neighbour point, drawing a perpendicular bisector line at a midpoint of each ray, said rays together forming a collection of perpendicular bisectors, the region circumscribed being the maximum frequency capability of the color matrix display, the collection of perpendicular bisectors comprising the Nyquist boundaries;
selecting a one dimensional interpolation waveform;
making the one dimensional waveform into a two dimensional waveform by rotating the one dimensional waveform through two dimensions and adjusting relative extent of the one dimensional waveform in accordance with the shape of the region circumscribed by the Nyquist boundaries thereby defining a desired point spread function of the grating in combination with a human eye having an impact characteristic;
making the grating have the point spread function minus the impact of the human eye; and, placing the grating over the panel at a distance t from the panel.
providing a flat panel two-dimensional color matrix display having regular structures of color pixels of a plurality of primary colors, said flat panel display having an inherent underlying grid structure which results in objectionable visual artifacts in the display commonly referred to as sampling noise;
determining a lattice as defined by at least one primary color;
determining a spatial frequency pattern of the lattice by taking a Fourier Transform;
determining Nyquist boundaries by, circumscribing a region having a region shape by drawing a ray from a reference point to each nearest neighbour point, drawing a perpendicular bisector line at a midpoint of each ray, said rays together forming a collection of perpendicular bisectors, the region circumscribed being the maximum frequency capability of the color matrix display, the collection of perpendicular bisectors comprising the Nyquist boundaries;
selecting a one dimensional interpolation waveform;
making the one dimensional waveform into a two dimensional waveform by rotating the one dimensional waveform through two dimensions and adjusting relative extent of the one dimensional waveform in accordance with the shape of the region circumscribed by the Nyquist boundaries thereby defining a desired point spread function of the grating in combination with a human eye having an impact characteristic;
making the grating have the point spread function minus the impact of the human eye; and, placing the grating over the panel at a distance t from the panel.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US07/382,514 | 1989-07-20 | ||
| US07382514 US5046827C1 (en) | 1989-07-20 | 1989-07-20 | Optical reconstruction filter for color mosaic displays |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2020372A1 CA2020372A1 (en) | 1991-01-21 |
| CA2020372C true CA2020372C (en) | 2001-09-11 |
Family
ID=23509293
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002020372A Expired - Lifetime CA2020372C (en) | 1989-07-20 | 1990-07-04 | Optical reconstruction filter for color mosaic displays |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US5046827C1 (en) |
| EP (1) | EP0409188B1 (en) |
| JP (1) | JP3184978B2 (en) |
| KR (1) | KR100223380B1 (en) |
| CA (1) | CA2020372C (en) |
| DE (1) | DE69024120T2 (en) |
| FI (1) | FI903645A0 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7742124B2 (en) | 2001-04-20 | 2010-06-22 | Puredepth Limited | Optical retarder |
| US8146277B2 (en) | 2002-09-20 | 2012-04-03 | Puredepth Limited | Multi-view display |
| US8149353B2 (en) | 2001-10-11 | 2012-04-03 | Puredepth Limited | Visual display unit illumination |
| US8154691B2 (en) | 2000-11-17 | 2012-04-10 | Pure Depth Limited | Altering surfaces of display screens |
| US8416150B2 (en) | 2007-08-22 | 2013-04-09 | Igt | Method and system for determining a position for an interstital diffuser for use in a multi-layer display |
| US9137525B2 (en) | 2002-07-15 | 2015-09-15 | Pure Depth Limited | Multilayer video screen |
Families Citing this family (67)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5300942A (en) * | 1987-12-31 | 1994-04-05 | Projectavision Incorporated | High efficiency light valve projection system with decreased perception of spaces between pixels and/or hines |
| JPH03289692A (en) * | 1990-04-06 | 1991-12-19 | Matsushita Electric Ind Co Ltd | Spatial light modulation element and hologram image recording device using same |
| DE4132902C2 (en) * | 1991-10-04 | 2001-08-02 | Optrex Europ Gmbh | Liquid crystal display |
| US5864326A (en) * | 1992-02-07 | 1999-01-26 | I-O Display Systems Llc | Depixelated visual display |
| US5303085A (en) | 1992-02-07 | 1994-04-12 | Rallison Richard D | Optically corrected helmet mounted display |
| US6097543A (en) | 1992-02-07 | 2000-08-01 | I-O Display Systems Llc | Personal visual display |
| US6219015B1 (en) * | 1992-04-28 | 2001-04-17 | The Board Of Directors Of The Leland Stanford, Junior University | Method and apparatus for using an array of grating light valves to produce multicolor optical images |
| KR0120397B1 (en) * | 1992-04-28 | 1997-10-22 | 나카무라 히사오 | Image display apparatus |
| JP3506144B2 (en) * | 1992-10-19 | 2004-03-15 | ソニー株式会社 | Image display device and optical filter for display device |
| US5526022A (en) | 1993-01-06 | 1996-06-11 | Virtual I/O, Inc. | Sourceless orientation sensor |
| US5757544A (en) * | 1993-03-09 | 1998-05-26 | Olympus Optical Co., Ltd. | Image display apparatus |
| EP0618473A3 (en) * | 1993-03-31 | 1995-03-15 | Kuraray Co | Video device utilizing a two-dimensional diffraction grating. |
| DE69429209T2 (en) * | 1993-06-01 | 2002-06-27 | Sharp Kk | Image display device with back lighting |
| JPH07104276A (en) * | 1993-10-08 | 1995-04-21 | Olympus Optical Co Ltd | Liquid crystal display device |
| US5991087A (en) * | 1993-11-12 | 1999-11-23 | I-O Display System Llc | Non-orthogonal plate in a virtual reality or heads up display |
| AU7392794A (en) * | 1994-02-07 | 1995-08-21 | Virtual I/O, Inc. | Depixelated visual display |
| US6160666A (en) | 1994-02-07 | 2000-12-12 | I-O Display Systems Llc | Personal visual display system |
| US5629784A (en) * | 1994-04-12 | 1997-05-13 | Ois Optical Imaging Systems, Inc. | Liquid crystal display with holographic diffuser and prism sheet on viewer side |
| US5550663A (en) * | 1994-05-24 | 1996-08-27 | Omron Corporation | Method of manufacturing optical low-pass filter |
| JPH0821991A (en) * | 1994-07-08 | 1996-01-23 | Sony Corp | Picture display device |
| JPH08114770A (en) * | 1994-08-26 | 1996-05-07 | Omron Corp | Optical low-pass filter and dot matrix display device utilizing the same |
| EP0698804A3 (en) * | 1994-08-26 | 1998-09-02 | Omron Corporation | Optical low pass filter, polariser and liquid crystal display devices using such |
| US5755501A (en) * | 1994-08-31 | 1998-05-26 | Omron Corporation | Image display device and optical low-pass filter |
| US5903395A (en) | 1994-08-31 | 1999-05-11 | I-O Display Systems Llc | Personal visual display system |
| US5737042A (en) * | 1994-08-31 | 1998-04-07 | Omron Corporation | Image display device with optical low-pass filter |
| US6061110A (en) * | 1994-10-18 | 2000-05-09 | Kabushiki Kaisha Toshiba | Reflection type liquid crystal display device and method of manufacturing the same |
| WO1996022590A1 (en) * | 1995-01-18 | 1996-07-25 | Virtual I/O, Inc. | Speckle depixelator |
| DE19502727A1 (en) * | 1995-01-28 | 1996-08-01 | Heidenhain Gmbh Dr Johannes | Phase grating |
| US5682266A (en) * | 1995-04-05 | 1997-10-28 | Eastman Kodak Company | Blur filter for eliminating aliasing in electrically sampled images |
| US5991085A (en) | 1995-04-21 | 1999-11-23 | I-O Display Systems Llc | Head-mounted personal visual display apparatus with image generator and holder |
| JP2951264B2 (en) * | 1995-05-24 | 1999-09-20 | 三洋電機株式会社 | 2D / 3D video compatible video display |
| JP3268625B2 (en) * | 1995-08-11 | 2002-03-25 | シャープ株式会社 | 3D image display device |
| JP3464570B2 (en) * | 1995-08-21 | 2003-11-10 | 株式会社 日立ディスプレイズ | Color liquid crystal display device |
| USD383455S (en) * | 1995-08-31 | 1997-09-09 | Virtual I/O, Inc. | Head mounted display with headtracker |
| US5721598A (en) * | 1995-12-26 | 1998-02-24 | Hughes Electronics | High efficiency, high color purity, on-axis holographic color filter and full-color liquid crystal display |
| JPH11507144A (en) * | 1996-03-25 | 1999-06-22 | レインボー ディスプレイズ，インコーポレイティド | Tile type flat panel display with color correction capability |
| IL118057A0 (en) * | 1996-04-29 | 1996-09-12 | Patir Research And Dev Limited | Optical phase element |
| US5696371A (en) * | 1996-05-23 | 1997-12-09 | Eastman Kodak Company | Diffractive/refractive lenslet array |
| US5751492A (en) * | 1996-06-14 | 1998-05-12 | Eastman Kodak Company | Diffractive/Refractive lenslet array incorporating a second aspheric surface |
| GB2315902A (en) * | 1996-08-01 | 1998-02-11 | Sharp Kk | LIquid crystal device |
| JP3683397B2 (en) * | 1997-07-02 | 2005-08-17 | 富士写真フイルム株式会社 | Color image data interpolation method and apparatus |
| KR100262825B1 (en) * | 1997-08-13 | 2000-08-01 | 구자홍 | Projective display device |
| US5903396A (en) * | 1997-10-17 | 1999-05-11 | I/O Display Systems, Llc | Intensified visual display |
| US5963284A (en) * | 1998-04-01 | 1999-10-05 | Ois Optical Imaging Systems, Inc. | LCD with diffuser having diffusing particles therein located between polarizers |
| KR100765308B1 (en) * | 2001-03-17 | 2007-10-09 | 삼성전자주식회사 | Liquid crystal display device |
| US7253799B2 (en) * | 2001-06-30 | 2007-08-07 | Samsung Electronics Co., Ltd. | Backlight using planar hologram for flat display device |
| NZ514119A (en) | 2001-09-11 | 2004-06-25 | Deep Video Imaging Ltd | Improvement to instrumentation |
| US6636285B2 (en) | 2001-11-01 | 2003-10-21 | Motorola, Inc. | Reflective liquid crystal display with improved contrast |
| AU2003217081A1 (en) * | 2002-03-17 | 2003-09-29 | Gareth Paul Bell | Optimising point spread function of spatial filter |
| KR20040013753A (en) * | 2002-08-08 | 2004-02-14 | 삼성전자주식회사 | a panel and a liquid crystal display including the panel |
| JP4216577B2 (en) * | 2002-12-20 | 2009-01-28 | シチズン電子株式会社 | Light guide plate |
| NZ526028A (en) * | 2003-05-21 | 2006-02-24 | Pure Depth Ltd | Backlighting system for display screen utilised to control the distribution of power to at least one light source |
| US7414595B1 (en) | 2003-12-07 | 2008-08-19 | Advanced Simulation Displays Co. | Virtual mosaic wide field of view display system |
| EP2038734A4 (en) * | 2006-06-02 | 2009-09-09 | Samsung Electronics Co Ltd | High dynamic contrast display system having multiple segmented backlight |
| US20100033456A1 (en) * | 2007-05-14 | 2010-02-11 | Keisuke Yoshida | Display device and display method thereof |
| KR20090111583A (en) * | 2008-04-22 | 2009-10-27 | 삼성전자주식회사 | Display apparatus |
| JP5437886B2 (en) * | 2009-04-06 | 2014-03-12 | 日東電工株式会社 | Liquid crystal display device and polarizing plate with condensing element |
| TWI428666B (en) * | 2010-02-04 | 2014-03-01 | Innolux Corp | Liquid crystal panel module, backlight module and liquid crystal display |
| TWI551917B (en) * | 2010-02-04 | 2016-10-01 | 群創光電股份有限公司 | Liquid crystal panel module and liquid crystal display |
| JP2012247783A (en) * | 2011-05-30 | 2012-12-13 | Samsung Corning Precision Materials Co Ltd | Display device |
| TWI625570B (en) * | 2012-03-14 | 2018-06-01 | 奇美材料科技股份有限公司 | Liquid crystal displayer |
| KR102260184B1 (en) * | 2014-02-26 | 2021-06-04 | 삼성디스플레이 주식회사 | Cover window and display device having the same |
| WO2015191949A1 (en) * | 2014-06-13 | 2015-12-17 | 3M Innovative Properties Company | Optical stacks for sparkle reduction |
| AU2016235072A1 (en) | 2015-03-24 | 2017-10-19 | University Of Utah Research Foundation | Imaging device with image dispersing to create a spatially coded image |
| CN106959510A (en) * | 2016-01-08 | 2017-07-18 | 京东方科技集团股份有限公司 | A kind of display device and virtual reality glasses |
| KR102375975B1 (en) * | 2017-04-28 | 2022-03-17 | 삼성디스플레이 주식회사 | Display device, organic light emitting display device and head mount display device |
| CN108983529A (en) | 2018-08-01 | 2018-12-11 | 京东方科技集团股份有限公司 | Display panel |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB1290577A (en) * | 1970-02-24 | 1972-09-27 | ||
| US3957354A (en) * | 1975-02-03 | 1976-05-18 | Rca Corporation | Diffractive subtractive color filtering technique |
| US4105289A (en) * | 1976-04-29 | 1978-08-08 | University Patents, Inc. | Apparatus and method for image sampling |
| US4251137A (en) * | 1977-09-28 | 1981-02-17 | Rca Corporation | Tunable diffractive subtractive filter |
| US4389096A (en) * | 1977-12-27 | 1983-06-21 | Matsushita Electric Industrial Co., Ltd. | Image display apparatus of liquid crystal valve projection type |
| US4255019A (en) * | 1979-04-09 | 1981-03-10 | Rca Corporation | Diffractive color filter |
| US4397558A (en) * | 1981-03-02 | 1983-08-09 | The University Of Arizona Foundation | System for reducing the effects of background radiation |
| JPS59214825A (en) * | 1983-05-20 | 1984-12-04 | Sanyo Electric Co Ltd | Color display device |
| US4506949A (en) * | 1983-05-27 | 1985-03-26 | Rca Corporation | Diffractive color separation filter |
| JPS6174247A (en) * | 1984-09-18 | 1986-04-16 | Sony Corp | Color cathode-ray tube |
| DE3581498D1 (en) * | 1984-11-16 | 1991-02-28 | Matsushita Electric Ind Co Ltd | ACTIVE MATRIX CIRCUIT FOR LIQUID CRYSTAL DISPLAYS. |
| US4751509A (en) * | 1985-06-04 | 1988-06-14 | Nec Corporation | Light valve for use in a color display unit with a diffraction grating assembly included in the valve |
| JPS6255624A (en) * | 1985-09-03 | 1987-03-11 | Fujitsu Ltd | Liquid crystal display device |
| US4800375A (en) * | 1986-10-24 | 1989-01-24 | Honeywell Inc. | Four color repetitive sequence matrix array for flat panel displays |
| US4871232A (en) * | 1987-12-07 | 1989-10-03 | Hughes Aircraft Company | Method and apparatus for ultra high frequency spectrum analysis |
-
1989
- 1989-07-20 US US07382514 patent/US5046827C1/en not_active Expired - Lifetime
-
1990
- 1990-07-04 CA CA002020372A patent/CA2020372C/en not_active Expired - Lifetime
- 1990-07-18 DE DE69024120T patent/DE69024120T2/en not_active Expired - Lifetime
- 1990-07-18 EP EP90113727A patent/EP0409188B1/en not_active Expired - Lifetime
- 1990-07-19 KR KR1019900010943A patent/KR100223380B1/en not_active IP Right Cessation
- 1990-07-19 FI FI903645A patent/FI903645A0/en not_active Application Discontinuation
- 1990-07-20 JP JP19092690A patent/JP3184978B2/en not_active Expired - Fee Related
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8154691B2 (en) | 2000-11-17 | 2012-04-10 | Pure Depth Limited | Altering surfaces of display screens |
| US7742124B2 (en) | 2001-04-20 | 2010-06-22 | Puredepth Limited | Optical retarder |
| US8149353B2 (en) | 2001-10-11 | 2012-04-03 | Puredepth Limited | Visual display unit illumination |
| US8687149B2 (en) | 2001-10-11 | 2014-04-01 | Pure Depth Limited | Visual display unit illumination |
| US9137525B2 (en) | 2002-07-15 | 2015-09-15 | Pure Depth Limited | Multilayer video screen |
| US8146277B2 (en) | 2002-09-20 | 2012-04-03 | Puredepth Limited | Multi-view display |
| US8416150B2 (en) | 2007-08-22 | 2013-04-09 | Igt | Method and system for determining a position for an interstital diffuser for use in a multi-layer display |
Also Published As
| Publication number | Publication date |
|---|---|
| US5046827A (en) | 1991-09-10 |
| FI903645A0 (en) | 1990-07-19 |
| KR100223380B1 (en) | 1999-10-15 |
| DE69024120T2 (en) | 1996-07-25 |
| EP0409188A3 (en) | 1991-12-27 |
| JP3184978B2 (en) | 2001-07-09 |
| US5046827C1 (en) | 2001-08-07 |
| EP0409188B1 (en) | 1995-12-13 |
| EP0409188A2 (en) | 1991-01-23 |
| KR910003427A (en) | 1991-02-27 |
| CA2020372A1 (en) | 1991-01-21 |
| DE69024120D1 (en) | 1996-01-25 |
| JPH03148622A (en) | 1991-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2020372C (en) | Optical reconstruction filter for color mosaic displays | |
| US7742239B2 (en) | Method to control point spread function of an image | |
| US5751383A (en) | Image display device having a pixel multiplying means | |
| DE60103535T2 (en) | GRAPHICAL SYSTEM | |
| US20130222745A1 (en) | Liquid crystal display device comprising periodically changed permutations of at least two types of electrode-pattern pairs | |
| US5945967A (en) | Speckle depixelator | |
| JPH07168130A (en) | Optical filter | |
| CN115735080A (en) | Optical device for augmented reality display | |
| CN105551390A (en) | Display substrate and display device | |
| JP4724952B2 (en) | Prism array pattern | |
| JP3454371B2 (en) | Multiple display using diffraction grating assembly | |
| CN111427107B (en) | Diffraction optical element value model, diffraction optical element and manufacturing method thereof | |
| JPH08122709A (en) | Image display device and optical low-pass filter | |
| KR100863164B1 (en) | Light reflective structure, method for producing the same and display | |
| JP4334707B2 (en) | Image display device | |
| JP3178216B2 (en) | Display consisting of diffraction grating device | |
| JP3033404B2 (en) | Display with diffraction grating pattern | |
| US7123321B2 (en) | Color filter comprising unit patterns with varied densities and liquid crystal display device using the color filter, and their manufacturing methods | |
| JPH04177220A (en) | Color liquid crystal display device | |
| JPH0749489A (en) | Color dot matrix type display device | |
| JP2003043478A (en) | Liquid crystal display device | |
| JP2980706B2 (en) | Projection display device | |
| JP2883492B2 (en) | LCD projection viewfinder | |
| WO1996022590A1 (en) | Speckle depixelator | |
| CN116413944A (en) | Pixel adjusting method and optical filter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKEX | Expiry |