CA2163839A1 - Method and apparatus for mapping texture - Google Patents
Method and apparatus for mapping textureInfo
- Publication number
- CA2163839A1 CA2163839A1 CA002163839A CA2163839A CA2163839A1 CA 2163839 A1 CA2163839 A1 CA 2163839A1 CA 002163839 A CA002163839 A CA 002163839A CA 2163839 A CA2163839 A CA 2163839A CA 2163839 A1 CA2163839 A1 CA 2163839A1
- Authority
- CA
- Canada
- Prior art keywords
- image
- texture
- polygon
- transformation
- points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/40—Filling a planar surface by adding surface attributes, e.g. colour or texture
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4007—Interpolation-based scaling, e.g. bilinear interpolation
Abstract
In a real-time texture mapping system, a more solid and naturally-mapped image is obtained with a minimum of computation volume. The texture-mapping system adds a texture image to an area of a polygon which forms a fundamental unit of three-dimensional image information of an object to be displayed on a screen. A
geometry transfer engine (GTE) 61 extracts representing points from the polygonal area. Then, coordinates of the thus extracted representing points are subjected to the perspective transformation. Thereafter, the representing points, after the perspective transformation, are subjected to the linear interpolation in a graphic processing unit (GPU) 62 so that the image is formed.
geometry transfer engine (GTE) 61 extracts representing points from the polygonal area. Then, coordinates of the thus extracted representing points are subjected to the perspective transformation. Thereafter, the representing points, after the perspective transformation, are subjected to the linear interpolation in a graphic processing unit (GPU) 62 so that the image is formed.
Description
METHOD AND APPARATUS FOR MAPPING TEXTURE
BACKGROUND OF THE INVENTION
The present invention relates generally to texture mapping systems and, more particularly, to a new and improved method and apparatus for mapping texture which creates an image through a technique of texture mapping in an instrument using computer graphics such as video game apparatus, graphic computers and like instruments.
Heretofore, in home TV game apparatus, personal computers, graphic computers and the like, an image generating unit has been used to create data of an image being outputted and displayed, i.e., displayed output image data appearing in TV receivers, monitor receivers, or CRT display units and the like. In such image generating units, there is provided an exclusive image-formation unit between a CPU and a frame buffer so as to realize high-speed processing.
In the image generating unit described above, the CPU does not directly access the frame buffer, but issues an image-formation instruction to the image-formation unit to prepare a fundamental figure, such as fundamental triangles and quadrangles. Then, the image-formation unit interprets the instruction issued from the CPU to form an image in the frame buffer. A
minimum unit of a figure treated in the image-formation unit is referred to as a polygon or primitive. An instruction to form such a primitive image is referred to as an image-formation instruction.
216383~
For example, if a three-dimensional object OB
is displayed, the object OB may be divided into three parts, each part constituting a primitive and the CPU
issues necessary image-formation instructions corresponding to each of those primitives to the image-formation unit.
Next, in order to enhance similarity between the thus formed image and the object, a so-called technique of texture mapping is frequently employed in the data processing.
Texture mapping is a technique for adding a surface texture pattern to a surface of the polygon forming the object, the texture pattern being a two-dimensional image independently prepared as a texture source image as shown.
A known technique of high-speed texture mapping with a minimum circuit size is a so-called linear transformation. In the linear transformation, coordinates B (u, v) of the texture source image corresponding to a point A (x, y) within the polygon are calculated as follows:
u = a x + b y v = c x + d y where each of a, b, c and d is a constant depending on a shape of the polygon. In texture mapping using the linear transformation, mapping or transformation to a shape other than parallelograms causes a diagonal image deformation.
Another known technique of texture mapping for releasing the image from such diagonal image deformation due to the linear transformation is a quadratic transformation. In this quadratic transformation, the coordinates B (u, v) of the texture source image 21638~g corresponding to the point A (x, y) within the polygon are calculated as follows:
u = a x + b x y + c y v = d x + e x y + f y where each of a, b, c, d, e and f is a constant depending on a shape of the polygon. Although this technique of texture mapping using the quadratic transformation is larger in computational volume than that of texture mapping using the linear transformation, it is capable of providing a naturally mapped image.
However, even this technique of texture mapping using the quadratic transformation can not make the image look solid. In this regard, the image fails to provide a perspective view in depth, i.e., in a direction perpendicular to the paper.
An additional known technique for completely solving the above problem is a so-called perspective transformation. In the perspective transformation, the coordinates B (u, v) of the texture source image corresponding to a point A (x, y, z) within the polygon are calculated as follows:
u = (a x + b y) / z v = (c x + d y) / z where each of a, b, c and d is a constant depending on a shape of the polygon. As is clear from the above, in calculation of the texture mapping using the perspective transformation, there is required depth information (z) before the polygon is projected onto a computer screen.
Further, in this calculation, there is additionally required a division process for each of the points to be subjected to the texture mapping. Although this perspective transformation is not realistic in real-time systems, it is capable of preparing a very naturally mapped solid image.
216383~
In the texture mapping using the linear transformation described above, when mapping or transformation to a shape other than parallelograms is performed, the diagonal image deformation occurs. This is a problem inherent in the linear transformation.
Further, in the texture mapping using the quadratic transformation, it is possible to obtain a naturally mapped image. However, the thus obtained image fails to provide a perspective view in depth, i.e., in a direction perpendicular to the paper. This is a problem inherent in the quadratic transformation.
In the texture mapping using the perspective transformation described above, it is possible to obtain a very naturally mapped solid image. However, in calculation of the texture mapping using the perspective transformation, there is required depth information (z) before the polygon is projected onto a computer screen.
Further, in this calculation, there is additionally required a division process for each of the points to be subjected to the texture mapping. Consequently, the perspective transformation is not realistic in real-time systems. This is a problem inherent in the perspective transformation.
Accordingly, there has been a long existing need for enhanced image processing providing for simplified texture mapping transformation with reduced image distortion and minimal required calculation. The present invention clearly fulfills these needs.
SUMMARY OF THE INVENTION
Briefly, and in general terms, the present invention provides enhanced real-time texture mapping 2163~
which produces a naturally-mapped realistic or solid image with a minimum calculation volume.
In accordance with the invention, by way of example and not necessarily by way of limitation, there is provided a new and improved method and apparatus for mapping texture, i.e., adding a texture image to a polygonal area forming a fundamental unit of information as to a three-dimensional image of an object to be graphically displayed, which includes a representative or representing point extracting means for extracting a representative or representing point from the polygonal area, a perspective-transformation means for performing a perspective transformation of the coordinates of the representing point having been extracted through the representing-point extracting means, and a linear-interpolation means for performing a linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means, so that the image information, in which the texture image is added to the polygonal area, is obtained as an interpolation output issued from the linear-interpolation means.
In the system of the present invention for performing the texture mapping, the representing-point extracting means extracts the representing points, the number of which varies in accordance with the size of the polygonal area.
In accordance with the present invention for performing the texture mapping, the representative or representing point is extracted by the representing point extracting means from an area of the polygonal shape forming a fundamental unit of three-dimensional image information, the information being provided for construction of an object to be displayed, coordinates of the thus extracted point are subjected to the perspective transformation through the perspective transformation means, and the linear interpolation between the representing points having been subjected to the S perspective transformation through the perspective-transformation means is then performed.
The representing point extracting means extracts the representing points, and the number of these points varies in accordance with the size of the polygonal area.
Hence, the present invention satisfies a long existing need for enhanced image processing providing for simplified texture mapping transformation with reduced image distortion and minimal required calculation.
These and other objects and advantages of the invention will become apparent from the following more detailed description, when taken in conjunction with the accompanying drawings of illustrative embodiments.
DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram of the overall system of a video game apparatus according to the present invention;
Fig. 2 is a schematic diagram illustrating an example of the texture pattern to be mapped on a polygon;
Fig. 3 is a view illustrating the contents of an image-formation instruction of a quadrangle to which the texture mapping is applied;
Fig. 4 is a flow chart illustrating the processing procedure of the image of one frame in the video game apparatus of Figs. 1-3;
Fig. 5 is a view illustrating the representing point in the processing of the image of the one frame;
216383~
Fig. 6 is a view illustrating the image-formation list prepared in the processing of the image of the one frame;
Fig. 7 is a view illustrating the texture pixel determined by executing the linear interpolation in the processing of the image of the one frame;
Fig. 8 is a view illustrating the results of the image formation on the frame buffer in the processing of the image of the one frame;
Fig. 9 is a view illustrating the switching conditions of the frame buffers conducted by the GPU in the video game apparatus referred to above;
Fig. 10 is a view illustrating the manner in which the size of the display area is specified in the video game apparatus referred to above;
Fig. 11 is a view illustrating the spline image-formation operation in the video game apparatus referred to above;
Fig. 12 is a view illustrating one of the texture pages in the video game apparatus referred to above;
Figs. 13(A) and 13(B) are views illustrating the image-formation operation in the video game apparatus referred to above;
Fig. 14 is a view illustrating the texture-mapping operation in the video game apparatus referred to above;
Fig. 15 is a view illustrating the texture pattern; and Figs. 16(A)-16(C) are views illustration the results of the texture mapping in video game apparatus referred to above.
216383~
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Referring now to the drawings, like reference numerals denote like or corresponding parts throughout the drawing figures.
As shown in Fig. 13(A), if a three-dimensional object OB is displayed, as shown in Fig. 13(B), the object OB is divided into three parts, i.e., primitives Pa, Pb and Pc, and the CPU issues necessary image-formation instructions corresponding to the primitives Pa, Pb, Pc to the image-formation unit.
At this time, in order to improve similarity between the thus formed image and the object, a technique of texture mapping is frequently employed.
As previously indicated, the texture mapping is a technique for adding a surface texture pattern Tx to a surface of the polygon forming the object, the texture pattern Tx being a two-dimensional image independently prepared as a texture source image as will be observed in Fig. 14. In Fig. 14, there is shown an example of texture mapping applied to the surface of the object OB
from Fig. 13(A).
A known technique of high-speed texture mapping with a minimum circuit size is a so-called linear transformation. In the linear transformation, coordinates B (u, v) of the texture source image corresponding to a point A (x, y) within the polygon are calculated as follows:
u = a x + b y v = c x + d y where each of a, b, c and d is a constant depending on a shape of the polygon. In texture mapping using the linear transformation, for example, as shown in Fig.15, 2163~3~
if a diced texture patter Tx is added to a surface of the polygon, an example of such mapping is shown in Fig.
16(A). As is clear from this example, mapping or transformation to a shape other than parallelograms causes a diagonal image deformation.
Another known technique of texture mapping for releasing the image from such diagonal image deformation due to the linear transformation is a quadratic transformation. In this quadratic transformation, the coordinates B (u, v) of the texture source image corresponding to the point A (x, y) within the polygon are calculated as follows:
u = a x + b x y + c y v = d x + e x y + f y where each of a, b, c, d, e and f is a constant depending on a shape of the polygon. Although this technique of texture mapping using the quadratic transformation is larger in computational volume than that of texture mapping using the linear transformation, it is capable of providing a naturally mapped image, as shown in Fig. 16(B). However, even the technique of texture mapping using the quadratic transformation can not make the image look solid, i.e., the image shown in Fig. 16(B) fails to provide a perspective view in depth, i.e., in a direction perpendicular to the paper.
A further technique for completely solving the above problem is a so-called perspective transformation.
In the perspective transformation, the coordinates B (u, v) of the texture source image corresponding to a point0 A (x, y, z) within the polygon are calculated as follows:
u = (a x + b y) / z v = (c x + d y) / z where each of a, b, c and d is a constant depending on a shape of the polygon. As is clear from the above, in calculation of the texture mapping using the perspective 21G3~3~
transformation, there is required depth information (z) before the polygon is projected onto a computer screen.
Further, in this calculation, there is additionally required a division process for each of the points to be subjected to the texture mapping. Although this perspective transformation is not realistic in real-time systems, it is capable of preparing a very naturally mapped solid image as shown in Fig. 16(C).
In accordance with the invention, there is provided a new and improved method and apparatus for mapping texture, i.e., adding a texture image to a polygonal area forming a fundamental unit of information as to a three-dimensional image of an object to be graphically displayed, which includes a representative or representing point extracting means for extracting a representative or representing point from the polygonal area, a perspective-transformation means for performing a perspective transformation of the coordinates of the representing point having been extracted through the representing-point extracting means, and a linear-interpolation means for performing a linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means, so that the image information, in which the texture image is added to the polygonal area, is obtained as an interpolation output issued from the linear-interpolation means.
In the system of the present invention for performing the texture mapping, the representing-point extracting means extracts the representing points, the number of which varies in accordance with the size of the polygonal area.
In accordance with the present invention for performing the texture mapping, the representative or 2163~39 representing point is extracted by the representing point extracting means from an area of the polygonal shape forming a fundamental unit of three-dimensional image information, the information being provided for construction of an object to be displayed, coordinates of the thus extracted point are subjected to the perspective transformation through the perspective transformation means, and the linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means is then performed.
The representing point extracting means extracts the representing points, and the number of these points varies in accordance with the size of the polygonal area.
An embodiment of the method and apparatus of the present invention for performing the texture mapping is next described.
Referring now more particularly to Fig. 1, the system of the present invention for performing the texture mapping is applied to a video game apparatus.
In this video game apparatus, a game is performed by retrieving and executing a game program stored in an auxiliary memory, such as optical disks and the like, in accordance with a user's instruction. The game apparatus has the overall system arrangement shown in Fig. 1.
This video game system includes: a control system 50 comprising a central processing unit (i.e., CPU
51) and its peripheral devices; a graphic system 60 comprising a graphic processing unit (i.e., GPU 62) for forming an image in a frame buffer 63, a sound system 70 216~83~
comprising a sound processing unit (i.e., an SPU); an optical-disk control subsystem 80 for controlling an optical disk forming an auxiliary memory, a communication control subsystem 90 for controlling both an input instruction issued from a controller operated by a user and an input/output signal issued from the auxiliary memory which stores the initial setting data of the game, and a bus 100 connected to the above components 50, 60, 70, 80, and 90.
The control system 50 is provided with the CPU
51, a peripheral-device controller 52 for performing necessary controls such as interrupt control, direct-memory access transfer control and like controls, a main memory 53 comprising a random access memory (i.e., RAM), and a read only memory (i.e., ROM 54) storing a program such as a so-called operating system and like programs for controlling the main memory 53, graphic system 60, sound system 70 and like systems. The CPU 51 executes the operating system stored in the ROM 54 to control the entire computer system, and typically comprises a 32-bit RISC CPU.
When a power switch of the video game system shown in Fig. 1 is turned on, the CPU 51 of the control system 50 executes the operating system stored in the ROM
54 to control the graphic system 60, sound system 70 and like systems. When the operating system is executed, the CPU 51 initializes the entire computer system to do its performance check, and thereafter controls the optical-disk control subsystem 80 to execute a game program or the like stored in the optical disk. By executing the game, the CPU 51 controls the graphic system 60, sound system 70 and like systems in accordance with an instruction inputted by the user, so as to control an image in a display, sound effects and musical sounds in production.
` - 2163~39 The graphic system 60 is provided with a geometry transfer engine (i.e., GTE 61) for performing a coordinate transformation and like processing, a GPU 62 for forming an image according to an image-formation S instruction issued from the CPU S1, a frame buffer 63 for storing the image thus formed by the CPU 62, and, an image decoder 64 for decoding an image data, the image data having been compressed and encoded through a so-called orthogonal transformation, such as the well known discrete-cosine transformation and like transformations.
Upon receipt of an instruction or demand for computation issued from the CPU S1, the GTE 61 employs its parallel computing mechanism for executing a lS plurality of computations in parallel with each other and is capable of performing computations at high speed, which computations are of coordinate transformations, of light sources, of matrixes, or of vectors. More specifically, for example, in computation for realizing a so-called flat shading through which an image is formed into a triangular polygon with a single color, the GTE 61 executes computations of the coordinates at a maximum rate of approximately one and a half million polygons (l,S00,000) per second, which enables the CPU S1 in the video game apparatus to reduce its load and permits the system to execute computations of the polygon's coordinates at high speed.
Further, in accordance with an image-formation instruction issued from the CPU 51, the GPU 62 forms an image of the polygon and like shapes in the frame buffer 63. This GPU 62 is capable of forming up to three hundred and sixty thousand images of polygons per second.
In the aforementioned embodiment, the CPU S1 has a series of image-formation instructions for 2163~39 generating single frame images in the main memory 53.
These instructions are provided with their own addresses which identify the image-formation instructions to be executed. A controller 52 is provided for controlling the peripheral devices. This is a DMA controller which transfers the image-formation instructions from the main memory 53 to the CPU 62. Then, the CPU 62 executes the image-formation instructions issued from the DMA
controller to obtain results which are then stored in the frame buffer 63. The DMA controller finds and executes a subsequent instruction by means of its address, after completion of transfer of one image-formation instruction.
As shown in Fig. 2, if a diced texture pattern Tx is mapped or transformed into a trapezoidal polygon PG
in image formation, an image-formation instruction "A"
for performing such texture mapping of a quadrangle ABCD
in image formation is provided as shown in Fig. 3.
In this regard, described first in image formation are a plurality of vertex coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC) of the quadrangle ABDC an image of which is formed, and a plurality of texture coordinates (UA, VA), (UB, VB), (UD, VD), (UC, VC) corresponding to such vertex coordinates. When a series of image-formation instructions described above is executed, the GPU 62 forms an image of the polygon on the frame buffer 63, the image having been modified by the texture mapping through a linear transformation.
In this embodiment, for example, as shown in a flow chart of Fig. 4, the processing for forming the image-of a single frame comprises a step S1 in which a transformation matrix is obtained. Then, in a subsequent step S2, when the image-formation instruction "A" and depth coordinates (ZA, ZB, ZD, ZC) in the instruction are 2163~3~
given, each of the vertex coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC) is subjected to perspective transformation.
In a step S3, sizes (delta X, delta Y) after completion of the perspective transformation are calculated based on the vertex coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC). As a result, in step S4, for example, as shown in Fig. 5, the number of the representing points Pn and its locations are determined.
As described above, by adequately varying the representing points Pn in number, it is possible to optimize a computation volume in the CPU.
In a subsequent set S5, it is judged whether or not the number of the representing points is more than one. When the number of the representing points is more than one, the step S5 is followed by a subsequent step S6 in which the vertex coordinates (xn, yn) corresponding to coordinates (UPn, VPn) of the representing points Pn are determined through the perspective transformation.
Then, in a step S7, the quadrangle ABCD is divided into four small quadrangles APOP2P1, POBP3P2, PlP2P4C and P2P3DP4, each of which uses its representing points as its vertices, so that a series of respective image-formation instructions B0 to B4 are generated. In other words, previously calculated values or coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC) and (UA, VA), (UB, VB), (UD, VD), (UC, VC) are set as the vertex coordinates and the texture coordinates of each of sub-image formation instructions Bn.
It should be noted that, when the number of the representing points determined in the step S4 is one in the step S5, the step S5 is followed by a step S8 in 2163~9 which an image-formation instruction is immediately prepared.
In a subsequent step S9 following the step S8, as shown in Fig. 6, an image-formation instruction list is prepared by setting an address of a series of the sub-image formation instructions Bn in a tag of a series of the sub-image formation instructions Bn-1, and the thus prepared list is replaced with the original image-formation instruction "A".
Then, in a step S10 following the step S9, it is judged whether or not the processing is completed as to all of the polygons. When some one of the polygons remains unprocessed, the processing procedure returns to the step S2, i.e., the step S10 is followed by the step S2 in which additional perspective transformation of such remaining polygon's vertices is conducted.
On the other hand, in the step S10, when it is found that no polygon remains unprocessed, the step S10 is followed by a step S11 in which the processing procedure waits for completion of image formation in a preceding frame. The step S11 is followed by a step S12 in which the processing procedure commences to form the images from the top of the list.
As shown in Fig. 7, the GPU 62 determines a texture pixel other than the above-described representing points by performing a linear interpolation between the representing points having been subjected to the perspective transformation, so that the image is formed in the frame buffer 63, as shown in Fig. 8.
As described above, the computation follows the processing procedure of the flow chart shown in Fig. 4, where the representing points are extracted from the 2163~39 polygons, each of which is used as a fundamental unit of three-dimensional image information forming an object to be displayed, the thus extracted representing points have their coordinates subjected to the perspective 5 transformation, and the linear interpolation is conducted between such representing points having been subjected to the perspective transformation. This considerably reduces the required computation volume and is capable of producing a real-time solid and naturally mapped image.
In the aforedescribed embodiment of the invention, the frame buffer 63 is constructed of a so-called dual-port RAM, and is capable of simultaneously performing image formation based on the instruction issued from the GPU 62, transfers from the main memory, 15 and a data retrieving operation for display. A typical capacity of the frame buffer 63 is 1 MB which is capable of providing a 16-bit matrix having a size of 1024 (Horizontal) x 512 (Vertical) pixels. Furthermore, the frame buffer 63, in addition to the video-output display 20 area is also provided with a CLUT area for storing a color look up table (CLUT) which the GPU 62 refers to in image formation of the polygons, and a texture area for storing a texture to be mapped or transformed into the polygons which have their images formed by the GPU 62 25 after completion of the coordinate transformation. Both the CLUT area and the texture area are dynamically modified as the display area is modified.
In addition, as shown in Fig. 9, the GPU 62 provides a pair of square-shaped areas "A", "B", and 30 forms the image on one of the "B" areas while having the contents of the other "A" area displayed. After completion of the image formation, the square-shaped areas "A", "B" are replaced during the period of time of a vertical retrace so as to prevent rewriting operations 35 from being displayed.
21~3~39 Moreover, the GPU 62 is capable of providing, in addition to the above-described flat shading, a Gouraud shading for determining a color of the polygon by performing interpolation based on colors of the vertices of the polygons, and a texture mapping for adding a texture stored in the texture area to the polygons. In each of the Gouraud shading and the texture mapping, the GTE 61 is capable of computing up to approximately five hundred thousand of the polygon's coordinates per second.
Further, the GPU 62 supports ten frame modes shown in the following Table 1 when it issues the contents of a desired one of the square-shaped areas of the frame buffer 63 as its video output.
TABLE 1: FRAME RESOLUTION
Mode Standard Resolution Remarks Mode 0 256(H) x 240(V) Non-interlacing Mode 1 320 x 240 Mode 2 512 x 240 Mode 3 640 x 480 Mod 4 256 x 480 Interlacing Mode 5 320 x 480 Mode 6 512 x 480 Mode 7 640 x 480 Mode 8 384 x 240 Non-interlacing Mode 9 384 x 240 Interlacing In addition, the frame size, i.e., the number of the pixels arranged on a CRT screen is variable. As shown in Fig. 10, the display area of the screen can be specified by determining therein both a display beginning position with coordinates (DTX, DTY), and a display ending position with coordinates (DBX, DBY).
Moreover, the GPU 62 supports display-color modes comprising: a 16-bit mode with a 32,768-color 2163~3~
display; and, a 24-bit mode with a 16,777,216-color display.
Still further, in image-formation function, the GPU 62 also supports a so-called spline image-formation function with a frame size of from 1 (H: Horizontal) x 1 (V: Vertical) to 256 (H) x 256 (V) dots, the number of the dots being arbitrarily selected.
In this connection, as shown in Fig. 11, an image data or spline pattern being added to a spline is transferred to the frame buffer before execution of an image-formation command, and is stored in a non-display area of the frame buffer.
It is possible to store any desired number of the spline patterns in the frame buffer as long as its capacity permits. In this regard, one page (i.e., texture page) has a size of 256 x 256 pixels.
As shown in Fig. 12, a size of the one texture page varies depending on the type of the mode. Further, as shown in Fig. 11, a location of the texture page in the frame buffer is determined by specifying a page number of a parameter called TSB in the image-formation command.
In the spline patterns, there are three types of color modes including a 4-bit CLUT mode, a 8-bit CLUT
mode, and a 16-bit DIRECT mode.
In the 4-bit CLUT mode, a 16-color spline image formation is realized by using the CLUT. On the other hand, in a 8-bit CLUT mode, a 256-color spline image formation is realized by using the CLUT. Still further, in a 16-bit DIRECT mode, a 32,768-color spline image 2163~3~
formation is realized by directly using the 16-bit system.
In the spline pattern in both the 4-bit CLUT
mode and the 8-bit CLUT mode, a color of each of the pixels is represented by a specific number which specifies one of the RGB values of the CLUT disposed on the frame buffer, the number of the RGB values being within a range of from 16 to 256. It is possible to specify the CLUT in spline units. Further, it is also possible to provide a separate CLUT for any spline.
The image decoder 64 is controlled by the CPU
51 to decode the image data of still pictures or moving pictures which have been stored in the main memory 53, and the thus decoded data is stored in the main memory 53.
Such reproduced image data is stored in the frame buffer 63 through the GPU 62, which makes it possible to use the reproduced image data as a background of a picture produced by the GPU 62.
The sound system 70 comprises a sound processing unit (SPU) 71 which generates musical sounds, sound effects and the like upon receipt of an instruction issued from the CPU 51, a sound buffer 72 which is controlled by the SPU 71 to store a sound-wave data and like data therein, and a loudspeaker 73 for outputting the musical sounds, sound effects and the like generated by the SPU 71.
The SPU 71 is provided with an ADPCM decoding function for reproducing a sound data, the sound data being 16-bit sound data composed of 4-bit differential signals which have been subjected to processing of adaptive differential PCM (ADPCM), a reproducing function 2163~39 for generating the sound effects and the like by reproducing the sound-wave data stored in the sound buffer 72, and a modulator function for modulating the sound-wave data stored in the sound buffer 72 to reproduce the thus modulated sounds.
With the provisions of such functions, the sound system 70 is capable of being used as a so-called sampling sound source for generating musical sounds, sound effects and the like, based on the wave-data stored in the sound buffer 72 when it receives an instruction issued from the CPU 51.
The optical-disk control subsystem portion 80 comprises an optical-disk unit 81 for reproducing a program, data and the like stored in an optical disk, a decoder 82 for decoding a program, data and the like having been provided with, for example, an error correction code (ECC), a memory buffer 83 which temporarily stores reproduced data issued from the optical-disk unit 81 to facilitate retrieving of such data from the optical disk, and a sub-CPU 84 for control.
As with sound data stored in the optical disk used in the optical-disk unit 81, in addition to the ADPCM data, there is so-called PCM data which is a sound signal which has been subjected to an analog-to-digital conversion.
Sound data stored as the ADPCM data (in which a difference, for example, in 16-bit digital data is represented as a 4-bit word and stored in this word) is decoded in the decoder 82, then supplied to the SPU 71 in which the supplied data is subjected to the analog-to-digital conversion, and thereafter used to drive the loudspeaker 73. Further, sound data stored as the PCM data (which is stored, for example, as a 16-bit 216~8~9 digital data) is also decoded in the decoder 82, and then used to drive the loudspeaker 73.
The communication control subsystem 90 is provided with a communication control unit 91 for controlling communications with the CPU 51 through a bus 100. Provided in the communication control unit 91 are a slot 93 connected with the controller 92 through which the user inputs his instruction, and a pair of card connectors 95A and 95B to which a pair of memory cards 94A and 94B for storing the game's setting data and the like data are connected, respectively.
The controller 92 connected with the slot 93 for receiving the user's instruction is provided with, for example, 16 control keys. Upon receipt of an instruction issued from the communication control unit 91, the controller 92 supplies data of the control key's conditions to the CPU 51 through synchronous communication, sixty times a second. The communication control unit 91 issues the data of the control key's conditions from the controller 92 to the CPU 51. As a result, the user's instruction is inputted to the CPU 51, so that the CPU 51 executes a necessary operation according to the user's instruction.
In addition, when the setting data of the game operated by the CPU 51 must be stored, the CPU 51 issues such data being stored to the communication control unit 91. Then, the unit 91 stores the data in one of the memory cards 93A and 93B which are connected with the card connectors 95A and 95B, respectively.
Further, incorporated in the communication control unit 91 is a protective circuit to prevent electrical failures. The memory cards 93A, 93B are separated from the bus 100. Consequently, the memory 216:~839 cards 93A, 93B are capable of being mounted and dismounted in a condition in which the power switch of the main unit is turned on. Therefore, when the memory lacks capacity, it is possible to mount a new one of the cards without turning off the power switch of the main unit. Consequently, there is no fear that necessary game data may be lost. Hence, it is possible to store such necessary game data in the new one of the memory cards being mounted.
Each of the memory cards 93A, 93B is constructed of a flash memory which permits random access, requires no backup power source, and has a microcomputer incorporated therein. When the memory cards 93A, 93B are connected with the card connectors 95A, 95B, electric power is supplied from the main unit to the microcomputer through the card connectors.
The memory cards 93A, 93B are recognized as file devices by an application, the file devices being identified by the use of hexadecimal numbers with two figures, such numbers specifying both the ports and the card connectors. Each of the memory cards 93A, 93B has an automatic initializing function which is performed when a file is opened.
When the memory cards 93A, 93B are connected with the card connectors 95A, 95B so that the main unit supplies electric power to these memory cards, the microcomputer initially sets an internal state of each of the memory cards at a "no-communication" state, and thereafter establishes communications with the memory cards through the communication control unit 91.
On the basis of a field representing an "internal state" in a response packet for confirmation of connection between the memory cards and the host in 2163~33 communication protocol, the CPU 51 in the main unit side tests an internal state of the microcomputer incorporated in each of the memory cards 93A, 93B which have been connected with the card connectors 95A, 95B. In the case of the "no communication" state, a new one of the memory cards 93A, 93B is recognized to be communicated, so that file control data relative to the new one of the memory cards 93A, 93B, for example, information as to file names, file sizes, slot numbers and the like, together with status information, are retrieved.
By means of such a communication protocol, it is possible to establish communications permitting the memory cards 93A, 93B to be dismounted as needed.
As a result, it is possible to store the game setting data in the pair of the memory cards 93A, 93B.
Further, it is also possible to directly copy the data stored in the pair of the memory cards 93A, 93B and to directly transfer various data from the pair of the memory cards 93A, 93B to the main unit at the same time.
Since each of the memory cards 93A, 93B is constructed of a flash memory which is randomly accessible and requires no backup power supply, it is possible for the memory cards 93A, 93B to store the data for a substantially indefinite period of time.
Further, this video game apparatus is provided with a parallel input/output (PIO) 101 and a serial input/output (SIO) 102, both of which are connected with the bus 100.
The video game apparatus is capable of communicating with the peripheral devices through the parallel inputtoutput (PIO) 101, and also capable of 2163~39 communicating with other video game apparatuses through the serial input/output (SIO) 102.
As described above, in the texture mapping method and apparatus of the present invention, a representing-point extracting means extracts a representing point from an area of a polygon which forms a fundamental unit of three-dimensional image information of an object to be displayed on the computer screen, a perspective transformation means performs a perspective transformation of the coordinates of the representing point having been extracted by the representing-point extracting means, and a linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means is performed. Consequently,regarding computation volume, the texture mapping apparatus of the present invention has considerably less requirements in comparison to the conventional apparatus in which all the points within the polygonal area are subjected to the perspective transformation. Therefore, it is possible for the texture mapping apparatus of the present invention to realize a real-time solid naturally-mapped image on the computer screen.
Furthermore, in the texture mapping apparatus of the present invention, the representing-point extracting means extracts the representing points which varies in number in accordance with the size of the polygonal area, and which optimizes the computation volume to make it possible to obtain a solid and naturally-mapped image on the computer screen.
Hence, the present invention satisfies a long existing need for enhanced image processing providing for simplified texture mapping transformation with reduced image distortion and minimal required calculation.
21~383g It will be apparent from the foregoing that, while particular forms of the invention have been illustrated and described, various modifications can be made without departing from the spirit and scope of the invention. Accordingly, it is not intended that the invention be limited, except as by the appended claims.
BACKGROUND OF THE INVENTION
The present invention relates generally to texture mapping systems and, more particularly, to a new and improved method and apparatus for mapping texture which creates an image through a technique of texture mapping in an instrument using computer graphics such as video game apparatus, graphic computers and like instruments.
Heretofore, in home TV game apparatus, personal computers, graphic computers and the like, an image generating unit has been used to create data of an image being outputted and displayed, i.e., displayed output image data appearing in TV receivers, monitor receivers, or CRT display units and the like. In such image generating units, there is provided an exclusive image-formation unit between a CPU and a frame buffer so as to realize high-speed processing.
In the image generating unit described above, the CPU does not directly access the frame buffer, but issues an image-formation instruction to the image-formation unit to prepare a fundamental figure, such as fundamental triangles and quadrangles. Then, the image-formation unit interprets the instruction issued from the CPU to form an image in the frame buffer. A
minimum unit of a figure treated in the image-formation unit is referred to as a polygon or primitive. An instruction to form such a primitive image is referred to as an image-formation instruction.
216383~
For example, if a three-dimensional object OB
is displayed, the object OB may be divided into three parts, each part constituting a primitive and the CPU
issues necessary image-formation instructions corresponding to each of those primitives to the image-formation unit.
Next, in order to enhance similarity between the thus formed image and the object, a so-called technique of texture mapping is frequently employed in the data processing.
Texture mapping is a technique for adding a surface texture pattern to a surface of the polygon forming the object, the texture pattern being a two-dimensional image independently prepared as a texture source image as shown.
A known technique of high-speed texture mapping with a minimum circuit size is a so-called linear transformation. In the linear transformation, coordinates B (u, v) of the texture source image corresponding to a point A (x, y) within the polygon are calculated as follows:
u = a x + b y v = c x + d y where each of a, b, c and d is a constant depending on a shape of the polygon. In texture mapping using the linear transformation, mapping or transformation to a shape other than parallelograms causes a diagonal image deformation.
Another known technique of texture mapping for releasing the image from such diagonal image deformation due to the linear transformation is a quadratic transformation. In this quadratic transformation, the coordinates B (u, v) of the texture source image 21638~g corresponding to the point A (x, y) within the polygon are calculated as follows:
u = a x + b x y + c y v = d x + e x y + f y where each of a, b, c, d, e and f is a constant depending on a shape of the polygon. Although this technique of texture mapping using the quadratic transformation is larger in computational volume than that of texture mapping using the linear transformation, it is capable of providing a naturally mapped image.
However, even this technique of texture mapping using the quadratic transformation can not make the image look solid. In this regard, the image fails to provide a perspective view in depth, i.e., in a direction perpendicular to the paper.
An additional known technique for completely solving the above problem is a so-called perspective transformation. In the perspective transformation, the coordinates B (u, v) of the texture source image corresponding to a point A (x, y, z) within the polygon are calculated as follows:
u = (a x + b y) / z v = (c x + d y) / z where each of a, b, c and d is a constant depending on a shape of the polygon. As is clear from the above, in calculation of the texture mapping using the perspective transformation, there is required depth information (z) before the polygon is projected onto a computer screen.
Further, in this calculation, there is additionally required a division process for each of the points to be subjected to the texture mapping. Although this perspective transformation is not realistic in real-time systems, it is capable of preparing a very naturally mapped solid image.
216383~
In the texture mapping using the linear transformation described above, when mapping or transformation to a shape other than parallelograms is performed, the diagonal image deformation occurs. This is a problem inherent in the linear transformation.
Further, in the texture mapping using the quadratic transformation, it is possible to obtain a naturally mapped image. However, the thus obtained image fails to provide a perspective view in depth, i.e., in a direction perpendicular to the paper. This is a problem inherent in the quadratic transformation.
In the texture mapping using the perspective transformation described above, it is possible to obtain a very naturally mapped solid image. However, in calculation of the texture mapping using the perspective transformation, there is required depth information (z) before the polygon is projected onto a computer screen.
Further, in this calculation, there is additionally required a division process for each of the points to be subjected to the texture mapping. Consequently, the perspective transformation is not realistic in real-time systems. This is a problem inherent in the perspective transformation.
Accordingly, there has been a long existing need for enhanced image processing providing for simplified texture mapping transformation with reduced image distortion and minimal required calculation. The present invention clearly fulfills these needs.
SUMMARY OF THE INVENTION
Briefly, and in general terms, the present invention provides enhanced real-time texture mapping 2163~
which produces a naturally-mapped realistic or solid image with a minimum calculation volume.
In accordance with the invention, by way of example and not necessarily by way of limitation, there is provided a new and improved method and apparatus for mapping texture, i.e., adding a texture image to a polygonal area forming a fundamental unit of information as to a three-dimensional image of an object to be graphically displayed, which includes a representative or representing point extracting means for extracting a representative or representing point from the polygonal area, a perspective-transformation means for performing a perspective transformation of the coordinates of the representing point having been extracted through the representing-point extracting means, and a linear-interpolation means for performing a linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means, so that the image information, in which the texture image is added to the polygonal area, is obtained as an interpolation output issued from the linear-interpolation means.
In the system of the present invention for performing the texture mapping, the representing-point extracting means extracts the representing points, the number of which varies in accordance with the size of the polygonal area.
In accordance with the present invention for performing the texture mapping, the representative or representing point is extracted by the representing point extracting means from an area of the polygonal shape forming a fundamental unit of three-dimensional image information, the information being provided for construction of an object to be displayed, coordinates of the thus extracted point are subjected to the perspective transformation through the perspective transformation means, and the linear interpolation between the representing points having been subjected to the S perspective transformation through the perspective-transformation means is then performed.
The representing point extracting means extracts the representing points, and the number of these points varies in accordance with the size of the polygonal area.
Hence, the present invention satisfies a long existing need for enhanced image processing providing for simplified texture mapping transformation with reduced image distortion and minimal required calculation.
These and other objects and advantages of the invention will become apparent from the following more detailed description, when taken in conjunction with the accompanying drawings of illustrative embodiments.
DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram of the overall system of a video game apparatus according to the present invention;
Fig. 2 is a schematic diagram illustrating an example of the texture pattern to be mapped on a polygon;
Fig. 3 is a view illustrating the contents of an image-formation instruction of a quadrangle to which the texture mapping is applied;
Fig. 4 is a flow chart illustrating the processing procedure of the image of one frame in the video game apparatus of Figs. 1-3;
Fig. 5 is a view illustrating the representing point in the processing of the image of the one frame;
216383~
Fig. 6 is a view illustrating the image-formation list prepared in the processing of the image of the one frame;
Fig. 7 is a view illustrating the texture pixel determined by executing the linear interpolation in the processing of the image of the one frame;
Fig. 8 is a view illustrating the results of the image formation on the frame buffer in the processing of the image of the one frame;
Fig. 9 is a view illustrating the switching conditions of the frame buffers conducted by the GPU in the video game apparatus referred to above;
Fig. 10 is a view illustrating the manner in which the size of the display area is specified in the video game apparatus referred to above;
Fig. 11 is a view illustrating the spline image-formation operation in the video game apparatus referred to above;
Fig. 12 is a view illustrating one of the texture pages in the video game apparatus referred to above;
Figs. 13(A) and 13(B) are views illustrating the image-formation operation in the video game apparatus referred to above;
Fig. 14 is a view illustrating the texture-mapping operation in the video game apparatus referred to above;
Fig. 15 is a view illustrating the texture pattern; and Figs. 16(A)-16(C) are views illustration the results of the texture mapping in video game apparatus referred to above.
216383~
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Referring now to the drawings, like reference numerals denote like or corresponding parts throughout the drawing figures.
As shown in Fig. 13(A), if a three-dimensional object OB is displayed, as shown in Fig. 13(B), the object OB is divided into three parts, i.e., primitives Pa, Pb and Pc, and the CPU issues necessary image-formation instructions corresponding to the primitives Pa, Pb, Pc to the image-formation unit.
At this time, in order to improve similarity between the thus formed image and the object, a technique of texture mapping is frequently employed.
As previously indicated, the texture mapping is a technique for adding a surface texture pattern Tx to a surface of the polygon forming the object, the texture pattern Tx being a two-dimensional image independently prepared as a texture source image as will be observed in Fig. 14. In Fig. 14, there is shown an example of texture mapping applied to the surface of the object OB
from Fig. 13(A).
A known technique of high-speed texture mapping with a minimum circuit size is a so-called linear transformation. In the linear transformation, coordinates B (u, v) of the texture source image corresponding to a point A (x, y) within the polygon are calculated as follows:
u = a x + b y v = c x + d y where each of a, b, c and d is a constant depending on a shape of the polygon. In texture mapping using the linear transformation, for example, as shown in Fig.15, 2163~3~
if a diced texture patter Tx is added to a surface of the polygon, an example of such mapping is shown in Fig.
16(A). As is clear from this example, mapping or transformation to a shape other than parallelograms causes a diagonal image deformation.
Another known technique of texture mapping for releasing the image from such diagonal image deformation due to the linear transformation is a quadratic transformation. In this quadratic transformation, the coordinates B (u, v) of the texture source image corresponding to the point A (x, y) within the polygon are calculated as follows:
u = a x + b x y + c y v = d x + e x y + f y where each of a, b, c, d, e and f is a constant depending on a shape of the polygon. Although this technique of texture mapping using the quadratic transformation is larger in computational volume than that of texture mapping using the linear transformation, it is capable of providing a naturally mapped image, as shown in Fig. 16(B). However, even the technique of texture mapping using the quadratic transformation can not make the image look solid, i.e., the image shown in Fig. 16(B) fails to provide a perspective view in depth, i.e., in a direction perpendicular to the paper.
A further technique for completely solving the above problem is a so-called perspective transformation.
In the perspective transformation, the coordinates B (u, v) of the texture source image corresponding to a point0 A (x, y, z) within the polygon are calculated as follows:
u = (a x + b y) / z v = (c x + d y) / z where each of a, b, c and d is a constant depending on a shape of the polygon. As is clear from the above, in calculation of the texture mapping using the perspective 21G3~3~
transformation, there is required depth information (z) before the polygon is projected onto a computer screen.
Further, in this calculation, there is additionally required a division process for each of the points to be subjected to the texture mapping. Although this perspective transformation is not realistic in real-time systems, it is capable of preparing a very naturally mapped solid image as shown in Fig. 16(C).
In accordance with the invention, there is provided a new and improved method and apparatus for mapping texture, i.e., adding a texture image to a polygonal area forming a fundamental unit of information as to a three-dimensional image of an object to be graphically displayed, which includes a representative or representing point extracting means for extracting a representative or representing point from the polygonal area, a perspective-transformation means for performing a perspective transformation of the coordinates of the representing point having been extracted through the representing-point extracting means, and a linear-interpolation means for performing a linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means, so that the image information, in which the texture image is added to the polygonal area, is obtained as an interpolation output issued from the linear-interpolation means.
In the system of the present invention for performing the texture mapping, the representing-point extracting means extracts the representing points, the number of which varies in accordance with the size of the polygonal area.
In accordance with the present invention for performing the texture mapping, the representative or 2163~39 representing point is extracted by the representing point extracting means from an area of the polygonal shape forming a fundamental unit of three-dimensional image information, the information being provided for construction of an object to be displayed, coordinates of the thus extracted point are subjected to the perspective transformation through the perspective transformation means, and the linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means is then performed.
The representing point extracting means extracts the representing points, and the number of these points varies in accordance with the size of the polygonal area.
An embodiment of the method and apparatus of the present invention for performing the texture mapping is next described.
Referring now more particularly to Fig. 1, the system of the present invention for performing the texture mapping is applied to a video game apparatus.
In this video game apparatus, a game is performed by retrieving and executing a game program stored in an auxiliary memory, such as optical disks and the like, in accordance with a user's instruction. The game apparatus has the overall system arrangement shown in Fig. 1.
This video game system includes: a control system 50 comprising a central processing unit (i.e., CPU
51) and its peripheral devices; a graphic system 60 comprising a graphic processing unit (i.e., GPU 62) for forming an image in a frame buffer 63, a sound system 70 216~83~
comprising a sound processing unit (i.e., an SPU); an optical-disk control subsystem 80 for controlling an optical disk forming an auxiliary memory, a communication control subsystem 90 for controlling both an input instruction issued from a controller operated by a user and an input/output signal issued from the auxiliary memory which stores the initial setting data of the game, and a bus 100 connected to the above components 50, 60, 70, 80, and 90.
The control system 50 is provided with the CPU
51, a peripheral-device controller 52 for performing necessary controls such as interrupt control, direct-memory access transfer control and like controls, a main memory 53 comprising a random access memory (i.e., RAM), and a read only memory (i.e., ROM 54) storing a program such as a so-called operating system and like programs for controlling the main memory 53, graphic system 60, sound system 70 and like systems. The CPU 51 executes the operating system stored in the ROM 54 to control the entire computer system, and typically comprises a 32-bit RISC CPU.
When a power switch of the video game system shown in Fig. 1 is turned on, the CPU 51 of the control system 50 executes the operating system stored in the ROM
54 to control the graphic system 60, sound system 70 and like systems. When the operating system is executed, the CPU 51 initializes the entire computer system to do its performance check, and thereafter controls the optical-disk control subsystem 80 to execute a game program or the like stored in the optical disk. By executing the game, the CPU 51 controls the graphic system 60, sound system 70 and like systems in accordance with an instruction inputted by the user, so as to control an image in a display, sound effects and musical sounds in production.
` - 2163~39 The graphic system 60 is provided with a geometry transfer engine (i.e., GTE 61) for performing a coordinate transformation and like processing, a GPU 62 for forming an image according to an image-formation S instruction issued from the CPU S1, a frame buffer 63 for storing the image thus formed by the CPU 62, and, an image decoder 64 for decoding an image data, the image data having been compressed and encoded through a so-called orthogonal transformation, such as the well known discrete-cosine transformation and like transformations.
Upon receipt of an instruction or demand for computation issued from the CPU S1, the GTE 61 employs its parallel computing mechanism for executing a lS plurality of computations in parallel with each other and is capable of performing computations at high speed, which computations are of coordinate transformations, of light sources, of matrixes, or of vectors. More specifically, for example, in computation for realizing a so-called flat shading through which an image is formed into a triangular polygon with a single color, the GTE 61 executes computations of the coordinates at a maximum rate of approximately one and a half million polygons (l,S00,000) per second, which enables the CPU S1 in the video game apparatus to reduce its load and permits the system to execute computations of the polygon's coordinates at high speed.
Further, in accordance with an image-formation instruction issued from the CPU 51, the GPU 62 forms an image of the polygon and like shapes in the frame buffer 63. This GPU 62 is capable of forming up to three hundred and sixty thousand images of polygons per second.
In the aforementioned embodiment, the CPU S1 has a series of image-formation instructions for 2163~39 generating single frame images in the main memory 53.
These instructions are provided with their own addresses which identify the image-formation instructions to be executed. A controller 52 is provided for controlling the peripheral devices. This is a DMA controller which transfers the image-formation instructions from the main memory 53 to the CPU 62. Then, the CPU 62 executes the image-formation instructions issued from the DMA
controller to obtain results which are then stored in the frame buffer 63. The DMA controller finds and executes a subsequent instruction by means of its address, after completion of transfer of one image-formation instruction.
As shown in Fig. 2, if a diced texture pattern Tx is mapped or transformed into a trapezoidal polygon PG
in image formation, an image-formation instruction "A"
for performing such texture mapping of a quadrangle ABCD
in image formation is provided as shown in Fig. 3.
In this regard, described first in image formation are a plurality of vertex coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC) of the quadrangle ABDC an image of which is formed, and a plurality of texture coordinates (UA, VA), (UB, VB), (UD, VD), (UC, VC) corresponding to such vertex coordinates. When a series of image-formation instructions described above is executed, the GPU 62 forms an image of the polygon on the frame buffer 63, the image having been modified by the texture mapping through a linear transformation.
In this embodiment, for example, as shown in a flow chart of Fig. 4, the processing for forming the image-of a single frame comprises a step S1 in which a transformation matrix is obtained. Then, in a subsequent step S2, when the image-formation instruction "A" and depth coordinates (ZA, ZB, ZD, ZC) in the instruction are 2163~3~
given, each of the vertex coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC) is subjected to perspective transformation.
In a step S3, sizes (delta X, delta Y) after completion of the perspective transformation are calculated based on the vertex coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC). As a result, in step S4, for example, as shown in Fig. 5, the number of the representing points Pn and its locations are determined.
As described above, by adequately varying the representing points Pn in number, it is possible to optimize a computation volume in the CPU.
In a subsequent set S5, it is judged whether or not the number of the representing points is more than one. When the number of the representing points is more than one, the step S5 is followed by a subsequent step S6 in which the vertex coordinates (xn, yn) corresponding to coordinates (UPn, VPn) of the representing points Pn are determined through the perspective transformation.
Then, in a step S7, the quadrangle ABCD is divided into four small quadrangles APOP2P1, POBP3P2, PlP2P4C and P2P3DP4, each of which uses its representing points as its vertices, so that a series of respective image-formation instructions B0 to B4 are generated. In other words, previously calculated values or coordinates (XA, YA), (XB, YB), (XD, YD), (XC, YC) and (UA, VA), (UB, VB), (UD, VD), (UC, VC) are set as the vertex coordinates and the texture coordinates of each of sub-image formation instructions Bn.
It should be noted that, when the number of the representing points determined in the step S4 is one in the step S5, the step S5 is followed by a step S8 in 2163~9 which an image-formation instruction is immediately prepared.
In a subsequent step S9 following the step S8, as shown in Fig. 6, an image-formation instruction list is prepared by setting an address of a series of the sub-image formation instructions Bn in a tag of a series of the sub-image formation instructions Bn-1, and the thus prepared list is replaced with the original image-formation instruction "A".
Then, in a step S10 following the step S9, it is judged whether or not the processing is completed as to all of the polygons. When some one of the polygons remains unprocessed, the processing procedure returns to the step S2, i.e., the step S10 is followed by the step S2 in which additional perspective transformation of such remaining polygon's vertices is conducted.
On the other hand, in the step S10, when it is found that no polygon remains unprocessed, the step S10 is followed by a step S11 in which the processing procedure waits for completion of image formation in a preceding frame. The step S11 is followed by a step S12 in which the processing procedure commences to form the images from the top of the list.
As shown in Fig. 7, the GPU 62 determines a texture pixel other than the above-described representing points by performing a linear interpolation between the representing points having been subjected to the perspective transformation, so that the image is formed in the frame buffer 63, as shown in Fig. 8.
As described above, the computation follows the processing procedure of the flow chart shown in Fig. 4, where the representing points are extracted from the 2163~39 polygons, each of which is used as a fundamental unit of three-dimensional image information forming an object to be displayed, the thus extracted representing points have their coordinates subjected to the perspective 5 transformation, and the linear interpolation is conducted between such representing points having been subjected to the perspective transformation. This considerably reduces the required computation volume and is capable of producing a real-time solid and naturally mapped image.
In the aforedescribed embodiment of the invention, the frame buffer 63 is constructed of a so-called dual-port RAM, and is capable of simultaneously performing image formation based on the instruction issued from the GPU 62, transfers from the main memory, 15 and a data retrieving operation for display. A typical capacity of the frame buffer 63 is 1 MB which is capable of providing a 16-bit matrix having a size of 1024 (Horizontal) x 512 (Vertical) pixels. Furthermore, the frame buffer 63, in addition to the video-output display 20 area is also provided with a CLUT area for storing a color look up table (CLUT) which the GPU 62 refers to in image formation of the polygons, and a texture area for storing a texture to be mapped or transformed into the polygons which have their images formed by the GPU 62 25 after completion of the coordinate transformation. Both the CLUT area and the texture area are dynamically modified as the display area is modified.
In addition, as shown in Fig. 9, the GPU 62 provides a pair of square-shaped areas "A", "B", and 30 forms the image on one of the "B" areas while having the contents of the other "A" area displayed. After completion of the image formation, the square-shaped areas "A", "B" are replaced during the period of time of a vertical retrace so as to prevent rewriting operations 35 from being displayed.
21~3~39 Moreover, the GPU 62 is capable of providing, in addition to the above-described flat shading, a Gouraud shading for determining a color of the polygon by performing interpolation based on colors of the vertices of the polygons, and a texture mapping for adding a texture stored in the texture area to the polygons. In each of the Gouraud shading and the texture mapping, the GTE 61 is capable of computing up to approximately five hundred thousand of the polygon's coordinates per second.
Further, the GPU 62 supports ten frame modes shown in the following Table 1 when it issues the contents of a desired one of the square-shaped areas of the frame buffer 63 as its video output.
TABLE 1: FRAME RESOLUTION
Mode Standard Resolution Remarks Mode 0 256(H) x 240(V) Non-interlacing Mode 1 320 x 240 Mode 2 512 x 240 Mode 3 640 x 480 Mod 4 256 x 480 Interlacing Mode 5 320 x 480 Mode 6 512 x 480 Mode 7 640 x 480 Mode 8 384 x 240 Non-interlacing Mode 9 384 x 240 Interlacing In addition, the frame size, i.e., the number of the pixels arranged on a CRT screen is variable. As shown in Fig. 10, the display area of the screen can be specified by determining therein both a display beginning position with coordinates (DTX, DTY), and a display ending position with coordinates (DBX, DBY).
Moreover, the GPU 62 supports display-color modes comprising: a 16-bit mode with a 32,768-color 2163~3~
display; and, a 24-bit mode with a 16,777,216-color display.
Still further, in image-formation function, the GPU 62 also supports a so-called spline image-formation function with a frame size of from 1 (H: Horizontal) x 1 (V: Vertical) to 256 (H) x 256 (V) dots, the number of the dots being arbitrarily selected.
In this connection, as shown in Fig. 11, an image data or spline pattern being added to a spline is transferred to the frame buffer before execution of an image-formation command, and is stored in a non-display area of the frame buffer.
It is possible to store any desired number of the spline patterns in the frame buffer as long as its capacity permits. In this regard, one page (i.e., texture page) has a size of 256 x 256 pixels.
As shown in Fig. 12, a size of the one texture page varies depending on the type of the mode. Further, as shown in Fig. 11, a location of the texture page in the frame buffer is determined by specifying a page number of a parameter called TSB in the image-formation command.
In the spline patterns, there are three types of color modes including a 4-bit CLUT mode, a 8-bit CLUT
mode, and a 16-bit DIRECT mode.
In the 4-bit CLUT mode, a 16-color spline image formation is realized by using the CLUT. On the other hand, in a 8-bit CLUT mode, a 256-color spline image formation is realized by using the CLUT. Still further, in a 16-bit DIRECT mode, a 32,768-color spline image 2163~3~
formation is realized by directly using the 16-bit system.
In the spline pattern in both the 4-bit CLUT
mode and the 8-bit CLUT mode, a color of each of the pixels is represented by a specific number which specifies one of the RGB values of the CLUT disposed on the frame buffer, the number of the RGB values being within a range of from 16 to 256. It is possible to specify the CLUT in spline units. Further, it is also possible to provide a separate CLUT for any spline.
The image decoder 64 is controlled by the CPU
51 to decode the image data of still pictures or moving pictures which have been stored in the main memory 53, and the thus decoded data is stored in the main memory 53.
Such reproduced image data is stored in the frame buffer 63 through the GPU 62, which makes it possible to use the reproduced image data as a background of a picture produced by the GPU 62.
The sound system 70 comprises a sound processing unit (SPU) 71 which generates musical sounds, sound effects and the like upon receipt of an instruction issued from the CPU 51, a sound buffer 72 which is controlled by the SPU 71 to store a sound-wave data and like data therein, and a loudspeaker 73 for outputting the musical sounds, sound effects and the like generated by the SPU 71.
The SPU 71 is provided with an ADPCM decoding function for reproducing a sound data, the sound data being 16-bit sound data composed of 4-bit differential signals which have been subjected to processing of adaptive differential PCM (ADPCM), a reproducing function 2163~39 for generating the sound effects and the like by reproducing the sound-wave data stored in the sound buffer 72, and a modulator function for modulating the sound-wave data stored in the sound buffer 72 to reproduce the thus modulated sounds.
With the provisions of such functions, the sound system 70 is capable of being used as a so-called sampling sound source for generating musical sounds, sound effects and the like, based on the wave-data stored in the sound buffer 72 when it receives an instruction issued from the CPU 51.
The optical-disk control subsystem portion 80 comprises an optical-disk unit 81 for reproducing a program, data and the like stored in an optical disk, a decoder 82 for decoding a program, data and the like having been provided with, for example, an error correction code (ECC), a memory buffer 83 which temporarily stores reproduced data issued from the optical-disk unit 81 to facilitate retrieving of such data from the optical disk, and a sub-CPU 84 for control.
As with sound data stored in the optical disk used in the optical-disk unit 81, in addition to the ADPCM data, there is so-called PCM data which is a sound signal which has been subjected to an analog-to-digital conversion.
Sound data stored as the ADPCM data (in which a difference, for example, in 16-bit digital data is represented as a 4-bit word and stored in this word) is decoded in the decoder 82, then supplied to the SPU 71 in which the supplied data is subjected to the analog-to-digital conversion, and thereafter used to drive the loudspeaker 73. Further, sound data stored as the PCM data (which is stored, for example, as a 16-bit 216~8~9 digital data) is also decoded in the decoder 82, and then used to drive the loudspeaker 73.
The communication control subsystem 90 is provided with a communication control unit 91 for controlling communications with the CPU 51 through a bus 100. Provided in the communication control unit 91 are a slot 93 connected with the controller 92 through which the user inputs his instruction, and a pair of card connectors 95A and 95B to which a pair of memory cards 94A and 94B for storing the game's setting data and the like data are connected, respectively.
The controller 92 connected with the slot 93 for receiving the user's instruction is provided with, for example, 16 control keys. Upon receipt of an instruction issued from the communication control unit 91, the controller 92 supplies data of the control key's conditions to the CPU 51 through synchronous communication, sixty times a second. The communication control unit 91 issues the data of the control key's conditions from the controller 92 to the CPU 51. As a result, the user's instruction is inputted to the CPU 51, so that the CPU 51 executes a necessary operation according to the user's instruction.
In addition, when the setting data of the game operated by the CPU 51 must be stored, the CPU 51 issues such data being stored to the communication control unit 91. Then, the unit 91 stores the data in one of the memory cards 93A and 93B which are connected with the card connectors 95A and 95B, respectively.
Further, incorporated in the communication control unit 91 is a protective circuit to prevent electrical failures. The memory cards 93A, 93B are separated from the bus 100. Consequently, the memory 216:~839 cards 93A, 93B are capable of being mounted and dismounted in a condition in which the power switch of the main unit is turned on. Therefore, when the memory lacks capacity, it is possible to mount a new one of the cards without turning off the power switch of the main unit. Consequently, there is no fear that necessary game data may be lost. Hence, it is possible to store such necessary game data in the new one of the memory cards being mounted.
Each of the memory cards 93A, 93B is constructed of a flash memory which permits random access, requires no backup power source, and has a microcomputer incorporated therein. When the memory cards 93A, 93B are connected with the card connectors 95A, 95B, electric power is supplied from the main unit to the microcomputer through the card connectors.
The memory cards 93A, 93B are recognized as file devices by an application, the file devices being identified by the use of hexadecimal numbers with two figures, such numbers specifying both the ports and the card connectors. Each of the memory cards 93A, 93B has an automatic initializing function which is performed when a file is opened.
When the memory cards 93A, 93B are connected with the card connectors 95A, 95B so that the main unit supplies electric power to these memory cards, the microcomputer initially sets an internal state of each of the memory cards at a "no-communication" state, and thereafter establishes communications with the memory cards through the communication control unit 91.
On the basis of a field representing an "internal state" in a response packet for confirmation of connection between the memory cards and the host in 2163~33 communication protocol, the CPU 51 in the main unit side tests an internal state of the microcomputer incorporated in each of the memory cards 93A, 93B which have been connected with the card connectors 95A, 95B. In the case of the "no communication" state, a new one of the memory cards 93A, 93B is recognized to be communicated, so that file control data relative to the new one of the memory cards 93A, 93B, for example, information as to file names, file sizes, slot numbers and the like, together with status information, are retrieved.
By means of such a communication protocol, it is possible to establish communications permitting the memory cards 93A, 93B to be dismounted as needed.
As a result, it is possible to store the game setting data in the pair of the memory cards 93A, 93B.
Further, it is also possible to directly copy the data stored in the pair of the memory cards 93A, 93B and to directly transfer various data from the pair of the memory cards 93A, 93B to the main unit at the same time.
Since each of the memory cards 93A, 93B is constructed of a flash memory which is randomly accessible and requires no backup power supply, it is possible for the memory cards 93A, 93B to store the data for a substantially indefinite period of time.
Further, this video game apparatus is provided with a parallel input/output (PIO) 101 and a serial input/output (SIO) 102, both of which are connected with the bus 100.
The video game apparatus is capable of communicating with the peripheral devices through the parallel inputtoutput (PIO) 101, and also capable of 2163~39 communicating with other video game apparatuses through the serial input/output (SIO) 102.
As described above, in the texture mapping method and apparatus of the present invention, a representing-point extracting means extracts a representing point from an area of a polygon which forms a fundamental unit of three-dimensional image information of an object to be displayed on the computer screen, a perspective transformation means performs a perspective transformation of the coordinates of the representing point having been extracted by the representing-point extracting means, and a linear interpolation between the representing points having been subjected to the perspective transformation through the perspective-transformation means is performed. Consequently,regarding computation volume, the texture mapping apparatus of the present invention has considerably less requirements in comparison to the conventional apparatus in which all the points within the polygonal area are subjected to the perspective transformation. Therefore, it is possible for the texture mapping apparatus of the present invention to realize a real-time solid naturally-mapped image on the computer screen.
Furthermore, in the texture mapping apparatus of the present invention, the representing-point extracting means extracts the representing points which varies in number in accordance with the size of the polygonal area, and which optimizes the computation volume to make it possible to obtain a solid and naturally-mapped image on the computer screen.
Hence, the present invention satisfies a long existing need for enhanced image processing providing for simplified texture mapping transformation with reduced image distortion and minimal required calculation.
21~383g It will be apparent from the foregoing that, while particular forms of the invention have been illustrated and described, various modifications can be made without departing from the spirit and scope of the invention. Accordingly, it is not intended that the invention be limited, except as by the appended claims.
Claims (14)
1. A method for producing an image, comprising the steps of:
(a) storing a texture pattern in a memory;
(b) selecting at least one additional point in addition to the vertices from an image polygon;
(c) carrying out a perspective transformation upon said vertices and said additional points; and (d) specifying a texture pixel read out from said memory corresponding to the interpolation of said additional points.
(a) storing a texture pattern in a memory;
(b) selecting at least one additional point in addition to the vertices from an image polygon;
(c) carrying out a perspective transformation upon said vertices and said additional points; and (d) specifying a texture pixel read out from said memory corresponding to the interpolation of said additional points.
2. A method as set forth in claim 1, and further comprising:
mapping said texture pixel on said polygon.
mapping said texture pixel on said polygon.
3. A method as set forth in claim 1, wherein said selecting step selects the number of said additional points in response to the area of the polygon which is transformed.
4. A method as set forth in claim 1, wherein said selecting step selects the positions of said additional points in response to the area of the polygon which is transformed.
5. A method as set forth in claim 1, wherein said specifying step specifies the texture pixel read out from said memory means corresponding to each linearly interpolated point which is transformed.
6. A method as set forth in any of claims 1-4 wherein said method includes the step of performing linear interpolation upon said additional points, whereby distortion is minimized.
7. An image producing apparatus, comprising:
(a) a memory for storing a texture pattern;
(b) selecting means for selecting at least one additional point in addition to the vertices from an image polygon;
(c) converting means for carrying out a perspective transformation upon said vertices and said additional points; and (d) specifying means for specifying a texture pixel read out from said memory corresponding to the interpolation of said additional points.
(a) a memory for storing a texture pattern;
(b) selecting means for selecting at least one additional point in addition to the vertices from an image polygon;
(c) converting means for carrying out a perspective transformation upon said vertices and said additional points; and (d) specifying means for specifying a texture pixel read out from said memory corresponding to the interpolation of said additional points.
8. An apparatus as set forth in claim 7, and further comprising:
drawing means for mapping said texture pixel on said polygon.
drawing means for mapping said texture pixel on said polygon.
9. An apparatus as set forth in claim 6, wherein said selecting means selects the number of said additional points in response to an area of said polygon which is transformed.
10. An apparatus as set forth in claim 7, wherein said selecting means selects the positions of said additional points in response to the area of said polygon which is transformed.
11. An apparatus as set forth in claim 7, wherein said specifying means specifies the texture pixel read out from said memory corresponding to each linearly interpolated point between which is transformed.
12. In a system for mapping texture to a polygonal area forming a fundamental unit of information as to a three-dimensional image of an object to be graphically displayed, the improvement comprising:
a representing-point extracting means for extracting a representing point from said polygonal area;
a perspective-transformation means for performing a perspective transformation of the coordinates of said representing point which have been extracted through said representing-point extracting means; and a linear-interpolation means for performing a linear interpolation between said representing points which have been subjected to said perspective transformation through said perspective-transformation means;
whereby image information, in which said texture image is added to said polygonal area, is obtained as an interpolation output issued from said linear-interpolation means with a minimum of distortion and reduced computation.
a representing-point extracting means for extracting a representing point from said polygonal area;
a perspective-transformation means for performing a perspective transformation of the coordinates of said representing point which have been extracted through said representing-point extracting means; and a linear-interpolation means for performing a linear interpolation between said representing points which have been subjected to said perspective transformation through said perspective-transformation means;
whereby image information, in which said texture image is added to said polygonal area, is obtained as an interpolation output issued from said linear-interpolation means with a minimum of distortion and reduced computation.
13. A system for mapping texture, as set forth in claim 12, wherein the number of said representing-points extracted by said extracting means varies in accordance with the size of said polygonal area.
14. A method for processing image data, comprising the steps of:
storing image data including three-dimensional coordinates of image points;
selecting additional representative coordinates for additional points in said image data in addition to said three-dimensional coordinates in said image data, for minimizing image distortion normally resulting from coordinate transformation; and linearly interpolating and transforming said image data and said additional points, to convert said three-dimensional coordinates of image points and said additional representative coordinates to two-dimensional image data with a minimum of distortion requiring minimum computation.
storing image data including three-dimensional coordinates of image points;
selecting additional representative coordinates for additional points in said image data in addition to said three-dimensional coordinates in said image data, for minimizing image distortion normally resulting from coordinate transformation; and linearly interpolating and transforming said image data and said additional points, to convert said three-dimensional coordinates of image points and said additional representative coordinates to two-dimensional image data with a minimum of distortion requiring minimum computation.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP30002694A JP3647487B2 (en) | 1994-12-02 | 1994-12-02 | Texture mapping device |
| JPP06-300026 | 1994-12-02 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2163839A1 true CA2163839A1 (en) | 1996-06-03 |
Family
ID=17879819
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002163839A Abandoned CA2163839A1 (en) | 1994-12-02 | 1995-11-27 | Method and apparatus for mapping texture |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US5933148A (en) |
| EP (1) | EP0715276A3 (en) |
| JP (1) | JP3647487B2 (en) |
| KR (1) | KR960025239A (en) |
| CN (1) | CN1110022C (en) |
| AU (1) | AU704617B2 (en) |
| CA (1) | CA2163839A1 (en) |
Families Citing this family (83)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7859551B2 (en) | 1993-10-15 | 2010-12-28 | Bulman Richard L | Object customization and presentation system |
| US5835097A (en) * | 1996-12-30 | 1998-11-10 | Cirrus Logic, Inc. | Non-homogenous second order perspective texture mapping using linear interpolation parameters |
| US5841442A (en) * | 1996-12-30 | 1998-11-24 | Cirrus Logic, Inc. | Method for computing parameters used in a non-homogeneous second order perspective texture mapping process using interpolation |
| JPH10198822A (en) * | 1997-01-10 | 1998-07-31 | Sharp Corp | Image compositing device |
| US6061066A (en) * | 1998-03-23 | 2000-05-09 | Nvidia Corporation | Method and apparatus for creating perspective correct graphical images |
| US6040837A (en) * | 1998-04-22 | 2000-03-21 | Ati Technologies, Inc. | Method and apparatus for space variable texture filtering |
| JPH11331700A (en) | 1998-05-15 | 1999-11-30 | Sony Corp | Image processing unit and image processing method |
| US7071949B1 (en) * | 1998-11-18 | 2006-07-04 | Microsoft Corporation | View dependent tiled textures |
| AU3673900A (en) | 1999-04-09 | 2000-11-14 | Sony Computer Entertainment Inc. | Method and apparatus for performing perspective transformation |
| US6396502B1 (en) | 1999-10-15 | 2002-05-28 | Hewlett-Packard Company | System and method for implementing accumulation buffer operations in texture mapping hardware |
| US6822658B1 (en) | 1999-10-25 | 2004-11-23 | Intel Corporation | Rendering a silhouette edge |
| US6798411B1 (en) * | 1999-10-29 | 2004-09-28 | Intel Corporation | Image processing |
| US7180523B1 (en) | 2000-03-31 | 2007-02-20 | Intel Corporation | Trimming surfaces |
| US7061501B1 (en) | 2000-11-07 | 2006-06-13 | Intel Corporation | Rendering a pencil-sketch image |
| US7034791B1 (en) | 2000-12-14 | 2006-04-25 | Gary Odom | Digital video display employing minimal visual conveyance |
| AU2001283782A1 (en) * | 2000-12-21 | 2002-07-01 | Active Online Gmbh | Electronic image processing method and system, particularly for mapping graphical objects |
| US7190374B2 (en) * | 2001-02-28 | 2007-03-13 | Intel Corporation | Shading polygons from a three-dimensional model |
| US7116330B2 (en) | 2001-02-28 | 2006-10-03 | Intel Corporation | Approximating motion using a three-dimensional model |
| US6980206B2 (en) * | 2001-06-07 | 2005-12-27 | Intel Corporation | Rendering a three-dimensional model using a dither pattern |
| US6924804B2 (en) * | 2001-09-25 | 2005-08-02 | Intel Corporation | Reducing the resolution of bones in a three-dimensional model |
| JP2003117241A (en) * | 2001-10-11 | 2003-04-22 | Sega Corp | Character arranging method, data managing method and model forming method |
| US6906724B2 (en) * | 2001-10-17 | 2005-06-14 | Lntel Corporation | Generating a shadow for a three-dimensional model |
| US7548241B2 (en) * | 2002-01-04 | 2009-06-16 | Intel Corporation | Determining a node path through a node graph |
| US7301547B2 (en) | 2002-03-22 | 2007-11-27 | Intel Corporation | Augmented reality system |
| US7146297B2 (en) * | 2002-03-27 | 2006-12-05 | Intel Corporation | Detecting collisions of three-dimensional models |
| US6975318B2 (en) * | 2002-06-25 | 2005-12-13 | Intel Corporation | Polygon binning process for tile-based rendering |
| US6982715B2 (en) * | 2002-07-26 | 2006-01-03 | Intel Corporation | Mesh compression process |
| TWI238975B (en) * | 2003-02-20 | 2005-09-01 | Via Tech Inc | Method of performing cubic mapping with texturing |
| US7681112B1 (en) | 2003-05-30 | 2010-03-16 | Adobe Systems Incorporated | Embedded reuse meta information |
| US7076735B2 (en) * | 2003-07-21 | 2006-07-11 | Landmark Graphics Corporation | System and method for network transmission of graphical data through a distributed application |
| US7636489B2 (en) * | 2004-04-16 | 2009-12-22 | Apple Inc. | Blur computation algorithm |
| US7847800B2 (en) * | 2004-04-16 | 2010-12-07 | Apple Inc. | System for emulating graphics operations |
| US8704837B2 (en) * | 2004-04-16 | 2014-04-22 | Apple Inc. | High-level program interface for graphics operations |
| US8134561B2 (en) * | 2004-04-16 | 2012-03-13 | Apple Inc. | System for optimizing graphics operations |
| US7231632B2 (en) * | 2004-04-16 | 2007-06-12 | Apple Computer, Inc. | System for reducing the number of programs necessary to render an image |
| US7248265B2 (en) * | 2004-04-16 | 2007-07-24 | Apple Inc. | System and method for processing graphics operations with graphics processing unit |
| US7397964B2 (en) * | 2004-06-24 | 2008-07-08 | Apple Inc. | Gaussian blur approximation suitable for GPU |
| US8130237B2 (en) * | 2004-06-24 | 2012-03-06 | Apple Inc. | Resolution independent user interface design |
| US8068103B2 (en) | 2004-06-24 | 2011-11-29 | Apple Inc. | User-interface design |
| US7652678B2 (en) * | 2004-06-25 | 2010-01-26 | Apple Inc. | Partial display updates in a windowing system using a programmable graphics processing unit |
| US7761800B2 (en) | 2004-06-25 | 2010-07-20 | Apple Inc. | Unified interest layer for user interface |
| US7546543B2 (en) | 2004-06-25 | 2009-06-09 | Apple Inc. | Widget authoring and editing environment |
| US8239749B2 (en) | 2004-06-25 | 2012-08-07 | Apple Inc. | Procedurally expressing graphic objects for web pages |
| US8302020B2 (en) | 2004-06-25 | 2012-10-30 | Apple Inc. | Widget authoring and editing environment |
| US7490295B2 (en) | 2004-06-25 | 2009-02-10 | Apple Inc. | Layer for accessing user interface elements |
| US8566732B2 (en) | 2004-06-25 | 2013-10-22 | Apple Inc. | Synchronization of widgets and dashboards |
| US8453065B2 (en) | 2004-06-25 | 2013-05-28 | Apple Inc. | Preview and installation of user interface elements in a display environment |
| US20050285866A1 (en) * | 2004-06-25 | 2005-12-29 | Apple Computer, Inc. | Display-wide visual effects for a windowing system using a programmable graphics processing unit |
| US7158143B2 (en) * | 2004-12-03 | 2007-01-02 | Via Technologies, Inc. | Fast algorithm for anisotropic texture sampling |
| CN100365660C (en) * | 2004-12-13 | 2008-01-30 | 北京中星微电子有限公司 | Method for image amplifying interpolation |
| US7227551B2 (en) * | 2004-12-23 | 2007-06-05 | Apple Inc. | Manipulating text and graphic appearance |
| US8140975B2 (en) | 2005-01-07 | 2012-03-20 | Apple Inc. | Slide show navigation |
| JP2006202083A (en) * | 2005-01-21 | 2006-08-03 | Seiko Epson Corp | Image data creation apparatus and printer |
| JP4613636B2 (en) * | 2005-02-21 | 2011-01-19 | セイコーエプソン株式会社 | Print data output device and print data output method |
| US8543931B2 (en) | 2005-06-07 | 2013-09-24 | Apple Inc. | Preview including theme based installation of user interface elements in a display environment |
| US7743336B2 (en) | 2005-10-27 | 2010-06-22 | Apple Inc. | Widget security |
| US7752556B2 (en) | 2005-10-27 | 2010-07-06 | Apple Inc. | Workflow widgets |
| US9104294B2 (en) | 2005-10-27 | 2015-08-11 | Apple Inc. | Linked widgets |
| US7954064B2 (en) | 2005-10-27 | 2011-05-31 | Apple Inc. | Multiple dashboards |
| US8543824B2 (en) | 2005-10-27 | 2013-09-24 | Apple Inc. | Safe distribution and use of content |
| US7707514B2 (en) | 2005-11-18 | 2010-04-27 | Apple Inc. | Management of user interface elements in a display environment |
| US7656412B2 (en) * | 2005-12-21 | 2010-02-02 | Microsoft Corporation | Texture resampling with a processor |
| JP4747881B2 (en) * | 2006-02-27 | 2011-08-17 | セイコーエプソン株式会社 | A data conversion method, a texture creation method, a program, a recording medium, and a projector using an arithmetic processing unit. |
| US8155682B2 (en) * | 2006-05-05 | 2012-04-10 | Research In Motion Limited | Handheld electronic device including automatic mobile phone number management, and associated method |
| US7953260B2 (en) * | 2006-06-09 | 2011-05-31 | Craniosim Solutions, Inc. | Predicting movement of soft tissue of the face in response to movement of underlying bone |
| US8869027B2 (en) | 2006-08-04 | 2014-10-21 | Apple Inc. | Management and generation of dashboards |
| US8253731B2 (en) | 2006-11-27 | 2012-08-28 | Designin Corporation | Systems, methods, and computer program products for home and landscape design |
| US20080126021A1 (en) * | 2006-11-27 | 2008-05-29 | Ramsay Hoguet | Converting web content into texture mapping objects |
| US8122370B2 (en) * | 2006-11-27 | 2012-02-21 | Designin Corporation | Visual bookmarks for home and landscape design |
| US8117558B2 (en) * | 2006-11-27 | 2012-02-14 | Designin Corporation | Converting web content into two-dimensional CAD drawings and three-dimensional CAD models |
| US8954871B2 (en) | 2007-07-18 | 2015-02-10 | Apple Inc. | User-centric widgets and dashboards |
| US8667415B2 (en) | 2007-08-06 | 2014-03-04 | Apple Inc. | Web widgets |
| US8156467B2 (en) | 2007-08-27 | 2012-04-10 | Adobe Systems Incorporated | Reusing components in a running application |
| EP2034445B1 (en) | 2007-09-05 | 2010-01-20 | Vidiom SA | Method for drawing geometric shapes |
| ATE470204T1 (en) * | 2007-09-05 | 2010-06-15 | Vidiom Sa | METHOD FOR ROTating IMAGES |
| US8176466B2 (en) | 2007-10-01 | 2012-05-08 | Adobe Systems Incorporated | System and method for generating an application fragment |
| US9619304B2 (en) | 2008-02-05 | 2017-04-11 | Adobe Systems Incorporated | Automatic connections between application components |
| US7973798B2 (en) * | 2008-03-31 | 2011-07-05 | Microsoft Corporation | Inverse texture synthesis |
| US8656293B1 (en) | 2008-07-29 | 2014-02-18 | Adobe Systems Incorporated | Configuring mobile devices |
| CN102543040B (en) * | 2008-12-15 | 2014-10-15 | 富士通株式会社 | Convex polygon interpolation method and system for graphic raster scanning |
| USD721717S1 (en) | 2011-10-31 | 2015-01-27 | Kings Mountain International Inc. | Display screen or portion thereof with a graphical user interface |
| US11127106B2 (en) | 2019-06-28 | 2021-09-21 | Intel Corporation | Runtime flip stability characterization |
| US11409341B2 (en) | 2019-10-01 | 2022-08-09 | Intel Corporation | Repeating graphics render pattern detection |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4580134A (en) * | 1982-11-16 | 1986-04-01 | Real Time Design, Inc. | Color video system using data compression and decompression |
| JPS628193A (en) * | 1985-07-04 | 1987-01-16 | インタ−ナショナル ビジネス マシ−ンズ コ−ポレ−ション | Color image display system |
| US4823120A (en) * | 1986-09-12 | 1989-04-18 | Apple Computer, Inc. | Enhanced video graphics controller |
| US4811124A (en) * | 1987-07-24 | 1989-03-07 | Advanced Micro Devices, Inc. | Defect skipping mechanism for disk drives |
| US5091717A (en) * | 1989-05-01 | 1992-02-25 | Sun Microsystems, Inc. | Apparatus for selecting mode of output in a computer system |
| US5224208A (en) * | 1990-03-16 | 1993-06-29 | Hewlett-Packard Company | Gradient calculation for texture mapping |
| US5307450A (en) * | 1991-02-19 | 1994-04-26 | Silicon Graphics, Inc. | Z-subdivision for improved texture mapping |
| JP2950346B2 (en) * | 1991-03-25 | 1999-09-20 | ソニー株式会社 | Image data decoding method and its decoder circuit |
| JP3158370B2 (en) * | 1991-07-12 | 2001-04-23 | ソニー株式会社 | Disc data playback device |
| JPH0567179A (en) * | 1991-09-10 | 1993-03-19 | Hitachi Ltd | Method and device for form data processing |
| US5291468A (en) * | 1991-09-16 | 1994-03-01 | International Business Machines Corporation | Method and apparatus for synchronizing the readout of a sequential media device with a separate clocked device |
| GB2270243B (en) * | 1992-08-26 | 1996-02-28 | Namco Ltd | Image synthesizing system |
| JPH06111495A (en) * | 1992-09-30 | 1994-04-22 | Sony Corp | Device for reproducing data |
| JP3243883B2 (en) * | 1993-04-12 | 2002-01-07 | ソニー株式会社 | Recording or playback device |
| JP3327986B2 (en) * | 1993-04-15 | 2002-09-24 | 株式会社ソニー・コンピュータエンタテインメント | Image creation device |
| JPH07146952A (en) * | 1993-11-22 | 1995-06-06 | Konami Kk | Three-dimensional image processor |
| JP3064799B2 (en) * | 1994-03-29 | 2000-07-12 | ヤマハ株式会社 | Texture mapping device |
| US5594846A (en) * | 1994-12-19 | 1997-01-14 | Sun Microsystems, Inc. | Perspective correction of texture in graphics by adaptive approximation |
| US5649082A (en) * | 1995-03-20 | 1997-07-15 | Silicon Graphics, Inc. | Efficient method and apparatus for determining texture coordinates for lines and polygons |
| US5719599A (en) * | 1995-06-07 | 1998-02-17 | Seiko Epson Corporation | Method and apparatus for efficient digital modeling and texture mapping |
-
1994
- 1994-12-02 JP JP30002694A patent/JP3647487B2/en not_active Expired - Lifetime
-
1995
- 1995-11-17 EP EP95118163A patent/EP0715276A3/en not_active Withdrawn
- 1995-11-27 CA CA002163839A patent/CA2163839A1/en not_active Abandoned
- 1995-11-28 KR KR1019950044125A patent/KR960025239A/en not_active Application Discontinuation
- 1995-11-30 US US08/565,719 patent/US5933148A/en not_active Expired - Lifetime
- 1995-12-01 AU AU40209/95A patent/AU704617B2/en not_active Expired
- 1995-12-01 CN CN95120025A patent/CN1110022C/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| CN1150675A (en) | 1997-05-28 |
| CN1110022C (en) | 2003-05-28 |
| US5933148A (en) | 1999-08-03 |
| JP3647487B2 (en) | 2005-05-11 |
| EP0715276A2 (en) | 1996-06-05 |
| JPH08161510A (en) | 1996-06-21 |
| AU4020995A (en) | 1996-06-13 |
| EP0715276A3 (en) | 1996-07-24 |
| AU704617B2 (en) | 1999-04-29 |
| KR960025239A (en) | 1996-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5933148A (en) | Method and apparatus for mapping texture | |
| AU702762B2 (en) | Method of producing image data, image data processing apparatus, and recording medium | |
| EP1353296B1 (en) | Image with depth of field using z-buffer image data and alpha blending | |
| JP3886184B2 (en) | Image data processing method and image processing apparatus | |
| EP0715279A2 (en) | Image processing and recording media | |
| US20120249566A1 (en) | Floating point computer system with frame buffer for storing color values during or after rasterization | |
| US6069635A (en) | Method of producing image data and associated recording medium | |
| US6011564A (en) | Method and apparatus for producing an image through operation of plotting commands on image data | |
| US6763176B1 (en) | Method and apparatus for real-time video editing using a graphics processor | |
| US5760782A (en) | Method and apparatus for generating images | |
| EP0676720B1 (en) | Image generation apparatus | |
| JP2002541600A (en) | Apparatus and method for perspective transformation | |
| JPH08161511A (en) | Image generating device | |
| MXPA95004904A (en) | Method for producing image data, image data processing device and regis medium | |
| JP2003150976A (en) | Image processing method, image processor, and storage medium and program for executing image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued | ||
| FZDE | Discontinued |
Effective date: 20031127 |