CA2140643C - Image processing device and method - Google Patents
Image processing device and method Download PDFInfo
- Publication number
- CA2140643C CA2140643C CA002140643A CA2140643A CA2140643C CA 2140643 C CA2140643 C CA 2140643C CA 002140643 A CA002140643 A CA 002140643A CA 2140643 A CA2140643 A CA 2140643A CA 2140643 C CA2140643 C CA 2140643C
- Authority
- CA
- Canada
- Prior art keywords
- memory
- data
- image data
- moving picture
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F13/95—Storage media specially adapted for storing game information, e.g. video game cartridges
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
- H04N19/23—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/203—Image generating hardware
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/206—Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
Abstract
An processing device and method by which a foreground to be combined with a background can be displayed with natural motion and a realistic superimposed image can be displayed. The image processing device, which combines first image data (foreground data) stored in a first memory (23) with second image data (background data) stored in a second memory (24) and outputs a superimposed image, includes a third memory (13) which stores image data of a moving picture, and means (17, 20) for reading the data of the moving picture from the third memory (13) and storing the data of the moving picture in the first memory (23) as the first image data.
Description
IMAGE PROCESSING DEVICE AND METHOD
The present invention relates to an image processing device and method, and more particularly to an image processing device having a function of superimposing a foreground image and a background 10 image.
BACKGROUND ART
Conventionally, a video game device is known such a kind of image processing device. The video game 15 device is connected to a monitor device such as a CRT
or a liquid crystal display. An image of a foreground such as a character coming on a game is superimposed with an image of a background and is displayed on the monitor device. The game is played by changing the 20 foreground image and the background image in response to a control signal input by the player.
The foreground contains an object (character) having motion, such as a human being or an animal. The motion of the character is represented by changing its 25 position and shape on the display. For example, the motion of a player character, which is a character directly controlled by the player, is represented so that the position and shape of the player character is changed in accordance with the control signal given by 30 the player.
Conventionally, in order to represent the motion of the character and the like by a change of its _ 2 1 shape, still pictures having different shapes are produced beforehand and are stored in a non-volatile memory such as a ROM. A series of motion is represented by sequentially reading the still pictures 5 from the memory. The still pictures may be artificially produced or pictures extracted from a natural picture taken by a video camera in a time-lapse way.
The technique of representing the motion of 10 the character by means of the still pictures can reduce the capacity of the memory to be built in the video game device, while it provides an unnatural motion of the character and the player feels insufficient reality during play of the game.
DISCLOSURE OF THE INVENTION
The present invention was made taking into consideration the above, and has an object of providing an image processing device and method capable of 20 representing natural motion of a foreground image to be superimposed with a background image and representing a resultant image having good reality.
In order to overcome the above disadvantages, the image processing device of the present invention, 25 in which a superimposed image is produced by combining first image data stored in a first memory (23) and second image data stored in a second memory (24), includes a third memory (13) storing data of a moving picture, and means (17, 20) for reading the data of the 30 moving picture from the third memory and storing, as the first image data, the data of the moving picture in the first memory.
The disadvantages described above can also be overcome by a method of obtaining a superimposed image by combining first image data stored in a first memor~~ (23), and second image da~a stored in a second memory (24), the method including a first step ([5], [7]), of storing data of a moving picture in a third memory (13), and a second step ([9] - [11]) of reading the data of the moving picture from the t:zird memory and storing, as the first image data, the data of the movir_g picture in the first memory.
In accordance with the present irwention there is provided an image processing device having a first memory, first data processing means for storing image data of a first type in said first memory, a second memory for storing image data of a second type, and second data processing means for combining the image data respectively read from said first memory and said second memory and for outputting resultant image information, said image processing device being characterized by further comprising a third memory, and third data processing means for reading data of a moving picture from an outside of said image processing device ar_d writing the data of the moving picture into said third memory, wherein said first data processing means reads the image data stored in said third memory, processes read image data as image data of the first type, and stores processed image data in said first memory.
Ir. accordance with the present invention. there is further provided an image processing device comprising: first data processing means; second data processing means, having a first memory and a second memoryr, for storing image data in said first memory under control of said first data processing means, producing image data of a first type by performing an z information process for the image data read from said First memory, and storing produced image data in said second memory;
third data processing means, having a third memory, for producing image data of a second type and storing the image data of the second type in said third memory;
fourth data processing means for combining the image data from said second ar~d third memories and outputting resultant display image information; and fifth data processing means, having a fourth memory, for reading data of a moving picture from an outside of the image processing device and storing the data of the moving picture in said fourth memory, said first data processing means comprising means for reading the data of tie moving picture stored in said fourth memory and storing read data of the moving picture in said first memor~r, and said second data processing means comprising means for performing an information process fen the data of the moving picture read from said second memory and storing information-processed data ef the moving picture in said second memory.
In accordance with the present invention there is further provided an image processing device characterized by comprising: a first memory; first data processing means for reading a series cf moving picture data from an external device and storing the series of moving picture data in said first memory; a second memory; a second data processing means including means for writing still-picture data in said second memory and means for writing the moving picture data stored in said first memory in said second memory; a third memory; third data processing means for producing F,lrst display image data by sequentially readir:g e-t:zer the still-picture data or the moving picture data 'nom said second memory and performing an 3a information process for read data sc that a series of motion car.
be represented and for storing the first d,~splay image data ir~
said third memory; a fourth memory; fourth data processing means for producing second image data and storing the second imace data in said fourth memory; and fifth data processing means for combining the image data read from said third and fourth memories and for outputting resultant display image irformaticn.
In accordance with the present invention there is further provided an image processing device characterized by comprising: a moving picture frame buffer memory; first data processing means for reading a series of moving picture data from an external storage device and sequentially storing the series of moving picture data in said moving picture frame buffer memory; a first video memory; a second data processing means including means for writing still-picture data in said first video memory and means for writing the moving picture data stored in said moving picture frame buffer memory into said first video memory; a second frame buffer memory; third data processing means for sequentially reading the still-picture data and the moving picture data from said first video memory and performing an information process for read data so that foreground image data for representing a series of motion can be produced and for storing the foreground image data in said second frame buffer memory; a second video memory; fourth data processing means for producing background image data and storing the background image. data in said second memory; and firth data processing means for combining the image data read from said second frame buffer memory and said second video memory and for outputting resultant display image information.
3b In accordance with the present invention t:zere is further provided a method including step (a) of storing image data in a first memory, step (b) of sequentially reading desired image data from said first memory, producing display image data of a first type representing motion, and storing the produced display image data in a second memory, step (c) of producing displ ay image data of a second tsrpe in a third memor~r, ar_d step (d) of sequentially reading image information from said second and third memories, combining the display image data of the first and second types to thereby produce superimposed display image data, characterized in that said method comprises: step (e) of sequentially reading a series of moving picture data stored in an external storage device and storing the series of moving picture data in a fourth memory; and step (fof sequentially reading the moving picture data stored in said fourth memory and storing it in said first memory, in the step (b), the moving picture data being s~~bjected to an information process and being stored, as the first display image data, in said second memory.
In accordance with t~:e present invention there is further provided an image processing method comprising the steps of: (a) sequentially reading a series of moving picture data from an external device and storing the read data in a first memory; producing still-picture data and storing the produced data in a second memory; (c) storing the moving picture image read from said first memory in said second memory; (d) performing an information for the still-picture data read from second memory to produce foreground image data representing a series of motion, and storing the thus produced foreground image data in a third memory when the still-picture data is stored in said second memory; (e) performing an information process ~or 3c the moving picture data read from said second memory to produce foreground image data including a moving picture, and storing the thus produced foreground image data in said third memory;
(f) producing backgrour_d image data and storing the background image data in a fourth memory; and (g) reading the image data from said third and fourth memories and producing display image data by combining the foreground image data and the background image data.
In accordance with t:~e present invention there is further provided an image processing device comprising: first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data; and second means for superimposing the foreground image data which has been subjected to the predetermined process and background image data out outputting superimposed image data to the outside of the image processing device.
In accordance with the present invent=on these is further provided an image processing device comprising: a memory; first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to the predetermined process beir_g stored in the memory; and second means for superimposing the foreground image data stored in the memory and background image data stored in the memory and for outputting superimposed image data to the outside of the image processing device.
3d In aCCOrdanCe With the TJreSent lnVentl.On t.'lere iS
further provided an image processing method comprising to steps of: acquiring foreground image data which form moving pi-~~ures and performing a predetermined prccess for the foreground image data; and superimpcsing the foregrcurd image data which has beer_ subjected to the predetermined process and background image data and outputting superimposed image data to a display.
In accordance with the present invention there is further provided an image processing met'.~.ed comprisng t:e steps of: acquiring foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to t'-~_e predetermined process being stored in a memcry; and superimposing the foreground image data stored in the memor-~r and background image data stored in the memcry and outputtinc superimposed image data to a display.
BRIEF DESCRIPTION OF THE DRAWINGS
Other objects, features and advantages of the present invention will become apparent from the following description read in conjunction with the accompanying drawings, in which:
Fig. 1 is a block diagram of an image processing system which uses an image processing device according to an embodiment of the present invention;
Fig. 2 is a diagram of a transfer of moving picture data from a moving picture frame buffer to a sprite VRAM shown in Fig. 1;
Fig. 3 is a diagram of an example of data stored in the sprite VRAM shown in Fig. 1;
Fig. 4 is a diagram of explaining a scroll process;
3e Fig. 5 is a diagram of the coeraticn of a pricrity circuit shown in Fic. 1;
Fig. 6 is a diagram of explaining priority bits necessary for the operaticn of the priority circuit;
Fig. 7 is a diagram of the cneration of the 3f 1 image processing device shown in Fig. 1;
Fig. 8 is a diagram of the operation of the image processing device shown in Fig. 1;
Fig. 9 is a diagram of the operation of the image processing device shown in Fig. 1;
Fig. 10 is a diagram of the operation of the image processing device shown in Fig. 1;
Fig. 11 is a diagram of the operation of the image processing device shown in Fig. 1; and Fig. 12 is a diagram of a variation of the image processing device shown in Fig. 1.
BEST MODE FOR CARRYING OUT THE INVENTION
A description will now be given of embodiments of the present invention with reference to the accompanying drawings.
Fig. 1 is a block diagram of an embodiment of the present invention. An image processing device 100 shown in Fig. 1 is used together with a disk drive 10, a monitor 32 and speakers 44, so that a video game system can be formed. For example, a video game device for home use is configured so that the image processing device 100 functions as a device main body, to which a television set having the monitor 32 and the speakers 44 are connected. Further, a disk (such as a CD-ROM) which stores a program of a game which the player wants to play is set in the disk drive 10.
The disk stores, in addition to the above program, sound data and image data of a moving picture formed by a natural picture or the like. It will be noted that the moving picture is defined as a picture having a series of motion represented by, for example, 1 10 - 60 sheets (frames) of image data (patterns) per second. For example, an image itself taken by the video camera is a moving picture. Hence, the sheets of image data are ordinarily different from each other.
5 On the other hand, as has been described previously, a motion realized by using the still'pictures is represented by repeatedly combining a few sheets of image data (patterns) together.
In order to save the available storage 10 capacity on the disk, the moving picture data is compressed and is then stored on the disk. The compression is achieved by, for example, the MPEG
(Moving Picture Experts Group) method, which is an international standard of the audiovisual signal 15 encoding method. According to the MPEG method, it is possible to store, on one disk for 74 minutes, 30 sheets of moving picture per second and a sound obtained by 44.1 kHz sampling.
In the disk drive 10, compressed moving 20 picture data reproduced from the disk is stored in an internal buffer 11. The above compressed moving picture data is data obtained by compressing moving picture data of the YUV system (luminance Y, color differences U and V) according to the MPEG method. The 25 compressed moving picture data stored in the buffer 11 is then supplied to a decoder 12 of the image processing device, in which the compressed moving picture data is expanded to moving picture data of the YUV system. Then, the expanded moving picture data is 30 written into a moving picture frame buffer 13. The decoder 12 has the function of reading the expanded moving picture data of the YW system from the moving 1 picture frame buffer 13, converting it into moving picture data of the RGB system and outputting the moving picture data of the RGB system. As will be described later, the moving picture data of the RGB
5 system produced by the decoder 12 may be output to a sprite VRAM 22 via a bus 14 and may be output to a priority circuit 30.
To the bus 14, there are connected a CPU 15, a RAM 16, a bus controller 17, a sprite engine 20 10 performing an image process for a foreground (sprite), and a scroll engine 21 performing an image process for a background. To the sprite engine 20, there are connected to the sprite VRAM 22 storing foreground patterns, and a sprite frame buffer 23 forming a 15 foreground pattern equal to at least one frame. A
scroll VRAM 24, which stores a background pattern and has a storage area greater than one frame, is connected to the scroll engine 21.
The CPU 15 issues a command against the 20 sprint engine 20 and the scroll engine 21 to cause these engines to produce a superimposed image. The bus controller 17 reads data of the foreground image from the moving picture frame buffer 13 at a timing in which the CPU 15 does not occupy the bus 14, and writes the 25 read image data into the sprite VRAM 22 from the bus 14 via the sprite engine 20. All the content of the moving picture frame buffer 13 may be transferred to the sprite VRAM 22, or part (only the foreground part) of the content of the moving picture frame buffer 13 30 may be transferred thereto.
Fig. 2 is a diagram of a transfer of the moving picture data from the moving picture frame 1 buffer 13 to the sprite VRAM 22. Under the control of the CPU 15, part or all of the moving picture data in the moving picture frame buffer 13 is transferred to the sprite VRAM 22. Cutting out of part of the moving 5 picture data is carried out so that the CPU 15 outputs coordinates data for cutting-out to the frame buffer 13 via the bus controller 17. The above transfer is performed every frame of the moving picture (every pattern). In the embodiment of the present invention 10 being considered, foreground images having natural motion can be produced by transferring the moving picture data from the moving picture frame buffer 13 to the sprite VRAM 22.
The sprite engine 20 selectively reads image 15 data of a foreground pattern such as a character, and carries out image processes for the read image data, such as rotation, enlargement, reduction and color computation processes. Thereafter, the sprite engine 20 causes the image-processed foreground pattern to be 20 stored in an area of the sprite frame buffer 23 specified by a given address. In the example shown in Fig. 2, picture data equal to the whole of one frame and transferred to the sprite VRAM 22 is subjected to the rotation process by the sprite engine 20 so that 25 the transferred picture data is converted into image data forming a rotating cube, which is then stored in the sprite frame buffer 22.
Fig. 3 is a diagram of the inner part of the sprite VRAM 22. In the sprite VRAM 22, a parameter 30 table 22A is stored in addition to a plurality of items of foreground image data (pattern data) 22B. The parameter table 22A is produced, for example, for each _ g _ 1 character contained in the foreground by the CPU 15.
The parameter table 22A includes position coordinates data indicating the position of the corresponding character on the sprite frame buffer 22, the size 5 (dimensions) of the character on the sprite frame buffer 23, data relating to the tilt of the character including rotation, and position coordinates data indicating the position in the sprite VRAM 22 storing pattern data of the character. The sprite engine 20 10 refers to the parameter table 22A, and writes the pattern data located in the specified position in the sprite VRAM 22 into a specified position in the sprite frame buffer 23. A transfer of the moving picture data to the sprite VRAM 22 is performed each time the moving 15 picture data in the moving picture frame buffer 13 is updated or at an appropriate timing other than updating.
The parameters relating to representation of the foreground image are not limited to the above-20 described ones, but desirable parameters can be defined in the parameter table 22A. The pattern data 22B
forming the foreground image is not limited to the moving picture frame buffer 13, but may include still-picture data conventionally used.
25 The foreground image data equal to one frame thus formed in the sprite frame buffer 23 is read by the sprite engine 20, and is directly supplied, without the bus 14, to the priority circuit 30 in synchronism with scanning of the monitor 32 (vertical, horizontal 30 and dot synchronizations for the monitor 32).
Principally, it is sufficient for the sprite frame buffer 23 to have a storage area equal to one _ g _ 1 frame. However, it is preferable that a storage area equal to two frames be provided and the writing and reading operations on the two frames are alternately carried out in order to speed up the process.
5 . The scroll engine 21 produces the background image, on which the characters can be moved, and other images. The scroll VRAM 24 has at least one storage area which is greater than one frame and corresponds to the scroll picture plane. The scroll picture plane 10 corresponds to a plane obtained by extending and connecting right, left, upper and lower ends of the screen (one frame) of the monitor 32. The scroll engine 21 scrolls the background by moving the display area which is located in the scroll picture plane in 15 the scroll VRAM 24 and is to be displayed on the monitor screen.
The background image data stored in the scroll VRAM 24 is, for example, data read from the disk drive 10 under the control of the CPU 15. In order to 20 reduce the amount of data stored in the scroll VRAM 24, an image equal to one frame can be formed by combining squares, each having a certain size (normally, 8 x 8 dots or 16 x 16 dots) (VRAM method).
Fig. 4 is a diagram showing the scroll 25 process. Units (a), (b) and (c) having different patterns as well as a table (pattern table) defining the order of arranging these units are stored in a storage area in the scroll VRAM 24 other than the storage area used for storing the scroll picture. For 30 example, these units are read from the CD-ROM
beforehand and are stored in the scroll VRAM 24. The CPU 15 outputs the parameters relating to the scroll 1 process to the scroll engine 21. The scroll engine 21 reads the pattern name table ~- in the scroll VRAM 24, ~' and then reads cells defined therein. Then, the scroll engine 21 directly outputs the scroll picture plane to the priority circuit 30 via the bus 14. The above sequential operation is carried out in real time in synchronism with the scan of the monitor 32 (vertical, horizontal and dot synchronizations).
The priority circuit 30 receives the sprite picture plane supplied from the sprite engine 20 (for example, a picture plane 50 in Fig. 5), and the scroll picture plane supplied from the scroll engine 21 (for example, a picture plane 51 in Fig. 5), and superimposes these picture planes to thereby produce a digital video signal indicating a superimposed picture plane (52 in Fig. 5) equal to one frame. In the picture plane superimposing operation, it is necessary to determine, for each dot, whether the sprite picture plane or the scroll picture plane should be valid (selected). In order to perform the above determination, a priority bit is added to the image data forming the sprite picture plane every dot.
Fig. 6 is a diagram of image data of a sprite picture plane and a priority bit added thereto. As shown in part (A) of Fig. 6, one pixel in the expanded moving picture forming the sprite picture plane is expressed by 15 bits consisting of five bits for R, five bits for G and five bits for B. One pixel shown in part (A) of Fig. 6 represents light yellow. A
priority bit PB of one bit is added to the one-pixel data as shown in part (A) of Fig. 6. When the priority bit PB is equal to 1 as shown in part (A) of Fig. 6, it 1 is valid, and the corresponding one-pixel data is selected by the priority circuit 30 and is output to a video D/A converter 31. When PB = 0 (shown in part (B) of Fig. 6), the priority bit is invalid, and the 5 corresponding one-pixel data is not selected by the priority circuit 30, but one-pixel data of image data forming the scroll picture plane is selected by the priority circuit 30, and is output to the D/A converter 31. The priority bit PB shown in Fig. 6 is one bit, 10 but may consist of a plurality of bits. For example, in the structure shown in Fig. 1, a plurality of priority bits PB, for example, two bits, are needed to process a case where the sequence of displaying the scroll picture plane and the sprite picture plane (the 15 sequence indicating whether the scroll picture plane or the sprite picture plane should be overlapped on the other one) is specified every dot. An example of the above case is such that there are moving pictures having a near-ground and a far-ground other than images 20 located in an equal distance, and the scroll plane or the sprite plane is inserted between the near-ground and the far-ground.
The decoder 12 shown in Fig. 1 expands the compressed moving picture data and adds the priority 25 bit PB to the expanded data under the control of the CPU 15. Images that are contained in the foreground and are other than the moving picture are assigned the priority bits PB beforehand and are stored in the sprite VRAM 22.
30 The D/A converter 31 shown in Fig. 1 receives the digital video signal from the priority circuit 30, and converts it into an analog video signal, which is 1 then output to the monitor 32. An I/O controller 41 receives a control signal from a control pad unit 40 operated by the player, and outputs it to the CPU 15.
A sound engine 42 produces sounds to be output during game play, and outputs a corresponding analog audio signal to the speakers 44 via an audio D/A converter 43.
A description will now be given, with reference to a timing chart of Fig. 7, of the operation of the image processing device 100 shown in Fig. 1. It will be noted that Fig. 7 is primarily intended to show signals transferred between parts of the image processing device 100 and these signals may not be transferred in the sequence illustrated in Fig. 7.
The CPU 15 outputs an instruction for reading the disk (CD-ROM) to the disk drive 10 (step [1]). The disk drive 10 reads the specified compressed moving picture data from the disk, and stores it in the built-in buffer 11. The decoder 12 reads the compressed moving picture data from the buffer 11, and reproduces (expands) it so that expanded moving picture data is stored in the moving picture frame buffer 13 (step [2]). The CPU 15 produces the aforementioned parameter tables in the sprite VRAM 22 via the sprite engine 20 (steps [3] and [4]). For example, the parameter tables used in a fighting game are respectively produced with respect to the player's character and an enemy character, and the coordinates, sizes, tilts and pattern data storage positions of the player's character and the enemy character are stored in the respective parameter tables, as shown in Fig. 3. The motion of the player's character is controlled in 1 accordance with the control signal input by the player via the control pad unit 40 (steps [8] and [9]). The CPU 15 updates one or plural parameters in the parameter table, such as the coordinates values, each 5 time it receives the control signal. The parameters of the player's character such as the coordinates values are updated according to a predetermined rule under the control of the CPU 15.
The CPU 15 outputs an instruction of 10 transferring the expanded moving picture data to the bus controller 17 (step [5]). The bus controller 17 reads the moving picture image data from the moving picture frame buffer 13, and transfers it to the sprite VRAM 22 via the bus 14 (steps [6] and [7]). The sprite 15 engine 20 reads image data (pattern data) of the foreground (sprite) stored in the sprite VRAM 22 according to the parameter tables formed in the sprite VRAM 22, and makes the read image data stored in the sprite frame buffer 23 with the specified coordinates, 20 size and tilt (steps [10], [11]).
After all foreground image equal to one frame is stored in the sprite frame buffer 23 in the above-mentioned way, the sprite engine 20 reads the image data of the sprite picture plane from the sprite frame 25 buffer 23, and outputs it to the priority circuit 30 (step [12]). The scroll engine 21 reads image data of the scroll picture plane from the scroll VRAM 24, and outputs it to the priority circuit 30 (steps [13], [14]). In the case where the moving picture data 30 stored in the moving picture frame buffer 13 is used instead of the scroll picture plane or is used as a background in addition to the scroll picture plane, the 1 priority circuit 30 receives image data of the moving picture from the moving picture frame buffer 13 (steps [15), [16]). In accordance with the priority bit, the priority circuit 30 selects either the sprite picture 5 plane or the scroll picture plane for each dot, and outputs the dot of the selected picture plane to the video D/A converter 31 (step [17]). In the case where the moving picture plane read from the moving picture frame buffer 13 is used, one of the planes including 10 the above plane is selected on the one-dot basis and is output to the video D/A converter 31 (step [17]). The video D/A converter converts the received digital video signal into the corresponding analog signal, which is then output to the monitor 32 (step [18)).
15 In parallel to the above image processing and outputting, the sound engine 42 produces BGM, effective sounds and speech, and outputs a corresponding digital audio signal to the audio D/A converter 43. The audio D/A converter 43 converts the digital audio signal to 20 the corresponding analog audio signal, which is then output to the speakers 44.
The above process is repeatedly performed and the game goes on.
Fig. 8 is a diagram showing that characters 25 of moving pictures used in a game are stored in the moving picture frame buffer 13. Three moving picture characters 40a, 40b and 40c are stored in one frame of the moving picture frame buffer 13. More particularly, Fig. 8 corresponds to one scene (one frame) of moving 30 picture data, and a large number of items of moving picture data (a large number of frames) are stored in the CD-ROM so as to lead to and follow the frame shown 1 in Fig. 8. The moving picture data shown in Fig. 8 is subjected to a process on the frame basis so that parts 40a - 40c are cut out and are then transferred to and stored in a specified area in the sprite VRAM 22. As 5 shown in Fig. 9, foreground images 41a, 41b, 41c and 41d of still pictures may be stored in the sprite VRAM
22.
Out of the foreground images shown in Fig. 9, the foreground image 40c is enlarged and rotated by the 10 sprite engine 20, and is stored in the sprite frame buffer 23, as shown in Fig. 10. Further, the foreground image 41c is reduced and stored in the sprite frame buffer 23, as shown in Fig. 10. The foreground image in the sprite frame buffer 23 shown in 15 Fig. 10 is superimposed with the background image stored in the scroll vRAM 24 by the priority circuit 30, and a resultant image as shown in Fig. 11 is produced. In the above-mentioned way, it becomes possible to realize a display in which the foreground 20 such as characters can be changed on the frame basis and hence the foreground can be displayed as a moving picture. Hence, natural motion of characters can be obtained and reality in playing the game can be improved.
25 It will be noted that the sprite engine 20, the scroll engine 21 and the priority process themselves can be carried out in conventional image processing devices, and the structures thereof will be apparent to a person having ordinary skill in the art.
30 Hence, a description of the structures referring to the detailed parts thereof will be omitted here. Normally, the sprite engine 20 and the scroll engine 21 are ~ ~ ~fl~4~
1 formed by hardware. The embodiment of the present invention being considered is intended to overcome the aforementioned disadvantages by primarily modifying signals to be processed in the structures of the 5 engines (all or part of the moving picture data is written into the sprite VRAM 22 orn the frame basis).
Fig. 12 is a block diagram of a variation of the structure shown in Fig. 1. A decoder 12a shown in Fig. 12 is substituted for the decoder 12 shown in Fig.
10 1. In the structure shown in Fig. 12, the moving picture frame buffer 13 is directly connected to the bus 14. The decoder shown in Fig. 12 expands compressed moving picture data of the YUV system read from the buffer 11, and converts it into the RGB-system 15 moving picture data, which is then stored in the moving picture frame buffer 13. The moving picture data of the RGB system read from the moving picture frame buffer 13 can be output to the sprite VRAM 22 and the priority circuit 30. In the above way, the moving 20 picture frame buffer 13 used in the structure shown in Fig. 12 can store moving picture data of the RGB
system.
INDUSTRIAL APPLICABILITY
25 As described above, according to the image processing device of the present invention, it becomes possible to use, as a foreground, a moving picture such as a character and reality of superimposed images can be improved. These advantages are very effective in 30 practical use. The present invention is not limited to home-use game machines but includes business-use game machines. Further, the present invention is not 2i40643 1 limited to game machines but broadly includes an image processing device which superimposed images to form a picture plane.
The present invention relates to an image processing device and method, and more particularly to an image processing device having a function of superimposing a foreground image and a background 10 image.
BACKGROUND ART
Conventionally, a video game device is known such a kind of image processing device. The video game 15 device is connected to a monitor device such as a CRT
or a liquid crystal display. An image of a foreground such as a character coming on a game is superimposed with an image of a background and is displayed on the monitor device. The game is played by changing the 20 foreground image and the background image in response to a control signal input by the player.
The foreground contains an object (character) having motion, such as a human being or an animal. The motion of the character is represented by changing its 25 position and shape on the display. For example, the motion of a player character, which is a character directly controlled by the player, is represented so that the position and shape of the player character is changed in accordance with the control signal given by 30 the player.
Conventionally, in order to represent the motion of the character and the like by a change of its _ 2 1 shape, still pictures having different shapes are produced beforehand and are stored in a non-volatile memory such as a ROM. A series of motion is represented by sequentially reading the still pictures 5 from the memory. The still pictures may be artificially produced or pictures extracted from a natural picture taken by a video camera in a time-lapse way.
The technique of representing the motion of 10 the character by means of the still pictures can reduce the capacity of the memory to be built in the video game device, while it provides an unnatural motion of the character and the player feels insufficient reality during play of the game.
DISCLOSURE OF THE INVENTION
The present invention was made taking into consideration the above, and has an object of providing an image processing device and method capable of 20 representing natural motion of a foreground image to be superimposed with a background image and representing a resultant image having good reality.
In order to overcome the above disadvantages, the image processing device of the present invention, 25 in which a superimposed image is produced by combining first image data stored in a first memory (23) and second image data stored in a second memory (24), includes a third memory (13) storing data of a moving picture, and means (17, 20) for reading the data of the 30 moving picture from the third memory and storing, as the first image data, the data of the moving picture in the first memory.
The disadvantages described above can also be overcome by a method of obtaining a superimposed image by combining first image data stored in a first memor~~ (23), and second image da~a stored in a second memory (24), the method including a first step ([5], [7]), of storing data of a moving picture in a third memory (13), and a second step ([9] - [11]) of reading the data of the moving picture from the t:zird memory and storing, as the first image data, the data of the movir_g picture in the first memory.
In accordance with the present irwention there is provided an image processing device having a first memory, first data processing means for storing image data of a first type in said first memory, a second memory for storing image data of a second type, and second data processing means for combining the image data respectively read from said first memory and said second memory and for outputting resultant image information, said image processing device being characterized by further comprising a third memory, and third data processing means for reading data of a moving picture from an outside of said image processing device ar_d writing the data of the moving picture into said third memory, wherein said first data processing means reads the image data stored in said third memory, processes read image data as image data of the first type, and stores processed image data in said first memory.
Ir. accordance with the present invention. there is further provided an image processing device comprising: first data processing means; second data processing means, having a first memory and a second memoryr, for storing image data in said first memory under control of said first data processing means, producing image data of a first type by performing an z information process for the image data read from said First memory, and storing produced image data in said second memory;
third data processing means, having a third memory, for producing image data of a second type and storing the image data of the second type in said third memory;
fourth data processing means for combining the image data from said second ar~d third memories and outputting resultant display image information; and fifth data processing means, having a fourth memory, for reading data of a moving picture from an outside of the image processing device and storing the data of the moving picture in said fourth memory, said first data processing means comprising means for reading the data of tie moving picture stored in said fourth memory and storing read data of the moving picture in said first memor~r, and said second data processing means comprising means for performing an information process fen the data of the moving picture read from said second memory and storing information-processed data ef the moving picture in said second memory.
In accordance with the present invention there is further provided an image processing device characterized by comprising: a first memory; first data processing means for reading a series cf moving picture data from an external device and storing the series of moving picture data in said first memory; a second memory; a second data processing means including means for writing still-picture data in said second memory and means for writing the moving picture data stored in said first memory in said second memory; a third memory; third data processing means for producing F,lrst display image data by sequentially readir:g e-t:zer the still-picture data or the moving picture data 'nom said second memory and performing an 3a information process for read data sc that a series of motion car.
be represented and for storing the first d,~splay image data ir~
said third memory; a fourth memory; fourth data processing means for producing second image data and storing the second imace data in said fourth memory; and fifth data processing means for combining the image data read from said third and fourth memories and for outputting resultant display image irformaticn.
In accordance with the present invention there is further provided an image processing device characterized by comprising: a moving picture frame buffer memory; first data processing means for reading a series of moving picture data from an external storage device and sequentially storing the series of moving picture data in said moving picture frame buffer memory; a first video memory; a second data processing means including means for writing still-picture data in said first video memory and means for writing the moving picture data stored in said moving picture frame buffer memory into said first video memory; a second frame buffer memory; third data processing means for sequentially reading the still-picture data and the moving picture data from said first video memory and performing an information process for read data so that foreground image data for representing a series of motion can be produced and for storing the foreground image data in said second frame buffer memory; a second video memory; fourth data processing means for producing background image data and storing the background image. data in said second memory; and firth data processing means for combining the image data read from said second frame buffer memory and said second video memory and for outputting resultant display image information.
3b In accordance with the present invention t:zere is further provided a method including step (a) of storing image data in a first memory, step (b) of sequentially reading desired image data from said first memory, producing display image data of a first type representing motion, and storing the produced display image data in a second memory, step (c) of producing displ ay image data of a second tsrpe in a third memor~r, ar_d step (d) of sequentially reading image information from said second and third memories, combining the display image data of the first and second types to thereby produce superimposed display image data, characterized in that said method comprises: step (e) of sequentially reading a series of moving picture data stored in an external storage device and storing the series of moving picture data in a fourth memory; and step (fof sequentially reading the moving picture data stored in said fourth memory and storing it in said first memory, in the step (b), the moving picture data being s~~bjected to an information process and being stored, as the first display image data, in said second memory.
In accordance with t~:e present invention there is further provided an image processing method comprising the steps of: (a) sequentially reading a series of moving picture data from an external device and storing the read data in a first memory; producing still-picture data and storing the produced data in a second memory; (c) storing the moving picture image read from said first memory in said second memory; (d) performing an information for the still-picture data read from second memory to produce foreground image data representing a series of motion, and storing the thus produced foreground image data in a third memory when the still-picture data is stored in said second memory; (e) performing an information process ~or 3c the moving picture data read from said second memory to produce foreground image data including a moving picture, and storing the thus produced foreground image data in said third memory;
(f) producing backgrour_d image data and storing the background image data in a fourth memory; and (g) reading the image data from said third and fourth memories and producing display image data by combining the foreground image data and the background image data.
In accordance with t:~e present invention there is further provided an image processing device comprising: first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data; and second means for superimposing the foreground image data which has been subjected to the predetermined process and background image data out outputting superimposed image data to the outside of the image processing device.
In accordance with the present invent=on these is further provided an image processing device comprising: a memory; first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to the predetermined process beir_g stored in the memory; and second means for superimposing the foreground image data stored in the memory and background image data stored in the memory and for outputting superimposed image data to the outside of the image processing device.
3d In aCCOrdanCe With the TJreSent lnVentl.On t.'lere iS
further provided an image processing method comprising to steps of: acquiring foreground image data which form moving pi-~~ures and performing a predetermined prccess for the foreground image data; and superimpcsing the foregrcurd image data which has beer_ subjected to the predetermined process and background image data and outputting superimposed image data to a display.
In accordance with the present invention there is further provided an image processing met'.~.ed comprisng t:e steps of: acquiring foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to t'-~_e predetermined process being stored in a memcry; and superimposing the foreground image data stored in the memor-~r and background image data stored in the memcry and outputtinc superimposed image data to a display.
BRIEF DESCRIPTION OF THE DRAWINGS
Other objects, features and advantages of the present invention will become apparent from the following description read in conjunction with the accompanying drawings, in which:
Fig. 1 is a block diagram of an image processing system which uses an image processing device according to an embodiment of the present invention;
Fig. 2 is a diagram of a transfer of moving picture data from a moving picture frame buffer to a sprite VRAM shown in Fig. 1;
Fig. 3 is a diagram of an example of data stored in the sprite VRAM shown in Fig. 1;
Fig. 4 is a diagram of explaining a scroll process;
3e Fig. 5 is a diagram of the coeraticn of a pricrity circuit shown in Fic. 1;
Fig. 6 is a diagram of explaining priority bits necessary for the operaticn of the priority circuit;
Fig. 7 is a diagram of the cneration of the 3f 1 image processing device shown in Fig. 1;
Fig. 8 is a diagram of the operation of the image processing device shown in Fig. 1;
Fig. 9 is a diagram of the operation of the image processing device shown in Fig. 1;
Fig. 10 is a diagram of the operation of the image processing device shown in Fig. 1;
Fig. 11 is a diagram of the operation of the image processing device shown in Fig. 1; and Fig. 12 is a diagram of a variation of the image processing device shown in Fig. 1.
BEST MODE FOR CARRYING OUT THE INVENTION
A description will now be given of embodiments of the present invention with reference to the accompanying drawings.
Fig. 1 is a block diagram of an embodiment of the present invention. An image processing device 100 shown in Fig. 1 is used together with a disk drive 10, a monitor 32 and speakers 44, so that a video game system can be formed. For example, a video game device for home use is configured so that the image processing device 100 functions as a device main body, to which a television set having the monitor 32 and the speakers 44 are connected. Further, a disk (such as a CD-ROM) which stores a program of a game which the player wants to play is set in the disk drive 10.
The disk stores, in addition to the above program, sound data and image data of a moving picture formed by a natural picture or the like. It will be noted that the moving picture is defined as a picture having a series of motion represented by, for example, 1 10 - 60 sheets (frames) of image data (patterns) per second. For example, an image itself taken by the video camera is a moving picture. Hence, the sheets of image data are ordinarily different from each other.
5 On the other hand, as has been described previously, a motion realized by using the still'pictures is represented by repeatedly combining a few sheets of image data (patterns) together.
In order to save the available storage 10 capacity on the disk, the moving picture data is compressed and is then stored on the disk. The compression is achieved by, for example, the MPEG
(Moving Picture Experts Group) method, which is an international standard of the audiovisual signal 15 encoding method. According to the MPEG method, it is possible to store, on one disk for 74 minutes, 30 sheets of moving picture per second and a sound obtained by 44.1 kHz sampling.
In the disk drive 10, compressed moving 20 picture data reproduced from the disk is stored in an internal buffer 11. The above compressed moving picture data is data obtained by compressing moving picture data of the YUV system (luminance Y, color differences U and V) according to the MPEG method. The 25 compressed moving picture data stored in the buffer 11 is then supplied to a decoder 12 of the image processing device, in which the compressed moving picture data is expanded to moving picture data of the YUV system. Then, the expanded moving picture data is 30 written into a moving picture frame buffer 13. The decoder 12 has the function of reading the expanded moving picture data of the YW system from the moving 1 picture frame buffer 13, converting it into moving picture data of the RGB system and outputting the moving picture data of the RGB system. As will be described later, the moving picture data of the RGB
5 system produced by the decoder 12 may be output to a sprite VRAM 22 via a bus 14 and may be output to a priority circuit 30.
To the bus 14, there are connected a CPU 15, a RAM 16, a bus controller 17, a sprite engine 20 10 performing an image process for a foreground (sprite), and a scroll engine 21 performing an image process for a background. To the sprite engine 20, there are connected to the sprite VRAM 22 storing foreground patterns, and a sprite frame buffer 23 forming a 15 foreground pattern equal to at least one frame. A
scroll VRAM 24, which stores a background pattern and has a storage area greater than one frame, is connected to the scroll engine 21.
The CPU 15 issues a command against the 20 sprint engine 20 and the scroll engine 21 to cause these engines to produce a superimposed image. The bus controller 17 reads data of the foreground image from the moving picture frame buffer 13 at a timing in which the CPU 15 does not occupy the bus 14, and writes the 25 read image data into the sprite VRAM 22 from the bus 14 via the sprite engine 20. All the content of the moving picture frame buffer 13 may be transferred to the sprite VRAM 22, or part (only the foreground part) of the content of the moving picture frame buffer 13 30 may be transferred thereto.
Fig. 2 is a diagram of a transfer of the moving picture data from the moving picture frame 1 buffer 13 to the sprite VRAM 22. Under the control of the CPU 15, part or all of the moving picture data in the moving picture frame buffer 13 is transferred to the sprite VRAM 22. Cutting out of part of the moving 5 picture data is carried out so that the CPU 15 outputs coordinates data for cutting-out to the frame buffer 13 via the bus controller 17. The above transfer is performed every frame of the moving picture (every pattern). In the embodiment of the present invention 10 being considered, foreground images having natural motion can be produced by transferring the moving picture data from the moving picture frame buffer 13 to the sprite VRAM 22.
The sprite engine 20 selectively reads image 15 data of a foreground pattern such as a character, and carries out image processes for the read image data, such as rotation, enlargement, reduction and color computation processes. Thereafter, the sprite engine 20 causes the image-processed foreground pattern to be 20 stored in an area of the sprite frame buffer 23 specified by a given address. In the example shown in Fig. 2, picture data equal to the whole of one frame and transferred to the sprite VRAM 22 is subjected to the rotation process by the sprite engine 20 so that 25 the transferred picture data is converted into image data forming a rotating cube, which is then stored in the sprite frame buffer 22.
Fig. 3 is a diagram of the inner part of the sprite VRAM 22. In the sprite VRAM 22, a parameter 30 table 22A is stored in addition to a plurality of items of foreground image data (pattern data) 22B. The parameter table 22A is produced, for example, for each _ g _ 1 character contained in the foreground by the CPU 15.
The parameter table 22A includes position coordinates data indicating the position of the corresponding character on the sprite frame buffer 22, the size 5 (dimensions) of the character on the sprite frame buffer 23, data relating to the tilt of the character including rotation, and position coordinates data indicating the position in the sprite VRAM 22 storing pattern data of the character. The sprite engine 20 10 refers to the parameter table 22A, and writes the pattern data located in the specified position in the sprite VRAM 22 into a specified position in the sprite frame buffer 23. A transfer of the moving picture data to the sprite VRAM 22 is performed each time the moving 15 picture data in the moving picture frame buffer 13 is updated or at an appropriate timing other than updating.
The parameters relating to representation of the foreground image are not limited to the above-20 described ones, but desirable parameters can be defined in the parameter table 22A. The pattern data 22B
forming the foreground image is not limited to the moving picture frame buffer 13, but may include still-picture data conventionally used.
25 The foreground image data equal to one frame thus formed in the sprite frame buffer 23 is read by the sprite engine 20, and is directly supplied, without the bus 14, to the priority circuit 30 in synchronism with scanning of the monitor 32 (vertical, horizontal 30 and dot synchronizations for the monitor 32).
Principally, it is sufficient for the sprite frame buffer 23 to have a storage area equal to one _ g _ 1 frame. However, it is preferable that a storage area equal to two frames be provided and the writing and reading operations on the two frames are alternately carried out in order to speed up the process.
5 . The scroll engine 21 produces the background image, on which the characters can be moved, and other images. The scroll VRAM 24 has at least one storage area which is greater than one frame and corresponds to the scroll picture plane. The scroll picture plane 10 corresponds to a plane obtained by extending and connecting right, left, upper and lower ends of the screen (one frame) of the monitor 32. The scroll engine 21 scrolls the background by moving the display area which is located in the scroll picture plane in 15 the scroll VRAM 24 and is to be displayed on the monitor screen.
The background image data stored in the scroll VRAM 24 is, for example, data read from the disk drive 10 under the control of the CPU 15. In order to 20 reduce the amount of data stored in the scroll VRAM 24, an image equal to one frame can be formed by combining squares, each having a certain size (normally, 8 x 8 dots or 16 x 16 dots) (VRAM method).
Fig. 4 is a diagram showing the scroll 25 process. Units (a), (b) and (c) having different patterns as well as a table (pattern table) defining the order of arranging these units are stored in a storage area in the scroll VRAM 24 other than the storage area used for storing the scroll picture. For 30 example, these units are read from the CD-ROM
beforehand and are stored in the scroll VRAM 24. The CPU 15 outputs the parameters relating to the scroll 1 process to the scroll engine 21. The scroll engine 21 reads the pattern name table ~- in the scroll VRAM 24, ~' and then reads cells defined therein. Then, the scroll engine 21 directly outputs the scroll picture plane to the priority circuit 30 via the bus 14. The above sequential operation is carried out in real time in synchronism with the scan of the monitor 32 (vertical, horizontal and dot synchronizations).
The priority circuit 30 receives the sprite picture plane supplied from the sprite engine 20 (for example, a picture plane 50 in Fig. 5), and the scroll picture plane supplied from the scroll engine 21 (for example, a picture plane 51 in Fig. 5), and superimposes these picture planes to thereby produce a digital video signal indicating a superimposed picture plane (52 in Fig. 5) equal to one frame. In the picture plane superimposing operation, it is necessary to determine, for each dot, whether the sprite picture plane or the scroll picture plane should be valid (selected). In order to perform the above determination, a priority bit is added to the image data forming the sprite picture plane every dot.
Fig. 6 is a diagram of image data of a sprite picture plane and a priority bit added thereto. As shown in part (A) of Fig. 6, one pixel in the expanded moving picture forming the sprite picture plane is expressed by 15 bits consisting of five bits for R, five bits for G and five bits for B. One pixel shown in part (A) of Fig. 6 represents light yellow. A
priority bit PB of one bit is added to the one-pixel data as shown in part (A) of Fig. 6. When the priority bit PB is equal to 1 as shown in part (A) of Fig. 6, it 1 is valid, and the corresponding one-pixel data is selected by the priority circuit 30 and is output to a video D/A converter 31. When PB = 0 (shown in part (B) of Fig. 6), the priority bit is invalid, and the 5 corresponding one-pixel data is not selected by the priority circuit 30, but one-pixel data of image data forming the scroll picture plane is selected by the priority circuit 30, and is output to the D/A converter 31. The priority bit PB shown in Fig. 6 is one bit, 10 but may consist of a plurality of bits. For example, in the structure shown in Fig. 1, a plurality of priority bits PB, for example, two bits, are needed to process a case where the sequence of displaying the scroll picture plane and the sprite picture plane (the 15 sequence indicating whether the scroll picture plane or the sprite picture plane should be overlapped on the other one) is specified every dot. An example of the above case is such that there are moving pictures having a near-ground and a far-ground other than images 20 located in an equal distance, and the scroll plane or the sprite plane is inserted between the near-ground and the far-ground.
The decoder 12 shown in Fig. 1 expands the compressed moving picture data and adds the priority 25 bit PB to the expanded data under the control of the CPU 15. Images that are contained in the foreground and are other than the moving picture are assigned the priority bits PB beforehand and are stored in the sprite VRAM 22.
30 The D/A converter 31 shown in Fig. 1 receives the digital video signal from the priority circuit 30, and converts it into an analog video signal, which is 1 then output to the monitor 32. An I/O controller 41 receives a control signal from a control pad unit 40 operated by the player, and outputs it to the CPU 15.
A sound engine 42 produces sounds to be output during game play, and outputs a corresponding analog audio signal to the speakers 44 via an audio D/A converter 43.
A description will now be given, with reference to a timing chart of Fig. 7, of the operation of the image processing device 100 shown in Fig. 1. It will be noted that Fig. 7 is primarily intended to show signals transferred between parts of the image processing device 100 and these signals may not be transferred in the sequence illustrated in Fig. 7.
The CPU 15 outputs an instruction for reading the disk (CD-ROM) to the disk drive 10 (step [1]). The disk drive 10 reads the specified compressed moving picture data from the disk, and stores it in the built-in buffer 11. The decoder 12 reads the compressed moving picture data from the buffer 11, and reproduces (expands) it so that expanded moving picture data is stored in the moving picture frame buffer 13 (step [2]). The CPU 15 produces the aforementioned parameter tables in the sprite VRAM 22 via the sprite engine 20 (steps [3] and [4]). For example, the parameter tables used in a fighting game are respectively produced with respect to the player's character and an enemy character, and the coordinates, sizes, tilts and pattern data storage positions of the player's character and the enemy character are stored in the respective parameter tables, as shown in Fig. 3. The motion of the player's character is controlled in 1 accordance with the control signal input by the player via the control pad unit 40 (steps [8] and [9]). The CPU 15 updates one or plural parameters in the parameter table, such as the coordinates values, each 5 time it receives the control signal. The parameters of the player's character such as the coordinates values are updated according to a predetermined rule under the control of the CPU 15.
The CPU 15 outputs an instruction of 10 transferring the expanded moving picture data to the bus controller 17 (step [5]). The bus controller 17 reads the moving picture image data from the moving picture frame buffer 13, and transfers it to the sprite VRAM 22 via the bus 14 (steps [6] and [7]). The sprite 15 engine 20 reads image data (pattern data) of the foreground (sprite) stored in the sprite VRAM 22 according to the parameter tables formed in the sprite VRAM 22, and makes the read image data stored in the sprite frame buffer 23 with the specified coordinates, 20 size and tilt (steps [10], [11]).
After all foreground image equal to one frame is stored in the sprite frame buffer 23 in the above-mentioned way, the sprite engine 20 reads the image data of the sprite picture plane from the sprite frame 25 buffer 23, and outputs it to the priority circuit 30 (step [12]). The scroll engine 21 reads image data of the scroll picture plane from the scroll VRAM 24, and outputs it to the priority circuit 30 (steps [13], [14]). In the case where the moving picture data 30 stored in the moving picture frame buffer 13 is used instead of the scroll picture plane or is used as a background in addition to the scroll picture plane, the 1 priority circuit 30 receives image data of the moving picture from the moving picture frame buffer 13 (steps [15), [16]). In accordance with the priority bit, the priority circuit 30 selects either the sprite picture 5 plane or the scroll picture plane for each dot, and outputs the dot of the selected picture plane to the video D/A converter 31 (step [17]). In the case where the moving picture plane read from the moving picture frame buffer 13 is used, one of the planes including 10 the above plane is selected on the one-dot basis and is output to the video D/A converter 31 (step [17]). The video D/A converter converts the received digital video signal into the corresponding analog signal, which is then output to the monitor 32 (step [18)).
15 In parallel to the above image processing and outputting, the sound engine 42 produces BGM, effective sounds and speech, and outputs a corresponding digital audio signal to the audio D/A converter 43. The audio D/A converter 43 converts the digital audio signal to 20 the corresponding analog audio signal, which is then output to the speakers 44.
The above process is repeatedly performed and the game goes on.
Fig. 8 is a diagram showing that characters 25 of moving pictures used in a game are stored in the moving picture frame buffer 13. Three moving picture characters 40a, 40b and 40c are stored in one frame of the moving picture frame buffer 13. More particularly, Fig. 8 corresponds to one scene (one frame) of moving 30 picture data, and a large number of items of moving picture data (a large number of frames) are stored in the CD-ROM so as to lead to and follow the frame shown 1 in Fig. 8. The moving picture data shown in Fig. 8 is subjected to a process on the frame basis so that parts 40a - 40c are cut out and are then transferred to and stored in a specified area in the sprite VRAM 22. As 5 shown in Fig. 9, foreground images 41a, 41b, 41c and 41d of still pictures may be stored in the sprite VRAM
22.
Out of the foreground images shown in Fig. 9, the foreground image 40c is enlarged and rotated by the 10 sprite engine 20, and is stored in the sprite frame buffer 23, as shown in Fig. 10. Further, the foreground image 41c is reduced and stored in the sprite frame buffer 23, as shown in Fig. 10. The foreground image in the sprite frame buffer 23 shown in 15 Fig. 10 is superimposed with the background image stored in the scroll vRAM 24 by the priority circuit 30, and a resultant image as shown in Fig. 11 is produced. In the above-mentioned way, it becomes possible to realize a display in which the foreground 20 such as characters can be changed on the frame basis and hence the foreground can be displayed as a moving picture. Hence, natural motion of characters can be obtained and reality in playing the game can be improved.
25 It will be noted that the sprite engine 20, the scroll engine 21 and the priority process themselves can be carried out in conventional image processing devices, and the structures thereof will be apparent to a person having ordinary skill in the art.
30 Hence, a description of the structures referring to the detailed parts thereof will be omitted here. Normally, the sprite engine 20 and the scroll engine 21 are ~ ~ ~fl~4~
1 formed by hardware. The embodiment of the present invention being considered is intended to overcome the aforementioned disadvantages by primarily modifying signals to be processed in the structures of the 5 engines (all or part of the moving picture data is written into the sprite VRAM 22 orn the frame basis).
Fig. 12 is a block diagram of a variation of the structure shown in Fig. 1. A decoder 12a shown in Fig. 12 is substituted for the decoder 12 shown in Fig.
10 1. In the structure shown in Fig. 12, the moving picture frame buffer 13 is directly connected to the bus 14. The decoder shown in Fig. 12 expands compressed moving picture data of the YUV system read from the buffer 11, and converts it into the RGB-system 15 moving picture data, which is then stored in the moving picture frame buffer 13. The moving picture data of the RGB system read from the moving picture frame buffer 13 can be output to the sprite VRAM 22 and the priority circuit 30. In the above way, the moving 20 picture frame buffer 13 used in the structure shown in Fig. 12 can store moving picture data of the RGB
system.
INDUSTRIAL APPLICABILITY
25 As described above, according to the image processing device of the present invention, it becomes possible to use, as a foreground, a moving picture such as a character and reality of superimposed images can be improved. These advantages are very effective in 30 practical use. The present invention is not limited to home-use game machines but includes business-use game machines. Further, the present invention is not 2i40643 1 limited to game machines but broadly includes an image processing device which superimposed images to form a picture plane.
Claims (19)
1. An image processing device having a first memory, first data processing means for storing image data of a first type in said first memory, a second memory for storing image data of a second type, and second data processing means for combining the image data respectively read from said first memory and said second memory and for outputting resultant image information, said image processing device being characterized by further comprising a third memory, and third data processing means for reading data of a moving picture from an outside of said image processing device and writing the data of the moving picture into said third memory, wherein said first data processing means reads the image data stored in said third memory, processes read image data as image data of the first type, and stores processed image data in said first memory.
2. The image processing device as claimed in claim 1, characterized in that:
the image data of the first type is foreground image data forming a foreground of the superimposed image;
the image data of the second type is background image data forming a background of the superimposed image;
said image processing device further comprises a fourth memory for storing foreground image data, and fourth data processing means for transferring the image data stored in said third memory to said fourth memory as the foreground image data; and said first data processing means performs an information process for the image data read from said fourth memory and stores the information-processed foreground image data in said first memory.
the image data of the first type is foreground image data forming a foreground of the superimposed image;
the image data of the second type is background image data forming a background of the superimposed image;
said image processing device further comprises a fourth memory for storing foreground image data, and fourth data processing means for transferring the image data stored in said third memory to said fourth memory as the foreground image data; and said first data processing means performs an information process for the image data read from said fourth memory and stores the information-processed foreground image data in said first memory.
3. The image processing device as claimed in claim 2, characterized in that said fourth data processing means comprises means for cutting out part of the image data stored in said third memory and transfers the cut-out image data to said fourth memory.
4. The image processing device as claimed in claim 2, characterized in that said fourth data processing means comprises means for transferring one frame of the image data stored in said third memory to said fourth memory.
5. The image processing device as claimed in claim 1, characterized in that said second data processing means further comprises priority circuit means for selecting, on a dot basis of the image data, the image data of the first type or the image data of the second type.
6. The image processing device as claimed in claim 1, characterized in that said third data processing means comprises decoder means for reading and expanding compressed moving picture data in an external storage device and for writing expanded moving picture data into said third memory.
7. The image processing device as claimed in claim 2, characterized in that said fourth data processing means further comprises means for transferring the image data to said second data processing means from said third memory; and priority circuit means for selecting, on a dot basis of the image data, one of the image data of the first type, the image data of the second type and the image data read from said third memory.
8. An image processing device comprising:
first data processing means;
second data processing means, having a first memory and a second memory, for storing image data in said first memory under control of said first data processing means, producing image data of a first type by performing an information process for the image data read from said first memory, and storing produced image data in said second memory;
third data processing means, having a third memory, for producing image data of a second type and storing the image data of the second type in said third memory;
fourth data processing means for combining the image data from said second and third memories and outputting resultant display image information; and fifth data processing means, having a fourth memory, for reading data of a moving picture from an outside of the image processing device and storing the data of the moving picture in said fourth memory, said first data processing means comprising means for reading the data of the moving picture stored in said fourth memory and storing read data of the moving picture in said first memory, and said second data processing means comprising means for performing an information process for the data of the moving picture read from said second memory and storing information-processed data of the moving picture in said second memory.
first data processing means;
second data processing means, having a first memory and a second memory, for storing image data in said first memory under control of said first data processing means, producing image data of a first type by performing an information process for the image data read from said first memory, and storing produced image data in said second memory;
third data processing means, having a third memory, for producing image data of a second type and storing the image data of the second type in said third memory;
fourth data processing means for combining the image data from said second and third memories and outputting resultant display image information; and fifth data processing means, having a fourth memory, for reading data of a moving picture from an outside of the image processing device and storing the data of the moving picture in said fourth memory, said first data processing means comprising means for reading the data of the moving picture stored in said fourth memory and storing read data of the moving picture in said first memory, and said second data processing means comprising means for performing an information process for the data of the moving picture read from said second memory and storing information-processed data of the moving picture in said second memory.
9. The image processing device as claimed in claim 8, characterized in that said first data processing means further comprises means for transferring the data of the moving picture from said fourth memory to said fourth data processing means, and priority selecting means for selecting, on a dot basis of the image data, one of the image data read from said second memory, the image data read from said third memory and the image data read from said fourth memory.
10. An image processing device characterized by comprising:
a first memory;
first data processing means for reading a series of moving picture data from an external device and storing the series of moving picture data in said first memory;
a second memory;
a second data processing means including means for writing still-picture data in said second memory and means for writing the moving picture data stored in said first memory in said second memory;
a third memory;
third data processing means for producing first display image data by sequentially reading either the still-picture data or the moving picture data from said second memory and performing an information process for read data so that a series of motion can be represented and for storing the first display image data in said third memory;
a fourth memory;
fourth data processing means for producing second image data and storing the second image data in said fourth memory;
and fifth data processing means for combining the image data read from said third and fourth memories and for outputting resultant display image information.
a first memory;
first data processing means for reading a series of moving picture data from an external device and storing the series of moving picture data in said first memory;
a second memory;
a second data processing means including means for writing still-picture data in said second memory and means for writing the moving picture data stored in said first memory in said second memory;
a third memory;
third data processing means for producing first display image data by sequentially reading either the still-picture data or the moving picture data from said second memory and performing an information process for read data so that a series of motion can be represented and for storing the first display image data in said third memory;
a fourth memory;
fourth data processing means for producing second image data and storing the second image data in said fourth memory;
and fifth data processing means for combining the image data read from said third and fourth memories and for outputting resultant display image information.
11. An image processing device characterized by comprising:
a moving picture frame buffer memory;
first data processing means for reading a series of moving picture data from an external storage device and sequentially storing the series of moving picture data in said moving picture frame buffer memory;
a first video memory;
a second data processing means including means for writing still-picture data in said first video memory and means for writing the moving picture data stored in said moving picture frame buffer memory into said first video memory;
a second frame buffer memory;
third data processing means for sequentially reading the still-picture data and the moving picture data from said first video memory and performing an information process for read data so that foreground image data for representing a series of motion can be produced and for storing the foreground image data in said second frame buffer memory;
a second video memory;
fourth data processing means for producing background image data and storing the background image data in said second memory; and fifth data processing means for combining the image data read from said second frame buffer memory and said second video memory and for outputting resultant display image information.
a moving picture frame buffer memory;
first data processing means for reading a series of moving picture data from an external storage device and sequentially storing the series of moving picture data in said moving picture frame buffer memory;
a first video memory;
a second data processing means including means for writing still-picture data in said first video memory and means for writing the moving picture data stored in said moving picture frame buffer memory into said first video memory;
a second frame buffer memory;
third data processing means for sequentially reading the still-picture data and the moving picture data from said first video memory and performing an information process for read data so that foreground image data for representing a series of motion can be produced and for storing the foreground image data in said second frame buffer memory;
a second video memory;
fourth data processing means for producing background image data and storing the background image data in said second memory; and fifth data processing means for combining the image data read from said second frame buffer memory and said second video memory and for outputting resultant display image information.
12. A game machine including the image processing device as described in claim 11, characterized in that:
said image processing device further comprises an I/O
controller for accommodating a game control device, means for connecting said image processing device to the external storage device, and means for executing a game program, said first data processing means comprises a decoder for expanding compressed moving picture data, in a state where a disk storing the game program and the compressed moving picture data is loaded to the external storage device, the game program is input to said image processing device, said first data processing means reads and expands the compressed moving picture data, and stores the expanded moving picture data in said moving picture frame buffer memory.
said image processing device further comprises an I/O
controller for accommodating a game control device, means for connecting said image processing device to the external storage device, and means for executing a game program, said first data processing means comprises a decoder for expanding compressed moving picture data, in a state where a disk storing the game program and the compressed moving picture data is loaded to the external storage device, the game program is input to said image processing device, said first data processing means reads and expands the compressed moving picture data, and stores the expanded moving picture data in said moving picture frame buffer memory.
13. A method including step (a) of storing image data in a first memory, step (b) of sequentially reading desired image data from said first memory, producing display image data of a first type representing motion, and storing the produced display image data in a second memory, step (c) of producing display image data of a second type in a third memory, and step (d) of sequentially reading image information from said second and third memories, combining the display image data of the first and second types to thereby produce superimposed display image data, characterized in that said method comprises:
step (e) of sequentially reading a series of moving picture data stored in an external storage device and storing the series of moving picture data in a fourth memory; and step (f) of sequentially reading the moving picture data stored in said fourth memory and storing it in said first memory, in the step (b), the moving picture data being subjected to an information process and being stored, as the first display image data, in said second memory.
step (e) of sequentially reading a series of moving picture data stored in an external storage device and storing the series of moving picture data in a fourth memory; and step (f) of sequentially reading the moving picture data stored in said fourth memory and storing it in said first memory, in the step (b), the moving picture data being subjected to an information process and being stored, as the first display image data, in said second memory.
14. The method as claimed in claim 13, characterized in that the step (d) sequentially reads the moving picture data stored in said third memory and combines it with a display image to thereby produce said superimposed display image data.
15. An image processing method comprising the steps of:
(a) sequentially reading a series of moving picture data from an external device and storing the read data in a first memory;
(b) producing still-picture data and storing the produced data in a second memory;
(c) storing the moving picture image read from said first memory in said second memory;
(d) performing an information process for the still-picture data read from second memory to produce foreground image data representing a series of motion, and storing the thus produced foreground image data in a third memory when the still-picture data is stored in said second memory;
(e) performing an information process for the moving picture data read from said second memory to produce foreground image data including a moving picture, and storing the thus produced foreground image data in said third memory;
(f) producing background image data and storing the background image data in a fourth memory; and (g) reading the image data from said third and fourth memories and producing display image data by combining the foreground image data and the background image data.
(a) sequentially reading a series of moving picture data from an external device and storing the read data in a first memory;
(b) producing still-picture data and storing the produced data in a second memory;
(c) storing the moving picture image read from said first memory in said second memory;
(d) performing an information process for the still-picture data read from second memory to produce foreground image data representing a series of motion, and storing the thus produced foreground image data in a third memory when the still-picture data is stored in said second memory;
(e) performing an information process for the moving picture data read from said second memory to produce foreground image data including a moving picture, and storing the thus produced foreground image data in said third memory;
(f) producing background image data and storing the background image data in a fourth memory; and (g) reading the image data from said third and fourth memories and producing display image data by combining the foreground image data and the background image data.
16. An image processing device comprising:
first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data; and second means for superimposing the foreground image data which has been subjected to the predetermined process and background image data and outputting superimposed image data to the outside of the image processing device.
first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data; and second means for superimposing the foreground image data which has been subjected to the predetermined process and background image data and outputting superimposed image data to the outside of the image processing device.
17. An image processing device comprising:
a memory;
first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to the predetermined process being stored in the memory; and second means for superimposing the foreground image data stored in the memory and background image data stored in the memory and for outputting superimposed image data to the outside of the image processing device.
a memory;
first means for acquiring, from an outside of the image processing device, foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to the predetermined process being stored in the memory; and second means for superimposing the foreground image data stored in the memory and background image data stored in the memory and for outputting superimposed image data to the outside of the image processing device.
18. An image processing method comprising the steps of:
acquiring foreground image data which form moving pictures and performing a predetermined process for the foreground image data; and superimposing the foreground image data which has been subjected to the predetermined process and background image data and outputting superimposed image data to a display.
acquiring foreground image data which form moving pictures and performing a predetermined process for the foreground image data; and superimposing the foreground image data which has been subjected to the predetermined process and background image data and outputting superimposed image data to a display.
19. An image processing method comprising the steps of:
acquiring foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to the predetermined process being stored in a memory; and superimposing the foreground image data stored in the memory and background image data stored in the memory and outputting superimposed image data to a display.
acquiring foreground image data which form moving pictures and performing a predetermined process for the foreground image data, the foreground image data which has been subjected to the predetermined process being stored in a memory; and superimposing the foreground image data stored in the memory and background image data stored in the memory and outputting superimposed image data to a display.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP5-120204 | 1993-05-21 | ||
| JP12020493 | 1993-05-21 | ||
| PCT/JP1994/000810 WO1994028507A1 (en) | 1993-05-21 | 1994-05-20 | Image processing device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2140643A1 CA2140643A1 (en) | 1994-12-08 |
| CA2140643C true CA2140643C (en) | 2000-04-04 |
Family
ID=14780486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002140643A Expired - Fee Related CA2140643C (en) | 1993-05-21 | 1994-05-20 | Image processing device and method |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US5634850A (en) |
| EP (1) | EP0652524A4 (en) |
| KR (1) | KR960700484A (en) |
| CN (1) | CN1130664C (en) |
| AU (1) | AU668043B2 (en) |
| CA (1) | CA2140643C (en) |
| TW (1) | TW313658B (en) |
| WO (1) | WO1994028507A1 (en) |
Families Citing this family (71)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR970700046A (en) * | 1993-04-27 | 1997-01-08 | 다까도시 다께모또 | IMAGE DISPLAYING GAME MACHINE AND MAGE DISPLAY CONTROLLING METHOD |
| EP1271957B1 (en) | 1994-12-20 | 2006-05-24 | Matsushita Electric Industrial Co., Ltd. | Object-based digital image predictive coding and transfer method and apparatus, and decoding apparatus |
| US5940068A (en) * | 1995-02-14 | 1999-08-17 | Snk Corporation | Display controlling apparatus and control method thereof |
| US6449352B1 (en) * | 1995-06-20 | 2002-09-10 | Matsushita Electric Industrial Co., Ltd. | Packet generating method, data multiplexing method using the same, and apparatus for coding and decoding of the transmission data |
| JP3562049B2 (en) * | 1995-07-21 | 2004-09-08 | セイコーエプソン株式会社 | Video display method and apparatus |
| US5808617A (en) * | 1995-08-04 | 1998-09-15 | Microsoft Corporation | Method and system for depth complexity reduction in a graphics rendering system |
| US6008820A (en) * | 1995-08-04 | 1999-12-28 | Microsoft Corporation | Processor for controlling the display of rendered image layers and method for controlling same |
| US5886701A (en) * | 1995-08-04 | 1999-03-23 | Microsoft Corporation | Graphics rendering device and method for operating same |
| US5852443A (en) * | 1995-08-04 | 1998-12-22 | Microsoft Corporation | Method and system for memory decomposition in a graphics rendering system |
| US5949428A (en) * | 1995-08-04 | 1999-09-07 | Microsoft Corporation | Method and apparatus for resolving pixel data in a graphics rendering system |
| US5990904A (en) * | 1995-08-04 | 1999-11-23 | Microsoft Corporation | Method and system for merging pixel fragments in a graphics rendering system |
| US5880737A (en) * | 1995-08-04 | 1999-03-09 | Microsoft Corporation | Method and system for accessing texture data in environments with high latency in a graphics rendering system |
| US5999189A (en) | 1995-08-04 | 1999-12-07 | Microsoft Corporation | Image compression to reduce pixel and texture memory requirements in a real-time image generator |
| US5977977A (en) * | 1995-08-04 | 1999-11-02 | Microsoft Corporation | Method and system for multi-pass rendering |
| US5870097A (en) * | 1995-08-04 | 1999-02-09 | Microsoft Corporation | Method and system for improving shadowing in a graphics rendering system |
| US5864342A (en) | 1995-08-04 | 1999-01-26 | Microsoft Corporation | Method and system for rendering graphical objects to image chunks |
| JPH09330423A (en) * | 1996-06-13 | 1997-12-22 | Fujitsu Ltd | Three-dimensional shape data transforming device |
| JPH10165649A (en) * | 1996-10-09 | 1998-06-23 | Sega Enterp Ltd | Game processing device, method, and recording medium |
| AU722393B2 (en) * | 1996-11-07 | 2000-08-03 | Broderbund Software, Inc. | System for adaptive animation compression |
| JP3723301B2 (en) * | 1996-11-21 | 2005-12-07 | 任天堂株式会社 | Image creation device, image display device, and game device |
| US6767286B1 (en) * | 1996-11-22 | 2004-07-27 | Kabushiki Kaisha Sega Enterprises | Game device, picture data forming method and medium |
| KR100393185B1 (en) * | 1996-12-20 | 2004-01-24 | 삼성전자주식회사 | Apparatus for synthesizing three-dimensional structure data with graphics object, and method therefor |
| WO1998035468A2 (en) * | 1997-01-27 | 1998-08-13 | Benjamin Slotznick | System for delivering and displaying primary and secondary information |
| US6069633A (en) * | 1997-09-18 | 2000-05-30 | Netscape Communications Corporation | Sprite engine |
| JP3126944B2 (en) * | 1997-10-24 | 2001-01-22 | コナミ株式会社 | Video game system and computer-readable recording medium on which program for executing the game is recorded |
| JPH11128533A (en) | 1997-10-30 | 1999-05-18 | Nintendo Co Ltd | Video game device and memory media for the same |
| US6140994A (en) * | 1997-11-12 | 2000-10-31 | Philips Electronics N.A. Corp. | Graphics controller for forming a composite image |
| US6414678B1 (en) | 1997-11-20 | 2002-07-02 | Nintendo Co., Ltd. | Image creating apparatus and image display apparatus |
| JP3554477B2 (en) * | 1997-12-25 | 2004-08-18 | 株式会社ハドソン | Image editing device |
| US6714591B1 (en) | 1998-01-27 | 2004-03-30 | Sharp Kabushiki Kaisha | Video image coding device and video image decoding device |
| JP2000107447A (en) * | 1998-10-08 | 2000-04-18 | Konami Co Ltd | Video game device, game image display method, and recording medium |
| US6735374B1 (en) | 1999-03-16 | 2004-05-11 | Matsushita Electric Industrial Co., Ltd. | Picture processing apparatus and method |
| FR2795589B1 (en) * | 1999-06-11 | 2001-10-05 | Centre Nat Rech Scient | OPTIMAL VIDEO DECODER BASED ON MPEG TYPE STANDARDS |
| US7839399B2 (en) | 1999-07-29 | 2010-11-23 | Benman William J | System and method for volumetric display of video images extracted from arbitrary background environments |
| JP3593943B2 (en) * | 1999-12-28 | 2004-11-24 | コナミ株式会社 | GAME DEVICE, IMAGE DISPLAY METHOD, AND RECORDING MEDIUM |
| KR100459376B1 (en) * | 2001-12-14 | 2004-12-03 | 박유상 | Image Object Synthesizer |
| US7034833B2 (en) * | 2002-05-29 | 2006-04-25 | Intel Corporation | Animated photographs |
| US7184094B2 (en) * | 2002-12-06 | 2007-02-27 | Motorola, Inc. | Decoding system, video color converter and method thereof |
| US7256797B2 (en) * | 2003-01-31 | 2007-08-14 | Yamaha Corporation | Image processing device with synchronized sprite rendering and sprite buffer |
| US20050021552A1 (en) * | 2003-06-02 | 2005-01-27 | Jonathan Ackley | Video playback image processing |
| KR101220676B1 (en) * | 2003-06-02 | 2013-01-21 | 디즈니엔터프라이지즈,인크. | System and method of video player commerce |
| CN1798594B (en) * | 2003-06-02 | 2011-05-11 | 迪斯尼实业公司 | System and method of interactive video playback |
| CA2527083C (en) * | 2003-06-02 | 2011-04-26 | Disney Enterprises, Inc. | System and method of programmatic window control for consumer video players |
| JP5189764B2 (en) * | 2003-06-27 | 2013-04-24 | ディズニー エンタープライゼス インコーポレイテッド | Dual Virtual Machine and Trusted Platform Module Architecture for Next Generation Media Player |
| US7469346B2 (en) * | 2003-06-27 | 2008-12-23 | Disney Enterprises, Inc. | Dual virtual machine architecture for media devices |
| EP1671483B1 (en) * | 2003-10-06 | 2014-04-09 | Disney Enterprises, Inc. | System and method of playback and feature control for video players |
| JP2005204754A (en) * | 2004-01-20 | 2005-08-04 | Nintendo Co Ltd | Game system employing touch panel input |
| US20060048056A1 (en) * | 2004-08-30 | 2006-03-02 | Chang-Shun Huang | Motion menu generation method and system |
| US20060103677A1 (en) * | 2004-11-18 | 2006-05-18 | Lai Jimmy K L | System and method for effectively performing arbitrary angle sprite rotation procedures |
| JP4445898B2 (en) * | 2005-05-24 | 2010-04-07 | 任天堂株式会社 | GAME PROGRAM AND GAME DEVICE USING INPUT TO POINTING DEVICE |
| US20070037625A1 (en) * | 2005-06-28 | 2007-02-15 | Samsung Electronics Co., Ltd. | Multiplayer video gaming system and method |
| US20070115288A1 (en) * | 2005-11-22 | 2007-05-24 | Microsoft Corporation | Sprite interface and code-based functions |
| US20070253630A1 (en) * | 2006-04-26 | 2007-11-01 | International Business Machines Corporation | Method and apparatus for fast and flexible digital image compression using programmable sprite buffer |
| TWI376930B (en) | 2006-09-04 | 2012-11-11 | Via Tech Inc | Scenario simulation system and method for a multimedia device |
| US8608560B1 (en) * | 2006-09-12 | 2013-12-17 | Tournament One, Corp. | Non-deterministic animations with predetermined result |
| US20080165200A1 (en) * | 2007-01-05 | 2008-07-10 | Raymond Chow | Hardware Background Tile Generation |
| KR101403422B1 (en) * | 2007-01-16 | 2014-06-09 | 삼성전자주식회사 | copy machine and method thereof |
| US8209223B2 (en) * | 2007-11-30 | 2012-06-26 | Google Inc. | Video object tag creation and processing |
| JP4963306B2 (en) * | 2008-09-25 | 2012-06-27 | 楽天株式会社 | Foreground region extraction program, foreground region extraction device, and foreground region extraction method |
| CN102096936B (en) * | 2009-12-14 | 2013-07-24 | 北京中星微电子有限公司 | Image generating method and device |
| DE112010005426T5 (en) * | 2010-03-30 | 2013-01-17 | Mitsubishi Electric Corp. | Animation display device |
| JP5729963B2 (en) * | 2010-10-07 | 2015-06-03 | キヤノン株式会社 | Image composition processing apparatus and control method thereof |
| US8688514B1 (en) | 2011-06-24 | 2014-04-01 | Google Inc. | Ad selection using image data |
| US11087424B1 (en) | 2011-06-24 | 2021-08-10 | Google Llc | Image recognition-based content item selection |
| US10972530B2 (en) | 2016-12-30 | 2021-04-06 | Google Llc | Audio-based data structure generation |
| US10586127B1 (en) | 2011-11-14 | 2020-03-10 | Google Llc | Extracting audiovisual features from content elements on online documents |
| US11093692B2 (en) | 2011-11-14 | 2021-08-17 | Google Llc | Extracting audiovisual features from digital components |
| US11030239B2 (en) | 2013-05-31 | 2021-06-08 | Google Llc | Audio based entity-action pair based selection |
| US9953085B1 (en) | 2013-05-31 | 2018-04-24 | Google Llc | Feed upload for search entity based content selection |
| KR102503442B1 (en) * | 2015-12-24 | 2023-02-28 | 삼성전자주식회사 | Electronic device and operating method thereof |
| CN111415054B (en) * | 2019-01-08 | 2023-06-27 | 昆山纬绩资通有限公司 | Equipment monitoring management method and system |
Family Cites Families (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4026555A (en) * | 1975-03-12 | 1977-05-31 | Alpex Computer Corporation | Television display control apparatus |
| US4445114A (en) * | 1979-01-15 | 1984-04-24 | Atari, Inc. | Apparatus for scrolling a video display |
| US4324401A (en) * | 1979-01-15 | 1982-04-13 | Atari, Inc. | Method and system for generating moving objects on a video display screen |
| US4398189A (en) * | 1981-08-20 | 1983-08-09 | Bally Manufacturing Corporation | Line buffer system for displaying multiple images in a video game |
| US4463380A (en) * | 1981-09-25 | 1984-07-31 | Vought Corporation | Image processing system |
| US4517654A (en) * | 1982-08-09 | 1985-05-14 | Igt | Video processing architecture |
| JPH0673573B2 (en) * | 1982-10-29 | 1994-09-21 | 株式会社セガ・エンタ−プライゼス | Two-dimensional memory method for video game machine |
| GB2133257B (en) * | 1982-12-22 | 1987-07-29 | Ricoh Kk | T v game system |
| GB8320357D0 (en) * | 1983-07-28 | 1983-09-01 | Quantel Ltd | Video graphic simulator systems |
| DE163863T1 (en) * | 1984-04-13 | 1986-04-30 | Ascii Corp., Tokio/Tokyo | VIDEO DISPLAY CONTROL UNIT TO DISPLAY MOVABLE PATTERNS. |
| US4672541A (en) * | 1984-05-31 | 1987-06-09 | Coleco Industries, Inc. | Video game with interactive enlarged play action inserts |
| US4766541A (en) * | 1984-10-24 | 1988-08-23 | Williams Electronics Games, Inc. | Apparatus for generating interactive video game playfield environments |
| JPS62149287A (en) * | 1985-12-24 | 1987-07-03 | Mitsubishi Electric Corp | Video transmission device |
| JPH0679320B2 (en) * | 1986-02-28 | 1994-10-05 | 株式会社東芝 | Image processing device |
| US4890833A (en) * | 1987-05-18 | 1990-01-02 | Williams Electronics, Inc. | Apparatus for generating enhanced interactive video game playfield environments |
| JPH01245363A (en) * | 1988-03-28 | 1989-09-29 | Hitachi Ltd | Data processor |
| US4895376A (en) * | 1988-06-17 | 1990-01-23 | Tigers Electronics, Inc. | Interactive video game |
| US5262965A (en) * | 1988-10-31 | 1993-11-16 | Bts-Broadcast Television Systems, Inc. | System and method for high speed computer graphics image computation using a parallel connected, asynchronous multiprocessor ring coupled to a synchronous special purpose video processing ring |
| JPH02230474A (en) * | 1989-03-03 | 1990-09-12 | Nippon Telegr & Teleph Corp <Ntt> | Picture display processor |
| JP2600904B2 (en) * | 1989-05-23 | 1997-04-16 | ダイキン工業株式会社 | Image synthesizing method and apparatus |
| JP2725062B2 (en) * | 1989-08-01 | 1998-03-09 | 株式会社リコー | Image processing device |
| JP3056514B2 (en) * | 1990-08-27 | 2000-06-26 | 任天堂株式会社 | Image display device and external storage device used therefor |
| AU667892B2 (en) * | 1992-04-29 | 1996-04-18 | Canon Kabushiki Kaisha | A real-time object based graphics sytems |
| JP2538488B2 (en) * | 1992-10-27 | 1996-09-25 | 株式会社バンダイ | Game device |
-
1994
- 1994-05-20 WO PCT/JP1994/000810 patent/WO1994028507A1/en not_active Application Discontinuation
- 1994-05-20 KR KR1019950700288A patent/KR960700484A/en not_active Application Discontinuation
- 1994-05-20 CN CN94190315A patent/CN1130664C/en not_active Expired - Fee Related
- 1994-05-20 CA CA002140643A patent/CA2140643C/en not_active Expired - Fee Related
- 1994-05-20 US US08/374,561 patent/US5634850A/en not_active Expired - Lifetime
- 1994-05-20 EP EP94915272A patent/EP0652524A4/en not_active Withdrawn
- 1994-05-20 AU AU66580/94A patent/AU668043B2/en not_active Ceased
- 1994-05-24 TW TW083104689A patent/TW313658B/zh active
Also Published As
| Publication number | Publication date |
|---|---|
| EP0652524A1 (en) | 1995-05-10 |
| CN1130664C (en) | 2003-12-10 |
| WO1994028507A1 (en) | 1994-12-08 |
| AU668043B2 (en) | 1996-04-18 |
| AU6658094A (en) | 1994-12-20 |
| CA2140643A1 (en) | 1994-12-08 |
| TW313658B (en) | 1997-08-21 |
| CN1110069A (en) | 1995-10-11 |
| EP0652524A4 (en) | 1996-01-03 |
| US5634850A (en) | 1997-06-03 |
| KR960700484A (en) | 1996-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2140643C (en) | Image processing device and method | |
| JP3133299B2 (en) | Game device, moving image display method, and recording medium | |
| EP0715279B1 (en) | Image processing and recording media | |
| US6561906B2 (en) | Game apparatus, method of reproducing movie images and recording medium recording program thereof | |
| US6256047B1 (en) | Method of judging hits and computer-readable storage medium storing game data | |
| US6924846B2 (en) | Information processing apparatus, graphic processing unit, graphic processing method, storage medium, and computer program | |
| KR100292148B1 (en) | Command input method and recording medium | |
| US6166718A (en) | Video game system with vertical array of cursor images | |
| KR20010033214A (en) | Recording medium, image processing device and image processing method | |
| JPH08161525A (en) | Image information preparing method, image information processor, and recording medium | |
| KR19980081007A (en) | Information processing apparatus and method and recording medium | |
| JP2000107447A (en) | Video game device, game image display method, and recording medium | |
| EP0821339B1 (en) | Address generating apparatus, picture display apparatus, address generation method and picture display method | |
| US6842183B2 (en) | Three-dimensional image processing unit and computer readable recording medium storing three-dimensional image processing program | |
| JP3990258B2 (en) | Image generation system, program, and information storage medium | |
| EP0983782A2 (en) | Video game system, method of saving image, and recording medium with game program recorded therein | |
| JP4447000B2 (en) | Image generation system, program, and information storage medium | |
| JP3348152B2 (en) | Game system | |
| JP2002336542A (en) | Videogame device, videogame screen control program, and its recording medium | |
| JP2003051032A (en) | Game information, information storage medium and game device | |
| JP3712175B2 (en) | Image composition apparatus and method, and information storage medium | |
| JP3547236B2 (en) | Image information generating apparatus and method, and image information processing apparatus and method | |
| JP2003018460A (en) | Information processor, graphic processing unit, graphic processing method, storage medium and computer program | |
| JPH11259640A (en) | Process and method for color reducton of image and information storage medium | |
| JPH08171657A (en) | Image information generation method and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed | ||
| MKLA | Lapsed |
Effective date: 20020521 |