US20120188239A1 - Intruction folding mechanism, method for performing the same and pixel processing system employing the same - Google Patents

Intruction folding mechanism, method for performing the same and pixel processing system employing the same Download PDF

Info

Publication number
US20120188239A1
US20120188239A1 US13/437,397 US201213437397A US2012188239A1 US 20120188239 A1 US20120188239 A1 US 20120188239A1 US 201213437397 A US201213437397 A US 201213437397A US 2012188239 A1 US2012188239 A1 US 2012188239A1
Authority
US
United States
Prior art keywords
instruction
instructions
src
combination
opc
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/437,397
Inventor
R-Ming Hsu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taichi Holdings LLC
Original Assignee
Taichi Holdings LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taichi Holdings LLC filed Critical Taichi Holdings LLC
Priority to US13/437,397 priority Critical patent/US20120188239A1/en
Publication of US20120188239A1 publication Critical patent/US20120188239A1/en
Assigned to TAICHI HOLDINGS, LLC reassignment TAICHI HOLDINGS, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SILICON INTEGRATED SYSTEMS CORP.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/005General purpose rendering architectures

Definitions

  • the present disclosure relates to a folding mechanism, a method for performing the folding mechanism and a pixel processing system employing the same, and more particularly to an instruction folding mechanism, a method for performing the instruction folding mechanism and a pixel processing system employing the instruction folding mechanism applied to a graphic processor unit (GPU).
  • GPU graphic processor unit
  • FIG. 1 is a block diagram of a pipeline configuration of a conventional graphic processor unit.
  • the conventional graphic processor unit 100 mainly includes a triangle setup unit 102 , a pixel processing unit 104 and a depth processing unit 106 .
  • the pixel processing unit 104 has a pixel shader 108 , a texture unit 110 and a color interpolator 112 both connected to the pixel shader 108 .
  • a surface of three-dimensional (3D) object is divided into a plurality of triangles two-dimensionally arranged in terms of their neighboring relationship and having an arbitrary size.
  • Each of the triangles has three vertices which are forwarded to the triangle setup unit 102 .
  • the triangle setup unit 102 outputs the parameters of the pixels, such as the positions of the pixels in triangles and texture coordinates of the vertices of the corresponding triangles, to the pixel processing unit 104 .
  • the texture unit 110 interpolates the texture coordinates for all the pixels.
  • the interpolated texture coordinates of the pixels are inputted and then processed in the pixel shader 108 (with DirectX terms, or Fragment Processor in OpenGL terms).
  • the pixel shader 108 executes a texture load instruction to return the processed texture coordinates to the texture unit 110 .
  • the texture unit 110 samples the texture colors of the pixels in a texture map and outputs the texture colors to the pixel shader 108 .
  • the color interpolator 112 interpolates the vertex colors for all the pixels and outputs the vertex colors of the pixels to the pixel shader 108 .
  • the pixel shader 108 then processes the texture colors and the vertex colors of the pixels and outputs color values and depth values of the pixels to the depth processing unit 106 , the final pixel colors are obtained.
  • the final pixel colors are then becoming available for drawing the whole frame.
  • FIG. 2 is a block diagram of an example program in a pixel shader of the conventional graphic processor.
  • the pixel shader 108 usually includes five kinds of registers: temporary registers r n for storing temporary data, texture coordinate registers t n , texture numbering registers s n , vertex color registers v n , and outputting registers o c n for transforming the final pixel colors to the depth processing unit 106 .
  • the process of the pixel shader 108 normally has four stages: a coordinate calculation stage, a texture processing stage, a color blending stage and an issue out stage.
  • the interpolated texture coordinates of the pixels from the texture unit 110 are stored in the texture coordinates registers t n .
  • the coordinate calculation stage the arithmetic, for the interpolated texture coordinates of the pixels from the texture unit 110 , is conducted in the texture coordinates registers t n and the temporary registers r n ; the arithmetic results, i.e. the processed texture coordinates, are stored in the temporary registers r n .
  • the pixel shader 108 executes texture load instructions to postulate the texture unit 110 to sample texture colors of the pixels in a texture map.
  • the texture map is appointed by the texture numbering registers s n .
  • the sampled texture colors are transformed to the temporary registers r n .
  • the pixel shader 108 blends the texture colors stored in the temporary registers r n with the vertex colors from the color interpolator 112 and the blending result is stored in the vertex color registers v n .
  • the pixel shader 108 outputs color and depth values of the pixels to the depth processing unit 106 .
  • the coordinate calculation stage, the texture processing stage and the color blending stage may be repetitiously processed or be omitted, respectively.
  • Each of the registers is composed of four components, e.g. (x, y, z, w) or (r, g, b, a) which are so-called four-wide vectors and data format of floating point.
  • the four components (x, y, z, w) represent coordinates in a three-dimensional (3D) space or of different texture formats.
  • the four components (r, g, b, a) represent three primary colors of red, green and blue, and transparency.
  • the components of source and target registers are assigned to instructions to read out or write the components. For example, r0.w represents the instructions that can read out or write component “w” of register “r0”.
  • FIG. 3B a ratio diagram of two color components to two transparency components for the instructions in a conventional pixel shader program is illustrated here.
  • these two independent instructions one is used to write color components “r” and “g”, and the other is used to write color components “b” and transparency “a”.
  • the probability of instruction pairing or co-issue is increased, however, it has a more complicated architecture and a higher cost in the hardware of pixel shader.
  • the nVidia Corporation began to implement such complicated co-issue in their GeForce6 Series GPU.
  • the fetcher 400 reads out two instructions from the instruction queue 402 according to the program counter (PC).
  • a pair of decoders ( 404 a , 404 b ) decodes control signals from the fetched instructions, respectively, to control the pipeline operation of the arithmetic logic units (ALUs) ( 406 a , 406 b ).
  • the pair of ALU ( 406 a , 406 b ) implements four vector components in parallel and consumes a pair of register ports ( 408 a , 408 b ).
  • Each of register ports ( 408 a , 408 b ) includes three register read ports and a write port. Furthermore, it is necessary to use a source and an instruction modifier for each register port to process component selections and format transformation of source and target operands in the instruction.
  • the co-issue mechanism requires an additional check mechanism to determine the timing of co-issue rule. Furthermore, since source and target registers of the two instructions are different in the timing of co-issue rule, the consumption of register read ports and register write ports are at least doubled the amount. The number of the source modifier and instruction modifier are also at least doubled the amount.
  • the first objective of the present invention is to provide a folding mechanism applied to a pixel processing system to fold instructions with data independency into reduced instructions for generating a new program.
  • the second objective of the present invention is to provide a folding mechanism applied to a pixel processing system to fold instructions having an identical target register and output data to different components of the target register to save the hardware cost of pixel processing system.
  • the third objective of the present invention is to provide a folding mechanism applied to a pixel processing system to improve the performance of the pixel processing system.
  • the present invention sets forth an instruction folding mechanism, a method for performing the folding mechanism and a pixel processing system employing the same.
  • the pixel processing system comprises an instruction folding mechanism and a pixel shader.
  • the instruction folding mechanism folds a plurality of first instructions in a first program to generate a second program having at least one second instruction which is a combination of the first instructions.
  • the pixel shader connected to the instruction folding mechanism fetches the second program to decode at least the second instruction having the combination of the first instructions to execute the second program.
  • the instruction folding mechanism comprises an instruction scheduler, a folding rule checker, and an instruction combiner.
  • the instruction scheduler connected to the folding rule checker is used to scan the first instructions according to static positions to schedule the first instructions in the first program.
  • the instruction scanner successively scans the first instructions.
  • the folding rule checker checks the first instructions according to a folding rule whether the first instructions has data independency.
  • the instruction combiner connected to the folding rule checker can combine the first instructions having the data independency to generate at least the second instruction.
  • the source register of the later first instruction is different from a target register of the former first instruction.
  • both the source register of the later first instruction and the target register of the former first instruction have a null set.
  • the data of the two adjacent first instructions is outputted into different components in the target register.
  • the total number of the source operands of the first and second instructions is within a predetermined threshold value, e.g. 3, 4, or more, so that the decoder can decode the combination of the first instructions.
  • a plurality of first instruction in a first program is folded by an instruction folding mechanism to generate a second program having at least one second instruction which is a combination of the first instruction.
  • the second instruction can be fetched according to a program counter.
  • Control signals are decoded from the second instruction having the combination with the first instruction.
  • an operation of a plurality of register components of the second instruction is performed according to the control signal by an ALU.
  • the register components are selected to transform operand formats of the second instruction by a register port.
  • the present invention folds instructions with data independency into reduced instructions for generating a new program.
  • the folding instructions have an identical target register and output data to different components of the target register to save the hardware cost of pixel processing system. Because these rules are the most frequently case that the fourth component is separately used, the performance of the expensive co-issue hardware mechanism can be achieve by a much chipper extended decoder.
  • FIG. 1 is a block diagram of a pipeline configuration of a conventional graphic processor unit.
  • FIG. 2 is a block diagram of an example program in a pixel shader of the conventional graphic processor.
  • FIG. 3A is a ratio diagram of three color components to one transparency component for the instructions in a conventional pixel shader program.
  • FIG. 3B is a ratio diagram of two color components to two transparency components for the instructions in a conventional pixel shader program.
  • FIG. 4 is a conventional pixel shader with a co-issue mechanism.
  • FIG. 5 is a block diagram of a pixel processing system having an instruction folding mechanism according to one preferred embodiment of the present invention.
  • FIG. 6 is a block diagram of an example program applied to the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention.
  • FIG. 7 is a detailed block diagram of the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention.
  • FIG. 8 shows a flow chart of performing a pixel processing system according to the present invention.
  • FIG. 9 shows a flow chart of performing an instruction folding mechanism of the pixel processing system in FIG. 8 according to the present invention.
  • the present invention is directed to an instruction folding mechanism, a method for performing the instruction folding mechanism and a pixel processing system employing the instruction folding mechanism to fold instructions with data independency into reduced instructions for generating a new program. Furthermore, the instruction folding mechanism is used to fold instructions having an identical target register and outputs data to different components of the target register to save the hardware cost of pixel processing system. It should be noted that the instruction folding mechanism is also suitable for vertex shader, geometric shader or a combination of the two.
  • FIG. 5 is a block diagram of a pixel processing system having an instruction folding mechanism according to one preferred embodiment of the present invention.
  • the pixel processing system comprises an instruction folding mechanism 500 and a pixel shader 502 .
  • the instruction folding mechanism 500 folds a plurality of first instruction in a first program 504 to generate a second program 506 having at least one second instruction which is a combination of the first instruction.
  • the pixel shader connected to the instruction folding mechanism 500 fetches the second program 506 to decode at least the second instruction having the combination of the first instruction to execute the second program 506 .
  • FIG. 6 is a block diagram of an example program applied to the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention.
  • the data of instruction “mul” is independent in the first program 504 from that of instruction “mov”, and the data output of “mul” and “mov” is stored in an identical register, i.e. “r 1 ”, but in different components.
  • the total number of source operands of the data is three, i.e. “r0”, “t0”, and “r0.a”, and it can easily be performed by the instruction folding mechanism to create a new instruction, e.g. “mul_mov”, as in the second program 506 . Therefore, a decoder can easily decode the new “folded” instruction.
  • FIG. 7 is a detailed block diagram of the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention.
  • the instruction folding mechanism 500 comprises an instruction scheduler 700 , a folding rule checker 702 , and an instruction combiner 704 .
  • the instruction scheduler 700 connected to the folding rule checker 702 is used to scan the first instruction according to static positions to schedule the first instruction in the first program 504 .
  • the instruction scanner 700 successively scans the first instruction.
  • the folding rule checker 702 checks the first instruction according to a folding rule whether the first instruction has data independency.
  • the instruction combiner 704 connected to the folding rule checker 702 can combine the first instruction having the data independency to generate at least the second instruction in the second program 506 .
  • a general formula of folding rule is represented as following items:
  • OPC 1 OPC 2 tgt.[r
  • OPC 1 and OPC 2 are arbitrary operators and OPC 1 _OPC 2 is a new combination operator indicating an operation instruction which performs OPC 1 in components (r, g, b) and OPC 2 in component “a”.
  • b] and tgt.a, of OPC 1 and OPC 2 are in a same register, i.e. register “tgt”, but in different components of “tgt”.
  • component “a” is located in OPC 1 and OPC 2 at the same time.
  • b] means that components “r”, “g”, and “b” are not necessarily present but not limited to their presence
  • Src 0 , src 1 , and src 2 are source operands and have arbitrary component(s), where OPC 1 is defined as a binary operator having two operands, including operands src 0 and src 1 , or defined as a unary operator including operand src 0 only.
  • instruction OPC 1 is not required to be adjacent to OPC 2 but only if the data of OPC 1 is independent from that of OPC 2 . While taking the orders of instruction OPC 1 and OPC 2 into consideration, the formula of the folding rule also can be represented as follows:
  • OPC 1 OPC 2 tgt.[r
  • OPC 1 OPC 2 tgt.[r
  • OPC 1 OPC 2 tgt.[r
  • operand includes src 1 only.
  • component “a” is operated alone and the result is then moved by instruction “mov” while component “a” is a “transparency” or coordinates of fourth dimension in the graphic effect applications.
  • Component “a” is operated by instruction “rsq” to calculate the result of (1/ ⁇ x) while component “a” is a distance or an angle from the light source in the lighting effect applications. While component “[r
  • OPC 1 when OPC 1 is instructions “mov”, “mul”, “add”, “mad”, or “dp3” and OPC 2 is “mov” or “rsq”, the combination of OPC 1 _OPC 2 can be instructions “mov_mov”, “mul_mov”, “add_mov”, “dp3_mov”, “mov_rsq”, “mul_rsq”, “add_rsq”, or “dp3_rsq”.
  • a decoder in the hardware is additionally able to decode these instructions of OPC 1 _OPC 2 or other combinations of OPC 1 and OPC 2 to increase the capability of the pixel shader.
  • the operands of new instructions of folding rule are four, src 0 , src 1 , src 2 , src 3 , and instruction “mad” can be used.
  • a register read port and source modifier in the hardware can be added, its cost-effectiveness is better than that of a co-issue mechanism.
  • the general formula of folding rule is represented as follows:
  • OPC 1 OPC 2 tgt.[r
  • OPC 1 OPC 2 tgt.[r
  • OPC 1 When OPC 1 is defined as a unary operator, its operand includes src 0 only, and when OPC 1 is defined as a binary operator, its operands include src 0 and src 1 .
  • OPC 1 is defined as a unary operator and OPC 2 is a triple operator
  • additional folding rule is described as follows:
  • OPC 1 OPC 2 tgt.[r
  • b] ⁇ ( src 1 ⁇ src 2 ⁇ src 3) ⁇ . (7)
  • OPC 1 OPC 2 tgt.[t
  • OPC 2 When OPC 2 is defined as a unary operator, its operand includes src 1 only, and when OPC 2 is defined as a binary operator, its operands include src 1 and src 2 .
  • OPC 1 is defined as a binary operator and OPC 2 is a binary operator also, additional folding rule is described as follows:
  • OPC 1 OPC 2 tgt.[r
  • b] ⁇ ( src 2 ⁇ src 3) ⁇ . (9)
  • OPC 1 OPC 2 tgt.[r
  • OPC 1 When OPC 1 is defined as a unary operator, its operand includes src 0 only, and when OPC 2 is defined as binary operator, its operands include src 1 and src 2 .
  • OPC 1 when OPC 1 is the instruction “mad” and OPC 2 is the instructions “mov” or “rsq”, the combination of OPC 1 _OPC 2 can be instructions “mad_mov” and “mad_rsq”.
  • the source register of the later first instruction is different from a target register of the former first instruction.
  • both the source register of the later first instruction and the target register of the former first instruction have a null set, e.g. “tgt.[r
  • b] ⁇ src 2 ⁇ ” in the above-mentioned item (1).
  • the data of the two adjacent first instructions is outputted into different components in the target register.
  • the total number of the source operands of the first and second instructions is within a predetermined threshold value, e.g. 3, 4, or more, so that the decoder can decode the combination of the first instructions.
  • the pixel shader comprises an instruction memory 508 , a fetcher 510 , a decoder 512 , an arithmetic logic unit (ALU) 514 , a register port 516 , and a register unit 518 .
  • the instruction memory 508 is used to store the second instructions of the second program 506 .
  • the fetcher 510 connected to the decoder 512 fetches the second instructions stored in the instruction memory 508 according to a program counter.
  • the decoder 512 decodes a control signal from the second instructions having the combination of the first instructions.
  • the ALU 514 connected to the decoder 512 performs an operation of a plurality of register components of the second instructions according to the control signal.
  • the register port connected to the ALU 514 is used to select the register components to transform operand formats of the second instructions.
  • the register unit 518 connected to the register port 516 is employed to store data of the register components of the second instructions.
  • instruction folding mechanism 500 can be implemented in the forms of software or hardware. If implemented in software, the instruction folding mechanism 500 is a software tool kit running in an operating system (OS), a program loader or a part of a device driver attached to a latter part of a compiler. Furthermore, if implemented in a hardware, the instruction folding mechanism 500 is preferably connected to an instruction fetch unit or a decode unit, i.e. before the instruction queue unit and decoder of the pixel shader in the preferred embodiment, or may be built in a pixel shader.
  • OS operating system
  • the instruction folding mechanism 500 is preferably connected to an instruction fetch unit or a decode unit, i.e. before the instruction queue unit and decoder of the pixel shader in the preferred embodiment, or may be built in a pixel shader.
  • FIG. 8 shows a flow chart of performing a pixel processing system according to the present invention.
  • a plurality of first instructions in a first program is folded by an instruction folding mechanism to generate a second program having at least one second instruction which is a combination of the first instructions.
  • step S 802 the second instructions are fetched according to a program counter.
  • a control signal is decoded from the second instructions having the combination of the first instructions by a decoder, as shown in step S 804 .
  • step S 806 an operation of a plurality of register components of the second instructions is performed according to the control signal by an ALU.
  • the register components are selected to transform operand formats of the second instructions by a register port in step S 808 .
  • FIG. 9 shows a flow chart of performing an instruction folding mechanism of the pixel processing system in FIG. 8 according to the present invention.
  • the first instructions are scanned according to static positions to schedule or rearrange the first instructions in the first program or to rearrange the first instructions with data independency in step S 900 .
  • the first instructions are checked by a folding rule checker according to a folding rule depending on whether the first instructions are data independent.
  • step S 904 a when the folding rule checker checks the first instructions by way of two adjacent first instructions and the two adjacent first instructions have data independency, one instruction and the other are combined to generate the second instruction to be written into the second program.
  • step S 904 b when the folding rule checker checks the first instructions by way of two adjacent first instructions and the two adjacent first instructions have data dependency, one instruction is written into the second program and the other is checked with a next first instruction according to the folding rule.
  • step S 906 the last first instruction is not processed and step S 902 is proceeded again.
  • the second program is then ready to be executed at step S 908 .
  • the instruction scheduler builds a dependence graph (DG) to determine whether the result of the former instruction is employed by the later one to indicate data dependency relationship between the first instructions, where each of the instruction is a node, as shown in step S 910 .
  • DG dependence graph
  • the instruction is dependent.
  • the folding rule checker can scan the DG.
  • the source register of the later first instruction is different from a target register of the former first instruction.
  • both the source register of the later first instruction and the target register of the former first instruction have a null set.
  • the data of the two adjacent first instructions are outputted into different components in the target register.
  • the total number of the source operands of the first and second instructions is within a predetermined threshold value to be decoded by the decoder.
  • the advantages of the present invention include: (a) folding instructions with data independency into reduced instructions for generating a new program; (b) folding instructions having an identical target register and output data to different components of the target register to save the hardware cost of pixel processing system; and (c) providing a folding mechanism applied to a pixel processing system to improve the performance of the pixel processing system.

Abstract

Methods, systems, and apparatuses, including computer programs encoded on computer-readable medium, including an instruction scheduler for scanning first and second instructions that are operable to output data to different components in a register. A rule checker determines if the scanned first and second instructions are data independent. An instruction combiner, in response to a determination that the scanned first and second instructions are data independent, forms a combination of the scanned first and second instructions. A processing unit that includes a single decoder, receives the combination, decodes the combination using the single decoder, and executes the combination.

Description

    CROSS-REFERENCE TO RELATED PATENT APPLICATIONS
  • This application is a Continuation of U.S. application Ser. No. 12/400,127, filed on Mar. 9, 2009, which is a Continuation of U.S. application Ser. No. 11/333,479, filed on Jan. 17, 2006, each of which are incorporated herein by reference in their entirety.
  • FIELD
  • The present disclosure relates to a folding mechanism, a method for performing the folding mechanism and a pixel processing system employing the same, and more particularly to an instruction folding mechanism, a method for performing the instruction folding mechanism and a pixel processing system employing the instruction folding mechanism applied to a graphic processor unit (GPU).
  • BACKGROUND
  • FIG. 1 is a block diagram of a pipeline configuration of a conventional graphic processor unit. The conventional graphic processor unit 100 mainly includes a triangle setup unit 102, a pixel processing unit 104 and a depth processing unit 106. The pixel processing unit 104 has a pixel shader 108, a texture unit 110 and a color interpolator 112 both connected to the pixel shader 108.
  • A surface of three-dimensional (3D) object is divided into a plurality of triangles two-dimensionally arranged in terms of their neighboring relationship and having an arbitrary size. Each of the triangles has three vertices which are forwarded to the triangle setup unit 102. The triangle setup unit 102 outputs the parameters of the pixels, such as the positions of the pixels in triangles and texture coordinates of the vertices of the corresponding triangles, to the pixel processing unit 104. In the pixel processing unit 104, based on the positions of the pixels and texture coordinates of the vertices, the texture unit 110 interpolates the texture coordinates for all the pixels. The interpolated texture coordinates of the pixels are inputted and then processed in the pixel shader 108 (with DirectX terms, or Fragment Processor in OpenGL terms). Next, the pixel shader 108 executes a texture load instruction to return the processed texture coordinates to the texture unit 110. Based on the unprocessed texture coordinates and the processed texture coordinates, the texture unit 110 samples the texture colors of the pixels in a texture map and outputs the texture colors to the pixel shader 108. Meanwhile, based on the positions of the pixels and texture coordinates of the vertices, the color interpolator 112 interpolates the vertex colors for all the pixels and outputs the vertex colors of the pixels to the pixel shader 108. The pixel shader 108 then processes the texture colors and the vertex colors of the pixels and outputs color values and depth values of the pixels to the depth processing unit 106, the final pixel colors are obtained. The final pixel colors are then becoming available for drawing the whole frame.
  • FIG. 2 is a block diagram of an example program in a pixel shader of the conventional graphic processor. The pixel shader 108 usually includes five kinds of registers: temporary registers rn for storing temporary data, texture coordinate registers tn, texture numbering registers sn, vertex color registers vn, and outputting registers ocn for transforming the final pixel colors to the depth processing unit 106.
  • The process of the pixel shader 108 normally has four stages: a coordinate calculation stage, a texture processing stage, a color blending stage and an issue out stage. The interpolated texture coordinates of the pixels from the texture unit 110 are stored in the texture coordinates registers tn. In the coordinate calculation stage, the arithmetic, for the interpolated texture coordinates of the pixels from the texture unit 110, is conducted in the texture coordinates registers tn and the temporary registers rn; the arithmetic results, i.e. the processed texture coordinates, are stored in the temporary registers rn. In the texture processing stage, based on the texture coordinates in the registers tn and rn, the pixel shader 108 executes texture load instructions to postulate the texture unit 110 to sample texture colors of the pixels in a texture map. The texture map is appointed by the texture numbering registers sn. The sampled texture colors are transformed to the temporary registers rn. In the color blending stage, the pixel shader 108 blends the texture colors stored in the temporary registers rn with the vertex colors from the color interpolator 112 and the blending result is stored in the vertex color registers vn. In the issued stage, the pixel shader 108 outputs color and depth values of the pixels to the depth processing unit 106. It should be noted that the coordinate calculation stage, the texture processing stage and the color blending stage may be repetitiously processed or be omitted, respectively.
  • Each of the registers is composed of four components, e.g. (x, y, z, w) or (r, g, b, a) which are so-called four-wide vectors and data format of floating point. In the coordinate calculation and texture processing stages, the four components (x, y, z, w) represent coordinates in a three-dimensional (3D) space or of different texture formats. In the color blending and issued stage, the four components (r, g, b, a) represent three primary colors of red, green and blue, and transparency. The components of source and target registers are assigned to instructions to read out or write the components. For example, r0.w represents the instructions that can read out or write component “w” of register “r0”.
  • Since processing steps of color components “r”, “g”, and “b” are considerably different from the transparency component “a”, there is a need of two independent pipelines to process these different kinds of components. When representing coordinates, “x”, “y” and “z” are also considerably different from the perspective component “w”. In DirectX standard, two independent pipelines are serially merged and concurrently issued out by a plus sign “+” preceding the second instruction of the pair, which is defined as instruction pairing or co-issue and has a component ratio of 3 to 1, as shown in FIG. 3A. However, the number of operator decoders, pipelines, register write ports and register read ports for the instructions is increased at least double the amount. Moreover, it is necessary to provide additional complicated functions, such as component selection, format transformation, source modification, and instruction modification in the pixel shader so that instructions can process operands located in the source and target registers. As a result, hardware cost of performing the functions is increased extremely.
  • Referring to FIG. 3B, a ratio diagram of two color components to two transparency components for the instructions in a conventional pixel shader program is illustrated here. In these two independent instructions, one is used to write color components “r” and “g”, and the other is used to write color components “b” and transparency “a”. Although the probability of instruction pairing or co-issue is increased, however, it has a more complicated architecture and a higher cost in the hardware of pixel shader. The nVidia Corporation began to implement such complicated co-issue in their GeForce6 Series GPU.
  • Referring to FIG. 4, a conventional pixel shader with a co-issue mechanism is shown here. The fetcher 400 reads out two instructions from the instruction queue 402 according to the program counter (PC). A pair of decoders (404 a, 404 b) decodes control signals from the fetched instructions, respectively, to control the pipeline operation of the arithmetic logic units (ALUs) (406 a, 406 b). The pair of ALU (406 a, 406 b) implements four vector components in parallel and consumes a pair of register ports (408 a, 408 b). Each of register ports (408 a, 408 b) includes three register read ports and a write port. Furthermore, it is necessary to use a source and an instruction modifier for each register port to process component selections and format transformation of source and target operands in the instruction.
  • Therefore, the co-issue mechanism requires an additional check mechanism to determine the timing of co-issue rule. Furthermore, since source and target registers of the two instructions are different in the timing of co-issue rule, the consumption of register read ports and register write ports are at least doubled the amount. The number of the source modifier and instruction modifier are also at least doubled the amount.
  • Consequently, there is a need to develop a pixel processing system having an instruction folding mechanism for reducing the hardware cost and increasing performance of graphic processor unit.
  • SUMMARY
  • The first objective of the present invention is to provide a folding mechanism applied to a pixel processing system to fold instructions with data independency into reduced instructions for generating a new program.
  • The second objective of the present invention is to provide a folding mechanism applied to a pixel processing system to fold instructions having an identical target register and output data to different components of the target register to save the hardware cost of pixel processing system.
  • The third objective of the present invention is to provide a folding mechanism applied to a pixel processing system to improve the performance of the pixel processing system.
  • According to the above objectives, the present invention sets forth an instruction folding mechanism, a method for performing the folding mechanism and a pixel processing system employing the same. The pixel processing system comprises an instruction folding mechanism and a pixel shader. The instruction folding mechanism folds a plurality of first instructions in a first program to generate a second program having at least one second instruction which is a combination of the first instructions. The pixel shader connected to the instruction folding mechanism fetches the second program to decode at least the second instruction having the combination of the first instructions to execute the second program.
  • The instruction folding mechanism comprises an instruction scheduler, a folding rule checker, and an instruction combiner. The instruction scheduler connected to the folding rule checker is used to scan the first instructions according to static positions to schedule the first instructions in the first program. Preferably, the instruction scanner successively scans the first instructions. The folding rule checker checks the first instructions according to a folding rule whether the first instructions has data independency. The instruction combiner connected to the folding rule checker can combine the first instructions having the data independency to generate at least the second instruction.
  • In the relationship of data independency between two adjacent first instructions, the source register of the later first instruction is different from a target register of the former first instruction. In other words, both the source register of the later first instruction and the target register of the former first instruction have a null set. In addition, the data of the two adjacent first instructions is outputted into different components in the target register. In one embodiment, the total number of the source operands of the first and second instructions is within a predetermined threshold value, e.g. 3, 4, or more, so that the decoder can decode the combination of the first instructions.
  • In operation, a plurality of first instruction in a first program is folded by an instruction folding mechanism to generate a second program having at least one second instruction which is a combination of the first instruction. Afterwards, the second instruction can be fetched according to a program counter. Control signals are decoded from the second instruction having the combination with the first instruction. Then, an operation of a plurality of register components of the second instruction is performed according to the control signal by an ALU. Finally, the register components are selected to transform operand formats of the second instruction by a register port.
  • The present invention folds instructions with data independency into reduced instructions for generating a new program. The folding instructions have an identical target register and output data to different components of the target register to save the hardware cost of pixel processing system. Because these rules are the most frequently case that the fourth component is separately used, the performance of the expensive co-issue hardware mechanism can be achieve by a much chipper extended decoder.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of a pipeline configuration of a conventional graphic processor unit.
  • FIG. 2 is a block diagram of an example program in a pixel shader of the conventional graphic processor.
  • FIG. 3A is a ratio diagram of three color components to one transparency component for the instructions in a conventional pixel shader program.
  • FIG. 3B is a ratio diagram of two color components to two transparency components for the instructions in a conventional pixel shader program.
  • FIG. 4 is a conventional pixel shader with a co-issue mechanism.
  • FIG. 5 is a block diagram of a pixel processing system having an instruction folding mechanism according to one preferred embodiment of the present invention.
  • FIG. 6 is a block diagram of an example program applied to the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention.
  • FIG. 7 is a detailed block diagram of the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention.
  • FIG. 8 shows a flow chart of performing a pixel processing system according to the present invention.
  • FIG. 9 shows a flow chart of performing an instruction folding mechanism of the pixel processing system in FIG. 8 according to the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The present invention is directed to an instruction folding mechanism, a method for performing the instruction folding mechanism and a pixel processing system employing the instruction folding mechanism to fold instructions with data independency into reduced instructions for generating a new program. Furthermore, the instruction folding mechanism is used to fold instructions having an identical target register and outputs data to different components of the target register to save the hardware cost of pixel processing system. It should be noted that the instruction folding mechanism is also suitable for vertex shader, geometric shader or a combination of the two.
  • FIG. 5 is a block diagram of a pixel processing system having an instruction folding mechanism according to one preferred embodiment of the present invention. The pixel processing system comprises an instruction folding mechanism 500 and a pixel shader 502. The instruction folding mechanism 500 folds a plurality of first instruction in a first program 504 to generate a second program 506 having at least one second instruction which is a combination of the first instruction. The pixel shader connected to the instruction folding mechanism 500 fetches the second program 506 to decode at least the second instruction having the combination of the first instruction to execute the second program 506.
  • FIG. 6 is a block diagram of an example program applied to the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention. The data of instruction “mul” is independent in the first program 504 from that of instruction “mov”, and the data output of “mul” and “mov” is stored in an identical register, i.e. “r1”, but in different components. In one embodiment, the total number of source operands of the data is three, i.e. “r0”, “t0”, and “r0.a”, and it can easily be performed by the instruction folding mechanism to create a new instruction, e.g. “mul_mov”, as in the second program 506. Therefore, a decoder can easily decode the new “folded” instruction. Since the instruction of the pixel shader is able to cover the total number of the source operands, an additional operand capacity of the instruction is not required to expand in order to save hardware cost of the pixel shader. However, in the prior art of a co-issue architecture, additional decoders for operators, operation pipelines, register write ports and register read ports for the operator are necessary to be prepared. Furthermore, instructions should be provided with many processing abilities, e.g. component selections, format transformations, source code modifications, and instruction modifications of source and target operands. Therefore, it is important to reduce the number of the operands.
  • FIG. 7 is a detailed block diagram of the instruction folding mechanism in FIG. 5 according to one embodiment of the present invention. The instruction folding mechanism 500 comprises an instruction scheduler 700, a folding rule checker 702, and an instruction combiner 704. The instruction scheduler 700 connected to the folding rule checker 702 is used to scan the first instruction according to static positions to schedule the first instruction in the first program 504. Preferably, the instruction scanner 700 successively scans the first instruction. The folding rule checker 702 checks the first instruction according to a folding rule whether the first instruction has data independency. The instruction combiner 704 connected to the folding rule checker 702 can combine the first instruction having the data independency to generate at least the second instruction in the second program 506. Specifically, in one preferred embodiment of the present invention, a general formula of folding rule is represented as following items:

  • OPC1 tgt.[r|g|b],src0,src1

  • OPC2 tgt.a,src2

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2, where

  • tgt.[r|g|b]∩src2=φ.  (1)
  • OPC1 and OPC2 are arbitrary operators and OPC1_OPC2 is a new combination operator indicating an operation instruction which performs OPC1 in components (r, g, b) and OPC2 in component “a”. The target operands, tgt.[r|g|b] and tgt.a, of OPC1 and OPC2 are in a same register, i.e. register “tgt”, but in different components of “tgt”. For example, component “a” is located in OPC1 and OPC2 at the same time. Additionally, the representation [r|g|b] means that components “r”, “g”, and “b” are not necessarily present but not limited to their presence
  • Src0, src1, and src2 are source operands and have arbitrary component(s), where OPC1 is defined as a binary operator having two operands, including operands src0 and src1, or defined as a unary operator including operand src0 only. The formula of tgt.[r|g|b]∩src2=φ. represents data independency in viewing of OPC1 and OPC2, which the operation results of OPC1 are irrelevant to that of OPC2. In one embodiment, instruction OPC1 is not required to be adjacent to OPC2 but only if the data of OPC1 is independent from that of OPC2. While taking the orders of instruction OPC1 and OPC2 into consideration, the formula of the folding rule also can be represented as follows:

  • OPC2 tgt.a,src2

  • OPC1 tgt[r|g|b],src0,src1

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2, where

  • tgt.a∩(src0∪src1)=φ.  (2)
  • While instruction OPC1 is a unary operator and OPC2 is a binary operator, the formula of folding rule also can be represented as follows:

  • OPC1 tgt.[r|g|b],src0

  • OPC2 tgt.a,src1,src2

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2, where

  • tgt.[r|g|b]∩(src1∪src2)=φ.  (3)

  • OPC2 tgt.a,src1,src2

  • OPC1 tgt.[r|g|b],src0

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2, where

  • tgt.a∩src0=φ.  (4)
  • When OPC2 is defined as a unary operator in the representation, operand includes src1 only.
  • In one preferred embodiment of the present invention, component “a” is operated alone and the result is then moved by instruction “mov” while component “a” is a “transparency” or coordinates of fourth dimension in the graphic effect applications. Component “a” is operated by instruction “rsq” to calculate the result of (1/√x) while component “a” is a distance or an angle from the light source in the lighting effect applications. While component “[r|g|b]” represents colors or coordinates, instructions “mov”, “mul”, “add”, “mad”, and “dp3” are usually used, for example. As a result, in one embodiment, when OPC1 is instructions “mov”, “mul”, “add”, “mad”, or “dp3” and OPC2 is “mov” or “rsq”, the combination of OPC1_OPC2 can be instructions “mov_mov”, “mul_mov”, “add_mov”, “dp3_mov”, “mov_rsq”, “mul_rsq”, “add_rsq”, or “dp3_rsq”. In the present invention, a decoder in the hardware is additionally able to decode these instructions of OPC1_OPC2 or other combinations of OPC1 and OPC2 to increase the capability of the pixel shader.
  • In another preferred embodiment of the present invention, the operands of new instructions of folding rule are four, src0, src1, src2, src3, and instruction “mad” can be used. Although, a register read port and source modifier in the hardware can be added, its cost-effectiveness is better than that of a co-issue mechanism. The general formula of folding rule is represented as follows:

  • OPC1 tgt.[r|g|b],src0,src1,src2

  • OPC2 tgt.a,src3

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2,src3, where

  • tgt.[r|g|b]∩src3=φ.  (5)
  • Taking the order of instructions OPC1 and OPC2 into consideration, the formula of folding rule also can be represented as follows: (6)

  • OPC2 tgt.a,src3

  • OPC1 tgt[r|g|b],src0,src1,src2

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2,src3, where

  • tgt.a∩(src0∪src1∪src2)=φ.  (5)
  • When OPC1 is defined as a unary operator, its operand includes src0 only, and when OPC1 is defined as a binary operator, its operands include src0 and src1.
  • When OPC1 is defined as a unary operator and OPC2 is a triple operator, additional folding rule is described as follows:

  • OPC1 tgt.[r|g|b],src0

  • OPC2 tgt.a,src1,src2,src3

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2,src3, where tgt.[r|g|b]∩(src1∪src2∪src3)=φ.  (7)

  • OPC2 tgt.a,src1,src2,src3

  • OPC1 tgt.[r|g|b],src0

  • OPC1 OPC2 tgt.[t|g|b]a,src0,src1,src2,src3, where

  • tgt.a∩src0=φ.  (8)
  • When OPC2 is defined as a unary operator, its operand includes src1 only, and when OPC2 is defined as a binary operator, its operands include src1 and src2.
  • When OPC1 is defined as a binary operator and OPC2 is a binary operator also, additional folding rule is described as follows:

  • OPC1 tgt.[r|g|b],src0,src1

  • OPC2 tgt.a,src2,src3

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2,src3, where tgt.[r|g|b]∩(src2∪src3)=φ.  (9)

  • OPC2 tgt.a,src2,src3

  • OPC1 tgt.[r|g|b],src0,src1

  • OPC1 OPC2 tgt.[r|g|b]a,src0,src1,src2,src3, where

  • tgt.a∩(src0∪src1)=φ.  (10)
  • When OPC1 is defined as a unary operator, its operand includes src0 only, and when OPC2 is defined as binary operator, its operands include src1 and src2. As a result, in one embodiment, when OPC1 is the instruction “mad” and OPC2 is the instructions “mov” or “rsq”, the combination of OPC1_OPC2 can be instructions “mad_mov” and “mad_rsq”.
  • In the relationship of data independency between two adjacent first instructions, the source register of the later first instruction is different from a target register of the former first instruction. In other words, both the source register of the later first instruction and the target register of the former first instruction have a null set, e.g. “tgt.[r|g|b]∩src2=φ” in the above-mentioned item (1). The data of the two adjacent first instructions is outputted into different components in the target register. In one embodiment, the total number of the source operands of the first and second instructions is within a predetermined threshold value, e.g. 3, 4, or more, so that the decoder can decode the combination of the first instructions. When the first instructions comprise at least two adjacent first instructions having data dependency, one instruction is written into the second program and the other is checked with a next first instruction according to the folding rule.
  • Referring to FIG. 5 again, the pixel shader comprises an instruction memory 508, a fetcher 510, a decoder 512, an arithmetic logic unit (ALU) 514, a register port 516, and a register unit 518. The instruction memory 508 is used to store the second instructions of the second program 506. The fetcher 510 connected to the decoder 512 fetches the second instructions stored in the instruction memory 508 according to a program counter. The decoder 512 decodes a control signal from the second instructions having the combination of the first instructions. The ALU 514 connected to the decoder 512 performs an operation of a plurality of register components of the second instructions according to the control signal. The register port connected to the ALU 514 is used to select the register components to transform operand formats of the second instructions. The register unit 518 connected to the register port 516 is employed to store data of the register components of the second instructions.
  • It should be noted that instruction folding mechanism 500 can be implemented in the forms of software or hardware. If implemented in software, the instruction folding mechanism 500 is a software tool kit running in an operating system (OS), a program loader or a part of a device driver attached to a latter part of a compiler. Furthermore, if implemented in a hardware, the instruction folding mechanism 500 is preferably connected to an instruction fetch unit or a decode unit, i.e. before the instruction queue unit and decoder of the pixel shader in the preferred embodiment, or may be built in a pixel shader.
  • FIG. 8 shows a flow chart of performing a pixel processing system according to the present invention. Starting at step S800, a plurality of first instructions in a first program is folded by an instruction folding mechanism to generate a second program having at least one second instruction which is a combination of the first instructions.
  • In step S802, the second instructions are fetched according to a program counter. A control signal is decoded from the second instructions having the combination of the first instructions by a decoder, as shown in step S804. Then, in step S806, an operation of a plurality of register components of the second instructions is performed according to the control signal by an ALU. Finally, the register components are selected to transform operand formats of the second instructions by a register port in step S808.
  • FIG. 9 shows a flow chart of performing an instruction folding mechanism of the pixel processing system in FIG. 8 according to the present invention. During the step S800, the first instructions are scanned according to static positions to schedule or rearrange the first instructions in the first program or to rearrange the first instructions with data independency in step S900. Then, in step S902, the first instructions are checked by a folding rule checker according to a folding rule depending on whether the first instructions are data independent.
  • In step S904 a, when the folding rule checker checks the first instructions by way of two adjacent first instructions and the two adjacent first instructions have data independency, one instruction and the other are combined to generate the second instruction to be written into the second program. In step S904 b, when the folding rule checker checks the first instructions by way of two adjacent first instructions and the two adjacent first instructions have data dependency, one instruction is written into the second program and the other is checked with a next first instruction according to the folding rule. At step S906, the last first instruction is not processed and step S902 is proceeded again. The second program is then ready to be executed at step S908.
  • Preferably, during the step S900, the instruction scheduler builds a dependence graph (DG) to determine whether the result of the former instruction is employed by the later one to indicate data dependency relationship between the first instructions, where each of the instruction is a node, as shown in step S910. Specifically, in the dependence graph, when the node is connected by an edge sign, the instruction is dependent. On the contrary, if the instruction is independent, then the folding rule checker can scan the DG.
  • In the relationship of data independency between two adjacent first instructions, the source register of the later first instruction is different from a target register of the former first instruction. In other words, both the source register of the later first instruction and the target register of the former first instruction have a null set. Preferably, the data of the two adjacent first instructions are outputted into different components in the target register. The total number of the source operands of the first and second instructions is within a predetermined threshold value to be decoded by the decoder.
  • The advantages of the present invention include: (a) folding instructions with data independency into reduced instructions for generating a new program; (b) folding instructions having an identical target register and output data to different components of the target register to save the hardware cost of pixel processing system; and (c) providing a folding mechanism applied to a pixel processing system to improve the performance of the pixel processing system.
  • As is understood by a person skilled in the art, the foregoing preferred embodiments of the present invention are illustrative rather than limiting of the present invention. It is intended that they cover various modifications and similar arrangements be included within the spirit and scope of the appended claims, the scope of which should be accorded the broadest interpretation so as to encompass all such modifications and similar structures.

Claims (13)

1. A system comprising:
an instruction scheduler configured to scan first and second instructions, wherein the first and second instructions are operable to output data to different components in a register;
a rule checker configured to determine if the scanned first and second instructions are data independent;
an instruction combiner configured, in response to a determination that the scanned first and second instructions are data independent, to form a combination of the scanned first and second instructions; and
a processing unit comprising a single decoder, the processing unit operable to receive the combination, decode the combination using the single decoder, and execute the combination.
2. The system of claim 1, wherein the combination is a reduced instruction.
3. The system of claim 1, wherein the combination is a new instruction.
4. The system of claim 1, wherein the combination is part of a program.
5. The system of claim 1, wherein the combination is operable to output data to the register.
6. The system of claim 1, wherein the scanned first and second instructions have an identical target register.
7. The system of claim 1, wherein the scanned first and second instructions are adjacent in a program.
8. The system of claim 1, wherein the processing unit is operable to perform an operation of a plurality of register components of the combination.
9. The system of claim 1, wherein the scanned second instruction has a source register different than a target register of the first scanned instruction.
10. A system comprising:
an instruction scheduler configured to scan first and second instructions each having one or more registers;
a rule checker configured to determine if the scanned first and second instructions are data independent by comparing the one or more registers of the scanned first instruction with the one or more registers of the scanned second instruction;
an instruction combiner configured, in response to a determination that the scanned first and second instructions are data independent, to form a combination of the scanned first and second instructions; and
a processing unit comprising a single decoder, the processing unit operable to receive the combination, decode the combination using the single decoder, and execute the combination.
11. A processing system comprising:
a checker operable to check for data independency between first and second instructions by comparing one or more target registers of said first instruction with one or more source registers of said second instruction;
an instruction combiner operable to form a combination of said first and second instructions responsive to a determination by said checker that the first and second instructions are data independent; and
a single decoder operable to decode the combination of said first and second instructions.
12. The system of claim 11, wherein the combination is a reduced instruction.
13. The system of claim 11, wherein the combination is a new instruction.
US13/437,397 2006-01-17 2012-04-02 Intruction folding mechanism, method for performing the same and pixel processing system employing the same Abandoned US20120188239A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/437,397 US20120188239A1 (en) 2006-01-17 2012-04-02 Intruction folding mechanism, method for performing the same and pixel processing system employing the same

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11/333,479 US7502029B2 (en) 2006-01-17 2006-01-17 Instruction folding mechanism, method for performing the same and pixel processing system employing the same
US12/400,127 US8520016B2 (en) 2006-01-17 2009-03-09 Instruction folding mechanism, method for performing the same and pixel processing system employing the same
US13/437,397 US20120188239A1 (en) 2006-01-17 2012-04-02 Intruction folding mechanism, method for performing the same and pixel processing system employing the same

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/400,127 Continuation US8520016B2 (en) 2006-01-17 2009-03-09 Instruction folding mechanism, method for performing the same and pixel processing system employing the same

Publications (1)

Publication Number Publication Date
US20120188239A1 true US20120188239A1 (en) 2012-07-26

Family

ID=38262745

Family Applications (3)

Application Number Title Priority Date Filing Date
US11/333,479 Active 2027-03-15 US7502029B2 (en) 2006-01-17 2006-01-17 Instruction folding mechanism, method for performing the same and pixel processing system employing the same
US12/400,127 Active 2026-08-01 US8520016B2 (en) 2006-01-17 2009-03-09 Instruction folding mechanism, method for performing the same and pixel processing system employing the same
US13/437,397 Abandoned US20120188239A1 (en) 2006-01-17 2012-04-02 Intruction folding mechanism, method for performing the same and pixel processing system employing the same

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US11/333,479 Active 2027-03-15 US7502029B2 (en) 2006-01-17 2006-01-17 Instruction folding mechanism, method for performing the same and pixel processing system employing the same
US12/400,127 Active 2026-08-01 US8520016B2 (en) 2006-01-17 2009-03-09 Instruction folding mechanism, method for performing the same and pixel processing system employing the same

Country Status (1)

Country Link
US (3) US7502029B2 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8904151B2 (en) * 2006-05-02 2014-12-02 International Business Machines Corporation Method and apparatus for the dynamic identification and merging of instructions for execution on a wide datapath
US20080122843A1 (en) * 2006-07-20 2008-05-29 Via Technologies, Inc. Multi-thread vertex shader, graphics processing unit and flow control method
US20080198166A1 (en) * 2007-02-16 2008-08-21 Via Technologies, Inc. Multi-threads vertex shader, graphics processing unit, and flow control method
JP5618639B2 (en) * 2010-06-07 2014-11-05 キヤノン株式会社 Image processing apparatus, image processing method, and program
US8854385B1 (en) * 2013-10-03 2014-10-07 Google Inc. Merging rendering operations for graphics processing unit (GPU) performance
US9292903B2 (en) 2013-10-03 2016-03-22 Google Inc. Overlap aware reordering of rendering operations for efficiency
US11157280B2 (en) * 2017-12-07 2021-10-26 International Business Machines Corporation Dynamic fusion based on operand size
CN112015474B (en) * 2020-08-28 2024-01-26 格兰菲智能科技有限公司 Electronic device and command quantity reducing method thereof

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1291A (en) * 1839-08-16 John hague
US5109504A (en) * 1989-12-29 1992-04-28 Texas Instruments Incorporated Graphics program adaptor
US5163139A (en) * 1990-08-29 1992-11-10 Hitachi America, Ltd. Instruction preprocessor for conditionally combining short memory instructions into virtual long instructions
US5852729A (en) * 1993-06-29 1998-12-22 Korg, Inc. Code segment replacement apparatus and real time signal processor using same
US5878242A (en) * 1997-04-21 1999-03-02 International Business Machines Corporation Method and system for forwarding instructions in a processor with increased forwarding probability
US5881307A (en) * 1997-02-24 1999-03-09 Samsung Electronics Co., Ltd. Deferred store data read with simple anti-dependency pipeline inter-lock control in superscalar processor
US5884059A (en) * 1996-01-26 1999-03-16 Advanced Micro Devices, Inc. Unified multi-function operation scheduler for out-of-order execution in a superscalar processor
US5896519A (en) * 1996-06-10 1999-04-20 Lsi Logic Corporation Apparatus for detecting instructions from a variable-length compressed instruction set having extended and non-extended instructions
US6026485A (en) * 1996-01-24 2000-02-15 Sun Microsystems, Inc. Instruction folding for a stack-based machine
US6081884A (en) * 1998-01-05 2000-06-27 Advanced Micro Devices, Inc. Embedding two different instruction sets within a single long instruction word using predecode bits
US6128720A (en) * 1994-12-29 2000-10-03 International Business Machines Corporation Distributed processing array with component processors performing customized interpretation of instructions
US6148391A (en) * 1998-03-26 2000-11-14 Sun Microsystems, Inc. System for simultaneously accessing one or more stack elements by multiple functional units using real stack addresses
US6237086B1 (en) * 1998-04-22 2001-05-22 Sun Microsystems, Inc. 1 Method to prevent pipeline stalls in superscalar stack based computing systems
US6301651B1 (en) * 1998-12-29 2001-10-09 Industrial Technology Research Institute Method and apparatus for folding a plurality of instructions
US6453407B1 (en) * 1999-02-10 2002-09-17 Infineon Technologies Ag Configurable long instruction word architecture and instruction set
US6650330B2 (en) * 1999-12-06 2003-11-18 Nvidia Corporation Graphics system and method for processing multiple independent execution threads
US6775765B1 (en) * 2000-02-07 2004-08-10 Freescale Semiconductor, Inc. Data processing system having instruction folding and method thereof
US6832307B2 (en) * 2001-07-19 2004-12-14 Stmicroelectronics, Inc. Instruction fetch buffer stack fold decoder for generating foldable instruction status information
US7268785B1 (en) * 2002-12-19 2007-09-11 Nvidia Corporation System and method for interfacing graphics program modules
US7477256B1 (en) * 2004-11-17 2009-01-13 Nvidia Corporation Connecting graphics adapters for scalable performance
US7761693B2 (en) * 2003-12-09 2010-07-20 Arm Limited Data processing apparatus and method for performing arithmetic operations in SIMD data processing
US7836282B2 (en) * 2007-12-20 2010-11-16 International Business Machines Corporation Method and apparatus for performing out of order instruction folding and retirement
US7844804B2 (en) * 2005-11-10 2010-11-30 Qualcomm Incorporated Expansion of a stacked register file using shadow registers
US8281108B2 (en) * 2002-01-19 2012-10-02 Martin Vorbach Reconfigurable general purpose processor having time restricted configurations

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4439828A (en) 1981-07-27 1984-03-27 International Business Machines Corp. Instruction substitution mechanism in an instruction handling unit of a data processing system
US5504932A (en) * 1990-05-04 1996-04-02 International Business Machines Corporation System for executing scalar instructions in parallel based on control bits appended by compounding decoder
USH1291H (en) 1990-12-20 1994-02-01 Hinton Glenn J Microprocessor in which multiple instructions are executed in one clock cycle by providing separate machine bus access to a register file for different types of instructions
US6377261B1 (en) 1991-02-28 2002-04-23 Adobe Systems Incorporated Compiling glyphs into instructions for imaging for execution on a general purpose computer
JPH06332680A (en) * 1993-05-21 1994-12-02 Tadao Shogetsu Automatic program generation device
US5634118A (en) 1995-04-10 1997-05-27 Exponential Technology, Inc. Splitting a floating-point stack-exchange instruction for merging into surrounding instructions by operand translation
US5826089A (en) 1996-01-04 1998-10-20 Advanced Micro Devices, Inc. Instruction translation unit configured to translate from a first instruction set to a second instruction set
WO1997027537A2 (en) 1996-01-24 1997-07-31 Sun Microsystems, Inc. A processor for executing instruction sets received from a network or from a local memory
WO1997027539A1 (en) * 1996-01-24 1997-07-31 Sun Microsystems, Inc. Methods and apparatuses for stack caching
US6674536B2 (en) * 1997-04-30 2004-01-06 Canon Kabushiki Kaisha Multi-instruction stream processor
US6108768A (en) 1998-04-22 2000-08-22 Sun Microsystems, Inc. Reissue logic for individually reissuing instructions trapped in a multiissue stack based computing system
US6349383B1 (en) * 1998-09-10 2002-02-19 Ip-First, L.L.C. System for combining adjacent push/pop stack program instructions into single double push/pop stack microinstuction for execution
AUPQ070599A0 (en) 1999-06-02 1999-06-24 Canon Kabushiki Kaisha Reconfigurable vliw processor
GB2367654B (en) * 2000-10-05 2004-10-27 Advanced Risc Mach Ltd Storing stack operands in registers
US6675376B2 (en) 2000-12-29 2004-01-06 Intel Corporation System and method for fusing instructions
US6980209B1 (en) * 2002-06-14 2005-12-27 Nvidia Corporation Method and system for scalable, dataflow-based, programmable processing of graphics data
US6825843B2 (en) * 2002-07-18 2004-11-30 Nvidia Corporation Method and apparatus for loop and branch instructions in a programmable graphics pipeline
US7210127B1 (en) * 2003-04-03 2007-04-24 Sun Microsystems Methods and apparatus for executing instructions in parallel
US7111154B2 (en) * 2003-06-25 2006-09-19 Intel Corporation Method and apparatus for NOP folding
US7600221B1 (en) * 2003-10-06 2009-10-06 Sun Microsystems, Inc. Methods and apparatus of an architecture supporting execution of instructions in parallel
GB2409065B (en) 2003-12-09 2006-10-25 Advanced Risc Mach Ltd Multiplexing operations in SIMD processing
US7281122B2 (en) * 2004-01-14 2007-10-09 Ati Technologies Inc. Method and apparatus for nested control flow of instructions using context information and instructions having extra bits
US7091982B2 (en) * 2004-05-14 2006-08-15 Nvidia Corporation Low power programmable processor
US7426724B2 (en) * 2004-07-02 2008-09-16 Nvidia Corporation Optimized chaining of vertex and fragment programs
US7324106B1 (en) * 2004-07-27 2008-01-29 Nvidia Corporation Translation of register-combiner state into shader microcode
US7643032B2 (en) * 2004-11-02 2010-01-05 Microsoft Corporation Texture-based packing, such as for packing 8-bit pixels into two bits
US7633505B1 (en) * 2004-11-17 2009-12-15 Nvidia Corporation Apparatus, system, and method for joint processing in graphics processing units
JP4692956B2 (en) * 2004-11-22 2011-06-01 株式会社ソニー・コンピュータエンタテインメント Drawing processing apparatus and drawing processing method
US7681187B2 (en) * 2005-03-31 2010-03-16 Nvidia Corporation Method and apparatus for register allocation in presence of hardware constraints
US7809928B1 (en) * 2005-11-29 2010-10-05 Nvidia Corporation Generating event signals for performance register control using non-operative instructions
US7584342B1 (en) * 2005-12-15 2009-09-01 Nvidia Corporation Parallel data processing systems and methods using cooperative thread arrays and SIMD instruction issue
US20080252652A1 (en) * 2007-04-13 2008-10-16 Guofang Jiao Programmable graphics processing element

Patent Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1291A (en) * 1839-08-16 John hague
US5109504A (en) * 1989-12-29 1992-04-28 Texas Instruments Incorporated Graphics program adaptor
US5163139A (en) * 1990-08-29 1992-11-10 Hitachi America, Ltd. Instruction preprocessor for conditionally combining short memory instructions into virtual long instructions
US5852729A (en) * 1993-06-29 1998-12-22 Korg, Inc. Code segment replacement apparatus and real time signal processor using same
US6128720A (en) * 1994-12-29 2000-10-03 International Business Machines Corporation Distributed processing array with component processors performing customized interpretation of instructions
US6026485A (en) * 1996-01-24 2000-02-15 Sun Microsystems, Inc. Instruction folding for a stack-based machine
US6125439A (en) * 1996-01-24 2000-09-26 Sun Microsystems, Inc. Process of executing a method on a stack-based processor
US5884059A (en) * 1996-01-26 1999-03-16 Advanced Micro Devices, Inc. Unified multi-function operation scheduler for out-of-order execution in a superscalar processor
US5896519A (en) * 1996-06-10 1999-04-20 Lsi Logic Corporation Apparatus for detecting instructions from a variable-length compressed instruction set having extended and non-extended instructions
US5881307A (en) * 1997-02-24 1999-03-09 Samsung Electronics Co., Ltd. Deferred store data read with simple anti-dependency pipeline inter-lock control in superscalar processor
US5878242A (en) * 1997-04-21 1999-03-02 International Business Machines Corporation Method and system for forwarding instructions in a processor with increased forwarding probability
US6081884A (en) * 1998-01-05 2000-06-27 Advanced Micro Devices, Inc. Embedding two different instruction sets within a single long instruction word using predecode bits
US6148391A (en) * 1998-03-26 2000-11-14 Sun Microsystems, Inc. System for simultaneously accessing one or more stack elements by multiple functional units using real stack addresses
US6237086B1 (en) * 1998-04-22 2001-05-22 Sun Microsystems, Inc. 1 Method to prevent pipeline stalls in superscalar stack based computing systems
US6301651B1 (en) * 1998-12-29 2001-10-09 Industrial Technology Research Institute Method and apparatus for folding a plurality of instructions
US6453407B1 (en) * 1999-02-10 2002-09-17 Infineon Technologies Ag Configurable long instruction word architecture and instruction set
US6650330B2 (en) * 1999-12-06 2003-11-18 Nvidia Corporation Graphics system and method for processing multiple independent execution threads
US6775765B1 (en) * 2000-02-07 2004-08-10 Freescale Semiconductor, Inc. Data processing system having instruction folding and method thereof
US6832307B2 (en) * 2001-07-19 2004-12-14 Stmicroelectronics, Inc. Instruction fetch buffer stack fold decoder for generating foldable instruction status information
US8281108B2 (en) * 2002-01-19 2012-10-02 Martin Vorbach Reconfigurable general purpose processor having time restricted configurations
US7268785B1 (en) * 2002-12-19 2007-09-11 Nvidia Corporation System and method for interfacing graphics program modules
US7761693B2 (en) * 2003-12-09 2010-07-20 Arm Limited Data processing apparatus and method for performing arithmetic operations in SIMD data processing
US7477256B1 (en) * 2004-11-17 2009-01-13 Nvidia Corporation Connecting graphics adapters for scalable performance
US7844804B2 (en) * 2005-11-10 2010-11-30 Qualcomm Incorporated Expansion of a stacked register file using shadow registers
US7836282B2 (en) * 2007-12-20 2010-11-16 International Business Machines Corporation Method and apparatus for performing out of order instruction folding and retirement

Also Published As

Publication number Publication date
US20070165028A1 (en) 2007-07-19
US7502029B2 (en) 2009-03-10
US20100177096A1 (en) 2010-07-15
US8520016B2 (en) 2013-08-27

Similar Documents

Publication Publication Date Title
US20120188239A1 (en) Intruction folding mechanism, method for performing the same and pixel processing system employing the same
US20200394750A1 (en) Graphics processing architecture employing a unified shader
US10140678B2 (en) Specialized code paths in GPU processing
US9202308B2 (en) Methods of and apparatus for assigning vertex and fragment shading operations to a multi-threaded multi-format blending device
US8203564B2 (en) Efficient 2-D and 3-D graphics processing
US6980209B1 (en) Method and system for scalable, dataflow-based, programmable processing of graphics data
US6624819B1 (en) Method and system for providing a flexible and efficient processor for use in a graphics processing system
JPWO2007049610A1 (en) Image processing device
US6807620B1 (en) Game system with graphics processor
CN107077828B (en) Compressing size of color lookup table
JP5133999B2 (en) Method and apparatus for performing user-defined clipping in object space
US6831635B2 (en) Method and system for providing a unified API for both 2D and 3D graphics objects
US20080094408A1 (en) System and Method for Geometry Graphics Processing
US20190172246A1 (en) Method, Display Adapter and Computer Program Product for Improved Graphics Performance by Using a Replaceable Culling Program
US7710427B1 (en) Arithmetic logic unit and method for processing data in a graphics pipeline
CN108780579B (en) MSAA rendering per sample using compressed data
WO2008128097A2 (en) Programmable graphics processing element
US20080084424A1 (en) Early retiring instruction mechanism, method for performing the same and pixel processing system thereof
US7508396B2 (en) Register-collecting mechanism, method for performing the same and pixel processing system employing the same
US9990748B2 (en) Corner texel addressing mode
CN108292426B (en) Partial span based rasterization
US20030014562A1 (en) Method and system for maintaining connections between surfaces and objects in a graphics display system
US20080098206A1 (en) Plotting Device And Plotting Method
CN101059865B (en) Instruction puckering mechanism and its method, and pixel processing system using same
Doggett Programmability features of graphics hardware

Legal Events

Date Code Title Description
AS Assignment

Owner name: TAICHI HOLDINGS, LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SILICON INTEGRATED SYSTEMS CORP.;REEL/FRAME:031256/0289

Effective date: 20090923

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION