CN106331663A - Interactive texture obtaining system and method for portable device - Google Patents
Interactive texture obtaining system and method for portable device Download PDFInfo
- Publication number
- CN106331663A CN106331663A CN201610738493.8A CN201610738493A CN106331663A CN 106331663 A CN106331663 A CN 106331663A CN 201610738493 A CN201610738493 A CN 201610738493A CN 106331663 A CN106331663 A CN 106331663A
- Authority
- CN
- China
- Prior art keywords
- pixel
- parameter
- module
- image
- diffuse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/43—Conversion of monochrome picture signals to colour picture signals for colour picture display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/73—Colour balance circuits, e.g. white balance circuits or colour temperature control
Abstract
The technical scheme of the invention comprises an interactive texture obtaining system and method for a portable device. The method comprises the steps of acquiring an image of flash texture and an image of non-flash texture; carrying out separation according to a separation parameter input by a user; creating a tangent vector based on a pixel difference of new light and dark images and calculating an initial value of a normal image; calculating the initial value of a diffuse reflection coefficient image; calculating the initial value of a highlight index image based on a highlight coefficient input by the user; calculating the initial value of a mirror image reflection coefficient image, and acquiring the final image of non-flash texture according to a highlight separation module, a normal image module, a diffuse reflection module and a highlight index module; and calculating a texture mapping parameter by using a nonlinear optimization technology, thereby generating a texture map. The method has the beneficial effects that the image of flash texture and the image of non-flash texture are collected by use of the portable devices such as a mobile phone and a digital single lens reflex, the more real texture map is generated interactively, and the existing problems that the texture production cycle is long, the cost is high and the precision is low in the fields of game production, television animation and the like are solved.
Description
Technical field
The mutual material that the present invention relates to a kind of portable equipment obtains system and method, belongs to graph and image processing field.
Background technology
In recent years, utilize single image obtain material appearance attribute and generate texturing technology, have made some progress,
Such as, CrazyBump is utilized to calculate Normal figure industrial quarters technical staff；In research field, Microsoft Research, Asia develops
Go out a interactive material and obtain system AppGen.But the single image that related system all assumes input is the highest
Light, limits the application of this type of method.On the other hand, the texturing utilizing this type of method to recover, it is difficult to produce and is similar to
Rendering effect under true illumination condition.
A kind of colour coding method that YUV is used by eurovision system, is PAL and SECAM simulation color TV
The color space that standard uses.In modern color television system, generally use three pipe colour cameras or colored CCD camera
Carry out capture, then the colour picture signal obtained is obtained RGB after color separation, respectively amplification correction, then through matrixing
Circuit obtains luminance signal Y and two colour difference signal B-Y (i.e. U), R-Y (i.e. V), and last transmitting terminal is by brightness and aberration three
Signal encodes respectively, sends with same channel.The method for expressing of this color is exactly so-called YUV color space table
Show.Luminance signal Y of YUV and carrier chrominance signal U, V are to separate.If only Y-signal component and there is no U, V component, then this
The image that sample represents is exactly black and white gray level image.Color television uses yuv space precisely in order to solve technicolo by luminance signal Y
Depending on the compatibling problem of machine Yu black and white television, make black and white television also can receive colour TV signal.
Summary of the invention
For the deficiencies in the prior art, technical scheme discloses the mutual material of a kind of portable equipment and obtains system
System method, view data is glistened by the equipment such as mobile phone, slr camera shooting band and flashless photo obtains.
Technical scheme includes that the mutual material of a kind of portable equipment obtains system, it is characterised in that this system
Including: acquisition module, it is used for using portable equipment to gather flashless texture map picture, is additionally operable to utilize portable equipment to gather band flash of light
Texture map picture；High light separation module, changes into for the flashless original RGB color image gathered by described acquisition module
YUV color space image, and separation parameter based on user's input and the original continuous-tone image of YUV color space image calculate
To new continuous-tone image, further by YUV image isolated mirror reflection figure and diffuse-reflectance figure；Normal direction module, according to Gao Guang
The pixel that separation module obtains new continuous-tone image is poor, creates the first tangent vector and the second tangent vector in tangent space, further, according to
All vector sum second tangent vectors calculate normal direction figure initial value；Diffuse-reflectance module, for obtaining the unrestrained of described high light isolated
Reflectogram, calculates diffuse-reflectance coefficient figure initial value；High optical index module, is used for obtaining described high light separation module and obtains new light and shade
Figure, further, high backscatter extinction logarithmic ratio based on user's input calculates the initial value of high optical index figure；Mirror reflection module, is used for obtaining
The mirror reflection figure of described high light isolated, calculates the initial value of mirror reflection coefficient figure further；Parameter optimization module, uses
In obtaining the initialization ginseng obtained according to described normal direction module, diffuse-reflectance module, high optical index module and mirror reflection module
Number, also obtains the band flash of light texture map picture of described acquisition module, uses non-linear optimization technique to calculate texturing parameter life
Become texturing.
Mutual material according to described portable equipment obtains system, and described high light separation module also includes: conversion
Module, for the original RGB color of the flashless texture map picture gathered being converted to the texture map picture of YUV color space,
Original continuous-tone image Y1 and primitive color figure U and saturation V；Segregant module, for the separation arranged according to User Defined
Parameter p, wherein new continuous-tone image Y2 is Y2=Y1*p, further, combines based on new continuous-tone image Y2, primitive color figure U and saturation V
For new RGB image, and using new RGB image as diffuse-reflectance figure, mirror reflection image and diffuse-reflectance figure and be that original RGB schemes
Picture.
Mutual material according to described portable equipment obtains system, and described normal direction module also includes: be used for obtaining
The pixel of described new continuous-tone image Y2 is poor, further, for any pixel (i, value D j) (i, j), tangential in S and T direction
Amount be respectively S (i, j)=(1,0, D (and i+1, j)-D (i-1, j)), T (i, j)=(0,1, D (i, j+1)-D (i, j-1)), then
Amassing as normal direction figure initial value of first tangent vector S and the second tangent vector T.
Mutual material according to described portable equipment obtains system, and described diffuse-reflectance module also includes: for unrestrained
Reflection initial value calculates, and wherein, diffuse-reflectance coefficient figure=diffuse-reflectance figure/NdotL, NdotL is pixel normal vector and illumination
The inner product of vector.
Mutual material according to described portable equipment obtains system, and described high optical index module also includes: for root
According to the high optical parameter of User Defined input, calculating the initial value of high optical index figure, its calculation is, high optical index
Figure=new continuous-tone image Y2* high optical parameter.
Mutual material according to described portable equipment obtains system, and described mirror reflection module also includes: based on by
Calculating the initial value of specularity factor figure, its calculation is, specularity factor figure=direct reflection figure/pow (NdotH, g
(x))/NdotL, wherein H represents illumination, sight line Middle Component, and NdotH is the inner product of pixel normal vector and H, and g (x) represents arbitrarily
The high optical index of pixel x.
Mutual material according to described portable equipment obtains system, and described parameter optimization module also includes: cluster
Module, for all pixels of the flashless image of parameter initialization are carried out N cluster, N represents cluster number；Acquisition parameter
Submodule, for obtaining the FOV parameter of portable equipment, initializes the illumination Lj of each pixel of band flashlight images, sight line Vj ginseng
Number；Processes pixel submodule, for each pixel class Ci process to described band flashlight images.
Mutual material according to described portable equipment obtains system, in a preferred embodiment, described picture
Element processes submodule to each pixel class Ci processs, including: pixel chooses submodule, is used for obtaining in current pixel classification
The value of any one pixel P；Read initial parameter sub-module, for obtaining the flashless texture map picture corresponding with pixel P
The initiation parameter of pixel；Read acquisition parameter submodule, for reading each pixel Pj of current pixel classification Ci
Rgb value, illumination Lj, sight line Vj；Nonlinear optimization submodule, chooses at the beginning of submodule, reading for transferring described pixel respectively
The data that beginning parameter sub-module, reading acquisition parameter submodule obtain, use nonlinear optimization to calculate the parameter of pixel P, and
Store the pinup picture parameter base corresponding as current pixel classification Ci；Pinup picture parameter sub-module, for calculating current pixel class one by one
The residual pixel point of other Ci and the ratio of pixel P, as the weight coefficient of residual pixel point, further, according to current pixel
The pinup picture parameter base of classification Ci, calculates the pinup picture parameter of residual pixel point.
Technical scheme also includes a kind of mutual material acquisition methods, it is characterised in that the method includes: use
Portable equipment gathers flashless texture map picture, is additionally operable to utilize portable equipment to gather band flash of light texture map picture；By described collection mould
The flashless original RGB color image of block collection changes into YUV color space image, and separation ginseng based on user's input
The original continuous-tone image of number and YUV color space image is calculated new continuous-tone image, further by YUV image isolated mirror
As reflectogram and diffuse-reflectance figure；Poor according to the pixel that high light separation module obtains new continuous-tone image, create first in tangent space tangential
Amount and the second tangent vector, further, calculate normal direction figure initial value according to the first tangent vector and the second tangent vector；Obtain described Gao Guang
The diffuse-reflectance figure of isolated, calculates diffuse-reflectance coefficient figure initial value；Obtain described high light separation module and obtain new continuous-tone image, enter
One step, high backscatter extinction logarithmic ratio based on user's input calculates the initial value of high optical index figure；Obtain the mirror image of described high light isolated
Reflectogram, calculates the initial value of mirror reflection coefficient figure further；Obtain according to described normal direction module, diffuse-reflectance module, height
The initiation parameter that optical index module and mirror reflection module obtain, also obtains the band flash of light texture map picture of described acquisition module,
Non-linear optimization technique is used to calculate texturing parameter and generate texturing.
Further, the method also includes: the original RGB color of the flashless texture map picture gathered is converted to YUV
The texture map picture of color space, original continuous-tone image Y1 and primitive color figure U and saturation V；Arrange according to User Defined
Separation parameter p, wherein new continuous-tone image Y2 is Y2=Y1*p, further, based on new continuous-tone image Y2, primitive color figure U and saturation V
Be combined as new RGB image, and using new RGB image as diffuse-reflectance figure, mirror reflection image and diffuse-reflectance figure and be original RGB
Image.
Further, the method also includes: the pixel obtaining described new continuous-tone image Y2 is poor, further, for any pixel
(i, value D j) (i, j), the tangent vector in S and T direction be respectively S (i, j)=(1,0, D (and i+1, j)-D (i-1, j)), T (i,
J)=(0,1, D (i, j+1)-D (i, j-1)), then the amassing as normal direction figure initial value of the first tangent vector S and the second tangent vector T.
Further, the method also includes: calculate diffuse-reflectance initial value, wherein, and diffuse-reflectance coefficient figure=diffuse-reflectance
Figure/NdotL, NdotL are the inner product of pixel normal vector and illumination vector.
Further, the method also includes: according to the high optical parameter of User Defined input, the initial value to high optical index figure
Calculating, its calculation is, the continuous-tone image Y2* high optical parameter of high optical index figure=new.
Further, the method also includes: calculating the initial value of specularity factor figure, its calculation is, direct reflection
Coefficient figure=direct reflection figure/pow (NdotH, g (x))/NdotL, wherein H represents illumination, sight line Middle Component, and NdotH is picture
Element normal vector and the inner product of H, g (x) represents the high optical index of any pixel x.
Further, the method also includes: all pixels of the flashless image of parameter initialization are carried out N cluster, N table
Show cluster number；Obtain the FOV parameter of portable equipment, initialize the illumination Lj of each pixel of band flashlight images, sight line Vj ginseng
Number；Each pixel class Ci process to described band flashlight images.
Further, the method also to not having individual Ci to calculate, including: obtain any one pixel in current pixel classification
The value of some P；Obtain the flashless texture map corresponding with pixel P as the initiation parameter of pixel；Read current pixel classification
The rgb value of each pixel Pj of Ci, illumination Lj, sight line Vj；Transfer described pixel respectively to choose submodule, read initial ginseng
The data that number submodule, reading acquisition parameter submodule obtain, use nonlinear optimization to calculate the parameter of pixel P, and store
As the pinup picture parameter base that current pixel classification Ci is corresponding；Calculate residual pixel point and the pixel of current pixel classification Ci one by one
The ratio of P, as the weight coefficient of residual pixel point, further, according to the pinup picture parameter base of current pixel classification Ci, calculates surplus
The pinup picture parameter of after image vegetarian refreshments.Weight coefficient, further, according to the pinup picture parameter base of current pixel classification Ci, calculate residue
The pinup picture parameter of pixel.
The invention have the benefit that the material appearance of the present invention obtains system and utilizes that mobile phone, slr camera etc. are portable to be set
Standby band flash of light, flashless two images of gathering, the most real texturing of interactive generation, thus the system that solves to play at present
The problems such as the field material fabrication cycle length such as work, video display animation, cost are high, precision is low.
Accompanying drawing explanation
Fig. 1 show the system block diagram according to embodiment of the present invention；
Fig. 2 show the detail flowchart according to embodiment of the present invention.
Detailed description of the invention
In order to make the object, technical solutions and advantages of the present invention clearer, below in conjunction with the accompanying drawings with specific embodiment pair
The present invention is described in detail.The mutual material of the portable equipment of the present invention obtains system and method and is applicable at graph image
Reason.
Fig. 1 show the system module figure according to embodiment of the present invention and flow chart.The most just acquisition module is for real
Existing image source data collection, high light separation module therein, normal direction module, diffuse-reflectance module, mirror reflection module are used for root
According to flashless image initial texturing parameter, parameter module therein is for flash of light material image procossing.This collection mould
Block, for gathering the flash of light texture map picture of the first portable equipment, is additionally operable to gather the non-flash texture map picture of the second portable equipment；
High light separation module, the original RGB color of non-flash described acquisition module gathered for separation parameter based on user's input
Spatial image changes into YUV color space image, and is new RGB image to converting YUV image twice transformation and separates
Obtaining mirror reflection figure and diffuse-reflectance figure, wherein YUV color space includes original continuous-tone image, primitive color figure and saturation；Method
To module, for obtaining the new continuous-tone image of YUV color space image, create the in tangent space according to the pixel difference of new continuous-tone image
All vector sum second tangent vectors, further, calculate normal direction figure initial value according to the first tangent vector and the second tangent vector；Diffuse-reflectance
Module, for obtaining the diffuse-reflectance figure of described high light isolated, calculates diffuse-reflectance coefficient figure initial value；High optical index module,
Obtaining new continuous-tone image for obtaining described high light separation module, further, high backscatter extinction logarithmic ratio based on user's input calculates high light and refers to
The initial value of number figure；Mirror reflection module, for obtaining the mirror reflection figure of described high light isolated, calculates mirror image further
The initial value of stickogram, obtains according to described high light separation module, normal direction module, diffuse-reflectance module and high optical index module
To final non-flash texture map picture；Parameter module, for according to described high light separation module, normal direction module, diffuse-reflectance module
Initiation parameter with high optical index module obtains final non-flash texture map picture, also obtains the flash of light material of described acquisition module
Image, uses non-linear optimization technique to calculate texturing parameter, further, obtains texture map and as appearance attribute and generate material
Pinup picture.
Fig. 2 show the detail flowchart according to embodiment of the present invention.It is embodied as step include S201～
S201, data acquisition, glistened and flashless two texture map pictures by the equipment such as mobile phone, slr camera shooting band.
S202, high light separates, and technical scheme utilizes light and shade value Y of YUV color space to be divided by original RGB image
From becoming diffuse-reflectance figure, direct reflection figure two parts.
It is embodied as follows shown in (1)～(5), including:
(1) original continuous-tone image Y and primitive color figure U, V are calculated according to original RGB image；
(2) user interactively enters separation parameter (generally 0.6～0.8)；
(3) new continuous-tone image Y2=original continuous-tone image Y* separation parameter；
(4) new RGB image is generated, as diffuse-reflectance figure according to new continuous-tone image Y2 and primitive color figure U, V；
(5) direct reflection figure=original RGB image-diffuse-reflectance figure.
S203, normal direction figure initializes, and basic thought is the margin of image element according to new continuous-tone image Y2, constructs S in tangent space
Vector sum T vector, is obtained N by S × TD.Specific as follows:
According to picture element (i, value D j) (i, j), the tangent vector in S and T direction is,
S (i, j)=(1,0, D (i+1, j)-D (i-1, j)),
T (i, j)=(0,1, D (i, j+1)-D (i, j-1)).
Therefore, according to ND(((i j) can calculate normal direction figure for i, j) × T for i, j)=S.
S204, diffuse-reflectance coefficient figure initializes, diffuse-reflectance coefficient=diffuse-reflectance figure/NdotL.Wherein, NdotL is pixel method
The inner product that vector is vectorial with illumination.Assume that illumination is perpendicular to material surface in this stage, i.e. L (0,0,1).
S205, high optical index figure initializes, and user's interactive mode inputs high optical parameter (generally 0.1～0.5), high optical index
Figure=new continuous-tone image Y2* high optical parameter.
S206, specularity factor figure initializes, specularity factor figure=direct reflection figure/pow (NdotH, g (x))/
NdotL.NdotL: for the inner product of pixel normal vector with illumination vector；NdotH: for pixel normal vector and H (in the middle of illumination, sight line
Component) inner product；G (x): arbitrarily pixel x height optical index；Pow (NdotH, g (x)): g (x) power of NdotH.
S207, according to band flashlight images, utilizes non-linear optimization technique to calculate texturing parameter, including following (1)～
(3):
(1) all pixels to flashless image cluster (N is cluster number).
(2) according to the FOV parameter of camera, the illumination Lj of each pixel of band flashlight images, sight line Vj parameter are initialized.
(3) each class pixel Ci is processed successively according to following steps.
For step (3), it also includes (A)～(E) 6 submodules:
(A) a pixel P is randomly choosed from current class Ci；
(B) corresponding for read pixel point P texturing parameter is (in step S202～S206 according to flashless image initial
Obtain)；
(C) rgb value of each pixel Pj of current class Ci, illumination Lj, sight line Vj are read；
(D) by the value of (B) and (C) respectively as the texturing initial parameter value of pixel P and known input data, profit
With non-linear optimization technique, recalculate the pinup picture parameter of pixel P, and as current class pinup picture parameter base.
(E) ratio of other pixels of current class Ci and pixel P is calculated successively, as the weight system of other pixels
Number, according to the pinup picture parameter base of current class, calculates the pinup picture parameter of other pixels.
The above, simply presently preferred embodiments of the present invention, the invention is not limited in above-mentioned embodiment, as long as
It reaches the technique effect of the present invention with identical means, all should belong to protection scope of the present invention.Protection model in the present invention
In enclosing, its technical scheme and/or embodiment can have various different modifications and variations.
Claims (16)
1. the mutual material of a portable equipment obtains system, it is characterised in that this system includes:
Acquisition module, is used for using portable equipment to gather flashless texture map picture, is additionally operable to utilize portable equipment to gather band flash of light
Texture map picture；
High light separation module, changes into YUV face for the flashless original RGB color image gathered by described acquisition module
Colour space image, and separation parameter based on user's input and the original continuous-tone image of YUV color space image be calculated newly
Continuous-tone image, further by YUV image isolated mirror reflection figure and diffuse-reflectance figure；
Normal direction module, poor according to the pixel that high light separation module obtains new continuous-tone image, create in tangent space the first tangent vector and
Second tangent vector, further, calculates normal direction figure initial value according to the first tangent vector and the second tangent vector；
Diffuse-reflectance module, for obtaining the diffuse-reflectance figure of described high light isolated, calculates diffuse-reflectance coefficient figure initial value；
High optical index module, is used for obtaining described high light separation module and obtains new continuous-tone image, further, height based on user's input
Backscatter extinction logarithmic ratio calculates the initial value of high optical index figure；
Mirror reflection module, for obtaining the mirror reflection figure of described high light isolated, calculates mirror reflection coefficient further
The initial value of figure；
Parameter optimization module, for obtaining according to described normal direction module, diffuse-reflectance module, high optical index module and mirror reflection
The initiation parameter that module obtains, also obtains the band flash of light texture map picture of described acquisition module, uses non-linear optimization technique meter
Calculate texturing parameter and generate texturing.
The mutual material of portable equipment the most according to claim 1 obtains system, it is characterised in that described high light separates
Module also includes:
Transform subblock, for being converted to YUV color space by the original RGB color of the flashless texture map picture gathered
Texture map picture, original continuous-tone image Y1 and primitive color figure U and saturation V；
Segregant module, for separation parameter p arranged according to User Defined, wherein new continuous-tone image Y2 is Y2=Y1*p, enters one
Step, is combined as new RGB image based on new continuous-tone image Y2, primitive color figure U and saturation V, and using new RGB image as diffuse-reflectance
Figure, mirror reflection image and diffuse-reflectance figure and be original RGB image.
The mutual material of portable equipment the most according to claim 1 obtains system, it is characterised in that described normal direction artwork
Block also includes:
Poor, further, for any pixel for obtaining the pixel of described new continuous-tone image Y2Value, at S and T
The tangent vector in direction is respectively
,
,
Then the amassing as normal direction figure initial value of the first tangent vector S and the second tangent vector T.
The mutual material of portable equipment the most according to claim 1 obtains system, it is characterised in that described diffuse-reflectance mould
Block also includes:
For diffuse-reflectance initial value is calculated, wherein,
Diffuse-reflectance coefficient figure=diffuse-reflectance figure/NdotL,
NdotL is the inner product of pixel normal vector and illumination vector.
The mutual material of portable equipment the most according to claim 1 obtains system, it is characterised in that described high optical index
Module also includes:
For the high optical parameter inputted according to User Defined, the initial value of high optical index figure is calculated, its calculation
For,
The continuous-tone image Y2* high optical parameter of high optical index figure=new.
The mutual material of portable equipment the most according to claim 1 obtains system, it is characterised in that described mirror reflection
Module also includes:
For calculating the initial value of specularity factor figure, its calculation is,
Specularity factor figure=direct reflection figure/pow (NdotH, g (x))/NdotL,
Wherein H represents illumination, sight line Middle Component, and NdotH is the inner product of pixel normal vector and H, and g (x) represents any pixel x
High optical index.
The mutual material of portable equipment the most according to claim 1 obtains system, it is characterised in that described parameter optimization
Module also includes:
Cluster submodule, for all pixels of the flashless image of parameter initialization are carried out N cluster, N represents cluster
Number；
Acquisition parameter submodule, for obtaining the FOV parameter of portable equipment, initializes the illumination of each pixel of band flashlight images
Lj, sight line Vj parameter；
Processes pixel submodule, for each pixel class Ci process to described band flashlight images.
The mutual material of portable equipment the most according to claim 7 obtains system, it is characterised in that described processes pixel
Each pixel class Ci is processed and also includes by module:
Pixel chooses submodule, for obtaining the value of any one pixel P in current pixel classification；
Read initial parameter sub-module, for obtaining the flashless texture map corresponding with pixel P as the initialization ginseng of pixel
Number；
Read acquisition parameter submodule, for read the rgb value of each pixel Pj of current pixel classification Ci, illumination Lj,
Sight line Vj；
Nonlinear optimization submodule, chooses submodule, reading initial parameter sub-module for transferring described pixel respectively, reads and adopt
The data that collection parameter sub-module obtains, use nonlinear optimization to calculate the parameter of pixel P, and store as current pixel classification
Pinup picture parameter base corresponding for Ci；
Pinup picture parameter sub-module, for calculating the residual pixel point of current pixel classification Ci and the ratio of pixel P one by one, as
The weight coefficient of residual pixel point, further, according to the pinup picture parameter base of current pixel classification Ci, calculates the patch of residual pixel point
Graph parameter.
9. a mutual material acquisition methods, it is characterised in that the method includes:
Acquisition module, is used for using portable equipment to gather flashless texture map picture, is additionally operable to utilize portable equipment to gather band flash of light
Texture map picture；
The flashless original RGB color image gathered by described acquisition module changes into YUV color space image, and based on
The separation parameter of user's input and the original continuous-tone image of YUV color space image are calculated new continuous-tone image, further will
YUV image isolated mirror reflection figure and diffuse-reflectance figure；
The pixel that high light separation module obtains new continuous-tone image is poor, creates the first tangent vector and the second tangent vector in tangent space, enters one
Step, calculates normal direction figure initial value according to the first tangent vector and the second tangent vector；
Obtain the diffuse-reflectance figure of described high light isolated, calculate diffuse-reflectance coefficient figure initial value；
Obtaining described high light separation module and obtain new continuous-tone image, further, high backscatter extinction logarithmic ratio based on user's input calculates high light and refers to
The initial value of number figure；
Obtain the mirror reflection figure of described high light isolated, calculate the initial value of mirror reflection coefficient figure further；
Obtain the initialization obtained according to described normal direction module, diffuse-reflectance module, high optical index module and mirror reflection module
Parameter, also obtains the band flash of light texture map picture of described acquisition module, uses non-linear optimization technique to calculate texturing parameter also
Generate texturing.
Mutual material acquisition methods the most according to claim 9, it is characterised in that the method also includes:
The original RGB color of the flashless texture map picture gathered is converted to the texture map picture of YUV color space, original bright
Secretly scheme Y1 and primitive color figure U and saturation V；
Separation parameter p arranged according to User Defined, wherein new continuous-tone image Y2 is Y2=Y1*p, further, based on new continuous-tone image
Y2, primitive color figure U and saturation V are combined as new RGB image, and using new RGB image as diffuse-reflectance figure, mirror reflection image
With diffuse-reflectance figure and be original RGB image.
11. mutual material acquisition methods according to claim 9, it is characterised in that the method also includes:
The pixel obtaining described new continuous-tone image Y2 is poor, further, for any pixelValue, in S and T direction
Tangent vector be respectively,,
Then the amassing as normal direction figure initial value of the first tangent vector S and the second tangent vector T.
12. mutual material acquisition methods according to claim 9, it is characterised in that the method also includes:
Calculating diffuse-reflectance initial value, wherein, diffuse-reflectance coefficient figure=diffuse-reflectance figure/NdotL, NdotL is pixel normal vector
Inner product with illumination vector.
13. mutual material acquisition methods according to claim 9, it is characterised in that the method also includes:
According to the high optical parameter of User Defined input, calculating the initial value of high optical index figure, its calculation is, high
The continuous-tone image Y2* high optical parameter of optical index figure=new.
14. mutual material acquisition methods according to claim 9, it is characterised in that the method also includes:
Calculating the initial value of specularity factor figure, its calculation is,
Specularity factor figure=direct reflection figure/pow (NdotH, g (x))/NdotL,
Wherein H represents illumination, sight line Middle Component, and NdotH is the inner product of pixel normal vector and H, and g (x) represents any pixel x
High optical index.
15. mutual material acquisition methods according to claim 9, it is characterised in that the method also includes:
All pixels of the flashless image of parameter initialization are carried out N cluster, and N represents cluster number；
Obtain the FOV parameter of portable equipment, initialize the illumination Lj of each pixel of band flashlight images, sight line Vj parameter；
Each pixel class Ci process to described band flashlight images.
16. mutual material acquisition methods according to claim 15, it is characterised in that the method is also to not having individual Ci to count
Calculate, including:
The value of any one pixel P in acquisition current pixel classification；
Obtain the flashless texture map corresponding with pixel P as the initiation parameter of pixel；
Read the rgb value of each pixel Pj of current pixel classification Ci, illumination Lj, sight line Vj；
Transfer described pixel respectively to choose submodule, read initial parameter sub-module, the number of reading acquisition parameter submodule acquisition
According to, use nonlinear optimization to calculate the parameter of pixel P, and store the pinup picture parameter base corresponding as current pixel classification Ci；
Calculate the residual pixel point of current pixel classification Ci and the ratio of pixel P one by one, as the weight system of residual pixel point
Number, further, according to the pinup picture parameter base of current pixel classification Ci, calculates the pinup picture parameter of residual pixel point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610738493.8A CN106331663B (en) | 2016-08-26 | 2016-08-26 | A kind of interaction material acquisition system and method for portable equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610738493.8A CN106331663B (en) | 2016-08-26 | 2016-08-26 | A kind of interaction material acquisition system and method for portable equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106331663A true CN106331663A (en) | 2017-01-11 |
| CN106331663B CN106331663B (en) | 2018-12-11 |
Family
ID=57791024
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610738493.8A Active CN106331663B (en) | 2016-08-26 | 2016-08-26 | A kind of interaction material acquisition system and method for portable equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106331663B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106971418A (en) * | 2017-04-28 | 2017-07-21 | 碰海科技（北京）有限公司 | Hand-held household building materials convex-concave surface texture reconstructing device |
| CN112150592A (en) * | 2020-09-28 | 2020-12-29 | 腾讯科技（深圳）有限公司 | Animation file generation method and device, storage medium and electronic equipment |
| CN112634156A (en) * | 2020-12-22 | 2021-04-09 | 浙江大学 | Method for estimating material reflection parameter based on portable equipment collected image |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6259455B1 (en) * | 1998-06-30 | 2001-07-10 | Cirrus Logic, Inc. | Method and apparatus for applying specular highlighting with specular components included with texture maps |
| KR20050066501A (en) * | 2003-12-26 | 2005-06-30 | 한국전자통신연구원 | Inverse rendering apparatus and method using filtered environment map |
| CN102819864A (en) * | 2012-08-14 | 2012-12-12 | 北京航空航天大学 | Luminosity diagram-based geometry and surface material reconstructing method |
| US20140176550A1 (en) * | 2010-08-27 | 2014-06-26 | Industry-Academia Cooperation Group Of Sejong University | Roy tracing appratus and method |
| CN104463198A (en) * | 2014-11-19 | 2015-03-25 | 上海电机学院 | Method for carrying out illumination estimation on real illumination environment |
| CN105574920A (en) * | 2016-01-28 | 2016-05-11 | 网易（杭州）网络有限公司 | Texture map generating method, texture map generating device, texture synthesizing method and texture synthesizing device |
-
2016
- 2016-08-26 CN CN201610738493.8A patent/CN106331663B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6259455B1 (en) * | 1998-06-30 | 2001-07-10 | Cirrus Logic, Inc. | Method and apparatus for applying specular highlighting with specular components included with texture maps |
| KR20050066501A (en) * | 2003-12-26 | 2005-06-30 | 한국전자통신연구원 | Inverse rendering apparatus and method using filtered environment map |
| US20140176550A1 (en) * | 2010-08-27 | 2014-06-26 | Industry-Academia Cooperation Group Of Sejong University | Roy tracing appratus and method |
| CN102819864A (en) * | 2012-08-14 | 2012-12-12 | 北京航空航天大学 | Luminosity diagram-based geometry and surface material reconstructing method |
| CN104463198A (en) * | 2014-11-19 | 2015-03-25 | 上海电机学院 | Method for carrying out illumination estimation on real illumination environment |
| CN105574920A (en) * | 2016-01-28 | 2016-05-11 | 网易（杭州）网络有限公司 | Texture map generating method, texture map generating device, texture synthesizing method and texture synthesizing device |
Non-Patent Citations (2)
| Title |
|---|
| 付曙光等: "基于三维纹理合成图像的重光照研究", 《科技信息(科学教研)》 * |
| 孙其民: "纹理物体表面反射参数的恢复", 《计算机研究与发展》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106971418A (en) * | 2017-04-28 | 2017-07-21 | 碰海科技（北京）有限公司 | Hand-held household building materials convex-concave surface texture reconstructing device |
| CN112150592A (en) * | 2020-09-28 | 2020-12-29 | 腾讯科技（深圳）有限公司 | Animation file generation method and device, storage medium and electronic equipment |
| CN112150592B (en) * | 2020-09-28 | 2023-07-14 | 腾讯科技（深圳）有限公司 | Animation file generation method and device, storage medium and electronic equipment |
| CN112634156A (en) * | 2020-12-22 | 2021-04-09 | 浙江大学 | Method for estimating material reflection parameter based on portable equipment collected image |
| CN112634156B (en) * | 2020-12-22 | 2022-06-24 | 浙江大学 | Method for estimating material reflection parameter based on portable equipment collected image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106331663B (en) | 2018-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11882369B2 (en) | Method and system of lens shading color correction using block matching | |
| CN102572443B (en) | For isochronous audio in image-signal processing system and the technology of video data | |
| US9398280B2 (en) | AWB using face detection | |
| CN108055452A (en) | Image processing method, device and equipment | |
| CN103440674B (en) | A kind of rapid generation of digital picture wax crayon specially good effect | |
| CN108154514A (en) | Image processing method, device and equipment | |
| CN109191403A (en) | Image processing method and device, electronic equipment, computer readable storage medium | |
| CN105828058B (en) | A kind of method of adjustment and device of white balance | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105260152B (en) | Image processing method and device for LED display | |
| CN108616700B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN108024054A (en) | Image processing method, device and equipment | |
| CN107396079B (en) | White balance adjustment method and device | |
| CN113556526B (en) | RGBW filter array-based color enhancement method for color night vision equipment | |
| CN106331663A (en) | Interactive texture obtaining system and method for portable device | |
| CN107580205B (en) | White balance adjustment method and device | |
| CN111491149B (en) | Real-time image matting method, device, equipment and storage medium based on high-definition video | |
| CN106550227A (en) | A kind of image saturation method of adjustment and device | |
| US8994848B2 (en) | Method and system for handling mixed illumination in video and photography | |
| CN107705263A (en) | A kind of adaptive Penetrating Fog method and terminal based on RGB IR sensors | |
| CN106408617B (en) | Interactive single image material obtaining system and method based on YUV color space | |
| CN107295261A (en) | Image defogging processing method, device, storage medium and mobile terminal | |
| CN105321153B (en) | Video monitoring low-light (level) image color restoring method and device | |
| CN109040598A (en) | Image processing method, device, computer readable storage medium and electronic equipment | |
| WO2017144014A1 (en) | Subtitled photograph generation method, image processing method, terminal, and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 519000 Room 102, 202, 302 and 402, No. 325, Qiandao Ring Road, Tangjiawan Town, high tech Zone, Zhuhai City, Guangdong Province, Room 102 and 202, No. 327 and Room 302, No. 329 Patentee after: Zhuhai Jinshan Digital Network Technology Co.,Ltd. Patentee after: Guangzhou Xishanju Network Technology Co.,Ltd. Address before: 519000 Jinshan software building, 8 Lanshan lane, Jida Jingshan Hill Road, Zhuhai, Guangdong Patentee before: ZHUHAI KINGSOFT ONLINE GAME TECHNOLOGY Co.,Ltd. Patentee before: GUANGZHOU SEASUN ENTERTAINMENT NETWORK TECHNOLOGY Co.,Ltd. |
|
| CP03 | Change of name, title or address |