CN103324327A - Virtue screen realizing method and system - Google Patents
Virtue screen realizing method and system Download PDFInfo
- Publication number
- CN103324327A CN103324327A CN2012100792571A CN201210079257A CN103324327A CN 103324327 A CN103324327 A CN 103324327A CN 2012100792571 A CN2012100792571 A CN 2012100792571A CN 201210079257 A CN201210079257 A CN 201210079257A CN 103324327 A CN103324327 A CN 103324327A
- Authority
- CN
- China
- Prior art keywords
- screen
- stereo
- axle
- mark
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
- Position Input By Displaying (AREA)
Abstract
A virtue screen realizing method comprises the following steps: initializing a three-dimensional screen; collecting the image sequence of a mark; identifying position changes of the mark in the three-dimensional screen; according to the position changes, detecting whether the three-dimensional screen is required to be calibrated or not; if yes, calibrating the three-dimensional screen according to the position changes; generating a command according to the position of the mark. With adoption of the virtue screen realizing method, whether the mark is subjected to undesired shake in the space can be judged according to the position changes of the mark in the three-dimensional screen; if yes, the three-dimensional screen is required to be calibrated so as to eliminate the undesired shake. Therefore, the action of a user can be identified more accurately through the manner, and the incorrect operation caused by hand shake can be avoided. In addition, the invention further provides a virtue screen realizing system.
Description
[technical field]
The present invention relates to human-computer interaction technique field, relate to especially a kind of virtual screen implementation method and system.
[background technology]
The conventional method of man-machine interaction is for passing through input media input operation instruction, with the control controlled device.Traditional input media generally comprises keyboard, mouse, button, operating grip etc., the in recent years appearance of touch-screen to the user brought do not economize convenient.The more hommization of the operator scheme of touch screen technology so that more directly perceived, simpler during user's input operation order, and bring the user and experience more really, so touch screen technology has been applied to every field more and more widely.
Yet traditional touch screen technology must arrange the touch-screen that is comprised of special substance at controlled device, and the user must touch touch-screen ability input control order.For so that man-machine interaction is more convenient, the concept of virtual screen has been proposed, namely the user often wishes to fictionalize a screen (virtual touch-screen) in face of oneself.By this virtual screen, the user can control display screen a long way off, and it is mobile forward that the user controls certain specific device, and the action of display screen is pinned in the expression simulation, and it is backward mobile that the user controls this specific device, and the action of display screen is left in the expression simulation.Aforesaid way need not to contact display screen, also need not to arrange traditional touch-screen.Yet, because the user controls and has certain randomness, for example, when carrying out simulated action, often cause maloperation because user's hand is trembled.Therefore, how to prevent that hand from trembling the inaccurate problem of the operation that brings is the essential problem that solves of virtual screen technology.
[summary of the invention]
Based on this, being necessary to provide a kind of can proofread and correct virtual screen, thereby can avoid hand to tremble the inaccurate virtual screen implementation method of the operation that causes.
Based on this, being necessary to provide a kind of can proofread and correct virtual screen, realizes system thereby can avoid hand to tremble the inaccurate virtual screen of the operation that causes.
A kind of virtual screen implementation method may further comprise the steps: initialization 3 D stereo screen; Gather the image sequence of mark; The change in location of identification marking in described 3 D stereo screen; Detect according to described change in location whether needs are proofreaied and correct the 3 D stereo screen, if, then according to the described 3 D stereo screen of described change in location correction; Position according to mark generates instruction.
Preferably, the step of described initialization 3 D stereo screen comprises: set up three-dimensional system of coordinate O-xyz, the described 3 D stereo screen of initialization is the rectangular parallelepiped zone in the described three-dimensional system of coordinate, and three ribs that intersect in described rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.
Preferably, described change in location is that mark changes to the second place from primary importance; Describedly detect needs whether according to described change in location and proofread and correct the step of 3 D stereo screen and comprise: whether detecting described mark, to move to the second place from primary importance larger than the shift length on the x of described three-dimensional system of coordinate axle and y axle at the shift length on the z of the described three-dimensional system of coordinate axle, if then judging needs to proofread and correct described 3 D stereo screen.
Preferably, described step according to the described 3 D stereo screen of change in location correction comprises: obtain described x axle and the displacement on the y axle that is marked at described three-dimensional system of coordinate, according to the described 3 D stereo screen of described displacement translation.
Preferably, the step that described position according to mark generates instruction comprises: obtain the position in the described 3 D stereo screen that is marked at after the correction, described position is converted to screen coordinate in the display screen and the generation instruction relevant with described screen coordinate.
Preferably, the described step that described position is converted to the screen coordinate in the display screen comprises: calculate the screen coordinate that is marked at the correspondence position in the display screen according to the component of position on x axle and y axle that is marked in the 3 D stereo screen.
Preferably, described method also comprises: detect and describedly mark whether to be positioned at outside the described 3 D stereo screen, if the zone that arranges when described 3 D stereo screen is initialization 3 D stereo screen then is set.
A kind of virtual screen is realized system, comprising: processing module is used for initialization 3 D stereo screen; Image capture module is for the image sequence that gathers mark; Identification module, the change in location of identification marking in described 3 D stereo screen; Described processing module also is used for detecting according to described change in location whether needs are proofreaied and correct the 3 D stereo screen, if, then according to the described 3 D stereo screen of described change in location correction; Described processing module also is used for generating instruction according to the position of mark.
Preferably, described processing module also is used for setting up three-dimensional system of coordinate O-xyz, the described 3 D stereo screen of initialization is the rectangular parallelepiped zone in the described three-dimensional system of coordinate, and three ribs that intersect in described rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.
Preferably, described change in location is that mark changes to the second place from primary importance; Whether described processing module also moves to the second place for detection of described mark from primary importance larger than the shift length on the x of described three-dimensional system of coordinate axle and y axle at the shift length on the z of the described three-dimensional system of coordinate axle, if then judging needs to proofread and correct described 3 D stereo screen.
Preferably, described processing module also is used for obtaining described x axle and the displacement on the y axle that is marked at described three-dimensional system of coordinate, according to the described 3 D stereo screen of described displacement translation when needs are proofreaied and correct described 3 D stereo screen.
Preferably, described processing module also is used for obtaining the described position that is marked at the 3 D stereo screen after the correction, and described position is converted to screen coordinate in the display screen and the generation instruction relevant with described screen coordinate.
Preferably, described processing module is used for when described position is converted to the screen coordinate of display screen, calculates the screen coordinate that is marked at the correspondence position in the display screen according to the component of position on x axle and y axle that is marked in the 3 D stereo screen.
Preferably, described processing module also marks whether to be positioned at outside the described 3 D stereo screen for detection of described, if the zone that arranges when described 3 D stereo screen is initialization 3 D stereo screen then is set.
Above-mentioned virtual screen implementation method and system, by initialization 3 D stereo screen, and according to the change in location that is marked in the 3 D stereo screen, judge whether to need to proofread and correct the 3 D stereo screen, if then proofread and correct the 3 D stereo screen, and generate instruction according to the position of mark.Aforesaid way can according to be marked in the 3 D stereo screen the change in location judge mark whether the generation in the space unnecessary shake, if, illustrating needs to proofread and correct the 3 D stereo screen, then further proofread and correct the unnecessary shake that the 3 D stereo screen produces to eliminate mark, thereby aforesaid way can identify user's behavior more accurately, and the operation of avoiding hand to tremble causing is inaccurate.
[description of drawings]
Fig. 1 is the schematic flow sheet of the virtual screen implementation method among the embodiment;
Fig. 2 is the schematic diagram of a 3 D stereo screen among the embodiment;
Fig. 3 is the structural representation that the virtual screen among the embodiment is realized system.
[embodiment]
As shown in Figure 1, in one embodiment, a kind of virtual screen implementation method may further comprise the steps:
Step S10, initialization 3 D stereo screen.
Concrete, in one embodiment, can set up three-dimensional system of coordinate O-xyz, initialization 3 D stereo screen is the rectangular parallelepiped zone in the three-dimensional system of coordinate, three ribs that intersect in rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.
As shown in Figure 2, in one embodiment, center that can display screen is initial point O, take through initial point O, display screen planar and direction as the straight line of horizontal direction as the x axle, take through initial point O and direction as the straight line of vertical direction as the y axle, take through initial point O and perpendicular to the straight line on xOy plane as the z axle, set up three-dimensional system of coordinate O-xyz.Further, it is the 3 D stereo screen that block length side's body region can be set in the place ahead of display screen, so that three ribs that intersect in rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.For example, but initialization 3 D stereo screen is the rectangular parallelepiped zone: and (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10}.In one embodiment, can input initialization 3 D stereo screen according to the user, the user can input according to self extending range, eyesight situation, motor habit etc. the position of the high and 3 D stereo screen of the length and width of 3 D stereo screen, so that the user is more convenient to operate.
In another embodiment, the 3 D stereo screen of other shape of initialization according to actual needs.Concrete, but initialization 3 D stereo screen is a cylinder, and the forward and backward surface of cylinder is parallel to the xOy plane, and the line of forward and backward centre of surface is perpendicular to forward and backward surface, the shape size on forward and backward surface is identical, and the shape on forward and backward surface is identical with the shape of display screen.The shape on the forward and backward surface of 3 D stereo screen can be set according to the shape of display screen, for example circle, ellipse, hexagon etc.
Three-dimensional system of coordinate O-xyz and 3 D stereo screen are set in the above described manner, then be marked at the coordinate (x on xOy plane, y) corresponding to the screen coordinate of icon in display screen of mark, namely, can calculate according to the coordinate (x, y) that is marked at the xOy plane screen coordinate of icon in display screen of mark.
Step S20, the image sequence of collection mark.
In one embodiment, mark can be the object of designated color and/or shape.In one embodiment, mark can be the reflectorized material of designated color and/or shape.Preferably, be labeled as circular reverse light-source.In other embodiments, mark can also be certain position of human body, such as being finger of people etc.The user can control to be marked in the space and move, the action of the real touch-screen of simulated touch.
Preferably, can adopt three-dimensional image acquisition apparatus to gather the image of mark, for example adopt stereo visual system (being formed by two known video camera and Correlation method for data processing equipment in locus), structured-light system (a right video camera, light source and Correlation method for data processing equipment form) or TOF (time of fight, flight time) depth camera etc., gather the three dimensional depth image (being 3-D view) of mark, do not repeat them here.
In one embodiment, can every interval the image of a default mark of duration collection, obtain the image sequence of mark.
Step S30, the change in location of identification marking in the 3 D stereo screen.
Concrete, but be marked at coordinate in the three-dimensional system of coordinate in the recognition image, judge mark whether in the 3 D stereo screen, further relatively the mark in the current frame image with respect to the change in location of the mark in front default frame (such as, the former frame) image.
In one embodiment, can adopt traditional image processing method to extract the zone of mark in the image, and obtain the coordinate that the coordinate of center of gravity in above-mentioned three-dimensional system of coordinate of mark serves as a mark, not repeat them here.
Whether step S40 detects needs according to above-mentioned change in location and proofreaies and correct the 3 D stereo screen, if, then execution in step S50 and step S60, if not, execution in step S60 then.
Because the user is (rather than on surface) operational label motion in the space, therefore the action of the real touch-screen of simulated touch, is marked with and may produces unnecessary shake, this shake might trigger the event outside user's expectation, perhaps affects user's operation.Take above-mentioned three-dimensional system of coordinate O-xyz as example, if the user is in the face of display screen, control mark mobile forward, namely controlling mark moves near display screen, when pinning the action of display screen with simulation, the user at first can navigate to mark the position that it need to be pressed, and then mark is mobile forward, wish control corresponding to " pinning " this position, but because user's hand might be shaken up and down, then mark not only there is displacement at the z direction of principal axis, it might also have displacement on the xOy plane, the phenomenon that " by incessantly " or " some miss " if generate the instruction of pinning display screen according to the position of mark, then may occur at this moment.Because, being marked at mobile front and back, variation has occured in its x coordinate and y coordinate, no longer is that the user has wished the position of " pinning ".
Same, when controlling mark, the user moves backward, namely controlling mark moves away from display screen, when leaving the action of display screen with simulation, because user's hand might be shaken up and down, then be marked at mobile front and back, not only at the z direction of principal axis displacement is arranged, it also may have displacement on the xOy plane, if the instruction of unclamping display screen according to the position generation of mark this moment, the then instruction of possibility generation error.
Concrete, in one embodiment, above-mentioned change in location is that mark changes to the second place from primary importance, whether detectable label moves to the second place from primary importance larger than the shift length on x axle and y axle at the shift length on the z of the above-mentioned three-dimensional system of coordinate axle, if then judging needs to proofread and correct the 3 D stereo screen.
The shift length that compares on x axle and y axle when the shift length that is marked on the z axle is large, illustrate that mark moves or moves away from display screen near display screen, the action of pinning display screen or unclamping display screen with simulation, if be marked at the x axle or/and displacement is also arranged on the y axle, then be marked at the x axle or/and on the y direction of principal axis shake has occured, at this moment, needs correction 3 D stereo screen is described, the impact that causes to eliminate mark jitter.Step S50 is according to above-mentioned change in location correction 3 D stereo screen.
Concrete, in one embodiment, can obtain mark and move to the second place in the x of above-mentioned three-dimensional system of coordinate axle and the displacement on the y axle from primary importance, according to above-mentioned x axle and the displacement translation 3 D stereo screen on the y axle of being marked at.
With the three-dimensional system of coordinate O-xyz among Fig. 2 and 3 D stereo screen { (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10} is example, establishes to be marked in the three-dimensional system of coordinate from (20,20,-139) move to (21,22 ,-132), then be marked at the x axle, the y axle, shift length on the z axle is respectively 1,2,7, the shift length that is marked on the z axle is larger than the shift length on x axle and y axle, and then this moment need to be according to being marked at x axle and the displacement translation 3 D stereo screen on the y axle, and the 3 D stereo screen after the correction is { (x, y, z) |-39≤x≤41 ,-29≤y≤31 ,-140≤z≤-10}.
After proofreading and correct the 3 D stereo screen, be marked at mobile front and back, its position component on x axle and y axle with respect to the 3 D stereo screen does not change.
In one embodiment, mark can be described to the vector of mark with the preset in the 3 D stereo screen with respect to the position of 3 D stereo screen, is designated as (Δ x, Δ y, Δ z).For example, can represent with the central point of the 3 D stereo screen vector to mark, or represent with certain summit of 3 D stereo screen vector to mark.With the 3 D stereo screen among Fig. 2 (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10} is example, can be with the summit A (40 ,-30 ,-140) of the 3 D stereo screen vector to mark M
Come expressive notation with respect to the position of this screen, wherein
In above-mentioned example, mark M moves to (21,22 ,-132) from (20,20 ,-139).The mobile front position of mark (20,20 ,-139) is with respect to the position of three-dimensional stereoscopic screen before proofreading and correct
After mark M moves, according to the displacement 1 and the displacement on the y axle 2 that are marked on the x axle, the 3 D stereo screen is carried out translation, by (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10} becomes { (x, y, z) |-39≤x≤41,-28≤y≤32 ,-140≤z≤-10}, so the position (21 of mark after moving, 22 ,-132) with respect to the position of the 3 D stereo screen after proofreading and correct
Namely (Δ x, Δ y) do not change.Proofread and correct the 3 D stereo screen and eliminated the impact that mark is shaken generation up and down.
Step S60 is according to the position generation instruction of mark.
Concrete, in one embodiment, can obtain the position that is marked in the 3 D stereo screen, this position is converted to screen coordinate in the display screen and the generation instruction relevant with screen coordinate.If the 3 D stereo screen is proofreaied and correct, then obtain the position in the 3 D stereo screen that is marked at after the correction.
Concrete, the position that is marked in the 3 D stereo screen can be with the position of above-mentioned mark with respect to three-dimensional screen
Represent.
In one embodiment, with the detailed process that is marked at position in the 3 D stereo screen and is converted to the step of the screen coordinate in the display screen be: calculate the screen coordinate that is marked at the correspondence position in the display screen according to the component of position on x axle and y axle that is marked in the 3 D stereo screen.Concrete, can be according to position (the Δ x of mark with respect to the 3 D stereo screen, Δ y, Δ z) be parallel to the size of the face on xOy plane in the component on x axle and y axle (being Δ x, Δ y), the 3 D stereo screen, the resolution sizes of display screen is calculated the screen coordinate that is marked at the correspondence position in the display screen.
Three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen are as example, and the size of easily knowing the face ABCD that is parallel to the xOy plane in the 3 D stereo screen is 80 * 60.The bidding note is (Δ x with respect to the position of 3 D stereo screen, Δ y, Δ z)=(60,10,2), (Δ x then, the resolution of Δ y)=(60,10), establishing display screen is 800 * 600, then easily calculate the screen coordinate that is marked in the display screen according to the ratio of the size of ABCD and display screen resolution size and be (600,100).
Further, move to the second place when detecting mark from primary importance, the shift length of Length Ratio on x axle and y axle that is marked at z axle top offset is large, and the distance that is marked at primary importance and display screen is than when the distance of the second place and display screen is large, can be according to the screen coordinate that is marked in the display screen, the instruction at this screen coordinate place in this display screen is pressed in generation, and the event of further being correlated with according to the instruction triggers of pressing display screen.If it is large to detect the shift length of Length Ratio on x axle and y axle that is marked at z axle top offset, and the distance that is marked at primary importance and display screen is than the distance that is marked at the second place and display screen hour, can be according to the screen coordinate that is marked in the display screen, the instruction of this screen coordinate position in the display screen is unclamped in generation, and further according to the instruction triggers dependent event of unclamping display screen.
In the present embodiment, when judge mark moves to the second place from primary importance at the shift length on the z axle whether greater than the shift length on x axle and y axle, if, explanation is when display screen is pinned in simulation or unclamp the action of display screen, mark has not only produced displacement at the z axle, may be because the shake of user's hand, be marked on x axle or the y axle and also produced displacement, at this moment, according to the displacement translation 3 D stereo screen that is marked on x axle and the y axle, to eliminate because mark jitter and in the displacement that x axle and y axle produce, further generate corresponding instruction according to the position that is marked in the 3 D stereo screen.Aforesaid way can be identified user's operation behavior more exactly, and the operation of avoiding hand to tremble causing is inaccurate.
In another embodiment, step S40 can judge whether needs correction 3 D stereo screen according to the correcting condition that sets in advance.Concrete, can set in advance the condition that needs to proofread and correct the 3 D stereo screen is the specific change in location of mark, for example, the condition of proofreading and correct the 3 D stereo screen is set is: mark moves or mark moves in a circle etc. along preset direction.But whether step S40 judge mark moves along preset direction, or marks whether to move in a circle, if then being judged to be needs to proofread and correct the 3 D stereo screen.
In the present embodiment, step S50 can proofread and correct the 3 D stereo screen according to bearing calibration corresponding to the correcting condition that sets in advance.Concrete, for example, can arrange when the mark along continuous straight runs when moving greater than pre-set velocity, the displacement translation 3 D stereo screen that moves according to mark; When mark when up moving greater than pre-set velocity, amplify the 3 D stereo screen according to the shift length of mark; When mark when moving down greater than pre-set velocity, dwindle the 3 D stereo screen according to the shift length of mark; When mark moves in a circle, the 3 D stereo screen is returned to the prime area, etc.
In the present embodiment, according to pre-conditioned correction 3 D stereo screen, the user can adjust position and the size of 3 D stereo screen as required, thereby can user friendlyly operate.
In one embodiment, above-mentioned virtual screen implementation method also comprises step:
Whether certification mark is positioned at outside the 3 D stereo screen, if, the zone that arranges when the 3 D stereo screen then being set being initialization 3 D stereo screen.
In the above-mentioned example, the prime area of the 3 D stereo screen that arranges during initialization 3 D stereo screen is { (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10}, when detecting mark and be positioned at outside the 3 D stereo screen, it is above-mentioned prime area that the 3 D stereo screen can be set.
In the present embodiment, the zone that the 3 D stereo screen arranges when being set to initialization 3 D stereo screen can be avoided the 3 D stereo screen through increasing with the skew of the 3 D stereo screen of original initialization after repeatedly proofreading and correct, and cause the user to control inconvenience.
In one embodiment, above-mentioned virtual screen implementation method also comprises:
According to the position of mark with respect to the 3 D stereo screen, obtain the pixel coordinate of the correspondence of this position in display screen, at the icon of this pixel coordinate place show tags of display screen.
Concrete, can be according to position (the Δ x of mark with respect to the 3 D stereo screen, Δ y, Δ z) be parallel to the size of the face on xOy plane in the component on x axle and y axle (being Δ x, Δ y), the 3 D stereo screen, the resolution sizes of display screen is calculated the pixel coordinate that is marked in the display screen.Three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen are as example, and the size of easily knowing the face ABCD that is parallel to the xOy plane in the 3 D stereo screen is 80 * 60.The bidding note is (60 with respect to the position of 3 D stereo screen, 10,2), then mark is (60 with respect to the component of position on the xOy plane of 3 D stereo screen, 10), if the resolution of display screen is 800 * 600, then easily calculates the pixel coordinate that is marked in the display screen and be (600,100).
In one embodiment, when through mark and perpendicular to the straight line on xOy plane during without the 3 D stereo screen, the icon of show tags in display screen not.For example, for above-mentioned 3 D stereo screen (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10}, when mark not at { (x, y) |-40≤x≤40, in the time of in-30≤y≤30} scope, the icon of show tags in display screen not.
In the present embodiment, according to the position of mark with respect to the 3 D stereo screen, icon at the corresponding position of display screen show tags, specifically labelled position in the time of can making things convenient for the user to control mark, improved user's operation ease, and simulate the same effect of touch entity touch-screen, improved user's experience.
In one embodiment, above-mentioned virtual screen implementation method also comprises: the distance of show tags and 3 D stereo screen and mark enter the information of the depth of 3 D stereo screen in display screen.
Concrete, the depth that can enter the 3 D stereo screen according to the distance between mark and the 3 D stereo screen or mark, change shape, size or the pattern of the icon of mark in the display screen, the depth that enters the 3 D stereo screen with distance or the mark of prompting user mark and 3 D stereo screen.
In the present embodiment, the distance of show tags and 3 D stereo screen and mark enter the information of the depth of 3 D stereo screen in display screen, can make the distance of user's perceptible markings and 3 D stereo screen and the depth that mark enters the 3 D stereo screen, thereby make things convenient for the user to control mark, and increased user's experience.
It should be noted that in one embodiment, carry out once when step S10 can start in system, until system closing does not need to carry out again.System's run duration can preset duration execution in step S20 in every interval, and in order execution in step S30～S60 of duration is preset at every interval.In one embodiment, step S20 and step S30～S60 can carry out parallel processing.
As shown in Figure 3, in one embodiment, a kind of virtual screen is realized system, comprises processing module 10, image capture module 20, identification module 30, wherein:
Concrete, in one embodiment, processing module 10 can be set up three-dimensional system of coordinate O-xyz, and initialization 3 D stereo screen is the rectangular parallelepiped zone in the three-dimensional system of coordinate, makes three ribs that intersect in rectangular parallelepiped zone parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.。
As shown in Figure 2, in one embodiment, processing module 10 can display screen the center be initial point O, take through initial point O, display screen planar and direction as the straight line of horizontal direction as the x axle, take through initial point O and direction as the straight line of vertical direction as the y axle, to set up three-dimensional system of coordinate O-xyz through initial point O and perpendicular to the straight line on xOy plane as the z axle, in the place ahead of display screen one block length side's body region being set is the 3 D stereo screen, so that three ribs that intersect in rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.For example, but initialization 3 D stereo screen is the rectangular parallelepiped zone: and (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10}.
In one embodiment, processing module 10 can input initialization 3 D stereo screen according to the user, the user can input according to self extending range, eyesight situation, motor habit etc. the position of the high and 3 D stereo screen of the length and width of 3 D stereo screen, so that the user is more convenient to operate.
In another embodiment, the processing module 10 3 D stereo screen of other shape of initialization according to actual needs.Concrete, but processing module 10 initialization 3 D stereo screens are a cylinder, the forward and backward surface of cylinder is parallel to the xOy plane, the line of forward and backward centre of surface is perpendicular to forward and backward surface, the shape size on forward and backward surface is identical, and the shape on forward and backward surface is identical with the shape of display screen.The shape on the forward and backward surface of 3 D stereo screen can be set according to the shape of display screen, for example circle, ellipse, hexagon etc.
Three-dimensional system of coordinate O-xyz and 3 D stereo screen are set in the above described manner, then be marked at the coordinate (x on xOy plane, y) corresponding to the screen coordinate of icon in display screen of mark, namely, can calculate according to the coordinate (x, y) that is marked at the xOy plane screen coordinate of icon in display screen of mark.
In one embodiment, mark can be the object of designated color and/or shape.In one embodiment, mark can be the reflectorized material of designated color and/or shape.Preferably, be labeled as circular reverse light-source.In other embodiments, mark can also be certain position of human body, such as being finger of people etc.The user can control to be marked in the space and move, the action of the real touch-screen of simulated touch.
Preferably, image capture module 20 can adopt three-dimensional image acquisition apparatus to gather the image of mark, for example adopt stereo visual system (being formed by two known video camera and Correlation method for data processing equipment in locus), structured-light system (a right video camera, light source and Correlation method for data processing equipment form) or TOF (timeof flight, flight time) depth camera etc., gather the three dimensional depth image (being 3-D view) of mark, do not repeat them here.
In one embodiment, image capture module 20 can every interval the image of a default mark of duration collection, obtain the image sequence of mark.
Concrete, but be marked at coordinate in the three-dimensional system of coordinate in identification module 30 recognition images, judge mark whether in the 3 D stereo screen, further relatively the mark in the current frame image with respect to the change in location of the mark in front default frame (such as, the former frame) image.
In one embodiment, identification module 30 can adopt traditional image processing method to extract the zone of mark in the image, and obtains the coordinate that the coordinate of center of gravity in above-mentioned three-dimensional system of coordinate of mark serves as a mark, and does not repeat them here.
Because the user is (rather than on surface) operational label motion in the space, therefore the action of the real touch-screen of simulated touch, is marked with and may produces unnecessary shake, this shake might trigger the event outside user's expectation, perhaps affects user's operation.Take above-mentioned three-dimensional system of coordinate O-xyz as example, if the user is in the face of display screen, control mark mobile forward, namely controlling mark moves near display screen, when pinning the action of display screen with simulation, the user at first can navigate to mark the position that it need to be pressed, and then mark is mobile forward, wish control corresponding to " pinning " this position, but because user's hand might be shaken up and down, then mark not only there is displacement at the z direction of principal axis, it might also have displacement on the xOy plane, the phenomenon that " by incessantly " or " some miss " if generate the instruction of pinning display screen according to the position of mark, then may occur at this moment.Because, being marked at mobile front and back, variation has occured in its x coordinate and y coordinate, no longer is that the user has wished the position of " pinning ".
Same, when controlling mark, the user moves backward, namely controlling mark moves away from display screen, when leaving the action of display screen with simulation, because user's hand might be shaken up and down, then be marked at mobile front and back, not only at the z direction of principal axis displacement is arranged, it also may have displacement on the xOy plane, if the instruction of unclamping display screen according to the position generation of mark this moment, the then instruction of possibility generation error.
Concrete, in one embodiment, above-mentioned change in location is that mark changes to the second place from primary importance, whether processing module 10 detectable labels move to the second place from primary importance larger than the shift length on x axle and y axle at the shift length on the z of the above-mentioned three-dimensional system of coordinate axle, if then judging needs to proofread and correct the 3 D stereo screen.
The shift length that compares on x axle and y axle when the shift length that is marked on the z axle is large, illustrate that mark moves or moves away from display screen near display screen, the action of pinning display screen or unclamping display screen with simulation, if be marked at the x axle or/and displacement is also arranged on the y axle, then be marked at the x axle or/and on the y direction of principal axis shake has occured, at this moment, needs correction 3 D stereo screen is described, the impact that causes to eliminate mark jitter.
Further, in one embodiment, processing module 10 also is used for when needs are proofreaied and correct the 3 D stereo screen, obtain mark and move to the second place in the x of above-mentioned three-dimensional system of coordinate axle and the displacement on the y axle from primary importance, according to above-mentioned x axle and the displacement translation 3 D stereo screen on the y axle of being marked at.
With the three-dimensional system of coordinate O-xyz among Fig. 2 and 3 D stereo screen { (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10} is example, establishes to be marked in the three-dimensional system of coordinate from (20,20,-139) move to (21,22 ,-132), then be marked at the x axle, the y axle, shift length on the x axle is respectively 1,2,7, the shift length that is marked on the z axle is larger than the shift length on x axle and y axle, and then this moment need to be according to being marked at x axle and the displacement translation 3 D stereo screen on the y axle, and the 3 D stereo screen after the correction is { (x, y, z) |-39≤x≤41 ,-29≤y≤31 ,-140≤z≤-10}.
After proofreading and correct the 3 D stereo screen, be marked at mobile front and back, its position component on x axle and y axle with respect to the 3 D stereo screen does not change.
In one embodiment, mark can be described to the vector of mark with the preset in the 3 D stereo screen with respect to the position of 3 D stereo screen, is designated as (Δ x, Δ y, Δ z).For example, can represent with the central point of the 3 D stereo screen vector to mark, or represent with certain summit of 3 D stereo screen vector to mark.With the 3 D stereo screen among Fig. 2 (x, y, z) |-40≤x≤40 ,-30≤y≤30 ,-140≤z≤-10} is example, can be with the summit A (40 ,-30 ,-140) of the 3 D stereo screen vector to mark M
Come expressive notation with respect to the position of this screen, wherein
In above-mentioned example, mark M moves to (21,22 ,-132) from (20,20 ,-139).The mobile front position of mark (20,20 ,-139) is with respect to the position of three-dimensional stereoscopic screen before proofreading and correct
After mark M moves, according to the displacement 1 and the displacement on the y axle 2 that are marked on the x axle, the 3 D stereo screen is carried out translation, by (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10} becomes { (x, y, z) |-39≤x≤41,-28≤y≤32 ,-140≤z≤-10}, so the position (21 of mark after moving, 22 ,-132) with respect to the position of the 3 D stereo screen after proofreading and correct
Namely (Δ x, Δ y) do not change.Proofread and correct the 3 D stereo screen and eliminated the impact that mark is shaken generation up and down.
Further, processing module 10 also is used for generating instruction according to the position of mark
Concrete, in one embodiment, processing module 10 can be used for obtaining the position that is marked in the 3 D stereo screen, and this position is converted to screen coordinate in the display screen and the generation instruction relevant with screen coordinate.
Concrete, if processing module 10 has been proofreaied and correct the 3 D stereo screen, then obtain the position in the 3 D stereo screen that is marked at after the correction.
Concrete, be marked at position in the 3 D stereo screen and can use in the example mark with respect to the position of three-dimensional screen
Represent.
In one embodiment, processing module 10 can be calculated the screen coordinate that is marked at the correspondence position in the display screen according to the component of position on x axle and y axle that is marked in the 3 D stereo screen.Concrete, processing module 10 can be according to position (the Δ x of mark with respect to the 3 D stereo screen, Δ y, Δ z) be parallel to the size of the face on xOy plane in the component on x axle and y axle (being Δ x, Δ y), the 3 D stereo screen, the resolution sizes of display screen is calculated the screen coordinate that is marked at the correspondence position in the display screen.
Three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen are as example, and the size of easily knowing the face ABCD that is parallel to the xOy plane in the 3 D stereo screen is 80 * 60.The bidding note is (Δ x with respect to the position of 3 D stereo screen, Δ y, Δ z)=(60,10,2), (Δ x then, the resolution of Δ y)=(60,10), establishing display screen is 800 * 600, then easily calculate the screen coordinate that is marked in the display screen according to the ratio of the size of ABCD and display screen resolution size and be (600,100).
Further, move to the second place when detecting mark from primary importance, the shift length of Length Ratio on x axle and y axle that is marked at z axle top offset is large, and the distance that is marked at primary importance and display screen is than when the distance of the second place and display screen is large, processing module 10 can be according to the screen coordinate that is marked in the display screen, the instruction at this screen coordinate place in this display screen is pressed in generation, and the event of further being correlated with according to the instruction triggers of pressing display screen.If it is large to detect the shift length of Length Ratio on x axle and y axle that is marked at z axle top offset, and the distance that is marked at primary importance and display screen is than the distance that is marked at the second place and display screen hour, processing module 10 can be according to the screen coordinate that is marked in the display screen, the instruction of this screen coordinate position in the display screen is unclamped in generation, and further according to the instruction triggers dependent event of unclamping display screen.
In the present embodiment, when judge mark moves to the second place from primary importance at the shift length on the z axle whether greater than the shift length on x axle and y axle, if, explanation is when display screen is pinned in simulation or unclamp the action of display screen, mark has not only produced displacement at the z axle, may be because the shake of user's hand, be marked on x axle or the y axle and also produced displacement, at this moment, according to the displacement translation 3 D stereo screen that is marked on x axle and the y axle, to eliminate because mark jitter and in the displacement that x axle and y axle produce, further generate corresponding instruction according to the position that is marked in the 3 D stereo screen.Aforesaid way can be identified user's operation behavior more exactly, and the operation of avoiding hand to tremble causing is inaccurate.
In another embodiment, processing module 10 also can be used for judging whether needs correction 3 D stereo screen according to the correcting condition that sets in advance.Concrete, can set in advance the condition that needs to proofread and correct the 3 D stereo screen is the specific change in location of mark, for example, the condition of proofreading and correct the 3 D stereo screen is set is: mark moves or mark moves in a circle etc. along preset direction.But whether processing module 10 judge marks move along preset direction, or mark whether to move in a circle, if then being judged to be needs to proofread and correct the 3 D stereo screen.
In the present embodiment, processing module 10 also can be used for the bearing calibration correction 3 D stereo screen corresponding according to the correcting condition that sets in advance.Concrete, for example, can arrange when the mark along continuous straight runs when moving greater than pre-set velocity, the displacement translation 3 D stereo screen that moves according to mark; When mark when up moving greater than pre-set velocity, amplify the 3 D stereo screen according to the shift length of mark; When mark when moving down greater than pre-set velocity, dwindle the 3 D stereo screen according to the shift length of mark; When mark moves in a circle, the 3 D stereo screen is returned to the prime area, etc.
In the present embodiment, according to pre-conditioned correction 3 D stereo screen, the user can adjust position and the size of 3 D stereo screen as required, thereby can user friendlyly operate.
In one embodiment, above-mentioned virtual screen realizes that the processing module 10 of system also is positioned at outside the 3 D stereo screen for detection of marking whether, if, the zone that arranges when the 3 D stereo screen then being set being initialization 3 D stereo screen.
In the above-mentioned example, the prime area of the 3 D stereo screen that arranges during initialization 3 D stereo screen is { (x, y, z) |-40≤x≤40,-30≤y≤30,-140≤z≤-10}, processing module 10 also is used for when detecting mark and be positioned at outside the 3 D stereo screen, and it is above-mentioned prime area that the 3 D stereo screen is set.
In the present embodiment, the zone that the 3 D stereo screen arranges when being set to initialization 3 D stereo screen can be avoided the 3 D stereo screen through increasing with the skew of the 3 D stereo screen of original initialization after repeatedly proofreading and correct, and cause the user to control inconvenience.
In one embodiment, processing module 10 also is used for according to the position of mark with respect to the 3 D stereo screen, obtains the pixel coordinate of the correspondence of this position in display screen.In the present embodiment, above-mentioned virtual screen realizes that system also comprises the display module (not shown), is used for the icon at this pixel coordinate place show tags of display screen.
Specifically, processing module 10 can be according to position (the Δ x of mark with respect to the 3 D stereo screen, Δ y, Δ z) be parallel to the size of the face on xOy plane in the component on x axle and y axle (being Δ x, Δ y), the 3 D stereo screen, the resolution sizes of display screen is calculated the pixel coordinate that is marked in the display screen.Three-dimensional system of coordinate in Fig. 2 and 3 D stereo screen are as example, and the size of easily knowing the face ABCD that is parallel to the xOy plane in the 3 D stereo screen is 80 * 60.The bidding note is (60 with respect to the position of 3 D stereo screen, 10,2), then mark is (60 with respect to the component of position on the xOy plane of 3 D stereo screen, 10), if the resolution of display screen is 800 * 600, then easily calculates the pixel coordinate that is marked in the display screen and be (600,100).
In one embodiment, when through mark and perpendicular to the straight line on xOy plane during without the 3 D stereo screen, the icon of show tags in display screen not.For example, for above-mentioned 3 D stereo screen (x, y, z) |-40≤x≤40,-30≤y≤30 ,-140≤z≤-10}, when mark not at { (x, y) |-40≤x≤40, in the time of in-30≤y≤30} scope, the icon of show tags in display screen not.
In the present embodiment, according to the position of mark with respect to the 3 D stereo screen, icon at the corresponding position of display screen show tags, specifically labelled position in the time of can making things convenient for the user to control mark, improved user's operation ease, and simulate the same effect of touch entity touch-screen, improved user's experience.
In one embodiment, display module also is used for the information that distance and mark at display screen show tags and 3 D stereo screen enter the depth of 3 D stereo screen.
Concrete, the depth that display module can enter the 3 D stereo screen according to the distance between mark and the 3 D stereo screen or mark, change shape, size or the pattern of the icon of mark in the display screen, the depth that enters the 3 D stereo screen with distance or the mark of prompting user mark and 3 D stereo screen.
In the present embodiment, the distance of show tags and 3 D stereo screen and mark enter the information of the depth of 3 D stereo screen in display screen, can make the distance of user's perceptible markings and 3 D stereo screen and the depth that mark enters the 3 D stereo screen, thereby make things convenient for the user to control mark, and increased user's experience.
Above-mentioned virtual screen implementation method and system provide a kind of touch-screen simulated operation pattern, in can be in face of it the virtual 3 D stereo screen of user, control the action that mark moves simulated touch entity touch-screen, can produce the effect identical with touching the entity touch-screen, and the user also can carry out remote control to controlled device by controlling mark, therefore, aforesaid way has improved user's operation ease, has increased user's experience.In addition, aforesaid way can make user's operation no longer be confined to the touch-screen of entity, but can more freely stretch more flexibly in the space and move, thereby aforesaid way is so that more hommization of user's operation has improved the convenience of user's operation.
Moreover, above-mentioned virtual screen implementation method and system also according to the change in location that is marked in the 3 D stereo screen, judge whether to need to proofread and correct the 3 D stereo screen, if then proofread and correct the 3 D stereo screen, and generate instruction according to the position of mark.Aforesaid way can according to be marked in the 3 D stereo screen the change in location judge mark whether the generation in the space unnecessary shake, if, illustrating needs to proofread and correct the 3 D stereo screen, then further proofread and correct the unnecessary shake that the 3 D stereo screen produces to eliminate mark, thereby aforesaid way can identify user's behavior more accurately, and the operation of avoiding hand to tremble causing is inaccurate.
The above embodiment has only expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.
Claims (14)
1. virtual screen implementation method may further comprise the steps:
Initialization 3 D stereo screen;
Gather the image sequence of mark;
The change in location of identification marking in described 3 D stereo screen;
Detect according to described change in location whether needs are proofreaied and correct the 3 D stereo screen, if, then according to the described 3 D stereo screen of described change in location correction;
Position according to mark generates instruction.
2. virtual screen implementation method according to claim 1, it is characterized in that, the step of described initialization 3 D stereo screen comprises: set up three-dimensional system of coordinate O-xyz, the described 3 D stereo screen of initialization is the rectangular parallelepiped zone in the described three-dimensional system of coordinate, and three ribs that intersect in described rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.
3. virtual screen implementation method according to claim 2 is characterized in that, described change in location is that mark changes to the second place from primary importance; Describedly detect needs whether according to described change in location and proofread and correct the step of 3 D stereo screen and comprise:
Whether detecting described mark, to move to the second place from primary importance larger than the shift length on the x of described three-dimensional system of coordinate axle and y axle at the shift length on the z of the described three-dimensional system of coordinate axle, if then judging needs to proofread and correct described 3 D stereo screen.
4. virtual screen implementation method according to claim 3 is characterized in that, described step according to the described 3 D stereo screen of change in location correction comprises:
Obtain described x axle and the displacement on the y axle that is marked at described three-dimensional system of coordinate, according to the described 3 D stereo screen of described displacement translation.
5. virtual screen implementation method according to claim 4, it is characterized in that, the step that described position according to mark generates instruction comprises: obtain the described position that is marked in the 3 D stereo screen, described position is converted to screen coordinate in the display screen and the generation instruction relevant with described screen coordinate.
6. virtual screen implementation method according to claim 4 is characterized in that, the described step that described position is converted to the screen coordinate in the display screen comprises:
Calculate the screen coordinate that is marked at the correspondence position in the display screen according to the component of position on x axle and y axle that is marked in the 3 D stereo screen.
7. according to claim 1 to the described virtual screen implementation method of 6 any one, it is characterized in that, described method also comprises: detect and describedly mark whether to be positioned at outside the described 3 D stereo screen, if the zone that arranges when described 3 D stereo screen is initialization 3 D stereo screen then is set.
8. a virtual screen is realized system, it is characterized in that, comprising:
Processing module is used for initialization 3 D stereo screen;
Image capture module is for the image sequence that gathers mark;
Identification module, the change in location of identification marking in described 3 D stereo screen;
Described processing module also is used for detecting according to described change in location whether needs are proofreaied and correct the 3 D stereo screen, if, then according to the described 3 D stereo screen of described change in location correction;
Described processing module also is used for generating instruction according to the position of mark.
9. virtual screen according to claim 8 is realized system, it is characterized in that, described processing module also is used for setting up three-dimensional system of coordinate O-xyz, the described 3 D stereo screen of initialization is the rectangular parallelepiped zone in the described three-dimensional system of coordinate, and three ribs that intersect in described rectangular parallelepiped zone are parallel with x axle, y axle, the z axle of described three-dimensional system of coordinate respectively.
10. virtual screen according to claim 9 is realized system, it is characterized in that, described change in location is that mark changes to the second place from primary importance;
Whether described processing module also moves to the second place for detection of described mark from primary importance larger than the shift length on the x of described three-dimensional system of coordinate axle and y axle at the shift length on the z of the described three-dimensional system of coordinate axle, if then judging needs to proofread and correct described 3 D stereo screen.
11. virtual screen according to claim 10 is realized system, it is characterized in that, described processing module also is used for obtaining described x axle and the displacement on the y axle that is marked at described three-dimensional system of coordinate, according to the described 3 D stereo screen of described displacement translation when needs are proofreaied and correct described 3 D stereo screen.
12. virtual screen according to claim 11 is realized system, it is characterized in that, described processing module also is used for obtaining the described position that is marked at the 3 D stereo screen, and described position is converted to screen coordinate in the display screen and the generation instruction relevant with described screen coordinate.
13. virtual screen according to claim 12 is realized system, it is characterized in that, described processing module is used for when described position is converted to the screen coordinate of display screen, calculates the screen coordinate that is marked at the correspondence position in the display screen according to the component of position on x axle and y axle that is marked in the 3 D stereo screen.
14. realize system to the described virtual screen of 13 any one according to claim 8, it is characterized in that, described processing module also marks whether to be positioned at outside the described 3 D stereo screen for detection of described, if the zone that arranges when described 3 D stereo screen is initialization 3 D stereo screen then is set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210079257.1A CN103324327B (en) | 2012-03-22 | 2012-03-22 | Virtual screen implementation method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210079257.1A CN103324327B (en) | 2012-03-22 | 2012-03-22 | Virtual screen implementation method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103324327A true CN103324327A (en) | 2013-09-25 |
| CN103324327B CN103324327B (en) | 2016-04-06 |
Family
ID=49193124
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210079257.1A Active CN103324327B (en) | 2012-03-22 | 2012-03-22 | Virtual screen implementation method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103324327B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105912101A (en) * | 2016-03-31 | 2016-08-31 | 联想(北京)有限公司 | Projection control method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0913790A1 (en) * | 1997-10-29 | 1999-05-06 | Takenaka Corporation | Hand pointing apparatus |
| CN101518096A (en) * | 2006-09-20 | 2009-08-26 | 苹果公司 | Three-dimensional display system |
| CN101625844A (en) * | 2008-07-07 | 2010-01-13 | 华晶科技股份有限公司 | System and method for preventing screen of image display device from vibrating |
| CN102004623A (en) * | 2010-11-29 | 2011-04-06 | 深圳市九洲电器有限公司 | Three-dimensional image display device and method |
-
2012
- 2012-03-22 CN CN201210079257.1A patent/CN103324327B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0913790A1 (en) * | 1997-10-29 | 1999-05-06 | Takenaka Corporation | Hand pointing apparatus |
| CN101518096A (en) * | 2006-09-20 | 2009-08-26 | 苹果公司 | Three-dimensional display system |
| CN101625844A (en) * | 2008-07-07 | 2010-01-13 | 华晶科技股份有限公司 | System and method for preventing screen of image display device from vibrating |
| CN102004623A (en) * | 2010-11-29 | 2011-04-06 | 深圳市九洲电器有限公司 | Three-dimensional image display device and method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105912101A (en) * | 2016-03-31 | 2016-08-31 | 联想(北京)有限公司 | Projection control method and electronic equipment |
| CN105912101B (en) * | 2016-03-31 | 2020-08-25 | 联想(北京)有限公司 | Projection control method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103324327B (en) | 2016-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6153564B2 (en) | Pointing device with camera and mark output | |
| JP5604739B2 (en) | Image recognition apparatus, operation determination method, and program | |
| JP4701424B2 (en) | Image recognition apparatus, operation determination method, and program | |
| US8180114B2 (en) | Gesture recognition interface system with vertical display | |
| JP5703703B2 (en) | Information processing apparatus, stereoscopic display method, and program | |
| CN102508578B (en) | Projection positioning device and method as well as interaction system and method | |
| CN104423578B (en) | Interactive input system and method | |
| CN106020436A (en) | Image analyzing apparatus and image analyzing method | |
| CA2810307A1 (en) | Image recognition apparatus, operation determining method and computer readable medium | |
| JP6146094B2 (en) | Information operation display system, display program, and display method | |
| KR101518727B1 (en) | A stereoscopic interaction system and stereoscopic interaction method | |
| KR102147430B1 (en) | virtual multi-touch interaction apparatus and method | |
| KR20120126508A (en) | method for recognizing touch input in virtual touch apparatus without pointer | |
| EP2904776A1 (en) | 3d camera calibration | |
| CN103677240A (en) | Virtual touch interaction method and equipment | |
| WO2012019322A1 (en) | Input method, input system and input device of vision directing type mouse using monocular camera calibration technique | |
| WO2015003544A1 (en) | Method and device for refocusing multiple depth intervals, and electronic device | |
| US8462110B2 (en) | User input by pointing | |
| JP5640681B2 (en) | Information processing apparatus, stereoscopic display method, and program | |
| CN104613939A (en) | Method and device for positioning operation body and method and device for determining depth | |
| CN103324327A (en) | Virtue screen realizing method and system | |
| CN102629155A (en) | Method and device for implementing non-contact operation | |
| KR20160072306A (en) | Content Augmentation Method and System using a Smart Pen | |
| CN105867597B (en) | 3D interaction method and 3D display equipment | |
| CN106951087B (en) | Interaction method and device based on virtual interaction plane |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 Shenzhen, Nanshan District Province, science and technology, South Road, the building of the big square, building 02, room 4, Patentee after: SHENZHEN TAISHAN SPORTS TECHNOLOGY CORP., LTD. Address before: 518000 Shenzhen, Nanshan District Province, science and technology, South Road, the building of the big square, building 02, room 4, Patentee before: Shenzhen Tol Technology Co., Ltd. |
|
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 room 02, 4th floor, Fangda building, Keji South 12th Road, Nanshan District, Shenzhen City, Guangdong Province Patentee after: Shenzhen Taishan Sports Technology Co.,Ltd. Address before: 518000 room 02, 4th floor, Fangda building, Keji South 12th Road, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN TAISHAN SPORTS TECHNOLOGY Corp.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |