US20130176218A1 - Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System - Google Patents
Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System Download PDFInfo
- Publication number
- US20130176218A1 US20130176218A1 US13/735,072 US201313735072A US2013176218A1 US 20130176218 A1 US20130176218 A1 US 20130176218A1 US 201313735072 A US201313735072 A US 201313735072A US 2013176218 A1 US2013176218 A1 US 2013176218A1
- Authority
- US
- United States
- Prior art keywords
- border
- reference frame
- shift
- user interface
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
Definitions
- the present invention is related to a multimedia interactive system, and more particularly, to a pointing device and an operating method thereof of the multimedia interactive system.
- FIG. 1 is a diagram illustrating movement restriction of a conventional multimedia interactive system 100 .
- the multimedia interactive system 100 comprises a display device 110 and a pointing device 120 .
- the pointing device 120 can be, for instance, an air mouse, a remote controller, a control handle of a gaming console or a laser pointer, etc., for controlling a cursor displayed on the display device 110 .
- the cursor displayed on the display device 110 moves according to orientation, direction and distance of the movement of the pointing device 120 .
- the display device 110 also displays movement trajectory and position-after-movement of the cursor according to such movement of the pointing device 120 .
- a position of the pointing device 120 can be represented by factors such as yaw angle, pitch angle and roll angle in a three-dimensional (3D) spatial reference frame.
- an initial position of the cursor is set to be L 1 ′ and an initial position of the pointing device 120 is L 1 .
- the shift is S 1 .
- the shift S 1 will lead the cursor to make a shift S 1 ′ and the cursor reaches a border (i.e. position L 2 ′) of the display device 110 .
- the shift is S 2 , but the cursor cannot continue to move towards right accordingly since the cursor has already reached the border of the display device 120 , so the cursors stops at the border of the display device 110 (i.e. the cursor remains at the position L 2 ′).
- the pointing device 120 then moves back (i.e. moves towards left) to the position L 2 and the shift is S 2 .
- the shift S 2 will lead the cursor to make a shift S 2 ′, so as to move from the position L 2 ′ to a position L 3 ′.
- the pointing device 120 then moves back (i.e. moves towards left) again to the initial position L 1 and the corresponding shift is S 1 .
- the shift S 1 will make the cursor to perform shift S 1 ′ so the cursor is moved from the position L 3 ′ to the position L 4 ′.
- the pointing device 120 moves towards right at first then moves towards left to get back to the initial position L 1 , the cursor cannot get back to the initial position L 1 ′ due to restriction of the border of the display device 110 .
- a maximum limit exists for shift of the pointing device 120 . If the maximum limit is exceeded, reset/recalibration is needed to restore the interaction between the cursor and the pointing device 120 back to normal.
- FIG. 2A and FIG. 2B are diagrams illustrating rotation restriction of the conventional multimedia interactive system 100 .
- FIG. 2A illustrates when the rotation of the pointing device 120 is within a permissible range and
- FIG. 2B illustrates when the rotation of the pointing device 120 is out of the permissible range.
- a rotation angle S 3 of the pointing device 120 is within the permissible range, so the cursor displayed on the display device 110 makes a shift S 3 ′ accordingly.
- FIG. 2A illustrates when the rotation of the pointing device 120 is within a permissible range
- FIG. 2B illustrates when the rotation of the pointing device 120 is out of the permissible range.
- a rotation angle S 3 of the pointing device 120 is within the permissible range, so the cursor displayed on the display device 110 makes a shift S 3 ′ accordingly.
- a rotation angle S 4 of the pointing device 120 exceeds the permissible range, so although the cursor displayed on the display device 110 moves accordingly, but the cursor will stop at the border of the display device 110 due to restriction of the border of the display device 110 . More specifically, the pointing device 120 continues transmitting signals of moving outwards, for the cursor to move outwards continuously, but due to restriction of the border of the display device 110 , the cursor appears to be stationary to the user.
- the pointing device 120 can be a laser pointer. In FIG. 2A the later pointer points to the display device 110 , for controlling movement of the cursor accordingly. In FIG. 2B the laser pointer points in a direction away from the display device 110 , hence the permissible range is exceeded for the cursor to appear to be stationary.
- FIG. 3A and FIG. 3B are diagrams illustrating region restriction of the conventional multimedia interactive system 100 .
- FIG. 3A illustrates when an operating range of the pointing device 120 is within a permissible region and
- FIG. 3B illustrates when the operating range of the pointing device 120 is beyond the permissible region.
- the pointing device 120 makes a shift S 5 in a permissible region A, hence the cursor displayed on the display device 110 also makes a shift S 5 ′ accordingly.
- FIG. 3B the pointing device 120 is changed to operate in a region A′ which is beyond the permissible region A.
- FIG. 3A illustrates when an operating range of the pointing device 120 is within a permissible region
- FIG. 3B illustrates when the operating range of the pointing device 120 is beyond the permissible region.
- the shift S 6 of the pointing device 120 in the region A′ cannot lead the cursor displayed on the display device 110 to move accordingly, and the cursor can only stop at the border of the display device 110 .
- the pointing device 120 can be a laser pointer.
- the laser pointer is in front of the display device 110 so the cursor can be controlled with the laser pointer.
- a position of the laser pointer is far away from the display device 110 , hence the permissible range is exceeded and the cursor cannot be controlled by the laser pointer.
- An embodiment of the present invention discloses an operating method of a pointing device.
- the operating method comprises controlling a shift of a cursor in a user interface reference frame according to a shift of the pointing device; and stopping controlling the shift of the cursor according to the shift of the pointing device, when the shift of the pointing device exceeds a border of a 3D (three-dimensional) spatial reference frame.
- the pointing device comprises a pointing module, a border module and a control module.
- the pointing module is for detecting and storing a shift of the pointing module.
- the border module is for detecting a relation between a cursor and a user interface reference frame.
- the control module is for controlling a shift of the cursor in the user interface reference frame, according to the shift of the pointing module and the relation between the cursor and the user interface reference frame.
- the multimedia interactive system comprises a pointing device and a display device.
- the pointing device comprises a pointing module.
- the pointing module comprises a motion sensing unit and a data transmission unit.
- the motion sensing unit is for detecting rotating behavior, acceleration or magnetic field of the pointing module.
- the data transmission unit is for transmitting data detected by the motion sensing unit.
- the display device comprises a processing unit, a border module, a control module and a display module.
- the processing unit is for performing an algorithm calculation to data transmitted by the data transmission unit, to generate a shift of the pointing module.
- the border module is for detecting a relation between a cursor and a user interface reference frame.
- the control module is for controlling a shift of the cursor in the user interface reference frame, according to the shift of the pointing module and the relation between the cursor and the user interface reference frame.
- the display module is for displaying the cursor and the user interface reference frame.
- FIG. 1 is a diagram illustrating movement restriction of a conventional multimedia interactive system.
- FIG. 2A and FIG. 2B are diagrams illustrating rotation restriction of the conventional multimedia interactive system.
- FIG. 3A and FIG. 3B are diagrams illustrating region restriction of the conventional multimedia interactive system.
- FIG. 4 is a flow chart illustrating an operating method of a pointing device according to a first embodiment of the present invention.
- FIG. 5 is a diagram illustrating a pointing device according to the first embodiment of the present invention.
- FIG. 6 is a diagram illustrating a multimedia interactive system according to the first embodiment of the present invention.
- FIG. 7 is a diagram illustrating how the multimedia interactive system sets the border of the user interface reference frame to correspond to the border of the 3D spatial reference frame according to the first embodiment of the present invention.
- FIG. 8 is a diagram illustrating the pointing device of the multimedia interactive system has moved beyond the 3D spatial reference frame according to the first embodiment of the present invention.
- FIG. 4 is a flow chart illustrating an operating method 400 of a pointing device according to a first embodiment of the present invention. Steps of the operating method 400 include:
- Step S 401 detecting a resolution of a display module for determining a border of a user interface reference frame;
- Step S 402 setting a border of a 3D spatial reference frame utilized by a pointing device to correspond to the detected border of the user interface reference frame;
- Step S 403 moving a cursor of the user interface reference frame displayed on the display module according to a shift of the pointing device;
- Step S 404 stopping controlling a shift of the cursor according to the shift of the pointing device, when the shift of the pointing device exceeds the border of the 3D spatial reference frame;
- Step S 405 resuming controlling the shift of the cursor in the user interface reference frame displayed on the display module when the pointing device is back within the border of the 3D spatial reference frame.
- step S 401 the operating method 400 firstly detects a resolution of a display module (e.g. size of a monitor) controlled by a pointing device, for determining a range in which a cursor is able to move, such as 1024 ⁇ 768, 1920 ⁇ 1080 . . . , etc., so as to obtain a border/range of a user interface reference frame provided by/displayed on the display module.
- a resolution of a display module e.g. size of a monitor
- a pointing device for determining a range in which a cursor is able to move, such as 1024 ⁇ 768, 1920 ⁇ 1080 . . . , etc.
- step S 402 the operating method 400 sets a border of a three-dimensional (3D) spatial reference frame utilized by the pointing device according to the border, detected in step S 401 , of the user interface reference frame.
- the 3D spatial reference frame utilized by the pointing device can be a plane which comprises an initial point in a 3D space.
- the operating method 400 can then set the border of the 3D spatial reference frame on the plane, according to the resolution (detected in step S 401 ) with respect to the initial point. This way, when the pointing device moves to the border of the 3D spatial reference frame, position of the pointing device corresponds to position of the cursor which also moves to the border of the user interface reference frame.
- the initial point of the 3D spatial reference frame corresponds to a lower left corner of the user interface reference frame
- the cursor is at a corresponding lower left corner of the user interface reference frame
- step S 403 the operating method 400 controls movement of the cursor in the user interface reference frame displayed on the display module, according to the shift of the pointing device in the 3D spatial reference frame. For instance, when the pointing device moves a first predetermined distance towards a direction x in the 3D spatial reference frame, the operating method 400 controls the cursor in the user interface reference frame to move a second predetermined distance towards the direction x, where the first predetermined distance and the second predetermined distance can be proportional to each other.
- step S 404 when the shift of the pointing device exceeds the border of the 3D spatial reference frame, the operating method 400 stops controlling movement of the cursor. For instance, assuming the resolution of the display module is 1024 ⁇ 768. When the shift of the pointing device in the direction x exceeds 1024 units, meaning the cursor has moved to the border of the user interface reference frame, the operating method 400 will not continue to move the cursor.
- step S 405 when the pointing device is back within the border of the 3D spatial reference frame, the operating method 400 resumes controlling movement of the cursor. For instance, assuming relative settings are the same as above, when the pointing device moves in the direction x from a position that is larger than 1024 units to a position that is smaller than 1024 units, the operating method 400 will still stop controlling movement of the cursor for the part that is larger than 1024 units, and resumes controlling movement of the cursor for the part that is smaller than 1024 units. Therefore, by utilizing operating method 400 , when the pointing device is operating outside of a default operating range, position of the cursor displayed on the display module will not have offset issues, so unlike conventional technology, reset/recalibration is not required.
- FIG. 5 is a diagram illustrating a pointing device 500 according to the first embodiment of the present invention.
- the pointing device 500 comprises a pointing module 510 , a border module 520 and a control module 530 .
- the pointing device 500 can be an air mouse, a remote controller, a control handle of a gaming console or a laser pointer, etc., for controlling a cursor displayed on a display device.
- the pointing module 510 detects and stores a shift/position of the pointing module 510 in a 3D spatial reference frame.
- the pointing module 510 comprises a motion sensing unit 511 , a processing unit 512 and a data transmission unit 513 .
- the motion sensing unit 511 comprises a rotation sensor 511 a, an accelerometer 511 b and/or a magnetometer 511 c.
- the rotation sensor 511 a detects rotating behavior of the pointing module 510 .
- the accelerometer 511 b detects acceleration of the pointing module 510 .
- the magnetometer 511 c determines a position of the pointing module 510 according to earth's magnetic field (i.e. detecting force of the earth's magnetic field).
- the processing unit 512 performs an algorithm calculation to data obtained by the motion sensing unit 511 (e.g. data obtained by the rotation sensor 511 a, the accelerometer 511 b and/or the magnetometer 511 c ), for obtaining a shift signal SM.
- the data transmission unit 513 then transmits the shift signal SM obtained to the border module 520 and the control module 530 .
- the motion sensing unit 511 can be realized with the rotation sensor and the accelerometer only, without the magnetometer. More specifically, when the motion sensing unit 511 is a six-axis sensing unit, the motion sensing unit 511 can be realized with only the rotation sensor and the accelerometer, but such setup is unable to detect the absolute position. When the motion sensing unit 511 is a nine-axis sensing unit, the motion sensing unit 511 then requires rotation sensor, the accelerometer and the magnetometer to be realized, so the absolute position can be detected.
- An advantage of being able to detect the absolute position is that if the pointing device is idled for a period of time, when a user is to use the pointing device again, the 3D spatial reference frame and the initial point utilized by the pointing device are not required to be reset. On the other hand, if the pointing device utilizes the six-axis sensing unit, the absolute position cannot be detected. If the pointing device is idled for a period of time, when a user is to use the pointing device again, the 3D spatial reference frame and the initial point utilized by the pointing device will require to be reset.
- the border module 520 detects whether the cursor being controlled has reached a border of a user interface reference frame displayed on the display module, for notifying the control module 530 to move the cursor or not.
- the display module displays the user interface reference frame and the cursor.
- the border module 520 comprises a border determining unit 521 , a border setting unit 522 and a resolution detecting unit 523 .
- the border determining unit 521 receives the shift signal SM, for determining whether the position/shift of the pointing module 510 is within a border of a 3D spatial reference frame, so as to transmit a border determining signal SB accordingly.
- the border setting unit 522 sets the border of the 3D spatial reference frame utilized by the pointing module 510 , and sets the border of the 3D spatial reference frame to correspond to the border of the user interface reference frame. This way, when the position/shift of the pointing module 510 is at the border of the 3D spatial reference frame, the corresponding position of the cursor is at the border of the user interface reference frame displayed on the display module.
- the resolution detecting unit 523 detects a resolution of the display module. The resolution of the display module is utilized to be the border of the user interface reference frame. The resolution detecting unit 523 generates a user interface reference frame border signal SBU according to the resolution of the display module.
- the resolution detecting unit 523 transmits border data of the user interface reference frame to the border setting unit 522 via the user interface reference frame border signal SBU, according to the resolution of the display module.
- the border setting unit 522 can then set the border of the 3D spatial reference frame according to the border of the user interface reference frame, for generating a 3D spatial reference frame border signal SB 3 and providing the 3D spatial reference frame border signal SB 3 to the border determining unit 521 .
- the border determining unit 521 does not output the border determining signal SB.
- the border determining unit 521 then outputs the border determining signal SB.
- the control module 530 controls the shift of the cursor in the user interface reference frame, according to the shift signal SM and a relation between the cursor and the user interface reference frame detected by the border module 520 . More specifically, when the control module 530 has not received the border determining signal SB, meaning the cursor is still within the user interface reference frame and has not reached the border of the user interface reference frame, the control module 530 controls the shift of the cursor according to the shift signal SM. On the other hand, when the control module 530 has received the border determining signal SB, meaning the cursor has reached the border of the user interface reference frame, the control module 530 stops controlling the cursor.
- FIG. 6 is a diagram illustrating a multimedia interactive system 600 according to the first embodiment of the present invention.
- the multimedia interactive system 600 comprises a pointing module 610 , a border module 620 , a control module 630 and a display module 670 .
- the pointing module 610 comprises a motion sensing unit 611 , a processing unit 612 and a data transmission unit 613 .
- the motion sensing unit 611 comprises a rotation sensor 611 a, an accelerometer 611 b and/or a magnetometer 611 c.
- the border module 620 comprises a border determining unit 621 , a border setting unit 622 and a resolution detecting unit 623 .
- the components mentioned above are similar to those mentioned in previous paragraphs (e.g.
- the multimedia interactive system 600 further comprises a pointing device 650 and a display device 660 .
- the pointing device 650 comprises the pointing module 610
- the display device 660 only needs to comprise the display module 670 , but a pointing device with such setup consumes more power.
- the pointing device 650 can only comprise the motion sensing unit 611 of the pointing module 610 and the data transmission unit 613 , and dispose the processing unit 612 , the border module 620 , the control module 630 and the display module 670 in the display device 660 (as shown in FIG. 6 ), for decreasing power consumption of the pointing device.
- such setup will cause the data obtained by the rotation sensor 611 a, the accelerometer 611 b and/or the magnetometer 611 c to transmit, via either wired or wireless transmission, to the processing unit 612 for processing, so as to obtain the shift signal SM.
- the data transmission unit 613 directly transmits, via either wired or wireless transmission, the data detected by the motion sensing unit to the display device 660 .
- the processing unit 612 can then receive, via either wired or wireless transmission, the data transmitted by the data transmission unit 613 and performing the algorithm calculation, for generating the shift of the pointing module 610 and then transmits the shift to the control module 630 .
- FIG. 7 is a diagram illustrating how the multimedia interactive system 600 sets the border of the user interface reference frame to correspond to the border of the 3D spatial reference frame according to the first embodiment of the present invention.
- vertical range of a user interface reference frame UF of the display device 660 can be from an upper right corner to a lower right corner of the user interface reference frame UF
- a pitch angle of the 3D spatial reference frame utilized by the corresponding pointing device 650 is AP.
- Horizontal range of the user interface reference frame UF of the display device 660 can be from the upper right corner to a upper left corner of the user interface reference frame UF, and a yaw angle of the 3D spatial reference frame utilized by the corresponding pointing device 650 is AY.
- a pitch angle of the pointing device 650 is larger than the pitch angle AP, or when a yaw angle of the pointing device 650 is larger than the yaw angle AY, meaning the pointing device 650 has exceeded the border of the 3D spatial reference frame and the cursor has reached the border of the user interface reference frame UF
- the control module 630 stops controlling movement of the cursor.
- the control module 630 resumes controlling movement of the cursor when the pointing device 650 is back within the border of the 3D spatial reference frame.
- FIG. 8 is a diagram illustrating the pointing device of the multimedia interactive system 600 has moved beyond the 3D spatial reference frame according to the first embodiment of the present invention.
- an initial position of the cursor is set to L 1 ′ and an initial position of the pointing device 650 is L 1 .
- the shift is S 1 .
- the shift S 1 will lead the cursor to make a shift S 1 ′ to reach a border (e.g. position L 2 ′) of the user interface reference frame (e.g. the display device 660 ).
- the multimedia interactive system 600 of the present invention is able to determine the border of the 3D spatial reference frame (as shown in FIG. 8 ) utilized by the pointing device 650 due to the border module 620 is disposed in the multimedia interactive system 600 . Therefore when the pointing device 650 continues to move towards right to a position L 3 , the shift is S 2 , but since the pointing device 650 has now exceeded the border of the 3D spatial reference frame, the control module 630 stops controlling the cursor.
- the control module 630 still stops controlling the cursor for the cursor to remain at the position L 2 ′.
- the pointing device 650 moves back (i.e. moves towards left) again to the initial position L 1 and the corresponding shift is S 1 . Since the pointing device 650 is now back within the border of the 3D spatial reference frame, the control module 630 resumes controlling the cursor, for the cursor to make the shift S 1 from the position L 2 ′ to reach the position L 1 ′. This way, the last position of the cursor is identical to the initial position of the cursor, so unlike the conventional technology, reset/recalibration is not needed.
- the pointing device of the present invention stops controlling the cursor, so as to lower the affect of offset, allowing the pointing device to be applied in different areas/directions without having the cursor displayed on the display device to incorrectly reflect shift of the pointing device.
Abstract
Description
- The present invention is related to a multimedia interactive system, and more particularly, to a pointing device and an operating method thereof of the multimedia interactive system.
- Please refer to
FIG. 1 .FIG. 1 is a diagram illustrating movement restriction of a conventional multimediainteractive system 100. The multimediainteractive system 100 comprises adisplay device 110 and apointing device 120. Thepointing device 120 can be, for instance, an air mouse, a remote controller, a control handle of a gaming console or a laser pointer, etc., for controlling a cursor displayed on thedisplay device 110. For instance, the cursor displayed on thedisplay device 110 moves according to orientation, direction and distance of the movement of thepointing device 120. Accordingly, thedisplay device 110 also displays movement trajectory and position-after-movement of the cursor according to such movement of thepointing device 120. Further, a position of thepointing device 120 can be represented by factors such as yaw angle, pitch angle and roll angle in a three-dimensional (3D) spatial reference frame. - In
FIG. 1 , an initial position of the cursor is set to be L1′ and an initial position of thepointing device 120 is L1. When the pointingdevice 120 moves towards right to a position L2, the shift is S1. The shift S1 will lead the cursor to make a shift S1′ and the cursor reaches a border (i.e. position L2′) of thedisplay device 110. When thepointing device 120 continues to move towards right to a position L3, the shift is S2, but the cursor cannot continue to move towards right accordingly since the cursor has already reached the border of thedisplay device 120, so the cursors stops at the border of the display device 110 (i.e. the cursor remains at the position L2′). - Afterwards, the pointing
device 120 then moves back (i.e. moves towards left) to the position L2 and the shift is S2. The shift S2 will lead the cursor to make a shift S2′, so as to move from the position L2′ to a position L3′. Thepointing device 120 then moves back (i.e. moves towards left) again to the initial position L1 and the corresponding shift is S1. The shift S1 will make the cursor to perform shift S1′ so the cursor is moved from the position L3′ to the position L4′. Although the pointingdevice 120 moves towards right at first then moves towards left to get back to the initial position L1, the cursor cannot get back to the initial position L1′ due to restriction of the border of thedisplay device 110. In other words, in the conventional multimediainteractive system 100, a maximum limit exists for shift of thepointing device 120. If the maximum limit is exceeded, reset/recalibration is needed to restore the interaction between the cursor and thepointing device 120 back to normal. - Please refer to
FIG. 2A andFIG. 2B .FIG. 2A andFIG. 2B are diagrams illustrating rotation restriction of the conventional multimediainteractive system 100.FIG. 2A illustrates when the rotation of thepointing device 120 is within a permissible range andFIG. 2B illustrates when the rotation of thepointing device 120 is out of the permissible range. InFIG. 2A , a rotation angle S3 of thepointing device 120 is within the permissible range, so the cursor displayed on thedisplay device 110 makes a shift S3′ accordingly. InFIG. 2B , a rotation angle S4 of thepointing device 120 exceeds the permissible range, so although the cursor displayed on thedisplay device 110 moves accordingly, but the cursor will stop at the border of thedisplay device 110 due to restriction of the border of thedisplay device 110. More specifically, thepointing device 120 continues transmitting signals of moving outwards, for the cursor to move outwards continuously, but due to restriction of the border of thedisplay device 110, the cursor appears to be stationary to the user. For instance, thepointing device 120 can be a laser pointer. InFIG. 2A the later pointer points to thedisplay device 110, for controlling movement of the cursor accordingly. InFIG. 2B the laser pointer points in a direction away from thedisplay device 110, hence the permissible range is exceeded for the cursor to appear to be stationary. - Please refer to
FIG. 3A andFIG. 3B .FIG. 3A andFIG. 3B are diagrams illustrating region restriction of the conventional multimediainteractive system 100.FIG. 3A illustrates when an operating range of thepointing device 120 is within a permissible region andFIG. 3B illustrates when the operating range of thepointing device 120 is beyond the permissible region. InFIG. 3A , thepointing device 120 makes a shift S5 in a permissible region A, hence the cursor displayed on thedisplay device 110 also makes a shift S5′ accordingly. InFIG. 3B , thepointing device 120 is changed to operate in a region A′ which is beyond the permissible region A. Hence inFIG. 3B the shift S6 of thepointing device 120 in the region A′ cannot lead the cursor displayed on thedisplay device 110 to move accordingly, and the cursor can only stop at the border of thedisplay device 110. For instance, thepointing device 120 can be a laser pointer. InFIG. 3A the laser pointer is in front of thedisplay device 110 so the cursor can be controlled with the laser pointer. InFIG. 3B a position of the laser pointer is far away from thedisplay device 110, hence the permissible range is exceeded and the cursor cannot be controlled by the laser pointer. - Therefore as described above, in the conventional multimedia interactive system, operation of the pointing device encounters a lot of restrictions, causing inconveniences.
- An embodiment of the present invention discloses an operating method of a pointing device. The operating method comprises controlling a shift of a cursor in a user interface reference frame according to a shift of the pointing device; and stopping controlling the shift of the cursor according to the shift of the pointing device, when the shift of the pointing device exceeds a border of a 3D (three-dimensional) spatial reference frame.
- Another embodiment of the present invention discloses a pointing device. The pointing device comprises a pointing module, a border module and a control module. The pointing module is for detecting and storing a shift of the pointing module. The border module is for detecting a relation between a cursor and a user interface reference frame. The control module is for controlling a shift of the cursor in the user interface reference frame, according to the shift of the pointing module and the relation between the cursor and the user interface reference frame.
- Another embodiment of the present invention discloses a multimedia interactive system. The multimedia interactive system comprises a pointing device and a display device. The pointing device comprises a pointing module. The pointing module comprises a motion sensing unit and a data transmission unit. The motion sensing unit is for detecting rotating behavior, acceleration or magnetic field of the pointing module. The data transmission unit is for transmitting data detected by the motion sensing unit. The display device comprises a processing unit, a border module, a control module and a display module. The processing unit is for performing an algorithm calculation to data transmitted by the data transmission unit, to generate a shift of the pointing module. The border module is for detecting a relation between a cursor and a user interface reference frame. The control module is for controlling a shift of the cursor in the user interface reference frame, according to the shift of the pointing module and the relation between the cursor and the user interface reference frame. The display module is for displaying the cursor and the user interface reference frame.
- These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
-
FIG. 1 is a diagram illustrating movement restriction of a conventional multimedia interactive system. -
FIG. 2A andFIG. 2B are diagrams illustrating rotation restriction of the conventional multimedia interactive system. -
FIG. 3A andFIG. 3B are diagrams illustrating region restriction of the conventional multimedia interactive system. -
FIG. 4 is a flow chart illustrating an operating method of a pointing device according to a first embodiment of the present invention. -
FIG. 5 is a diagram illustrating a pointing device according to the first embodiment of the present invention. -
FIG. 6 is a diagram illustrating a multimedia interactive system according to the first embodiment of the present invention. -
FIG. 7 is a diagram illustrating how the multimedia interactive system sets the border of the user interface reference frame to correspond to the border of the 3D spatial reference frame according to the first embodiment of the present invention. -
FIG. 8 is a diagram illustrating the pointing device of the multimedia interactive system has moved beyond the 3D spatial reference frame according to the first embodiment of the present invention. - Please refer to
FIG. 4 .FIG. 4 is a flow chart illustrating anoperating method 400 of a pointing device according to a first embodiment of the present invention. Steps of theoperating method 400 include: - Step S401: detecting a resolution of a display module for determining a border of a user interface reference frame;
Step S402: setting a border of a 3D spatial reference frame utilized by a pointing device to correspond to the detected border of the user interface reference frame;
Step S403: moving a cursor of the user interface reference frame displayed on the display module according to a shift of the pointing device;
Step S404: stopping controlling a shift of the cursor according to the shift of the pointing device, when the shift of the pointing device exceeds the border of the 3D spatial reference frame;
Step S405: resuming controlling the shift of the cursor in the user interface reference frame displayed on the display module when the pointing device is back within the border of the 3D spatial reference frame. - In step S401, the
operating method 400 firstly detects a resolution of a display module (e.g. size of a monitor) controlled by a pointing device, for determining a range in which a cursor is able to move, such as 1024×768, 1920×1080 . . . , etc., so as to obtain a border/range of a user interface reference frame provided by/displayed on the display module. - In step S402, the
operating method 400 sets a border of a three-dimensional (3D) spatial reference frame utilized by the pointing device according to the border, detected in step S401, of the user interface reference frame. More specifically, the 3D spatial reference frame utilized by the pointing device can be a plane which comprises an initial point in a 3D space. In step S402, theoperating method 400 can then set the border of the 3D spatial reference frame on the plane, according to the resolution (detected in step S401) with respect to the initial point. This way, when the pointing device moves to the border of the 3D spatial reference frame, position of the pointing device corresponds to position of the cursor which also moves to the border of the user interface reference frame. For instance, assuming the initial point of the 3D spatial reference frame corresponds to a lower left corner of the user interface reference frame, so when the pointing device is at the initial point of the 3D spatial reference frame, the cursor is at a corresponding lower left corner of the user interface reference frame. - In step S403, the
operating method 400 controls movement of the cursor in the user interface reference frame displayed on the display module, according to the shift of the pointing device in the 3D spatial reference frame. For instance, when the pointing device moves a first predetermined distance towards a direction x in the 3D spatial reference frame, theoperating method 400 controls the cursor in the user interface reference frame to move a second predetermined distance towards the direction x, where the first predetermined distance and the second predetermined distance can be proportional to each other. - In step S404, when the shift of the pointing device exceeds the border of the 3D spatial reference frame, the
operating method 400 stops controlling movement of the cursor. For instance, assuming the resolution of the display module is 1024×768. When the shift of the pointing device in the direction x exceeds 1024 units, meaning the cursor has moved to the border of the user interface reference frame, theoperating method 400 will not continue to move the cursor. - In step S405, when the pointing device is back within the border of the 3D spatial reference frame, the
operating method 400 resumes controlling movement of the cursor. For instance, assuming relative settings are the same as above, when the pointing device moves in the direction x from a position that is larger than 1024 units to a position that is smaller than 1024 units, theoperating method 400 will still stop controlling movement of the cursor for the part that is larger than 1024 units, and resumes controlling movement of the cursor for the part that is smaller than 1024 units. Therefore, by utilizingoperating method 400, when the pointing device is operating outside of a default operating range, position of the cursor displayed on the display module will not have offset issues, so unlike conventional technology, reset/recalibration is not required. - Please refer to
FIG. 5 .FIG. 5 is a diagram illustrating apointing device 500 according to the first embodiment of the present invention. As shown inFIG. 5 , thepointing device 500 comprises apointing module 510, aborder module 520 and acontrol module 530. Thepointing device 500 can be an air mouse, a remote controller, a control handle of a gaming console or a laser pointer, etc., for controlling a cursor displayed on a display device. - The
pointing module 510 detects and stores a shift/position of thepointing module 510 in a 3D spatial reference frame. Thepointing module 510 comprises amotion sensing unit 511, aprocessing unit 512 and adata transmission unit 513. Themotion sensing unit 511 comprises arotation sensor 511 a, anaccelerometer 511 b and/or amagnetometer 511 c. Therotation sensor 511 a detects rotating behavior of thepointing module 510. Theaccelerometer 511 b detects acceleration of thepointing module 510. Themagnetometer 511 c determines a position of thepointing module 510 according to earth's magnetic field (i.e. detecting force of the earth's magnetic field). Theprocessing unit 512 performs an algorithm calculation to data obtained by the motion sensing unit 511 (e.g. data obtained by therotation sensor 511 a, theaccelerometer 511 b and/or themagnetometer 511 c), for obtaining a shift signal SM. Thedata transmission unit 513 then transmits the shift signal SM obtained to theborder module 520 and thecontrol module 530. - Further, the
motion sensing unit 511 can be realized with the rotation sensor and the accelerometer only, without the magnetometer. More specifically, when themotion sensing unit 511 is a six-axis sensing unit, themotion sensing unit 511 can be realized with only the rotation sensor and the accelerometer, but such setup is unable to detect the absolute position. When themotion sensing unit 511 is a nine-axis sensing unit, themotion sensing unit 511 then requires rotation sensor, the accelerometer and the magnetometer to be realized, so the absolute position can be detected. An advantage of being able to detect the absolute position is that if the pointing device is idled for a period of time, when a user is to use the pointing device again, the 3D spatial reference frame and the initial point utilized by the pointing device are not required to be reset. On the other hand, if the pointing device utilizes the six-axis sensing unit, the absolute position cannot be detected. If the pointing device is idled for a period of time, when a user is to use the pointing device again, the 3D spatial reference frame and the initial point utilized by the pointing device will require to be reset. - The
border module 520 detects whether the cursor being controlled has reached a border of a user interface reference frame displayed on the display module, for notifying thecontrol module 530 to move the cursor or not. The display module displays the user interface reference frame and the cursor. Theborder module 520 comprises aborder determining unit 521, aborder setting unit 522 and aresolution detecting unit 523. Theborder determining unit 521 receives the shift signal SM, for determining whether the position/shift of thepointing module 510 is within a border of a 3D spatial reference frame, so as to transmit a border determining signal SB accordingly. - The
border setting unit 522 sets the border of the 3D spatial reference frame utilized by thepointing module 510, and sets the border of the 3D spatial reference frame to correspond to the border of the user interface reference frame. This way, when the position/shift of thepointing module 510 is at the border of the 3D spatial reference frame, the corresponding position of the cursor is at the border of the user interface reference frame displayed on the display module. Theresolution detecting unit 523 detects a resolution of the display module. The resolution of the display module is utilized to be the border of the user interface reference frame. Theresolution detecting unit 523 generates a user interface reference frame border signal SBU according to the resolution of the display module. In other words, theresolution detecting unit 523 transmits border data of the user interface reference frame to theborder setting unit 522 via the user interface reference frame border signal SBU, according to the resolution of the display module. Theborder setting unit 522 can then set the border of the 3D spatial reference frame according to the border of the user interface reference frame, for generating a 3D spatial reference frame border signal SB3 and providing the 3D spatial reference frame border signal SB3 to theborder determining unit 521. - This way, when the shift signal SM indicates the shift of the pointing module is within the border of the 3D spatial reference frame, meaning the cursor is within the border of the user interface reference frame, the
border determining unit 521 does not output the border determining signal SB. In contrast, when the shift signal SM indicates the shift of the pointing module has exceeded the border of the 3D spatial reference frame, meaning the cursor has reached the border of the user interface reference frame, theborder determining unit 521 then outputs the border determining signal SB. - The
control module 530 controls the shift of the cursor in the user interface reference frame, according to the shift signal SM and a relation between the cursor and the user interface reference frame detected by theborder module 520. More specifically, when thecontrol module 530 has not received the border determining signal SB, meaning the cursor is still within the user interface reference frame and has not reached the border of the user interface reference frame, thecontrol module 530 controls the shift of the cursor according to the shift signal SM. On the other hand, when thecontrol module 530 has received the border determining signal SB, meaning the cursor has reached the border of the user interface reference frame, thecontrol module 530 stops controlling the cursor. - Please refer to
FIG. 6 .FIG. 6 is a diagram illustrating a multimediainteractive system 600 according to the first embodiment of the present invention. The multimediainteractive system 600 comprises apointing module 610, aborder module 620, acontrol module 630 and adisplay module 670. Thepointing module 610 comprises amotion sensing unit 611, aprocessing unit 612 and adata transmission unit 613. Themotion sensing unit 611 comprises arotation sensor 611 a, anaccelerometer 611 b and/or amagnetometer 611 c. Theborder module 620 comprises aborder determining unit 621, aborder setting unit 622 and aresolution detecting unit 623. The components mentioned above are similar to those mentioned in previous paragraphs (e.g.FIG. 5 ), so relative descriptions are omitted hereinafter. The multimediainteractive system 600 further comprises apointing device 650 and adisplay device 660. When thepointing device 650 comprises thepointing module 610, theborder module 620 and thecontrol module 630, thedisplay device 660 only needs to comprise thedisplay module 670, but a pointing device with such setup consumes more power. - Alternatively, the
pointing device 650 can only comprise themotion sensing unit 611 of thepointing module 610 and thedata transmission unit 613, and dispose theprocessing unit 612, theborder module 620, thecontrol module 630 and thedisplay module 670 in the display device 660 (as shown inFIG. 6 ), for decreasing power consumption of the pointing device. However, such setup will cause the data obtained by therotation sensor 611 a, theaccelerometer 611 b and/or themagnetometer 611 c to transmit, via either wired or wireless transmission, to theprocessing unit 612 for processing, so as to obtain the shift signal SM. In other words, in such setup, thedata transmission unit 613 directly transmits, via either wired or wireless transmission, the data detected by the motion sensing unit to thedisplay device 660. In thedisplay device 660, theprocessing unit 612 can then receive, via either wired or wireless transmission, the data transmitted by thedata transmission unit 613 and performing the algorithm calculation, for generating the shift of thepointing module 610 and then transmits the shift to thecontrol module 630. - Please refer to
FIG. 7 .FIG. 7 is a diagram illustrating how the multimediainteractive system 600 sets the border of the user interface reference frame to correspond to the border of the 3D spatial reference frame according to the first embodiment of the present invention. As shown inFIG. 7 , vertical range of a user interface reference frame UF of thedisplay device 660 can be from an upper right corner to a lower right corner of the user interface reference frame UF, and a pitch angle of the 3D spatial reference frame utilized by the correspondingpointing device 650 is AP. Horizontal range of the user interface reference frame UF of thedisplay device 660 can be from the upper right corner to a upper left corner of the user interface reference frame UF, and a yaw angle of the 3D spatial reference frame utilized by the correspondingpointing device 650 is AY. This way, when a pitch angle of thepointing device 650 is larger than the pitch angle AP, or when a yaw angle of thepointing device 650 is larger than the yaw angle AY, meaning thepointing device 650 has exceeded the border of the 3D spatial reference frame and the cursor has reached the border of the user interface reference frame UF, thecontrol module 630 stops controlling movement of the cursor. Thecontrol module 630 resumes controlling movement of the cursor when thepointing device 650 is back within the border of the 3D spatial reference frame. - Please refer to
FIG. 8 .FIG. 8 is a diagram illustrating the pointing device of the multimediainteractive system 600 has moved beyond the 3D spatial reference frame according to the first embodiment of the present invention. As shown inFIG. 8 , assuming an initial position of the cursor is set to L1′ and an initial position of thepointing device 650 is L1. When thepointing device 650 moves towards right to a position L2, the shift is S1. The shift S1 will lead the cursor to make a shift S1′ to reach a border (e.g. position L2′) of the user interface reference frame (e.g. the display device 660). At this moment, the multimediainteractive system 600 of the present invention is able to determine the border of the 3D spatial reference frame (as shown inFIG. 8 ) utilized by thepointing device 650 due to theborder module 620 is disposed in the multimediainteractive system 600. Therefore when thepointing device 650 continues to move towards right to a position L3, the shift is S2, but since thepointing device 650 has now exceeded the border of the 3D spatial reference frame, thecontrol module 630 stops controlling the cursor. - Afterwards, the
pointing device 650 moves back (i.e. moves towards left) to the position L2 and the shift is S2, and since the pointing device still exceeds the border of the 3D spatial reference frame, thecontrol module 630 still stops controlling the cursor for the cursor to remain at the position L2′. Lastly, thepointing device 650 moves back (i.e. moves towards left) again to the initial position L1 and the corresponding shift is S1. Since thepointing device 650 is now back within the border of the 3D spatial reference frame, thecontrol module 630 resumes controlling the cursor, for the cursor to make the shift S1 from the position L2′ to reach the position L1′. This way, the last position of the cursor is identical to the initial position of the cursor, so unlike the conventional technology, reset/recalibration is not needed. - In conclusion, when out of the operating range, the pointing device of the present invention stops controlling the cursor, so as to lower the affect of offset, allowing the pointing device to be applied in different areas/directions without having the cursor displayed on the display device to incorrectly reflect shift of the pointing device.
- Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the meters and bounds of the appended claims.
Claims (11)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/735,072 US20130176218A1 (en) | 2012-01-10 | 2013-01-07 | Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261585193P | 2012-01-10 | 2012-01-10 | |
US13/735,072 US20130176218A1 (en) | 2012-01-10 | 2013-01-07 | Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System |
Publications (1)
Publication Number | Publication Date |
---|---|
US20130176218A1 true US20130176218A1 (en) | 2013-07-11 |
Family
ID=48743562
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/735,072 Abandoned US20130176218A1 (en) | 2012-01-10 | 2013-01-07 | Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System |
US13/737,516 Active 2033-06-02 US8917241B2 (en) | 2012-01-10 | 2013-01-09 | Pointing device, operating method thereof and relative multimedia interactive system |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/737,516 Active 2033-06-02 US8917241B2 (en) | 2012-01-10 | 2013-01-09 | Pointing device, operating method thereof and relative multimedia interactive system |
Country Status (2)
Country | Link |
---|---|
US (2) | US20130176218A1 (en) |
CN (2) | CN103279205B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2801891B1 (en) | 2013-05-09 | 2018-12-26 | Samsung Electronics Co., Ltd | Input Apparatus, Pointing Apparatus, Method for Displaying Pointer, and Recordable Medium |
CN103727899B (en) * | 2013-12-31 | 2015-07-01 | 京东方科技集团股份有限公司 | Method for detecting rotation angle of remote controller in television system and television system |
US9529454B1 (en) * | 2015-06-19 | 2016-12-27 | Microsoft Technology Licensing, Llc | Three-dimensional user input |
CN110851056B (en) * | 2019-11-14 | 2024-02-27 | 珠海金山数字网络科技有限公司 | Cursor control method and device, computing equipment and storage medium |
CN113721777B (en) * | 2021-09-08 | 2024-01-30 | 得力集团有限公司 | Control method and device of mouse pointer, electronic equipment and storage medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020015137A1 (en) * | 2000-07-27 | 2002-02-07 | Masahide Hasegawa | Image display system, image display method, storage medium, and computer program |
US20020140854A1 (en) * | 2001-03-30 | 2002-10-03 | Koninklijke Philips Electronics N.V. | Scalable resolution enhancement of a video image |
US20050104867A1 (en) * | 1998-01-26 | 2005-05-19 | University Of Delaware | Method and apparatus for integrating manual input |
US20070058047A1 (en) * | 2004-10-25 | 2007-03-15 | Henty David L | Multi-directional remote control system and method |
US20090327964A1 (en) * | 2008-06-28 | 2009-12-31 | Mouilleseaux Jean-Pierre M | Moving radial menus |
US20110260968A1 (en) * | 2010-01-06 | 2011-10-27 | Cywee Group Ltd. | 3d pointing device and method for compensating rotations of the 3d pointing device thereof |
US20120119989A1 (en) * | 2009-08-10 | 2012-05-17 | Koninklijke Philips Electronics N.V. | System and method for moving a cursor on a screen |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7535456B2 (en) * | 2004-04-30 | 2009-05-19 | Hillcrest Laboratories, Inc. | Methods and devices for removing unintentional movement in 3D pointing devices |
US7683883B2 (en) * | 2004-11-02 | 2010-03-23 | Pierre Touma | 3D mouse and game controller based on spherical coordinates system and system for use |
KR100714722B1 (en) * | 2005-06-17 | 2007-05-04 | 삼성전자주식회사 | Apparatus and method for implementing pointing user interface using signal of light emitter |
US20070080940A1 (en) * | 2005-10-07 | 2007-04-12 | Sharp Kabushiki Kaisha | Remote control system, and display device and electronic device using the remote control system |
JP5343852B2 (en) * | 2007-08-08 | 2013-11-13 | ソニー株式会社 | Input device and control method |
KR20110032596A (en) * | 2009-09-23 | 2011-03-30 | 삼성전자주식회사 | Method for providing gui generating and using gravity map for pointer movement and display device thereof |
JP2011070256A (en) * | 2009-09-24 | 2011-04-07 | Toshiba Corp | Debugger and program |
JP5762967B2 (en) * | 2010-05-18 | 2015-08-12 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | Coordinate determination device, coordinate determination method, and coordinate determination program |
CN101882371B (en) * | 2010-06-08 | 2012-01-11 | 广州代代星电子科技有限公司 | Remote-control operating device with extendable functions |
US9377876B2 (en) * | 2010-12-15 | 2016-06-28 | Hillcrest Laboratories, Inc. | Visual whiteboard for television-based social network |
US20120206350A1 (en) * | 2011-02-13 | 2012-08-16 | PNI Sensor Corporation | Device Control of Display Content of a Display |
US9182838B2 (en) * | 2011-04-19 | 2015-11-10 | Microsoft Technology Licensing, Llc | Depth camera-based relative gesture detection |
-
2013
- 2013-01-07 CN CN201310005006.3A patent/CN103279205B/en active Active
- 2013-01-07 US US13/735,072 patent/US20130176218A1/en not_active Abandoned
- 2013-01-09 US US13/737,516 patent/US8917241B2/en active Active
- 2013-01-09 CN CN201310008106.1A patent/CN103425271B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050104867A1 (en) * | 1998-01-26 | 2005-05-19 | University Of Delaware | Method and apparatus for integrating manual input |
US20020015137A1 (en) * | 2000-07-27 | 2002-02-07 | Masahide Hasegawa | Image display system, image display method, storage medium, and computer program |
US20020140854A1 (en) * | 2001-03-30 | 2002-10-03 | Koninklijke Philips Electronics N.V. | Scalable resolution enhancement of a video image |
US20070058047A1 (en) * | 2004-10-25 | 2007-03-15 | Henty David L | Multi-directional remote control system and method |
US20090327964A1 (en) * | 2008-06-28 | 2009-12-31 | Mouilleseaux Jean-Pierre M | Moving radial menus |
US20120119989A1 (en) * | 2009-08-10 | 2012-05-17 | Koninklijke Philips Electronics N.V. | System and method for moving a cursor on a screen |
US20110260968A1 (en) * | 2010-01-06 | 2011-10-27 | Cywee Group Ltd. | 3d pointing device and method for compensating rotations of the 3d pointing device thereof |
Also Published As
Publication number | Publication date |
---|---|
CN103425271B (en) | 2016-09-28 |
CN103425271A (en) | 2013-12-04 |
CN103279205A (en) | 2013-09-04 |
US20130234940A1 (en) | 2013-09-12 |
US8917241B2 (en) | 2014-12-23 |
CN103279205B (en) | 2016-12-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3436867B1 (en) | Head-mounted display tracking | |
US9342925B2 (en) | Information processing apparatus, information processing method, and program | |
US9327396B2 (en) | Tele-operation system and control method thereof | |
US8957909B2 (en) | System and method for compensating for drift in a display of a user interface state | |
US20130176218A1 (en) | Pointing Device, Operating Method Thereof and Relative Multimedia Interactive System | |
EP2538309A2 (en) | Remote control with motion sensitive devices | |
US20210208699A1 (en) | Direct three-dimensional pointing using light tracking and relative position detection | |
JP2011075559A (en) | Motion detecting device and method | |
KR101893601B1 (en) | Input apparatus of display apparatus, display system and control method thereof | |
JP2013161267A5 (en) | ||
US20140078311A1 (en) | Method for guiding controller to move to within recognizable range of multimedia apparatus, the multimedia apparatus, and target tracking apparatus thereof | |
CN103218059A (en) | Three-dimensional remote control device and positioning method thereof | |
CN102662404A (en) | Cloud platform control apparatus and cloud platform control method | |
WO2018070624A3 (en) | Mobile terminal and control method thereof | |
US20120092332A1 (en) | Input device, input control system, method of processing information, and program | |
US10978019B2 (en) | Head mounted display system switchable between a first-person perspective mode and a third-person perspective mode, related method and related non-transitory computer readable storage medium | |
US20130082923A1 (en) | Optical pointer control system and method therefor | |
US20160154478A1 (en) | Pointing apparatus, interface apparatus, and display apparatus | |
US20130038529A1 (en) | Control device and method for controlling screen | |
EP2887184A1 (en) | Air pointer with improved user experience | |
US9013404B2 (en) | Method and locating device for locating a pointing device | |
US20110298980A1 (en) | Resizing tv graphic elements and reorienting graphics plane for user position | |
US20130002549A1 (en) | Remote-control device and control system and method for controlling operation of screen | |
KR102248741B1 (en) | Display appaeatus and control method thereof | |
US20200327867A1 (en) | Head mounted display system capable of displaying a virtual scene and a map of a real environment in a picture-in-picture mode, related method and related non-transitory computer readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CYWEE GROUP LIMITED, VIRGIN ISLANDS, BRITISH Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HSIEH, CHING-LIN;LEE, CHIN-LUNG;LIOU, SHUN-NAN;AND OTHERS;REEL/FRAME:029574/0030 Effective date: 20130107 |
|
AS | Assignment |
Owner name: CYWEEMOTION HK LIMITED, HONG KONG Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CYWEE GROUP LIMITED;REEL/FRAME:037926/0156 Effective date: 20160301 |
|
AS | Assignment |
Owner name: CM HK LIMITED, HONG KONG Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CYWEEMOTION HK LIMITED;REEL/FRAME:041773/0175 Effective date: 20170329 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |