COMBINED POINTING DEVICE AND JOYSTICK
Field of the Invention
The invention relates to pointer devices for actuating a pointer on the
screen of a computer, which devices are also capable of controlling the
representation on the screen of an object or part of an object indicated by
the pointer or of controlling the way in which the object or the part
thereof is viewed on the screen. The pointer devices to which the
invention relates are therefore capable of carrying out functions that may
be carried out by mouse and joystick.
Background of the Invention
Pointer devices of various kinds are used for actuating a pointer or index,
that is generally in the form of an arrow, and is capable of assuming the
various forms in various stages of its operation, to indicate points on the
screen, whereby to identify objects or cause operations to be carried out
that are defined by the indicated points. The mouse is a typical pointer
device, but there are various different ones. Pointer devices can be
connected to the computer by means of cables, but also by means of
radiation, such as radio waves, infra-red or the type of transceiver known
as "Bluetooth". For the sake of clarity, the term "pointer" alone will be
used to designate the index that is seen on the computer screen, and the
expression "pointer device" to designate the device, such as a mouse, that
is actuated by the operator to shift the pointer to the desired location on
the screen.
Copending PCT Application No. PCT/IL99/00601 describes a novel
pointer device that can be used to select points on a surface and transmit
to the computer the coordinates of the selected points, so that these latter
may be represented by points on the computer screen.
Fig 1 schematically illustrates the determination of the 3-D coordinates of
a transmission point by receiving data transmitted from the transmission
point in three receivers, each of which is located at a different point in the
spatial domain. The three receivers Rl, R2 and R3 are located at three
points with known coordinates, (xl,yl,zl), (x2,y2,z2), and (x3,y3,z3),
respectively. The transmission point TO is located at a point (x0,y0,z0) in
the spatial domain, the coordinates of which should be calculated. The
time at which the data transmission from point TO is received at each
receiver, is converted into a distance information. Hence, the time
required for the transmitted data to pass the distances 101, 102 and 103,
from point TO to receivers Rl, R2 and R3, respectively, is used to calculate
the distances 101, 102 and 103 (knowing the propagation velocity of the
transmitted data).
After knowing the distances 101, 102 and 103, the required coordinates
(xO,yO,zO) of point TO can be simply calculated as follows:
The three points (xl,yl,zl), (x2,y2,z2), and (x3,y3,z3) define a plane which
contains a triangle formed between these three points (vertices of the
triangle). A triangular pyramid is formed by connecting point (x0,y0,z0)
with all three points (xl,yl,zl), (x2,y2,z2), and (x3,y3,z3) with straight
hnes 101, 102 and 103, respectively. The desired coordinate values of point
(x0,y0,z0) can be calculated from these distances using geometric
calculations. For example, a corresponding sphere can be drawn for each
receiver by determining the center of the sphere at the receiving point,
and the radius of the sphere as the distance from the receiving point to
the transmission point TO. In this example, each sphere may be
represented by a corresponding equation:
The intercept point of the three spheres represented by Eqs. 1 to 3 is
T0(x0,y0,z0). Therefore, the coordinates of point TO fulfill all three
equations. By arranging Eqs. 1 to 3 as a set and substituting the
coordinates x0,y0,z0:
x=xo
y=y
Z=ZQ
The set may be solved for the three required coordinate values, x0,y0,z0.
Figs. 2A to 2C schematically illustrate the calculation of the 3-D
coordinates of the tip of a pointing device having two aligned transmission
points located essentially along its longitudinal central axis. The tip
location is co-linear with these two transmission points. The coordinates
(Xc,Yc,Zc) of tip are calculates from the coordinate values (Xα,Yα,Zα) and
Kb,Yb,Zb) which are determined by a set of three receivers Rl to R3. The
distance between the two transmitters 12a and 12b is Lab and the distance
between transmitter 12b and the tip (point c) is Lbc. The transmitters 12a
and 12b and the tip are collinear, and normally coincide with the central
axis of the pointing device. The tilt angle α which is formed between the
central axis of the writing pointing device and the X-Z plane is first
determined. It is determined by Equation 4 hereinbelow and is illustrated
in Fig. 2B:
α= Sin 1 [(Za - Zb)/Lab] [Eq. 4]
By using the tilt angle α the height coordinate Zc of the tip, the length Lβ of
the projection of the distance Lab on the X-Y plane and the length LO of the
projection of the distance L6c on the X-Y plane are calculated as follows:
Zc = Zb - Lbcsin(α) [Eq. 5]
Lβ = Labcos(α) [Eq. 6]
Using the calculated angle β and the projection Lβ the coordinates Xc and
Yc of the tip, in the X-Y plane are calculated as follows and as shown in Fig.
2C:
β= Cos-1 [(Xa - Xb)/Lβ] [Eq. 8]
The value of β is also a function of the coordinate quadrant in which the
coordinates are located. Thus, the values of Yα and Y6 are needed to
determine the value of β. Finally, the Xc and Yc coordinates of the tip are
calculated using the angle β as follows:
Xc = Xύ-LoCos(β) [Eq. 9]
Yc = Yi-LoSin(β) [Eq. 10]
Both transmitters 12a and 12b determine a straight line and, any point
along that line can be calculated.
It is a purpose of this invention to provide a combined pointer -joy stick /
mouse device that can carry out the functions of a conventional pointer
device, e.g., a mouse, and those of a joystick.
It is another purpose of this invention to provide such a device which can
actuate a pointer of a computer screen and control the representation on
the screen of an object or part of an object indicated by said pointer.
It is a further purpose of this invention to provide such a device which
controls the representation on the screen of an object or part thereof by
causing and/or controlling the motion of said object or part thereof, e.g.,
by controlling the direction or the speed of said motion.
It is a further purpose of this invention to provide such a device that can
control the representation on the screen of an object, or part of an object,
indicated by the pointer, by controlling the parameters according to which
the object or part thereof is viewed on the screen.
It is a still further purpose of this invention to control the way in which
the object, or part thereof, is viewed on the screen, by controlling the
angle or viewpoint from which it is seen and represented.
It is a still further purpose of this invention to provide such a device that
achieves the purposes hereinbefore set forth, and has a robust and simple
structure, whereby it is inexpensive and safe in operation.
It is a still further purpose of this invention to provide a device which can
operate as a three-dimensional mouse.
Summary of the Invention
The pointer-joystick / mouse device according to the invention comprises:
a) an elongated pointer element having an axis and a tip;
b) means for determining and transmitting to a computer the coordinates
of two points lying on said axis, whereby to determine 1) the position
on a predetermined reference surface of the intersection of said axis
with said surface, and 2) the orientation of said axis with respect to a
reference plane;
c) a supporting body, which comprises:
1) a sliding element defining said reference plane;
2) means for supporting said pointer element, with its tip in fixed
position with respect to said sliding surface;
3) means for permitting and guiding the swinging motion of said
element about said tip as a pivot point; and
4) elastic means for constantly urging said pointer element to the
position in which the axis thereof has a predetermined reference
orientation.
The means for determining and transmitting to a computer the
coordinates of two points of the pointer element axis are described in the
aforesaid copending PCT application. As set forth thereof, the
determination of three coordinate XYZ of said two points also permit to
determine the distance of a point of the axis of the pointer element from a
reference surface.
In a preferred embodiment of the invention, the lowermost surface of the
aforesaid sliding element coincides with the reference plane. However,
said reference plane may be at a slant to or/and at a distance from said
sliding element lowermost surface.
The reference orientation of the pointer element axis is preferably an
orientation perpendicular to the reference plane and particularly to the
sliding element lowermost surface, when this latter coincides with said
reference plane.
Brief Description of the Drawings
The above and other characteristics and advantages of the invention will
be better understood through the following illustrative and non-limitative
detailed description of preferred embodiments thereof, with reference to
the appended drawings, wherein:
Fig 1 schematically illustrates the determination of the 3-D coordinates of
a transmission point by receiving data transmitted from the transmission
point in three receivers;
Figs. 2A to 2C schematically illustrate the calculation of the 3-D coordinates
of the tip of a pointing device having two ahgned transmission points
located essentially along its longitudinal central axis;
- Fig. 3 is a perspective view from above and from one side of a
pointer -joystick device according to an embodiment of the invention;
- Fig. 4 is a view similar to Fig. 3, but with the device partially exploded;
- Figs. 5A, 5B, 5C and 5D schematically show the device according to said
embodiment of the invention in various positions of the pointer element
which serves as a joystick;
- Fig. 6 schematically indicates, in perspective view, how the device
according to the aforesaid embodiment is operated;
- Fig. 7 is an axial cross-section of the device according to the aforesaid
embodiment of the invention;
- Fig. 8 schematically shows how the device is handled by the user,
according to a preferred embodiment of the invention;
- Fig. 9 illustrates a joystick, according to a preferred embodiment of the
invention;
Fig. 10A and 10B illustrates the additional movement axis, according to
the invention;
Fig. 11 schematically illustrates the contact points of a pointing device,
according to a preferred embodiment of the invention;
Fig. 12 schematically illustrates the contact points of the supporting body;
Fig. 13a and 13b schematically illustrate the pen pointing device as a
joystick or as a mouse, according to a preferred embodiment of the
invention;
Fig. 14 is an electronic circuit of the mechanism which enables to use the
pointing device as a mouse, according to a preferred embodiment of the
invention;
Fig. 15 schematically illustrates a track-ball mouse, according to a
preferred embodiment of the invention; and
Fig. 16 schematically illustrates a spherical pointing device, according to
a preferred embodiment of the invention.
Detailed Description of Preferred Embodiments
With reference firstly to Figs. 3 and 4, the pointer-joystick device 10,
according to an embodiment of the invention, comprises a body generally
indicated at 11 and a pointer element, which operates as a joystick,
indicated at 12. Pointer element 12 is attached to an arc-shaped strip 13,
on which an actuating key or button 14 is provided. Sleeve 13 is
supported and slides on an arc support 15, better seen in Fig. 3, which is
fixed to another component of the body of the device, as will be explained
hereinafter, and which has an arc-shaped sht 16 through which the
pointer element 12 passes in its swinging motion and a sht 17 for the
passage of the connections of arc shaped strip 13 and the actuating button
14 with the electronic components of the device, which they are such as
described in the aforesaid copending PCT patent application.
The inner structure of the pointer -joystick device, according to the
illustrated embodiment, is best seen in Fig. 7. The bottom of the device is
formed by a plate 20, the lowermost surface thereof indicated at 21
constituting a sliding surface that coincides with the aforesaid reference
plane relatively to which the orientation of the pointer element 12 is
defined. Bottom plate 20 is rigidly connected to a portion 22 that is
substantially shaped as an approximately semi-spherical plate having a
central opening 23, through which the pointer element 12 passes and in
which it swings. The arc support 15 is fixed, e.g. by two screws 27, to said
the semi-spherical plate 22. Two wing plates 24, shaped to conform with
the semi-spherical plate 22, are juxtaposed to this latter as better seen in
Fig. 4, and are separated by a gap 25, through which the pointer element
12 passes. Said wing plates 24 rest on and are connected to bottom plate
20, which projects outwardly of the substantially semi-spherical plate 22.
Moreover, said wing plates 24 are used as edge-limit to arc support 15.
The wing plates 24 may be replaced by two recesses.
Pointer element 12 is fixed on a support 30, which comprises a sleeve-like
portion 31, in which the terminal cylindrical portion of element 12 is
housed and to which it is fixed, and a substantially semi-spherical portion
32, fixed to said sleeve 31. The semi-spherical portion 32 is juxtaposed
and can slide over two support bases 33, which are shaped as parts of a
semi-sphere and are separated by a gap 34, through which a tapering
bottom portion 35 of element 12 passes. Element 12 has a tip indicated at
36 which is preferably placed at the center of the uppermost surface of
plate 20 and defines the point 36 at which the axis of pointer element 12
intersects said uppermost surface, and therefore is separated only by the
thickness of said bottom plate from the point of intersection of the axis of
pointer element 12 with the lowermost surface 21 and therefore with the
surface on which the device 10 is placed when in use. In defining the
position of the pointer-joystick device of this embodiment and the
orientation of the pointer element 12 with respect to the surface 21, the
software of the computer will take into consideration the thickness of the
bottom plate and compensate for it.
Fig. 6 schematically shows how the device is handled by the user,
according to a preferred embodiment of the invention. The user lays his
hand on top of the device and moves it as indicated by the arrows of Fig.
6, in any desired direction. Concurrently, he keeps a finger, preferably the
thumb, on actuating key or button 14 to depress it in order to cause any
desired operation to be carried out by the computer where indicated by
the pointer on the screen, as is normally done with pointer devices such
as a mouse.
Fig. 5 A schematically illustrates the operation of the device as a joystick.
It is seen that the pointer 12 has two extreme orientations on the two
sides of the reference position of the axis, as indicated at 12' and 12". Figs.
5B, 5C and 5D schematically illustrate in perspective view the three
aforesaid positions of the pointer element 12.
When the pointer -joystick device is in operation, it can be displaced over a
surface, generally a flat surface that coincides with the surface 21 when
the device has the structure indicated in this embodiment. The pointer on
the computer screen constantly indicates the position of the point of
intersection of the axis of element 12 with the supporting surface. The
control of the pointer is as described in the aforesaid PCT application.
Once the device has reached the position in which the pointer on the
screen is in the desired position, the pointer element 12 can be swung
from its reference orientation, that is usually perpendicular to the
reference surface in the embodiment herein described, to any desired
orientation right or left of the said reference position. This angular
displacement is used to control the representation on the screen of the
point or region or part of region on which the pointer on the screen is
presently located. If it is desired to move the object identified by the
pointer, the speed of the motion can be determined by the angle by which
the element 12 is swung with respect to its reference orientation, as seen
in fig. 8, and the direction of motion will depend on whether the element
12 is swung one way or the other.
If, on the other hand, the action that it is desired to cause in the region
indicated by the pointer on the screen is a change in the way in which the
object that is represented therein is seen, e.g., the object is to be
represented as seen at a desired slant, the representation on the screen is
angularly swung in an angular velocity as a function of the angle by
which the element 12 is swung.
Fig. 9 illustrates a joystick, according to a preferred embodiment of the
invention. The implementation comprises a handle 41, such as a joystick,
which is screwed or set into sleeve 31. The handle 41 is hollow, such that
the pointing device 12 can be installed in the supporting body 42 through
the hollow handle 41. Handle 41 can be replaced by another handle,
according to the usage. For instance, a joystick which is used for a flight
simulator may differ from a joystick which is used for computer ball
games. Therefore, the handle 41 should be detachable.
The joystick handle may comprise buttons, as in the prior art.
Fig. 10A and 10B illustrate the additional rotation axis, according to the
invention. The additional axis 64 is perpendicular to the basis of the
device. The movement around this axis is the angle 65. The same benefits
are valid for the usage as a mouse. When the present invention is used as
a mouse, the pointing device may be much shorter than when it is used as
a joystick. Additional axes are 62 and 63.
When the pointing device is screwed or fixed into the supporting body 42,
the power of the supporting body 42 may be used for recharging.
When using the pointing device as a mouse, the system must take in
consideration the equation of the plane upon which the pointing device is
moving on. The plane equation may be calculated according to the points
upon which the pointing device was pointing at. The points were are
collected while moving the pointing device.
Using the pointing device as a mouse requires an additional process of
calibration. In this process the user defines the following:
- A point (x,y,z) in the room's space which is related to the a point of the
screen, such as the left-top corner.
- The range in the plane which is used as mouse pad which is related to
the screen's range.
Fig. 11 schematically illustrates the contact points of pointing device 12,
according to a preferred embodiment of the invention. The mechanism
comprises the rings 43A to 43F, which are made of conductive material,
and the switch 44. When the pointing device is fixed into the supporting
device 42, following events happen:
A contact is carried out between the rings 43 of the pointing device 12 and
the supporting device 42. With this contact, the pointing device receives
power from the supporting device 42.
Switch 44, which resides on the pointing device 12, is turned on. This
switch disconnects the pointing device 12 from its internal power supply,
and connects it to the external power supply and external contacts as
seen in Fig. 14, from the supporting body 42.
For example, rings 43G and 43H are connected to the power supply of the
pointing device 12; rings 43A and 43B are connected to the left button of
the pointing device 12; and rings 43C, 43D, 43E and 43F are connected to
the right button of pointing device 12, respectively to the electronic
scheme described in Fig. 14. Then:
- A contact is carried out between rings 43G , 43H and the power supply
of the pointing device 12.
- A contact is carried out between rings 43A, 43B and button 14 is
which is used as a left button.
- A contact is carried out between rings 43C, 43D, 43E, 43F and button
14 is which is used as a right button.
- A contact can be carried out between contact points 46 and 47, and
hence the pointing device can be used as a joystick.
Fig. 12 schematically illustrates the contact points of the supporting body
42. The contact points reside on sleeve 31.
Fig. 13a and 13b schematically illustrate the pen pointing device
functions as a joystick or as a mouse, according to a preferred
embodiment of the invention.
There are several ways to indicate if the system is being used by the user
as a joystick or as a mouse:
By analyzing the position of the pointing device 12. If the pointing device
12 is perpendicular to a reference plane, then the system operates as a
mouse (Fig. 13a), otherwise as a joystick (Fig. 13b).
By adding contact points 46 to the mobile element 30 of the support and
contact points 47 to the mobile element 33 of the support. A contact
between contact points 46 and 47 causes the upper and lower
transmitters to transmit, and then the system calculates the angle
between the pointing device and the reference plane. If the pointing
device is perpendicular to the reference plane, then the system is
considered to operate as a mouse, otherwise the system is considered to
operate as a joystick. Contact points 46 and 47 may be rings.
Fig. 14 is an electronic circuit of the mechanism which enables to use the
pointing device as a mouse, according to a preferred embodiment of the
invention.
Power supply 51 is an alternative power supply that resides in the system
and replaces the power supply of the pointing device;
A right chck turns on switch 52, and hence the lower transmitter stops
transmitting. The upper transmitter is transmitting;
A left click turns on switch 53, and hence the upper transmitter
transmitting; The lower transmitter continues is transmitting;
Setting the pen inside the supporting body 11 turns off switch 54, and
hence the power internal supply from the pointing device is cut off;
A chck on the left button or on the right button is performed by a "blink"
transmission of one of the transmitters. For instance, clicking the left
button causes the upper transmitter to "blink" while the lower
transmitter continues to transmit, and clicking the right button causes
the upper transmitter to "blink" and the lower transmitter to stop
transmitting. A "blink" transmission may be a transmission that is not
performed sequentially, but with short pauses.
Fig. 15 schematically illustrates a track -ball mouse, according to a
preferred embodiment of the invention. Instead of the pen-like pointing
device, Fig. 15 represents a pointing device 12 which is spherical. The
spherical pointing device 12 comprises two transmitters, 57 and 58. The
concave socket 59 is used as a gripping means for rotating the sphere 12.
The size of the socket 59 is usually scaled according to the size of a human
finger. The sphere is tracked usually by urging slot 59. It also comprises
the batteries 51, the battery housing 52, the buttons 53 (the same
function as mouse buttons), the springs 54 for centering the sphere 12
such a way that the transmitters 57 and 58 will be perpendicular, and a
switch 50. Springs 54 are connected to a bulge 61 which is a part of the
spherical pointing device 12 and to the supporting body 42. When the ball
12 is fixed into its place, switch 50 is turned on, and hence the upper
transmitter stops to transmit its position. Switch 50 may be implemented
in variety of ways, such that a click operation and double click operation
will be effective. This way the click and the double chck may be used as
additional input devices or as a substitute for the left and right buttons.
Moreover, by pressing the ball down and tracking it, we can gain a
dragging function.
According to another preferred embodiment of the invention, there is a
single transmitter, but it transmits the position of the two points 58 and
59.
Such a track ball has all the benefits of the track-ball known in the art,
and additionally the aforementioned benefits.
The operation of said joystick, mouse and track-ball is not based on optics
in any sense. Its operation principal is based on the detection of the
location of the two transmitters, and calculations, as aforementioned.
Fig. 16 schematically illustrates a spherical pointing device, according to
a preferred embodiment of the invention. The pointing device does not
comprise any supporting body, as in previous examples.
The transmitting points 57 and 58 reside on the symmetric axis 71. In
order to return the pointing device to its default position, which is
perpendicular to the ground, the sphere comprises a region 72 with higher
mass density. This way the center of mass is shifted from the center, and
hence the sphere gets a default position, which is perpendicular to the ground.
Such a pointing device may comprise also a recess or a salient on the
surface 73, by which the user may feel the top of the sphere, and two
buttons 53, in similarity to a mouse. According to another embodiment of
the invention, one of the buttons is replaced by a switch, so that when
pressing the spherical pointing device down, a "chck" is carried out.
According to another embodiment of the invention, one of the buttons is
replaced by a switch which is placed in the recess (or salient) 73.
Table 1 describes an operation scheme, according to a preferred
embodiment of the invention. Those who skilled in the art will appreciate
that other operation schemes may be implemented.
Table 1
While embodiments of the invention have been described by way of
illustration, it will be apparent that variations, modifications and
adaptations can be made, without departing from the spirit of the
invention or exceeding the scope of the claims.