WO1998050839A2 - System for data management based on hand gestures - Google Patents

System for data management based on hand gestures Download PDF

Info

Publication number
WO1998050839A2
WO1998050839A2 PCT/US1998/008450 US9808450W WO9850839A2 WO 1998050839 A2 WO1998050839 A2 WO 1998050839A2 US 9808450 W US9808450 W US 9808450W WO 9850839 A2 WO9850839 A2 WO 9850839A2
Authority
WO
WIPO (PCT)
Prior art keywords
sensor
flexure
hand
wearer
sensors
Prior art date
Application number
PCT/US1998/008450
Other languages
French (fr)
Other versions
WO1998050839A3 (en
Original Assignee
Modern Cartoons, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Modern Cartoons, Ltd. filed Critical Modern Cartoons, Ltd.
Publication of WO1998050839A2 publication Critical patent/WO1998050839A2/en
Publication of WO1998050839A3 publication Critical patent/WO1998050839A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B7/00Measuring arrangements characterised by the use of electric or magnetic techniques
    • G01B7/16Measuring arrangements characterised by the use of electric or magnetic techniques for measuring the deformation in a solid, e.g. by resistance strain gauge
    • G01B7/18Measuring arrangements characterised by the use of electric or magnetic techniques for measuring the deformation in a solid, e.g. by resistance strain gauge using change in resistance
    • G01B7/20Measuring arrangements characterised by the use of electric or magnetic techniques for measuring the deformation in a solid, e.g. by resistance strain gauge using change in resistance formed by printed-circuit technique
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B7/00Measuring arrangements characterised by the use of electric or magnetic techniques
    • G01B7/28Measuring arrangements characterised by the use of electric or magnetic techniques for measuring contours or curvatures
    • G01B7/287Measuring arrangements characterised by the use of electric or magnetic techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers

Definitions

  • the present invention relates generally to data
  • Virtual reality systems are computer based systems
  • the system also includes a data entry
  • manipulator device such as a pointing device or a specially configured data glove containing sensors and
  • actuators for interacting with objects in the virtual
  • buttons on either the mouse or keyboard are buttons on either the mouse or keyboard.
  • One increasingly prevalent data entry device comprises
  • the data glove is provided to enable the
  • the apparatus is an operator's hand or other body part.
  • the hand includes a glove worn on the hand which includes sensors for detecting the gestures of the hand.
  • computer system includes circuitry connected to receive
  • gesture signals and hand position signals for
  • control signals are generating control signals.
  • the control signals are
  • sensors are placed over the joints of a hand, with each
  • the fiber is treated so that transmission loss of light
  • a flexible tube is
  • a patient places his or
  • the computer then generates rehabilitation control
  • the Lee system includes a plurality of finger
  • the sensors may generate
  • a disadvantage is that it is not possible for a
  • animation in real time that includes a data management device which manages data based on the hand gestures of
  • present invention operated in real time and includes a
  • the invented data management device comprises a data
  • the data is used to manipulate objects
  • control signals output from the glove is transmitted to
  • the data is
  • present invention is made from an elastic material that
  • the elastic material is preferably breathable for
  • the glove is configured with an aperture that extends
  • a movement sensing unit senses any movements of
  • the sensing unit is retained in the
  • the sensing unit comprises a flexible
  • circuit board configured to extend along the dorsal
  • the base region is provided with
  • the movement sensors include a plurality of
  • Each of the sensors transmits signals to the
  • each of the sensors has a resistive material
  • a negative voltage is
  • the conductors are preferably a balanced copper
  • FIG. 1 is a plan view of a preferred embodiment of
  • FIG. 2 is a side elevational, cross-sectional view
  • FIG. 3 is a plan view of a flexible circuit board
  • FIG. 4 is a plan view of the flexible circuit
  • FIG. 5 is a cross-sectional view showing of the
  • the preferred embodiment includes a data glove 10
  • the data is continuously processed so that an
  • the computer 10 is manipulated in real time while the
  • elastic material is preferably breathable which is
  • the glove portion 12 is
  • portion 12 include spandex and super-spandex.
  • unit 30 is provided for sensing any movements of the
  • the sensing unit 30 comprises a flexible
  • circuit board 32 that is configured to extend along the
  • the circuit board 32 includes a base
  • the base region 34 is provided with signal
  • processing means 38 for processing received signals
  • the processing means 38 are configured to generate the generated by the sensors 36.
  • the processing means 38 are configured to generate the generated by the sensors 36.
  • semiconductor devices such as multiplexers and
  • demultiplexers for processing the signals generated by
  • the movement sensors 36 include a plurality of
  • sensor 36 is provided for sensing movement in each of
  • a first sensor 36A is
  • a fifth sensor 36E is provided to sense the thumb 28.
  • a thumb extension sensor 36G provided for sensing a web
  • a further sensor 36H referred to as a
  • thumb roll sensor may be provided for sensing movement
  • the flexible circuit board Referring to FIGS. 3-5, the flexible circuit board
  • sensor conductors 46 comprise an innermost lamina of
  • the sensor conductors 46 extend
  • processing means 38 for transmitting signals generated
  • the conductors 46 are preferably
  • embodiments comprise a ductile material, preferably
  • the sensor conductors 46 are interposed between a
  • lamina 48 preferably comprises a suitable flexible
  • insulating material such as kapton for example, for
  • a suitable adhesive 50 such as a pliant epoxy
  • each insulating lamina 48 is approximately
  • the base region 34 is formed on the lamina 46, 48
  • conductors 52 are located adjacent to the insulating lamina 48 of the sensors 36 and comprise 1/2 ounce
  • An outermost insulating lamina 54 is provided over
  • kapton a suitable flexible material
  • pliant adhesive 50 such as epoxy is disposed between
  • each lamina 52, 54 comprising the base region 34 for
  • Each side of the thumb sensor 36E is provided with
  • the extension and flexion sensor 36F is
  • the resistive material 56 preferably comprises a
  • Each side 58, 60 of the sensors 36 are provided
  • resistive material 56 of substantially identical
  • resistive material 56 disposed on each side 58, 60 of
  • the sensor 36 will have a similar initial resistance value. While, the initial resistance value of the
  • material 56 on each side of the sensors 36 may comprise
  • any flexure of the sensor 36 causes the
  • the resistive material 56 provides a means for
  • resistance value of the material 56 need only diverge
  • processing means 38 is additionally
  • conductors 46 to establish a reference voltage.
  • a negative voltage such as -5 V may be
  • the adduction side 60 for establishing a voltage differential, of approximately 10 V, between the two
  • the senor 36 is maintained at a
  • abduction and adduction sides 58, 60 such as by the
  • sensors 36 provides a facile means for measuring the
  • sensors 36 of the data glove 10 continuously generate data representative of the actual positions
  • processing means 38 to transmit data representative of
  • the system includes a data glove for
  • data glove includes a movement sensing unit that
  • the sensors includes a plurality of movement sensors.
  • the sensors include a plurality of movement sensors.
  • the sensors have a
  • a reference voltage is applied to each side of the

Abstract

A system is provided for manipulating computer generated animation in real time, such as a virtual reality program running on a computer. The system includes a data gloves (12) for managing data based on an operator's hand gestures. The data gloves comprises an elastic material that closely matches the shape of a wearer's hand (14), enabling the wearer to move their hand freely. A movement sensing unit (30) is provided for sensing any hand gestures of the wearer. The movement sensing unit comprises a flexible circuit board (32) that extends along the dorsal region (24) of the wearer's fingers and hand. A signal processor (38) receives signals generated by a plurality of movement sensors (36) and determines movements of the wearer's hand. The sensors have a resistive material disposed on each side thereof, so that any flexure of the sensor causes the resistance values to diverge. The resistance values on each side of the sensor diverge to a value corresponding to the degree of flexure of the sensor.

Description

SYSTEM FOR DATA MANAGEMENT BASED ON HAND GESTURES
FIELD OF THE INVENTION
The present invention relates generally to data
entry and manipulation devices for computers, and more
particularly, to a data management system for a
computer that manages data based on the hand gestures
of an operator.
BACKGROUND OF THE INVENTION
Virtual reality systems are computer based systems
that provide the experience of acting in a simulated
environment that forms a three dimensional virtual
world. These systems are used in several different
applications such as commercial flight simulators and
entertainment systems including computer games and
video arcade games. In virtual reality systems a
participant typically wears a head-mounted device that
enables viewing of a virtual reality world generated by
the computer. The system also includes a data entry
and manipulation device, such as a pointing device or a specially configured data glove containing sensors and
actuators, for interacting with objects in the virtual
world. In somewhat sophisticated systems, a full body
suit, also containing sensors and actuators,
additionally may be provided so that the user can
influence and has a realistic feel of objects in the
virtual world.
Data entry and manipulation devices for computers,
including virtual reality systems, include keyboards,
digitizers, computer mice, joysticks, and light pens.
One function of these devices, and particularly
computer mice and light pens, is to position a cursor
on a display screen of a monitor connected to the
computer and cause the computer to perform a set of
operations, such as invoking a program, which
operations are indicated by the location of the cursor
on the screen. Once the cursor is at the desired
location, buttons on either the mouse or keyboard are
depressed to perform the instruction set. However,
over time this may become somewhat tedious, since the
user must transfer one of their hands from the keyboard
to the mouse, move the mouse cursor to the desired location on the screen, then either actuate a button on
the mouse, or transfer their hand back to the keyboard
and depress buttons to invoke the program.
Alternative means for data entry and manipulation
into computers have been provided in the prior art .
One increasingly prevalent data entry device comprises
a data entry and data manipulation glove, commonly
known as "data gloves" and "virtual reality gloves".
Data gloves are currently used in several virtual
reality related applications ranging from virtual
reality entertainment and education systems to medical
rehabilitation applications. In a virtual reality
system, the data glove is provided to enable the
operator to touch and feel objects on a virtual screen
and to manipulate the objects.
U.S. Patent No. 4,988,981, to Zimmerman et al
discloses an apparatus and method for generating
control signals for manipulating virtual objects in a
computer system according to gestures and positions of
an operator's hand or other body part. The apparatus
includes a glove worn on the hand which includes sensors for detecting the gestures of the hand. The
computer system includes circuitry connected to receive
gesture signals and hand position signals for
generating control signals. The control signals are
used to manipulate a graphical representation of the
operator's hand which is displayed on a monitor coupled
to the computer system. The graphical representations
of the operator's hand manipulates virtual objects or
tools also displayed by the computer.
U.S. Patent No. 5,097,252, to Harvill et al . ,
discloses a motion sensor which produces an
asymmetrical signal in response to symmetrical
movement. In a first embodiment, a plurality of motion
sensors are placed over the joints of a hand, with each
sensor comprising an optical fiber disposed between a
light source and a light sensor. An upper portion of
the fiber is treated so that transmission loss of light
being communicated through the optical fiber is
increased only when the fiber bends in one direction.
In another Harvill embodiment, a flexible tube is
disposed in close proximity to a finger joint and bends
in response to bending of the finger. A light source and light sensor on opposite ends of the tube
continuously indicate the extent that the tube is bent.
U.S. Patent No. 5,429,140, to Burdea et al . , is
directed to an integrated virtual reality
rehabilitation system that employs a force feedback
system, such as a force feedback glove to simulate
virtual deformable objects. A patient places his or
her hand in a sensing glove that measures the force
exerted by the patient. Information from the sensing
glove is received by an interface and transmitted to a
computer where the information can be used to diagnose
the patient's manual capability.
The computer then generates rehabilitation control
signals for the force feedback glove. The patient
places his or her hand in the force feedback glove and
attempts to bring the digits together as though
grasping the virtual object. The force feedback glove
resists the squeezing movement of the digits in a
manner that simulates the tactile feel of the virtual
object. The force exerted by the fingers of the
patient is fed back to the computer control system, where it can be recorded or used to modify
rehabilitation control signals.
U.S. Patent No. 5,612,689, to Lee Jr., discloses a
finger articulation controlled information generating
system. The Lee system includes a plurality of finger
articulation units that individually mount on finger
and thumb nails and together, by selected up and down
movement of the finger and thumbs, serve as an
alternate to a keyboard or other computer interface.
Vertical up and down movements of any single one of the
ten fingers and various combinations of the fingers is
translated into a range of signals recognizable as
alpha-numeric numbers, digital signaling, word and
picture forms, or other symbol forms a user may choose.
However, a disadvantage common to the above noted
data gloves is that the gloves are substantially
difficult and expensive to manufacture. Difficultly of
manufacture is due to the plurality of discrete
movement monitoring devices provided with the glove for
sensing the hand gestures of the wearer. These devices
include light emitting sources and appropriate sensing devices. Complex circuitry is needed for the light
emitters and coupled sensors and to generate movement
indicating control signals.
A further disadvantage of these data gloves is
that the movement monitoring devices have to poor
longevity and are prone to reliability problems.
Another disadvantage of these movement monitoring
devices is that they may not sufficiently track the
hand gestures of the wearer. The sensors may generate
signals that are not an accurate representation of the
wearer's hand gestures causing erroneous data to be
generated. Furthermore, the plurality of sensors
located about on the periphery of the gloves, and
particularly on the wearer's joints, may substantially
inhibit the wearer from moving their hand freely.
Computer generated animation is programmed within
the computer to form a cartoon or other animation prior
to the animation being run for display. This is
similar to a draftsman drawing cells in a cartoon
strip. A disadvantage is that it is not possible for a
person to have interaction with the computer animation while the animation is being developed or displayed.
It would be advantageous to provide a system for
interacting with computer animation in "real time";
i.e., wherein a person can interact with the animation
while the animation is running.
Thus, there exists a need for a system for
manipulating computer generated animation in real time
that includes a data management device for a computer
which manages data based on hand gestures of an
operator.
OBJECTS OF THE INVENTION
It is therefore an object of the present invention
to provide a system for manipulating computer generated
animation in real time;
It is another object of the present invention to
provide a system for manipulating computer generated
animation in real time that includes a data management
device which manages data based on the hand gestures of
an operator; It is a further object of the present invention to
provide a system for manipulating computer generated
animation in real time that includes a data management
device which manages data based on the hand gestures of
an operator that provides ease of manufacture thereof;
It is still another object of the present
invention to provide a system for manipulating computer
generated animation in real time which includes a data
management device that manages data based on the hand
gestures of an operator that accurately tracks the
movements of the operator's hand;
It is yet a further object of the present
invention to provide a system for manipulating computer
generated animation in real time which includes a data
management device that manages data based on the hand
gestures of an operator that does not prevent the
operator from moving there hand freely about ; and
It is another object of the present invention to
provide a system for manipulating computer generated
animation in real time that includes a data management device which manages data based on the hand gestures of
an operator that can be used repeatedly without causing
harm thereto .
SUMMARY OF THE INVENTION
These and other objects and advantages of the
present invention are achieved by providing a system
for manipulating computer generated animation, such as
a virtual reality program running on a computer. The
present invention operated in real time and includes a
data management device which manages data based on an
operator's hand gestures. The preferred embodiment of
the invented data management device comprises a data
glove that provides data entry into a computer and data
manipulation. The data is used to manipulate objects
in the virtual reality program based upon the
operator's hand gestures and positioning.
The preferred embodiment of the present invention
includes a glove worn on a wearer's hand, a computer
for processing data control signals output from the
glove, and a data cable coupling the glove to the computer for data transfer. Data generated from the
control signals output from the glove is transmitted to
the computer for processing in real time. The data is
continuously processed so that an object in the virtual
environment displayed on the computer (such as the
hands of a cartoon figure or other desired object) can
be manipulated in real time while the program is
running.
The glove of the preferred embodiment of the
present invention is made from an elastic material that
closely matches the shape of a wearer's hand while
still enabling the wearer to move their hand freely.
The elastic material is preferably breathable for
providing a glove that is comfortable for the wearer.
The glove is configured with an aperture that extends
over a dorsal region of the wearer's hand and along the
dorsal region of each of their fingers.
A movement sensing unit senses any movements of
the wearer's hand. The sensing unit is retained in the
aperture of the data glove. Securing the sensing unit
within the aperture prevents the unit from contacting the wearer and from being positioned externally on the
glove, which can substantially limit the wearer's
freedom of movement and may expose the unit to damage.
In the preferred embodiment of the present
invention, the sensing unit comprises a flexible
circuit board configured to extend along the dorsal
region of the wearer's fingers and hand. The circuit
board includes a base region and a plurality of
movement sensors. The base region is provided with
signal processing means for processing signals
generated by the movement sensors. The processing
means multiplexes the signals and then transmits the
multiplexed signals to the computer via the data cable.
The movement sensors include a plurality of
elongated portions of the flexible circuit board that
extend outwardly from the base region. In the
preferred embodiment of the present invention, a sensor
is provided for sensing movement in each of the
wearer's fingers and thumb. Additional sensors are
also provided for sensing the web areas between the
wearer's index and middle fingers, and the thumb and index finger. In the preferred embodiment, an even
further sensor is provided for sensing the dorsal
region of the wearer's hand between the index finger
and thumb .
Each of the sensors transmits signals to the
processing means so that each of the regions are
simultaneously monitored for determining any movement
of the wearer's hand. Any movement of the wearer's
hand is then transmitted to the computer in real time
for manipulating a program running on the computer.
In the preferred embodiment of the present
invention, each of the sensors has a resistive material
disposed on each side, with each side of the sensor
having a similar initial resistance value. Any flexure
of the sensor causes the resistance values thereof to
diverge in a linear manner. When the resistance value
on one side of the circuit board/sensor decreases, the
resistance level on the other side simultaneously
increases. The resistance values on each side of the
sensor diverge to a value corresponding to the degree
of flexure of the sensor. In the preferred embodiment of the present
invention, a different voltage level is applied to each
side of a sensor to establish a voltage differential
between the two sides and an initial voltage potential
on the sensor. Preferably, a negative voltage is
applied to one side of the sensor and a corresponding
positive voltage is applied to the other side of the
sensor. Any flexure of the sensor causes the
resistance value on each side thereof to change. The
change in resistance corresponds to a change in the
initial voltage potential on the sensor to another
voltage level (i.e., the voltage potential going more
positive or more negative) to indicate that the sensor
has been flexed and the degree of flexure.
For example, when a wearer bends their fingers and
thumb, the circuit board is flexed. The resistance
value on one side of the board decreases to a value
determined by the degree of flexure of the board, while
the resistance level on the other side simultaneously
increases to a value also determined by the degree of
flexure. The resistance values of the two sides change
linearly, and causes the initial voltage potential of the sensor to change to a voltage potential
representative of the resistance values.
Thus, varying the voltage potential of each of the
sensors provides a facile system for measuring the
extent that the sensors are flexed and determining the
various positions of each of the sensors. Further, if
the degree of flexure of any one of the sensors is
maintained, the resistance values remain constant. The
voltage differential also remains constant and
indicates that the position of the sensor is being
maintained.
The movement sensors of the data glove of the
preferred embodiment continuously generate data
representative of the actual positions and gestures of
the wearer's hand. This allows the processing means to
transmit data representative of the wearer's hand
gestures to the computer.
Further, the data glove of the preferred
embodiment of the present invention is provided with
flexible conductors extending through the circuit board from the movement sensors to the processing means for
transmitting signals therebetween. The conductors used
by the preferred embodiment are well suited for
repeated bending and enhance the longevity of the data
glove. The conductors are preferably a balanced copper
having a selected thickness that enable the conductors
to be repeatedly flexed without causing excessive
strain.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other features, organizations,
advantages and objects of this invention will be fully
understood from the following detailed description and
the accompanying drawings . Each of the drawings
contained herein are not considered to be accurate
depictions of the embodiments of the invention, but are
provided for illustrative purposes only and are to be
interpreted in conjunction with the attached
specification.
FIG. 1 is a plan view of a preferred embodiment of
a data management device for manipulating objects in a computer generated animation in real time, shown
partiality in cross-section;
FIG. 2 is a side elevational, cross-sectional view
of the preferred embodiment of the invented data
management device;
FIG. 3 is a plan view of a flexible circuit board
of the preferred embodiment;
FIG. 4 is a plan view of the flexible circuit
board of the preferred embodiment showing locations of
sensor electrodes thereon; and
FIG. 5 is a cross-sectional view showing of the
flexible circuit board of the preferred embodiment .
DETAILED DESCRIPTION OF THE INVENTION
The following description is provided to enable
any person skilled in the art to make and use the
invention and sets forth the best modes presently
contemplated by the inventors of carrying out their invention. Various modifications, however, will remain
readily apparent to those skilled in the art, since the
generic principles of the present invention have been
defined herein.
Referring now to FIG. 1 and FIG. 2 of the
drawings, there is shown, generally at 10, a preferred
embodiment of a system for manipulating a computer
generated animation in real time which is constructed
according to the principles of the present invention.
The preferred embodiment includes a data glove 10
having a glove portion 12 configured to be worn on a
wearer's hand 14, a computer 16 for processing data
control signals generated by the data glove 10, and a
data cable 18 coupling the data glove 10 to the
computer 16 for data transfer therebetween. Data
generated from the processed control signals is
transmitted to the computer 16 for processing in real
time. The data is continuously processed so that an
object in a virtual reality program, or other
appropriate program or application which is running on
the computer 10 is manipulated in real time while the
program is running. The glove portion 12 of the data glove 10 of the
preferred embodiment of the present invention is
constructed from an elastic material closely matching
the shape of the wearer's hand 14, while enabling the
wearer to move their hand 14 freely. Additionally, the
elastic material is preferably breathable which is
comfortable for the wearer. The glove portion 12 is
configured with an aperture 20 that extends over a
dorsal region 22 of the wearer's hand 14 and along a
dorsal region 24 of each of their fingers 26 and thumb
28. Suitable textiles for fabricating the glove
portion 12 include spandex and super-spandex.
Referring now to FIGS. 1-4, a movement sensing
unit 30 is provided for sensing any movements of the
wearer's hand 14, such as any movement of the fingers
26, thumb 28, or hand 14 itself. The sensing unit 30
is preferably retained in the aperture 20 of the glove
12, for sensing any hand gestures of the wearer.
Securing the sensing unit 30 within the aperture 20
prevents the unit 30 from contacting the hand 14 and
from being positioned externally on the data glove 10 which can substantially limit the wearer's freedom of
movement and may expose the unit 30 to damage.
In the preferred embodiment of the present
invention 10, the sensing unit 30 comprises a flexible
circuit board 32 that is configured to extend along the
dorsal region 24 of the wearer's fingers 26, thumb 28
and hand 14. The circuit board 32 includes a base
region 34 and a plurality of movement sensor electrodes
36. The base region 34 is provided with signal
processing means 38 for processing received signals
generated by the sensors 36. The processing means 38
may comprise commercially available integrated circuit
semiconductor devices such as multiplexers and
demultiplexers for processing the signals generated by
the sensors 36, and generating data indicative of the
movements of the sensors 36; i.e., the hand gestures of
the wearer. Once the signals are processed, the data
is transmitted to the computer 16 via the data cable 18
for manipulating the program running on the computer
16. The movement sensors 36 include a plurality of
elongated portions of the flexible circuit board 32
that extend outwardly from the base region 34. In the
preferred embodiment of the present invention 10, a
sensor 36 is provided for sensing movement in each of
the wearer's fingers 26 and thumb 28, with additional
sensors provided for sensing additional regions of the
wearer's hand 14. Preferably, a first sensor 36A is
provided to sense movements of the little finger 26A, a
second sensor 36B senses the ring finger 26B, a third
sensor 36C senses the middle finger 26C, a fourth
sensor 36D senses movement of the index finger 26D, and
a fifth sensor 36E is provided to sense the thumb 28.
Additionally, an extension and flexion sensor 36F
may be provided for sensing movement in a web area 40
between the index finger 26D and middle finger 26C, and
a thumb extension sensor 36G provided for sensing a web
area 42 between the wearer's index finger 26D and thumb
28. If desired, a further sensor 36H, referred to as a
thumb roll sensor, may be provided for sensing movement
of a dorsal region 44 of the hand 14 that extends generally between the base of the index finger 26D to
the base of the thumb 28.
Each of the fingers 26, thumb 28, and hand regions
40, 42, 44 are simultaneously monitored for determining
any movement of the wearer's hand 14. Any movement of
the fingers 26, thumb 28, or hand 14, causes some
degree of flexure of one or more of the sensors 36,
causing the appropriate sensors 36 to transmit signals
to the processing means 38 for transmitting
representative data to the computer 16. Thus, any
movement of the hand 14, indicating hand gestures
thereby, is transmitted to the computer 16 in real time
for manipulating a program running on the computer 16
such as manipulating an object in a virtual reality
program running on the computer.
Referring to FIGS. 3-5, the flexible circuit board
32 comprising the sensing unit 30 is constructed in a
known laminar configuration. Preferably, electronic
sensor conductors 46 comprise an innermost lamina of
the circuit board 32. The sensor conductors 46 extend
from a distal end 47 of each of the sensors 36 to the base region 34 and couple the sensors 36 to the
processing means 38 for transmitting signals generated
by flexure thereof. The conductors 46 are preferably
centered along the length of each of the sensors 36 for
balancing the conductor 46. Balancing the conductor 46
along the length of the sensors 36 substantially
increases the number of flexures that the conductors 46
can endure without causing harm thereto.
Additionally, the conductors 46 of the preferred
embodiment comprise a ductile material, preferably
copper, that may be flexed repeatedly without damaging
the conductor 46. The copper conductors 46 extending
along the sensors 36 preferably comprise one ounce
copper wherein there is once ounce of copper disposed
on one square foot of circuit board, as is known in the
art .
The sensor conductors 46 are interposed between a
pair of sensor insulating lamina 48. The insulating
lamina 48 preferably comprises a suitable flexible
insulating material, such as kapton for example, for
enabling repeated flexure of the sensors 36. A suitable adhesive 50, such as a pliant epoxy
adhesive, is interposed between the insulating lamina
48 and sensor conductor 46 for bonding the conductor 46
to the insulating lamina 48. In the preferred
embodiment, each insulating lamina 48 is approximately
0.003 inch thick for providing a sensor electrode 36
that is at least approximately 0.010 inch thick. The
preferred minimum thickness of the sensors 36 provides
a sensor 36 that is sufficiently pliant so that the
sensors 36 do not restrict movement of the hand 14,
while being sufficiently robust to withstand continued
flexure thereof. A single conductor 46 interposed
between a pair of insulators 48 in the laminar
construction of the sensors 36, provides enhanced
longevity and reliability of the invented movement
sensing unit 30.
The base region 34 is formed on the lamina 46, 48
comprising the sensors 36 and further includes a
plurality of signal conductors 52 for coupling the
sensor conductors 46 to the processing means 38. The
conductors 52 are located adjacent to the insulating lamina 48 of the sensors 36 and comprise 1/2 ounce
copper, for example.
An outermost insulating lamina 54 is provided over
the conductors 52 for mounting the processing means 38
on the base region 34. The outermost lamina 54
comprises a suitable flexible material, such as kapton,
and is preferably approximately 0.001 inch thick. A
pliant adhesive 50, such as epoxy is disposed between
each lamina 52, 54 comprising the base region 34 for
bonding the base region 34 together and for bonding the
base 34 to the sensors 36, to provide a unitary
movement sensing unit 30.
Referring now to FIG. 1 and FIGS. 4-5 of the
drawings, a layer of a suitable variable resistive
material 56 is disposed over a portion of each outer
insulating lamina 48 of the sensors 36, such that an
abduction side 58 and an adduction side 60 of each
sensor 36 each have substantially identically
configured layers of the resistive material 56 thereon.
In the preferred embodiment 10, the resistive material
56 is disposed on the finger sensors 36A-36D, such that a distal layer of the material 56A extends from the
distal end 47 of each sensor to a selected mid-region
64 thereof. A proximal layer of the material 56B
extends from the mid-region 64 toward the base 34.
Each side of the thumb sensor 36E is provided with
a layer of resistive material 56 that extends from the
distal end 47A of the sensor 36E toward a mid-region
64A thereof. The extension and flexion sensor 36F is
provided with a layer of resistive material 56 that
extends from a distal end 47B thereof to a mid-region
64B of the sensor 36F, while the thumb roll sensor 36H
is provided with a layer of material 56 that extends
substantially the length thereof.
The resistive material 56 preferably comprises a
suitable graphite based paint, with each layer thereof
having a preferred thickness of approximately 0.0005
inch. Each side 58, 60 of the sensors 36 are provided
with resistive material 56 of substantially identical
configuration, length and thickness, so that the
resistive material 56 disposed on each side 58, 60 of
the sensor 36 will have a similar initial resistance value. While, the initial resistance value of the
material 56 on each side of the sensors 36 may comprise
any value desired, preferably the initial resistance
value of the material 56 is approximately 2 thousand
ohms (2k ohms) .
Due to the characteristics of the graphite
material 56, any flexure of the sensor 36 causes the
resistance value of the material 56 thereof to change
in a diverging manner, and most preferably, in a linear
fashion. For example, during sensor abduction, wherein
the user bends one or more of their fingers 26, or
thumb 28, toward the palm of the hand 14, the material
56 on each side 58, 60 undergoes flexure, causing the
initial resistance values thereof to diverge.
Preferably, during abduction, the resistance value of
the material 56 on the adduction side 60 increases,
while the resistance value of the material 56 on the
abduction side 58 decreases. The resistance values of
the material 56 on each side 58, 60 of the sensor 60
diverge to a value corresponding to the degree of
flexure of the sensor 36. The resistive material 56 provides a means for
tracking flexure, by providing a differential
measurement source. The material 56 on each side 58,
60 of the sensor 36 does not have to have similar
initial resistance values, so long as the initial
resistance value thereof are known. Additionally, the
resistance value of the material 56 need only diverge
to provide a measurement, so that it is not important
as to which layer of material 56, abduction 58 or
adduction 60, increases or decreases in resistance
value .
Referring again to the drawing Figures, voltage
that is applied to the sensing unit 30 for energizing
the processing means 38, for example, is additionally
applied to each side 58, 60 of each sensor 36, via the
conductors 46 to establish a reference voltage. For
example, a negative voltage, such as -5 V may be
applied to one side, such as the abduction side 58, of
the sensor 36 and a corresponding positive voltage,
such as +5 V may be applied to the other side, such as
the adduction side 60, for establishing a voltage differential, of approximately 10 V, between the two
sides 58, 60, for establishing a voltage divider.
With a positive voltage applied to one side of the
sensor 36 and a corresponding negative voltage applied
to the remaining side, the sensor 36 is maintained at a
0 V initial voltage potential, when the sensor 36 is
substantially planar, prior to any flexure thereof.
Flexure of the sensor 36 causes the resistance value of
the material 56 on each side thereof to change, for
changing the reference voltage level between the
abduction and adduction sides 58, 60, such as by the
voltage level going more positive or more negative, to
indicate that the sensor 36 has been flexed and the
degree of flexure.
Referring to the previous example, a desired
degree of flexure of a sensor 36, due to abduction of a
finger 26, causes the resistance value of the material
56 on the abduction side 58 to decrease, thus
increasing the voltage level thereon a corresponding
amount, to -5.2 V for example, while the resistance
value of the material 56 on the adduction side 60 increases, thus decreasing the voltage level thereon a
corresponding amount, to +4.8 V, for example. Thus,
flexure of the sensor 36 results in the voltage
potential thereon changing from 0 V to -0.2 V. Signals
representative of the change of voltage potential are
transmitted to the processing means 38, which processes
the signals for transmitting representative data to the
computer 16, via the data cable 18. As the sensors 36
are flexed, the voltage potential thereon constantly
changes to indicate the degree of flexure and position
of the sensor 36 relative to the initial position
thereof .
Thus, the varying voltage potential on each of the
sensors 36 provides a facile means for measuring the
extent that the sensors 36 are flexed and for
determining the various positions of each of the
sensors 36. Further, if the degree of flexure of any
one of the sensors is maintained, the resistance values
remain constant, so that the voltage potential thereon
remains constant and indicates that the position of the
sensor 36 has not changed. Therefore, the movement
sensors 36 of the data glove 10 continuously generate data representative of the actual positions and
gestures of the wearer's hand 10, for allowing the
processing means 38 to transmit data representative of
the wearer's hand gestures to the computer 16.
Thus, there has been described a system for
manipulating a computer generated animation in real
time, such as a virtual reality program running on a
computer. The system includes a data glove for
managing data based on an operator's hand gestures. The
data glove includes a movement sensing unit that
comprises a flexible circuit board that extends along
the dorsal region of the wearer's fingers and hand, and
includes a plurality of movement sensors. The sensors
transmit signals to a processor for determining any
movement of the wearer's hand. The sensors have a
resistive material disposed on each side thereof, so
that any flexure of the sensor causes the resistance
values to diverge, preferably linearly. The resistance
values on each side of the sensor diverge to a value
corresponding to the degree of flexure of the sensor.
A reference voltage is applied to each side of the
sensor for establishing a voltage differential between the two sides. Any flexure of the sensor causes the
resistance value of each side to change, and thereby
changes the reference voltage level between the two
sides to indicate that the sensor has been flexed and
the degree of flexure.
Those skilled in the art will appreciate that
various adaptations and modifications of the just-
described preferred embodiments can be configured
without departing from the scope and spirit of the
invention. Therefore, it is to be understood that,
within the scope of the appended claims, the invention
may be practiced other than as specifically described
herein.

Claims

CLAIMSWhat is Claimed Is:
1. A device for measuring flexure
comprising:
a flexible circuit board having a base region
and at least one sensor electrode;
a resistive material applied to each sensor
electrode, the resistive material having an
initial resistance value when the sensor is in an
initial position; and
an initial voltage potential established on
each sensor, wherein flexure of any sensor causes
the resistance value thereof to change, for
shifting the initial voltage potential thereon for
indicating flexure of the sensor.
2. The device of Claim 1 wherein the
resistance value of the resistive material changes
linearly in response to flexures thereof for
causing the voltage potential on the electrode to
shift linearly.
3. The device of Claim 2 wherein the
resistance value of the resistive material changes
linearly for shifting the voltage potential on the
electrode linearly to indicate flexure of the
electrode and degree of flexure relative to the
initial position thereof.
4. The device of Claim 1 further
comprising:
signal processing means for processing
signals generated by the sensor electrodes; and flexible conductor means for coupling the
electrodes to the processing means, the conductor
means adapted to be flexed repeatedly.
5. A device for measuring flexure
comprising:
a flexible circuit board having a base region
and a plurality of sensor electrodes extending
outwardly therefrom, each of the sensors having a
first side and a second side;
a layer of resistive material applied to each
side of each of the sensor electrodes, the
resistive material applied to each side of the
electrode, such that each side thereof has a
similar resistance value when the sensor is in an
initial position;
a power source for applying a different
voltage level to each side of each sensor for establishing a voltage differential between the
two sides and an initial voltage potential on each
sensor,
wherein any flexure of any sensor causes the
resistance value on each side thereof to change,
for shifting the initial voltage potential on the
sensor to indicate that the sensor has been flexed
and the degree of flexure.
6. The device of Claim 5 wherein the layer
of resistive material applied to each side of each
sensor comprises a variable resistance material
that increases and decreases in value linearly in
response to flexures thereof, such that each layer
of resistive material has a similar resistance
value when the sensor is in an initial position,
the resistance material adapted to diverge in a
linear manner upon any flexure of the sensor for
shifting the voltage potential on the electrode
linearly to indicate flexure of the electrode and degree of flexure relative to the initial position
thereof .
7. The device of Claim 6 wherein each layer
of resistive material comprises a graphite based
paint ranging in thickness from approximately
0.00025 inch to approximately 0.0010 inch.
8. The device of Claim 5 further
comprising:
signal processing means for processing
signals generated by the sensor electrodes;
flexible conductor means for coupling the
electrodes to the processing means, the conductor
means comprising a pliable material for repeatedly
flexing the conductor means without causing harm
thereto; and means for transmitting processed signals from
the signal processing means to a computing means.
9. The device of Claim 8 wherein the sensor
electrodes comprise elongated portions of flexible
circuit board, the flexible circuit board
comprising a first layer and a second layer of a
flexible insulating material with the flexible
conductor means interposed therebetween, the
conductor means comprising a layer of copper
having a selected thickness enabling the copper to
be repeatedly flexed.
10. The device of Claim 9 wherein the copper
conductor of each of the sensor electrodes is
centered along its length for balancing the copper
to reduce strain thereon enabling the copper to be
repeatedly flexed.
11. The device of Claim 10 wherein the
electrode sensors are approximately 0.010 inch
thick.
12. The device of Claim 10 wherein the
electrode sensors are at least 0.010 inch thick.
13. A data management device for managing
data based on an operator's hand gestures, the
device comprising:
a glove for coupling the device to a hand of
a wearer;
a flexible circuit board coupled to the glove
and positioned adjacent to the hand of the wearer,
the circuit board having a base region and a
plurality of sensor electrodes configured to extend along the dorsal region of each digit of
the hand of the wearer;
a resistive material applied to each
electrode, the resistive material having an
initial resistance value when the sensor is in an
initial position; and
a power source for establishing an initial
voltage potential on each sensor, wherein hand
gestures by the wearer cause flexure of at lease
one of the sensors causing the resistance value
thereof to change, the changing resistance value
shifting the initial voltage potential on the
sensor for indicating flexure of the sensor
representative of the hand gesture.
14. The system of Claim 12 further
comprising : data transmission means for transmitting
signals generated by the sensors to a computing
means; and
a sensor provided for sensing movement of
each digit of the hand of the wearer, the
electrodes generating signals determined by the
flexure thereof to provide data representative of
the hand gestures of the wearer to the computing
means .
15. The system of Claim 14 wherein the
resistive material comprises a variable resistance
material that increases and decreases in resistive
value linearly in response to flexures thereof,
such that the resistance material has its initial
resistance value when the electrode is in the
initial position, the resistance value of the
material adapted to increase and decrease linearly
upon adduction and abduction of the hand inducing
analogous flexure of the sensors, the changing resistance value shifting the voltage potential on
the electrode linearly to indicate flexure of the
electrode and degree of flexure relative to the
initial position thereof.
16. The device of Claim 13 wherein the
flexible circuit board is retained in the glove
17. A data management device for managing
data based on an operator's hand gestures, the
device comprising:
a glove for coupling the device to a hand of
a wearer;
a flexible circuit board coupled to the glove
and interposed between a dorsal region of the hand
of the wearer and the glove, the circuit board having a base region and a plurality of sensor
electrodes;
a layer of variable resistance resistive
material applied to each side of each of the
sensor electrodes so that each side thereof has a
common resistance value when the sensor electrode
is in an initial position, the common resistance
value of the resistive material diverging upon
flexure thereof for indicating flexure of the
sensor, wherein the resistance value of the
material on one side of the sensor decreases,
while the resistance level on the other side
increases, the resistance values on each side of
the sensor diverging to a value corresponding to
the degree of flexure of the sensor;
a power source for applying a different
voltage level to each side of each sensor for
establishing a voltage differential between the
two sides and an initial voltage potential on each
sensor, wherein hand gestures by the wearer cause
flexure of at lease one of the sensors causing the resistance value of the material thereon to
change, the changing resistance value shifting the
initial voltage potential thereon for indicating
flexure of the sensor representative of the hand
gesture; and
data transmission means for transmitting
signals generated by the sensors to a computing
means .
18. The system of Claim 17 wherein each
layer of resistive material comprises a variable
resistance material that increases and decreases
in resistive value linearly in response to
flexures thereof, the common resistance value of
the resistive material on each sensor diverges
linearly upon adduction and abduction of the hand
inducing analogous flexure of the sensors, the
changing resistance value of the variable
resistance material shifting the voltage potential
on the sensor linearly to indicate flexure of the sensor and degree of flexure relative to the
initial position thereof, the resistive value of
the resistance material increasing and decreasing
only during flexure of the sensors for shifting
the voltage potential only during flexure of the
sensors .
19. The device of Claim 17 wherein a sensor
is provided for sensing movement of each digit of
the hand of the wearer, the sensors comprising
elongated portions of the flexible circuit board
configured to extend along the dorsal region of
each of the digits .
20. The device of Claim 19 further
comprising a sensor for sensing movement in at
least one region of the hand, a sensed region
extending along a web between two of the digits of
the hand of the wearer .
21. The device of Claim 20 further
comprising a sensor for sensing movement in
selected regions of the hand, one of the selected
sensed regions extending along the web between the
thumb and index finger and another one of the
selected sensed regions extending along the web
between two of the remaining digits of the hand of
the wearer.
22. The device of Claim 17 wherein the glove
has an aperture extending along a dorsal side
thereof configured to retain the flexible circuit
board therein, the circuit board retained in the
aperture for preventing the circuit board from
contacting the hand and for preventing the circuit
board from inadvertently contacting external
objects for inhibiting harm from coming to the
circuit board.
23. The device of Claim 17 wherein the glove
comprises a substantially elastic material for
conforming to the hand of the wearer while
enabling freedom of movement thereof.
24. The device of Claim 18 further
comprising :
signal processing means coupled to the base
region of the circuit board, the processing means
for processing signals generated by the sensors to
generate data representative of the hand gestures
of the hand of the wearer for transmitting the
data to the computing means with the transmission
means ; and
flexible conductor means for coupling the
sensors to the processing means, the conductor
means comprising a pliable metal enabling repeated
flexure thereof; the flexible circuit board comprising a first
layer and a second layer of a flexible insulating
material with the conductor means interposed
therebetween .
25. The device of Claim 9 wherein the
conductor means comprises a layer of copper having
a selected thickness for enabling the copper to be
repeatedly flexed, the copper conductor of each of
the sensors centered along the length of the
sensor for balancing the copper to reduce strain
thereon enabling the copper to be repeatedly
flexed.
PCT/US1998/008450 1997-04-23 1998-04-23 System for data management based on hand gestures WO1998050839A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US08/838,938 1997-04-23
US08/838,938 US6049327A (en) 1997-04-23 1997-04-23 System for data management based onhand gestures

Publications (2)

Publication Number Publication Date
WO1998050839A2 true WO1998050839A2 (en) 1998-11-12
WO1998050839A3 WO1998050839A3 (en) 1999-03-18

Family

ID=25278439

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1998/008450 WO1998050839A2 (en) 1997-04-23 1998-04-23 System for data management based on hand gestures

Country Status (2)

Country Link
US (2) US6049327A (en)
WO (1) WO1998050839A2 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002027456A1 (en) * 2000-09-29 2002-04-04 Senseboard Technologies Ab Wearable data input interface
EP1327853A2 (en) 2002-01-10 2003-07-16 Navigation Technologies Corporation Method and system using a hand-gesture responsive device for collecting data for a geographic database
WO2015116008A1 (en) * 2013-11-07 2015-08-06 Bavunoglu Harun System of converting hand and finger movements into text and audio
EP3092969A3 (en) * 2009-11-13 2017-03-01 Intuitive Surgical Operations, Inc. A master finger tracking device and method of use in a minimally invasive surgical system
GR1009085B (en) * 2016-06-21 2017-08-11 Αλεξανδρος Τηλεμαχου Τζαλλας Method and glove-like device for the determination and improved assessment of disease-associated kinetic symptoms
US9743989B2 (en) 2010-09-21 2017-08-29 Intuitive Surgical Operations, Inc. Method and system for hand presence detection in a minimally invasive surgical system
US9901402B2 (en) 2010-09-21 2018-02-27 Intuitive Surgical Operations, Inc. Method and apparatus for hand gesture control in a minimally invasive surgical system
US10296085B2 (en) 2014-03-05 2019-05-21 Markantus Ag Relatively simple and inexpensive finger operated control device including piezoelectric sensors for gesture input, and method thereof
US11470895B2 (en) 2014-10-11 2022-10-18 Workaround Gmbh Workwear unit having a glove that fastens a control system and functional module to a user's body

Families Citing this family (149)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US6049327A (en) * 1997-04-23 2000-04-11 Modern Cartoons, Ltd System for data management based onhand gestures
US20020036617A1 (en) 1998-08-21 2002-03-28 Timothy R. Pryor Novel man machine interfaces and applications
US6750848B1 (en) * 1998-11-09 2004-06-15 Timothy R. Pryor More useful man machine interfaces and applications
US6720949B1 (en) * 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
US6610917B2 (en) 1998-05-15 2003-08-26 Lester F. Ludwig Activity indication, external source, and processing loop provisions for driven vibrating-element environments
US7079114B1 (en) * 1998-08-21 2006-07-18 Peter Smith Interactive methods for design of automobiles
US6215498B1 (en) * 1998-09-10 2001-04-10 Lionhearth Technologies, Inc. Virtual command post
US7904187B2 (en) 1999-02-01 2011-03-08 Hoffberg Steven M Internet appliance system and method
US7015950B1 (en) 1999-05-11 2006-03-21 Pryor Timothy R Picture taking method and apparatus
US7328119B1 (en) * 2000-03-07 2008-02-05 Pryor Timothy R Diet and exercise planning and motivation including apparel purchases based on future appearance
US7096454B2 (en) 2000-03-30 2006-08-22 Tyrsted Management Aps Method for gesture based modeling
US7109970B1 (en) * 2000-07-01 2006-09-19 Miller Stephen S Apparatus for remotely controlling computers and other electronic appliances/devices using a combination of voice commands and finger movements
US20020128952A1 (en) * 2000-07-06 2002-09-12 Raymond Melkomian Virtual interactive global exchange
WO2002015560A2 (en) * 2000-08-12 2002-02-21 Georgia Tech Research Corporation A system and method for capturing an image
US6491649B1 (en) 2000-10-06 2002-12-10 Mark P. Ombrellaro Device for the direct manual examination of a patient in a non-contiguous location
US20040097836A1 (en) * 2000-10-06 2004-05-20 Ombrellaro Mark P. Direct manual examination of remote patient with virtual examination functionality
US20050149364A1 (en) * 2000-10-06 2005-07-07 Ombrellaro Mark P. Multifunction telemedicine software with integrated electronic medical record
AU2002230814A1 (en) * 2000-11-02 2002-05-15 Essential Reality, Llc Electronic user worn interface device
AU2002237957B2 (en) * 2001-01-31 2006-09-14 Accenture Global Services Limited Configuring architecture for mobile access to at least one business resource
US8306635B2 (en) 2001-03-07 2012-11-06 Motion Games, Llc Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction
US6672174B2 (en) * 2001-07-23 2004-01-06 Fidelica Microsystems, Inc. Fingerprint image capture device with a passive sensor array
US7295181B2 (en) * 2001-09-06 2007-11-13 Gunilla Alsio Data input device
US20030132913A1 (en) * 2002-01-11 2003-07-17 Anton Issinski Touchless computer input device to control display cursor mark position by using stereovision input from two video cameras
US7008231B2 (en) * 2002-01-23 2006-03-07 Patrick Pesnell Catching training apparatus
CN1167996C (en) * 2002-07-11 2004-09-22 庄胜雄 Glove mouse capable of forming virtual tracing ball
KR100486739B1 (en) * 2003-06-27 2005-05-03 삼성전자주식회사 Wearable phone and method using the same
US7042438B2 (en) * 2003-09-06 2006-05-09 Mcrae Michael William Hand manipulated data apparatus for computers and video games
US20050151722A1 (en) * 2004-01-14 2005-07-14 Xerox Corporation Methods and systems for collecting and generating ergonomic data utilizing an electronic portal
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US8442331B2 (en) 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US7362305B2 (en) * 2004-02-10 2008-04-22 Senseboard Technologies Ab Data input device
US10635723B2 (en) 2004-02-15 2020-04-28 Google Llc Search engines and systems with handheld document data capture devices
US7812860B2 (en) 2004-04-01 2010-10-12 Exbiblio B.V. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US8146156B2 (en) 2004-04-01 2012-03-27 Google Inc. Archive of text captures from rendered documents
US20060098900A1 (en) 2004-09-27 2006-05-11 King Martin T Secure data gathering from rendered documents
US7990556B2 (en) 2004-12-03 2011-08-02 Google Inc. Association of a portable scanner with input/output and storage devices
US7894670B2 (en) 2004-04-01 2011-02-22 Exbiblio B.V. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
WO2008028674A2 (en) 2006-09-08 2008-03-13 Exbiblio B.V. Optical scanners, such as hand-held optical scanners
US20060081714A1 (en) 2004-08-23 2006-04-20 King Martin T Portable scanning device
US8081849B2 (en) 2004-12-03 2011-12-20 Google Inc. Portable scanning and memory device
US9143638B2 (en) 2004-04-01 2015-09-22 Google Inc. Data capture from rendered documents using handheld device
US9116890B2 (en) 2004-04-01 2015-08-25 Google Inc. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US9008447B2 (en) 2004-04-01 2015-04-14 Google Inc. Method and system for character recognition
US8713418B2 (en) 2004-04-12 2014-04-29 Google Inc. Adding value to a rendered document
US8620083B2 (en) 2004-12-03 2013-12-31 Google Inc. Method and system for character recognition
US8874504B2 (en) 2004-12-03 2014-10-28 Google Inc. Processing techniques for visual capture data from a rendered document
WO2005102088A1 (en) * 2004-04-19 2005-11-03 4Sight, Inc. Hand covering features for the manipulation of small devices
US8489624B2 (en) 2004-05-17 2013-07-16 Google, Inc. Processing techniques for text capture from a rendered document
US8346620B2 (en) 2004-07-19 2013-01-01 Google Inc. Automatic modification of web pages
JP2006060584A (en) * 2004-08-20 2006-03-02 Fuji Photo Film Co Ltd Digital camera
US7662113B2 (en) * 2004-11-05 2010-02-16 California Institute Of Technology Fingertip tracker
US7562572B2 (en) * 2004-12-29 2009-07-21 Postech Foundation Apparatus for measuring force applied by the hand, analyzing apparatus, and system
WO2006078604A2 (en) * 2005-01-18 2006-07-27 Rallypoint, Inc. Sensing input actions
US8659546B2 (en) 2005-04-21 2014-02-25 Oracle America, Inc. Method and apparatus for transferring digital content
US7768409B2 (en) * 2005-06-10 2010-08-03 American Air Liquide, Inc. Embedded RFID scanner for mobile product management
US20070063992A1 (en) * 2005-09-17 2007-03-22 Lundquist Paul B Finger-keyed human-machine interface device
US7347578B1 (en) 2005-12-14 2008-03-25 Nourse Connie L Apparel having selectively activated light source
US8300798B1 (en) 2006-04-03 2012-10-30 Wai Wu Intelligent communication routing system and method
TW200741509A (en) * 2006-04-19 2007-11-01 Kye Systems Corp Finger wearing type input device and input method thereof
JP4921113B2 (en) * 2006-10-25 2012-04-25 キヤノン株式会社 Contact presentation apparatus and method
US20080259028A1 (en) * 2007-04-19 2008-10-23 Brenda Teepell Hand glove mouse
US20090009466A1 (en) * 2007-05-01 2009-01-08 Hubbard Sandra L Force-sensing orthotic electric device controller
US8244655B2 (en) * 2007-05-01 2012-08-14 University Of Florida Research Foundation, Inc. Force-sensing orthotic electric device controller
JP2008305198A (en) * 2007-06-07 2008-12-18 Fujitsu Component Ltd Input system and input device
TWI377055B (en) * 2007-08-10 2012-11-21 Ind Tech Res Inst Interactive rehabilitation method and system for upper and lower extremities
US20110035662A1 (en) 2009-02-18 2011-02-10 King Martin T Interacting with rendered documents using a multi-function mobile device, such as a mobile phone
US9003567B2 (en) * 2007-12-09 2015-04-14 180S, Inc. Hand covering with tactility features
US8336119B2 (en) * 2007-12-09 2012-12-25 180's. Inc. Hand covering with conductive portion
US8166421B2 (en) * 2008-01-14 2012-04-24 Primesense Ltd. Three-dimensional user interface
US8933876B2 (en) 2010-12-13 2015-01-13 Apple Inc. Three dimensional user interface session control
US9035876B2 (en) 2008-01-14 2015-05-19 Apple Inc. Three-dimensional user interface session control
US20090212979A1 (en) * 2008-02-22 2009-08-27 William Catchings Glove-based input device
US8132468B2 (en) * 2008-05-29 2012-03-13 Zoran Radivojevic Flexural deformation sensing device and a user interface using the same
US20100177039A1 (en) * 2009-01-10 2010-07-15 Isaac Grant Finger Indicia Input Device for Computer
US8447066B2 (en) 2009-03-12 2013-05-21 Google Inc. Performing actions based on capturing information from rendered documents, such as documents under copyright
CN102349087B (en) 2009-03-12 2015-05-06 谷歌公司 Automatically providing content associated with captured information, such as information captured in real-time
WO2010103482A2 (en) * 2009-03-13 2010-09-16 Primesense Ltd. Enhanced 3d interfacing for remote devices
US8477986B1 (en) * 2009-04-22 2013-07-02 Mary Kiser Audience participation gloves
ES2351143B1 (en) * 2009-05-14 2011-11-18 Consejo Superior De Investigaciones Científicas (Csic) CONTROL SYSTEM AND PROCEDURE FOR MANIPULATORS
US8680390B2 (en) 2009-10-16 2014-03-25 Kesumo Llc Foot-operated controller
US9081799B2 (en) 2009-12-04 2015-07-14 Google Inc. Using gestalt information to identify locations in printed information
US9323784B2 (en) 2009-12-09 2016-04-26 Google Inc. Image search using text-based elements within the contents of images
US20110164032A1 (en) * 2010-01-07 2011-07-07 Prime Sense Ltd. Three-Dimensional User Interface
US8787663B2 (en) * 2010-03-01 2014-07-22 Primesense Ltd. Tracking body parts by combined color image and depth processing
KR101835413B1 (en) * 2010-04-13 2018-03-09 삼성전자주식회사 Method and Apparatus for Processing Virtual World
CN102959616B (en) 2010-07-20 2015-06-10 苹果公司 Interactive reality augmentation for natural interaction
US9201501B2 (en) 2010-07-20 2015-12-01 Apple Inc. Adaptive projector
US8959013B2 (en) 2010-09-27 2015-02-17 Apple Inc. Virtual keyboard for a non-tactile three dimensional user interface
KR20120036244A (en) * 2010-10-07 2012-04-17 삼성전자주식회사 Implantable medical device(imd) and method for controlling of the imd
US8872762B2 (en) 2010-12-08 2014-10-28 Primesense Ltd. Three dimensional user interface cursor control
CN103347437B (en) 2011-02-09 2016-06-08 苹果公司 Gaze detection in 3D mapping environment
US9377865B2 (en) 2011-07-05 2016-06-28 Apple Inc. Zoom-based gesture user interface
US9459758B2 (en) 2011-07-05 2016-10-04 Apple Inc. Gesture-based interface with enhanced features
US8881051B2 (en) 2011-07-05 2014-11-04 Primesense Ltd Zoom-based gesture user interface
US8971572B1 (en) 2011-08-12 2015-03-03 The Research Foundation For The State University Of New York Hand pointing estimation for human computer interaction
US9030498B2 (en) 2011-08-15 2015-05-12 Apple Inc. Combining explicit select gestures and timeclick in a non-tactile three dimensional user interface
US9122311B2 (en) 2011-08-24 2015-09-01 Apple Inc. Visual feedback for tactile and non-tactile user interfaces
US9218063B2 (en) 2011-08-24 2015-12-22 Apple Inc. Sessionless pointing user interface
US9229534B2 (en) 2012-02-28 2016-01-05 Apple Inc. Asymmetric mapping for tactile and non-tactile user interfaces
US9076419B2 (en) 2012-03-14 2015-07-07 Bebop Sensors, Inc. Multi-touch pad controller
CN104246682B (en) 2012-03-26 2017-08-25 苹果公司 Enhanced virtual touchpad and touch-screen
US9891718B2 (en) 2015-04-22 2018-02-13 Medibotics Llc Devices for measuring finger motion and recognizing hand gestures
US9389684B2 (en) 2013-03-13 2016-07-12 Visual Music Systems, Inc. Platform for finger controls
CN103251419A (en) * 2013-04-25 2013-08-21 西安交通大学苏州研究院 Data gloves for function rehabilitation training and assessment of hands and monitoring method thereof
US9201508B2 (en) * 2013-06-28 2015-12-01 Samsung Electronics Co., Ltd. Alternative glove-based key entry for mobile devices
CN103549965A (en) * 2013-10-23 2014-02-05 中国科学院合肥物质科学研究院 Measurement range automatic adjustable traditional Chinese medical massage manipulation mechanical information obtaining system
US9189022B2 (en) * 2013-11-13 2015-11-17 Symbol Technologies, Llc Wearable glove electronic device
CN104020846A (en) * 2014-04-29 2014-09-03 诺力科技有限公司 Method, assembly and system for sensing mainframe movement
US9468847B2 (en) * 2014-04-30 2016-10-18 Umm Al-Qura University Tactile feedback gloves
US9753568B2 (en) 2014-05-15 2017-09-05 Bebop Sensors, Inc. Flexible sensors and applications
US9442614B2 (en) 2014-05-15 2016-09-13 Bebop Sensors, Inc. Two-dimensional sensor arrays
US9965076B2 (en) 2014-05-15 2018-05-08 Bebop Sensors, Inc. Piezoresistive sensors and applications
US9710060B2 (en) * 2014-06-09 2017-07-18 BeBop Senors, Inc. Sensor system integrated with a glove
US10362989B2 (en) 2014-06-09 2019-07-30 Bebop Sensors, Inc. Sensor system integrated with a glove
CN104227733A (en) * 2014-07-28 2014-12-24 南京工程学院 Human-body-induced mechanical arm
CN104156068B (en) * 2014-08-04 2017-04-12 北京航空航天大学 Virtual maintenance interaction operation method based on virtual hand interaction feature layer model
US10019059B2 (en) * 2014-08-22 2018-07-10 Sony Interactive Entertainment Inc. Glove interface object
JP6524663B2 (en) * 2014-10-17 2019-06-05 ヤマハ株式会社 Data glove
JP2016125931A (en) * 2015-01-06 2016-07-11 ヤマハ株式会社 Data glove
EP3208687B1 (en) 2014-10-17 2019-11-27 Yamaha Corporation Data glove
WO2016060031A1 (en) * 2014-10-17 2016-04-21 ヤマハ株式会社 Data glove
CN104523234B (en) * 2014-12-30 2017-08-22 深圳先进技术研究院 The wrist strap and its implementation of joint injury situation can be monitored
JP6447150B2 (en) * 2015-01-14 2019-01-09 東洋紡株式会社 Glove-type input device
US9863823B2 (en) 2015-02-27 2018-01-09 Bebop Sensors, Inc. Sensor systems integrated with footwear
JP6755885B2 (en) * 2015-04-29 2020-09-16 ビオセルボ テクノロジーズ アクチエボラグBioservo Technologies Aktiebolag Control system for reinforcing gloves
US10082381B2 (en) 2015-04-30 2018-09-25 Bebop Sensors, Inc. Sensor systems integrated with vehicle tires
US9827996B2 (en) 2015-06-25 2017-11-28 Bebop Sensors, Inc. Sensor systems integrated with steering wheels
CN105334959B (en) * 2015-10-22 2019-01-15 北京小鸟看看科技有限公司 Gesture motion control system and method in a kind of reality environment
CN105446485B (en) * 2015-11-20 2018-03-30 哈尔滨工业大学 System and method is caught based on data glove and the human hand movement function of position tracking instrument
CN205485914U (en) * 2015-12-31 2016-08-17 博世汽车部件(苏州)有限公司 Intelligence gloves
US10151606B1 (en) 2016-02-24 2018-12-11 Ommo Technologies, Inc. Tracking position and movement using a magnetic field
US9792567B2 (en) * 2016-03-11 2017-10-17 Route4Me, Inc. Methods and systems for managing large asset fleets through a virtual reality interface
US10372213B2 (en) * 2016-09-20 2019-08-06 Facebook Technologies, Llc Composite ribbon in a virtual reality device
CN106775258A (en) * 2017-01-04 2017-05-31 虹软(杭州)多媒体信息技术有限公司 The method and apparatus that virtual reality is interacted are realized using gesture control
DE102017121991A1 (en) * 2017-09-22 2019-03-28 Deutsches Zentrum für Luft- und Raumfahrt e.V. Sensor arrangement for detecting movements of the thumb and input device and method for detecting hand and / or finger movements
CN111433831B (en) * 2017-12-27 2022-05-17 索尼公司 Information processing apparatus, information processing method, and computer-readable storage medium
JP7231616B2 (en) * 2018-01-03 2023-03-01 エヌエスイー プロダクツ インコーポレイテッド Fingertip microcurrent device for skin
US10837599B2 (en) * 2018-02-08 2020-11-17 Alken Inc. Safety system for machinery
DE102018203193A1 (en) * 2018-03-02 2019-09-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Flexible handheld portable control for controlling an electrically controllable device and uses thereof
US10276289B1 (en) 2018-06-01 2019-04-30 Ommo Technologies, Inc. Rotating a permanent magnet in a position detection system
US10613626B2 (en) * 2018-06-15 2020-04-07 Immersion Corporation Kinesthetically enabled glove
US10884496B2 (en) 2018-07-05 2021-01-05 Bebop Sensors, Inc. One-size-fits-all data glove
US10996754B2 (en) 2018-10-12 2021-05-04 Aurora Flight Sciences Corporation Manufacturing monitoring system
EP3935305A1 (en) * 2019-03-05 2022-01-12 Grasselli S.p.A. Improved garment
US11480481B2 (en) 2019-03-13 2022-10-25 Bebop Sensors, Inc. Alignment mechanisms sensor systems employing piezoresistive materials
US11041772B2 (en) * 2019-03-25 2021-06-22 Toyota Motor Engineering & Manufacturing North America, Inc. Sensor diffusion stack materials for pressure sensing gloves and methods incorporating the same
USD933840S1 (en) 2020-04-21 2021-10-19 Nse Products, Inc. Microcurrent skin treatment device
JP6949407B1 (en) * 2021-06-18 2021-10-13 峻之 石田 Golf gloves for proper grip

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4988981A (en) * 1987-03-17 1991-01-29 Vpl Research, Inc. Computer data entry and manipulation apparatus and method
US5316017A (en) * 1992-10-07 1994-05-31 Greenleaf Medical Systems, Inc. Man-machine interface for a joint measurement system
US5442729A (en) * 1988-10-14 1995-08-15 The Board Of Trustees Of The Leland Stanford Junior University Strain-sensing goniometers, systems and recognition algorithms

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4414537A (en) * 1981-09-15 1983-11-08 Bell Telephone Laboratories, Incorporated Digital data entry glove interface device
US5097252A (en) * 1987-03-24 1992-03-17 Vpl Research Inc. Motion sensor which produces an asymmetrical signal in response to symmetrical movement
US5184319A (en) * 1990-02-02 1993-02-02 Kramer James F Force feedback and textures simulating interface device
US5444462A (en) * 1991-12-16 1995-08-22 Wambach; Mark L. Computer mouse glove with remote communication
US5429140A (en) * 1993-06-04 1995-07-04 Greenleaf Medical Systems, Inc. Integrated virtual reality rehabilitation system
US5488362A (en) * 1993-10-01 1996-01-30 Anaphase Unlimited, Inc. Apparatus for controlling a video game
US5533531A (en) * 1994-08-22 1996-07-09 Greenleaf Medical Systems Electronically aligned man-machine interface
US5612689A (en) * 1995-10-05 1997-03-18 Lee, Jr.; Edward A. Finger articulation controlled information generating system
US6049327A (en) * 1997-04-23 2000-04-11 Modern Cartoons, Ltd System for data management based onhand gestures

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4988981A (en) * 1987-03-17 1991-01-29 Vpl Research, Inc. Computer data entry and manipulation apparatus and method
US4988981B1 (en) * 1987-03-17 1999-05-18 Vpl Newco Inc Computer data entry and manipulation apparatus and method
US5442729A (en) * 1988-10-14 1995-08-15 The Board Of Trustees Of The Leland Stanford Junior University Strain-sensing goniometers, systems and recognition algorithms
US5316017A (en) * 1992-10-07 1994-05-31 Greenleaf Medical Systems, Inc. Man-machine interface for a joint measurement system

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002027456A1 (en) * 2000-09-29 2002-04-04 Senseboard Technologies Ab Wearable data input interface
EP1327853A2 (en) 2002-01-10 2003-07-16 Navigation Technologies Corporation Method and system using a hand-gesture responsive device for collecting data for a geographic database
EP1327853A3 (en) * 2002-01-10 2011-05-25 Navteq North America, LLC Method and system using a hand-gesture responsive device for collecting data for a geographic database
EP3092969A3 (en) * 2009-11-13 2017-03-01 Intuitive Surgical Operations, Inc. A master finger tracking device and method of use in a minimally invasive surgical system
US10543050B2 (en) 2010-09-21 2020-01-28 Intuitive Surgical Operations, Inc. Method and system for hand presence detection in a minimally invasive surgical system
US11707336B2 (en) 2010-09-21 2023-07-25 Intuitive Surgical Operations, Inc. Method and system for hand tracking in a robotic system
US9743989B2 (en) 2010-09-21 2017-08-29 Intuitive Surgical Operations, Inc. Method and system for hand presence detection in a minimally invasive surgical system
US9901402B2 (en) 2010-09-21 2018-02-27 Intuitive Surgical Operations, Inc. Method and apparatus for hand gesture control in a minimally invasive surgical system
WO2015116008A1 (en) * 2013-11-07 2015-08-06 Bavunoglu Harun System of converting hand and finger movements into text and audio
DE212014000212U1 (en) 2013-11-07 2016-06-13 Elif Saygi Bavunoglu System of conversion of hand and finger movements into text and sound
US10319257B2 (en) 2013-11-07 2019-06-11 Harun Bavunoglu System of converting hand and finger movements into text and audio
US10296085B2 (en) 2014-03-05 2019-05-21 Markantus Ag Relatively simple and inexpensive finger operated control device including piezoelectric sensors for gesture input, and method thereof
US11470895B2 (en) 2014-10-11 2022-10-18 Workaround Gmbh Workwear unit having a glove that fastens a control system and functional module to a user's body
GR1009085B (en) * 2016-06-21 2017-08-11 Αλεξανδρος Τηλεμαχου Τζαλλας Method and glove-like device for the determination and improved assessment of disease-associated kinetic symptoms

Also Published As

Publication number Publication date
US6049327A (en) 2000-04-11
US6452584B1 (en) 2002-09-17
WO1998050839A3 (en) 1999-03-18

Similar Documents

Publication Publication Date Title
US6049327A (en) System for data management based onhand gestures
CA2701963C (en) Input device configured to monitor skin movement of a user by mapping and recording deformations of their skin
CN111638801B (en) Controller for gesture recognition and gesture recognition method thereof
US6677927B1 (en) X-Y navigation input device
Biggs et al. Haptic interfaces
US5610528A (en) Capacitive bend sensor
AU734986B2 (en) Force feedback interface having isotonic and isometric functionality
US6061004A (en) Providing force feedback using an interface device including an indexing function
Achibet et al. FlexiFingers: Multi-finger interaction in VR combining passive haptics and pseudo-haptics
Wicaksono et al. Fabrickeyboard: multimodal textile sensate media as an expressive and deformable musical interface.
US20050219355A1 (en) Information input device
GB2247066A (en) Manual controller for computer graphic object display with six degrees of freedom
TW201533608A (en) Gloves with pressure sensors
EP0696014B1 (en) Pressure sensitive input device wearable around a human finger
Yoon et al. Plex: finger-worn textile sensor for mobile interaction during activities
McCaw et al. Sensory glove for dynamic hand proprioception and tactile sensing
Calvo et al. Pointing devices for wearable computers
KR101688193B1 (en) Data input apparatus and its method for tangible and gestural interaction between human-computer
Saliba et al. A compact glove input device to measure human hand, wrist and forearm joint positions for teleoperation applications
WO2010064987A1 (en) Device for transferring mouse and keyboard commands
Banić et al. Kinetic Skin: Feasibility and Implementation of Bare Skin Tracking of Hand and Body Joints for 3D User Interfaces
KR20220107802A (en) Wearable glove type input apparatus
Sears et al. Input Technologies and Techniques
JPH0540571A (en) Method and device for three-dimensional position input
Sears et al. Input Technologies and Techniques Ken Hinckley

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 1998548150

Format of ref document f/p: F

122 Ep: pct application non-entry in european phase