WO2002028067A1 - Method and system for inputting characters - Google Patents

Method and system for inputting characters Download PDF

Info

Publication number
WO2002028067A1
WO2002028067A1 PCT/NO2001/000384 NO0100384W WO0228067A1 WO 2002028067 A1 WO2002028067 A1 WO 2002028067A1 NO 0100384 W NO0100384 W NO 0100384W WO 0228067 A1 WO0228067 A1 WO 0228067A1
Authority
WO
WIPO (PCT)
Prior art keywords
finger
movements
sensor
sign
display
Prior art date
Application number
PCT/NO2001/000384
Other languages
French (fr)
Inventor
Camilla Mathiassen
Original Assignee
Bioprint As
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bioprint As filed Critical Bioprint As
Priority to AU2001292451A priority Critical patent/AU2001292451A1/en
Publication of WO2002028067A1 publication Critical patent/WO2002028067A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • G06F3/0236Character input methods using selection techniques to select from displayed items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/142Image acquisition using hand-held instruments; Constructional details of the instruments
    • G06V30/1423Image acquisition using hand-held instruments; Constructional details of the instruments the instrument generating sequences of position coordinates corresponding to handwriting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/23Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16HGEARING
    • F16H59/00Control inputs to control units of change-speed-, or reversing-gearings for conveying rotary motion
    • F16H59/02Selector apparatus
    • F16H59/0217Selector apparatus with electric switches or sensors not for gear or range selection, e.g. for controlling auxiliary devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16HGEARING
    • F16H59/00Control inputs to control units of change-speed-, or reversing-gearings for conveying rotary motion
    • F16H59/02Selector apparatus
    • F16H59/0278Constructional features of the selector lever, e.g. grip parts, mounting or manufacturing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/70Details of telephonic subscriber devices methods for entering alphabetical characters, e.g. multi-tap or dictionary disambiguation

Definitions

  • This invention relates to a sign/character generator represented by a fingerprint sensor with navigation means, for text/sign input to information and communication devices with displays, like set-top boxes, cellular phones, palmtop PCs, PDAs, etc.
  • the present information society provides the users with an increasing number of information and communication devices for numerous purposes, and the use of such information and communication devices are expected to accelerate both in types of devices and the number of users of the respective devices.
  • palmtops small handheld PCs
  • PDAs personal digital assistants
  • palmtops small handheld PCs
  • PDAs personal digital assistants
  • Various solutions have been implemented to eliminate the keyboard, but they are all associated with serious negative effects .
  • One solution is to provide the palmtop or PDA with a touch-screen, but such screens are more expensive than regular displays.
  • Another known solution is to provide the palmtop or PDA with a special pen to write on the screen.
  • such pens are expensive, they may easily be lost, and they generally require that writing is done according to predefined sequences of sign elements that must be drawn within fairly narrow boundaries of shape.
  • keyboard It shall further be able to execute accurate cursor control on the display providing full touch-pad functionality, and shall incorporate fingerprint scanning for authentication. This objective is obtained by a sign generator based on combining a fingerprint sensor having navigation means, with analysing/interpreting means and translation means as described in claims 1 and 9.
  • Figure 1 illustrates a traditional reduced keyboard for cellular phones, with multi-character keys.
  • Figure 2 illustrates schematically an information/- communication device, equipped with a large display and a single sign-generator key as part of a minimum "keyboard" .
  • Figure 3 illustrates the invention schematically.
  • Figure 4 illustrates categories of finger movements in two dimensions.
  • Figure 5 illustrates how to operate text input by selecting characters on the display, by finger commands.
  • Figure 6 illustrates the stroke hierarchy for Chinese signs, and the representation of reduced strokes on a small keyboard.
  • Figure 7 tabulates stroke/sign hierarchy of Chinese signs.
  • Figure 8 illustrates how to operate in calculation mode by finger commands on a palmtop PC.
  • Figure 9 illustrates a typical example of embodiment in set-top boxes.
  • Figure 10 illustrates a typical example of embodiment in automobiles.
  • a touch sensitive switch 1 in the form of a _ co to H I- 1 o i ⁇ o in o in
  • the time limits of Table 1 above may of course be chosen otherwise.
  • a particular embodiment of the invention is to set the above ranges dynamically to adapt to the user's skills and his learning curve in using the invention. This may be done by registering the e.g. ' 50 last commands of each type, and calculating the arithmetic mean and standard deviation.
  • the statistics may be based upon any written text or a predetermined learning sequence, and may be used to shift the category definitions according to the speed of the user, and thus also adapt as the user learns the system and increases his input speed.
  • the touch-sensitive switch 1 may in its simplest form be a simple on and off touch sensitive switch.
  • This is insufficient relative to the objective of the invention to provide combined user authentication by finger print biometrics, accurate cursor control and fast, versatile and flexible text input, all served by the very same single- button sensor.
  • the preferred embodiment of the invention must therefore provide a fingerprint sensor with navigation means where the switch is also capable of registering lateral finger movements on the switch.
  • a known sensor is described in EP 735.502, which describes a line shaped fingerprint sensor.
  • the fingerprint sensor described in this patent publication scans the fingerprint, and in order to be able to analyse the finger print, is able to detect the finger movement across the sensor in one dimension; ⁇ Up> and ⁇ Down>.
  • Such one-dimensional finger movement detection may be expanded to two-dimensional finger registering by arranging some of the sensor elements as per fig. 4. This may for example be obtained by using two orthogonal sensors of the type shown in the EP publication mentioned above.
  • This embodiment of the invention comprising a single- button input device for multiple input modes uses "universally defined" finger command structures embedded in the translation means, ensuring that the sign generator provides the required input type in the respective input modes of the information/communication devices.
  • the input modes are arranged in a hierarchy. Level 1 is shown in Table 3a. This is the overall mode level, where input mode alternative is set by the information/communication device.
  • the next example of this embodiment of the invention demonstrates text input by Chinese signs on a cellular phone.
  • Each sign of a sign-based language like e.g. Chinese is composed of strokes (and components thereof) .
  • strokes and components thereof
  • a QWERTY keyboard Although there are hundreds of thousands of signs in such a language, it is possible to enter such signs by a QWERTY keyboard, because individual strokes can be assigned to the various keys and each sign is composed of a strict sequence of strokes. As more signs are entered in a certain sequence the resulting optional signs are gradually limited until finally the wanted sign is uniquely defined.
  • ZiCorp has taken this approach one step further by their Zi 8TM method. It consists of a new level of so-called reduced strokes that represents the 29 basic strokes by 8 reduced strokes.
  • These eight reduced strokes of Zi 8TM can thereby be represented by the limited keys of a reduced keyboard, similar to how the alphabetic letters are represented on such a keyboard in fig. 1.
  • the corresponding representation of the Zi 8TM reduced strokes on such a reduced keyboard is shown in fig. 6b, while fig. 6a shows the hierarchy of reduced strokes, basic strokes, components and finally Chinese signs.
  • the hierarchy comprises 4 or 3 levels, pending if components are considered as an independent level or not.
  • An elegant solution to resolve this problem by another preferred embodiment of the invention is to use the single- button sign-generator method by using the touch-sensitive switch 1 combined with finger commands and a Finger Command Structure embedded in the translation means 4.
  • the invention can be used in two input modes for generating e.g. Chinese signs; either by stroke selection from vertical selection fields on the display, or by directly drawing the components on the sensor switch 1 with two-dimensional registering of OJ w to to ⁇ > I- 1 in o in o in o in o in
  • the preferred embodiment of the invention for this mode will, however, be to draw the Zi 8TM reduced strokes directly on the sensor.
  • the required finger movement categories, and their sequence for combined movements needs to be embedded in the finger command structure of the translation means.
  • a further enhancement will be to embed the required finger commands for all the 29 basic strokes directly in the finger command structure, to skip one level of the hierarchy of fig. 6a.
  • the candidate signs may be displayed in an option field placed horizontally over the command field 9. The most frequently used of the candidate signs should be displayed first.
  • this embodiment of the invention enables generating even complex text composed from Chinese signs by a single sign-generator button. It is therefore possible to shrink reduced keyboard sets, as per fig. 1, to a single sign-generator switch, as per fig. 2, without loosing functionality in generating complex text messages, and with vastly improved speed and convenience.
  • the above examples were described for use with cellular phones, but is equally applicable to palmtop PCs and PDAs.
  • Fig. 8 illustrates another input mode that the Finger Command Structure of the translation means 4 can accommodate.
  • This example pertains to mathematical calculation on a palmtop PC, but may as well be embodied in cellular phones or PDAs. For such calculations the applicable Finger Command Structure set will be limited to taps on multiple selection fields as per Table 1, while lateral finger movements is reserved for cursor control.
  • Fig. 8a illustrates a palmtop PC set to Calculation Mode (arithmetic) in which mode the display 5 contains another type of vertical selection field 16 and another horizontal selection field 17.
  • the vertical selection field 16 contains all numbers from 0 to 9, plus decimal point (,) as illustrated in fig. 8b.
  • the horizontal selection field 17 comprises in this mode the arithmetic operators (+, -, * , /) plus Clear All (C A11 ) , Clear Memory (M clear ) , add to memory (M + ) , subtract from memory (M " ) , square root (v) and n th power (n) , etc as illustrated in fig. 8c.
  • the lateral finger commands are mainly reserved for cursor control. This means that when the finger is moved laterally over the sensor 1, the cursor moves accordingly on the display 5.
  • Navigation by fingerprints inside the selection fields may be initiated by finger command ⁇ Short Tap> when cursor is positioned within the vertical selection field to temporarily disengage the cursor control by finger commands . Then the user may shift character sets of the vertical selection field 16 by ⁇ Finger Left> or ⁇ Finger Right> commands (as per fig. 5b) . When the new character set has been activated the cursor control by lateral finger commands on the switch 1 can be re-engaged by pressing another ⁇ Short Tap>.
  • the horizontal selection field may be changed to other subsets of mathematical operators by placing the cursor in the horizontal selection field, pressing ⁇ Short Tap> to disengage the cursor control, use finger commands ⁇ Finger Up> or ⁇ Finger Down> to select other subsets, and finally press ⁇ Short Tap> to re-engage the cursor control by lateral finger commands.
  • This embodiment of the invention enables a versatile and flexible calculation mode on the display, still operated by a single-button switch 1.
  • the combined fingerprint sensor with navigation means, and interpretation/- analysing means to identify finger commands on the sensor and a finger command structure embedded in the translation means enables the use of a single-button keypad to enter complex text via the display in a convenient and versatile way.
  • the same sensor is also used for finger scanning for access control by user authentication to protect personal and privileged information on the device.
  • the invention thereby enables a cost-efficient solution with a large display and a minimum keyboard, yet enhancing the versatility for the user.
  • FIG. 9 Another embodiment of the invention for set-top boxes for television sets for pay-TV, etc.
  • the invention using a combined fingerprint sensor with touch-pad functionality enables identity verification of the user. By enrolling the fingerprints of the family, minors can be prevented from ordering X-rated movies, etc.
  • the combined fingerprint sensor and cursor control enable complex communication via the TV screen, by the use of a minimum keypad, eliminating the need to hook up a full- fledged QWERTY keyboard to the TV.
  • This embodiment of the invention is illustrated in Fig. 9.
  • the set-top box 18 may contain an On/Off button 19, two function keys (Accept/- Reject) 20 and 21, and the switch 1 with navigation means.
  • the user may position the cursor in dedicated communication fields on the TV screen 22.
  • the communication fields may comprise; search for titles, order selection, user profile of family members (access to X-rated movies or not) and similar for other services.
  • the Finger Commands for this application may be a significantly reduced instruction set, as compared to the comprehensive Finger Command Structure exemplified in Table 2.
  • the analysing/interpretation and translation means of fig. 3 may be embedded in a chip integrated in the set-top box 18.
  • Yet another embodiment of the invention is for Driver's interaction with the onboard computer in a car, as illu- strated in fig. 10.
  • the combined fingerprint sensor/navigation means will act as an intelligent key preventing anybody than the authorised and enrolled users to ignite the engine, as theft protection.
  • This application requires encryption of the sensor communication with the onboard computer and its engine control, to prevent by-pass by hackers/thieves.
  • the sensor 1 may be located on the steering wheel 23 or on the gear stick knob 25, as per fig. 10.
  • the sensor with navigation means may be used by the driver to communicate with the onboard computer, for GPS navigation display, for audio system control etc.
  • Circular finger motions (clockwise and counterclockwise) according to the Finger Command Structure of Table 2 may change mode, e.g.
  • ⁇ finger .up> and ⁇ finger down> movements may change radio channels, switch between tracks on CDs, etc.
  • the left sensor may be used for entertainment (audio systems, etc.) while the right switch may be used for gear shift, where upward finger strokes represent gearshift upwards, and downwards finger strokes represent gearshift downwards.
  • the finger commands on the switch 1 will be the driver's input device to the onboard computer while the interface will be presented on a display 24 mounted in the car's dashboard.
  • the display 24 shall preferably be menu-driven for convenient operation in a hierarchy of functions, as indicated by a typical opening screen of the dashboard display 24.
  • Yet another embodiment of the invention is for Laptop PCs, not illustrated by any figure.
  • the need to eliminate the keyboard is not a prioritised issue, as a full-fledged QWERTY keyboard provides higher input speed than a single button input key, and keyboard input is the main input form to laptop PCs.
  • laptop PCs normally comprises a touch-pad to eliminate the need for an external mouse.
  • laptop PC producers are looking for fingerprint biometrics for access control user authentication by biometrics to protect any privileged and sensitive information that the laptop may comprise.
  • the fingerprint sensor with navigation means according to the invention will combine both. functions into one single switch.
  • the invention thus uses a fingerprint sensor as touch- sensitive switch 1 that has the ability to register finger connections on the sensor and the duration of such touches, as well as lateral finger movements and their directions and type of movement.
  • a sensor with navigation means as described above is supplemented with sets of finger movement categories and sequences thereof in the interpretation/- analysing means 2.
  • sets of Finger Command Structures (as per Table 2) embedded in the translation means 4.
  • This preferred embodiment of the invention enables a multi-function single-button input key which combines several functions;
  • Fingerprint scanning for user authentication for access control A powerful text input device where sets of extensive finger commands supports convenient and fast input of complex text/signs/characters in a versatile and flexible manner for text input of alphabetic languages and sign-based languages, as well as enabling input to special operations like calculations etc.
  • the sensor's registration of lateral finger movements enable accurate cursor control either as part of text input sequences via the display, or for stand-alone cursor control through a single-button input device for multiple functionality, thereby integrating touch-pad functionality in the single device.
  • the invention enables reduction of the device's traditional keyboard as per fig. 1 towards devices with a large display and a minimum keyboard as per fig.2 without loosing versatility and flexibility even with complex inputs.
  • the invention also eliminates the need for large keyboards for input to/interfacing with set-top boxes and for onboard computers in automobiles.
  • the compact sensor may be fitted in small spaces, e.g. on the knob of the gear- stick in a car, etc.

Abstract

Method and system for generating complex text input by sequences of finger touches on a single sign generator in cellular phones including a display and a sign generator, the sign generator including a finger touch sensitive sensor being adapted to sense movements in at least one dimension, analysing means, and translation means, measuring omni-directional finger movements across the sensor in two dimensions, using the analysing means for categorising omni-directional finger movements across the sign generator according to predefined sets of finger movement sequences including directional and touch/no-touch finger movement sequences, using the translating means including uniquely defined command table for translating the categorised finger movements into signals controlling the display as results of the finger movements on the sensor.

Description

Method and system for inputting characters
This invention relates to a sign/character generator represented by a fingerprint sensor with navigation means, for text/sign input to information and communication devices with displays, like set-top boxes, cellular phones, palmtop PCs, PDAs, etc.
The present information society provides the users with an increasing number of information and communication devices for numerous purposes, and the use of such information and communication devices are expected to accelerate both in types of devices and the number of users of the respective devices.
Most of these information and communication devices contains, or give access to privileged and/or sensitive information. This accentuates the need for access control by identity verification of the user. This has traditionally been handled by passwords or PIN codes. However, these are not personal as they can be given to other persons by the owner, or stolen from the owner. Accordingly there is a strong trend to base access control on biometrics which is mathematical description of characteristic elements of the owner's body or behaviour that can not be separated from this person, and which describes him uniquely. Many forms of biometrics for identity verification is available, but the dominating type of biometrics appear to be fingerprints as it uniquely defines the person, is easy to scan and is not feel to intrude the user's privacy. Hence many types of fingerprint sensors have been made. One such fingerprint sensor is described in EP 735.502.
Implementation of such sensors in information and communication devices on an industrial scale with large volumes is in most cases pending the benefits established through a cost versus benefit analysis. It is also in many cases a question of available space on the device. The utilisation of such identity verification devices as e.g. fingerprint sensors will therefore be significantly enhanced if it can be combined with other functionality, and
Figure imgf000004_0001
0 0 CO TJ 0 3 TJ Ω H- ?? 3 tr Ω Ω fT ^ Ω 3 H- TJ Φ Hi P. H Ω 0 Ω F- H H Hi rr Pi ΓT Φ
Φ Hi tr l-i Hi tr H M Φ O SU " tr tr tr PJ 01 tr X n 0 Φ O C tr r-1 Φ Φ i S ø S3 01 to 0 Φ Φ Φ H *ϋ • ! <! H SD $11 φ H- Φ Λ O PJ ø TJ 0 3 J -> 01 tQ H p. O TJ
P> Hi s3 CQ pi N 01 01 O H- H H H Ω J Φ -1 ø 3 Ω ø H 01 1 ϋ 0 O ø P- Φ
ΓT H- 0 01 Φ 01 O 01 O 0 Φ 0> fu Hi 0* TJ i Φ T rr O Φ rr φ Pi 01 H- H1 Ω Ω Pi Ω
H- 0 φ TJ tr H3 P- H Φ ø tQ Ω Ω H- " Φ Ω H -> H- rr cn 01 H l-i Ω ΓT <! H Φ PJ Q O 01 H-
< IQ H- CQ J ^ Φ 0 01 Φ . ΓT ΓT 0 PJ 0 H φ IQ 3 Φ O O Φ PJ rr l-i Φ Φ 01 φ 3 TJ Pi
Φ φ a H IQ tQ Ω rr φ Φ tQ O Φ Pi ø TJ 3 0 H- O Φ Pi P. P. 01 r-1 H 3 φ H1
K 0 rr 01 W- 0 m O øJ H H H φ 3 rr 0 H- PJ ι-j φ ΓT 0 Hi ri rr "<! M ø Ω l-J pi Hi Hi H- O Ω rr 0 H Φ 0 01 H φ tr 0 P» ø 01 l-1 O Φ Φ tr ΓT ? ø ø ΓT
01 ΓT H- Ω Hi ø" ΓT 01 H- *" Ω φ I-" ø Hi <{ 01 P. O w H P. *< O φ P I-1 H- 01
TJ Pi IQ pi ø rr O Φ H φ 3 Hi TJ 01 O 0- H P) P. P) Pi rr H- o 0 φ Φ *< 01 Pi Ω H- φ TJ a H S3 O O K ø H- H 0 σ fu Ω ^ P. r-1 O ^ T H- P) H- 01 ri Pi S3 Hi
Ω oi "< Pi J 3 tr I-1 H- 0 9J TJ H 0 X Φ rr Hi Φ 0 0 PJ 01 H ø 01 0 01 rr H-
ΓT I-1 H H 3 s» o ΓT tQ Ω φ ΓT H- H- 0 T y, ø 0 rr rr < Φ 01 TJ ΓT tr TJ H- I-" H-
F- • w Φ ø H rr P H- Φ ΓT H ø" 0 Ω O tr TJ H H1 O 01 H- 01 PJ ) 01 Hi H- 0 tr O tr O r-> rr
H- 01 φ a H O 01 W H H- Hi Φ IQ 0) s. O φ Φ ø O 0 H- H φ H- iQ rr Pi s3 O ø
01 H_ ^ JU H" H- φ I-1 Ω 0 H- I-1 0 ø 0 H Φ Hi 0 Ω H φ 0 IQ 0 ø ø 0 tr ΓT
TJ tr 0 0 Ω \-> O Ω φ Hi Φ H P. 0 Φ 01 lO Hi Hi 01 tr i rr • H- Ω φ P. Φ tr rr H H- H. to tQ J ø 0 K. 3 H- IQ tr 01 CQ H- tύ 33 Hi H- tr CQ P> 0 O rr F- CQ Φ φ tr φ CQ φ ø H- rr Hi Φ 0 rr O ΓT φ 01 JU 0 <! H d Φ Ω tr H M O rr H tQ 3 tr 0 <J H- K
P> CQ TJ ΪU Ω H- O 01 H- 3 tr P. TJ 0 H H H- Φ H- ta Ω H- p. Φ φ H- . TJ φ 0 H- r-> φ
ΓT β μ- H tQ O ri P. rr 3 H- I-1 TJ r fj 0 Ω H_ rr Φ <! P. M O 01 H Hi 0 Ω I-" tr
3 01 φ Φ 01 P H- H Φ w 01 tr fU Φ ΓT Ω PJ 01 κ| 0 Φ 0 Ω H- ø M φ Φ H- H Φ 0 •<!
H- 0) 01 - Φ 01 Ω 3 Pi 01 φ •< J M H- r 0 01 <! rr Ω tr 3 O <! X Φ IQ 3 01 O
ΓT tr Pi φ PJ tr φ H- •<; H- O Φ P. O W Φ tr Φ PJ H- O s: Φ ΓT . Pi rr Ω a ø rr H u JD ø 0 01 3 <! O 0 Pl 0 Φ H Ω Φ P. H Γ ø Φ H rr ΓT I-1 tr ι-{ Pi
H ; rr tr Ω i H 01 H_ ΓT φ n φ 0 01 Ω • : *<: O Φ PJ φ < P) Φ φ I-1 I-1 Φ Pi ø to
Φ Φ H- φ tr CQ PJ H- O " O 0 Ω φ H H- O tr 01 ø X Ω P. 01 Φ X H * -1 rr
Λ CQ a K Ω O 0 Φ O 0" rr ΓT 01 0 0 M O TJ r φ r 0 H rr 01 o Φ H ø H- Φ uα φ Hi P. ΓT 0 W ΓT JU φ H- tr tQ 0 O PJ Φ *^^ H- •<: φ ΓT Ω Ω 0- Ω S3 P. φ
H- IQ iQ tr O φ Φ Ω ≥! Φ 0 Ω Ω φ rr rr s: l-i ø tr 0 tr ϋ tr * tr 3 0 O TJ r-j 0 Pi 3 > K <! ι-i P JU ^ JU H- ΓT i tr *<! Φ φ P. Φ Φ rr O 01 J Φ J φ Ω Ω 0 Hi M
Φ H- a ø Φ Λ H <! Ω H- h-1 Hi φ H <! rr ø H J *^-- rr H <! H 01 tr tr rr O Pi O l-h ΓT 3 I-1 I-1 01 P 01 H- ju Hi fu O H 3 J Φ TJ H Φ O H 01 Φ Φ pi 01 Pi Pi K Ω
H- ΓT H- φ o Φ o H ø ft) H1 ø Ω o ≥l o Ω H ϋ i Hi P. P. H- H- P. 0 Ω i H i-i H- Φ
PI Ω 01 F- a tQ TJ H V H O P. 01 M o 0 0 rr O rr H- ø • tQ rr ø rr tQ i φ 0 01
PJ 0 TJ H- i φ φ I-1 ΓT ^ O I-1 ΓT Φ 01 <! Φ rr Ω 0 Ω Φ Ω P. O O
ΓT rr s: Φ
0 H1 3 M P. Ω i 3 M T Φ Hi s H- H- Φ CQ T Φ H- ϋ 01 ΓT 0 i 3 rr ri ΓT ø Φ H- rr 0 o - Φ H H TJ 3 TJ i Ω rr tr P. rr H •P. O P. rr 01 • Φ Ω φ tr J M ΓT CQ H PJ H- P. <1 Φ H m 0 OJ O tr μ- φ tr P> rr 01 tr H φ H Φ
0 * ! H- Ω H- Φ O φ £ 01 01 Φ 0 B5 3 Φ 01 P. Φ rr tr Φ W ΓT H_ CQ p. Φ ΓT K
01 O tr a ΓT 01 0 Λ 3 01 O 01 TJ 0 Φ P. TJ H- tr i 01 Φ Pi O tr P.
M K. a PJ tQ ΓT < P. φ 01 H- I-1 01 fu Hi H <! P IQ φ tr 3 0 ø rr *< μ- PJ Pt ø
SD Φ H Φ 01 0 0 0 0 0 H- H H- Ω Φ X >< J rr i tr 3 Φ 01 0 φ Ω S P.
H- Φ
ΓT p. Pi pi ΓT H ΓT -5 ΓT M IQ ΓT 0 ΓT CQ H- ϋ rr rr M ) Ω o ø PJ P. ^ Φ Ω <
H- ø oi Ω tr Φ ø 01 P H- tQ H- H- 01 O - Φ Φ ΓT ? ø ΓT ) 01 PJ H1 Ω H- tr P. Pi H-
0 Ω ΓT φ Ω 3 V rr ΓT O Ω tQ I-1 H K tr Φ P. tr ø H- H rr tr 01 01 0 r-> Ω
0 Φ rr Φ O - i H- tr ø P. 0 0 ι-{ (- M J ø Φ rr Φ CQ α H- H- PJ pr Φ
P. tr H 3 3 Ω CQ O Φ O I-1 01 O Φ H- P> . •<! tr ø 01 TJ w TJ IQ H Φ H- 01
TJ φ 01 ø ø1 J φ ø ΓT ^ ϋ IQ H1 Ω φ H- Φ PJ 0 p.
01 *< 0 •
K •* H- X H- 01 a- 0 H PJ h-1 _! tr rr Φ O IQ Hi Φ H 01
O tr a rr a H Ω rf J φ PJ 0 Φ rr H ΪV M 0 Φ H- rr ^ tr Hi
ΓT 0 O ι-3
0Q ø ø PJ H- P φ Φ I-1 ø ΓT 01 P. P. H- Φ Φ Φ Φ 0 Ω tr M tr i K tr i-f ΓT 3 CQ TJ rr P. O -> 01 Φ tr H- 0 ø ; 0 Φ PI Φ ) *< pi H 3 Φ
Pi * I-1 P- ΓT F- O Ω Φ iQ tr P- tr H 0 01 <! P. pi 01
3 ΓT φ Φ O 1-3 3 ΓT 0 *< fu o J Pi ΓT Φ ΓT Φ tr l-i a so HI H- φ 0 rr PJ l-i H- φ 01 __ O ΓΓ P. 0 P. O ri O K 01 K P. 0
> > to to H Ή n o in o in o OI
01 tr ø 0 rr 01 TJ Ω 01 01 01 3 0 3 ø 3 Pi ι-3 Ω 01 Ω TJ W H- ΓT w Pi Ω 01 01 TJ CQ TJ Hi μ- 0 pi 0 tr ϊ l-i Φ 0 H- F- Φ o Φ ø ø 0 tr tr H- Φ H Φ 0 tr φ 0 O μ- H 0 tr 0
3 s3 <j 0 Φ H- o H H 3 tQ ø 0 rr H P. φ pi N H O *< TJ Φ *< TJ 3 H tQ 0 H 0 H
H- Φ F- Φ ΓT <! H 0 H- 0 r tr & ΓT H Φ H tr tr 0 01 Pi TJ 0 ø <! 0 ø
H <! tQ Ω ) Ω H- 0 rr H P) F- H o φ H- Φ Hi Pi 0 H O ΓT ø ^ H O ΓT 01 H- rr Φ Φ pi Φ Pi CJ Φ tr tr ci P. H H- l-t PJ H o J P. i-i cl TJ J H- Ω H H φ Pi ø ΓT 01 H- P. CO H- )
H i-i rr to 01 0 Φ en φ Pi O ΓT l-i 01 0 ΓT 01 CO H Ω 0 rr μ- pi 3 H 0 3 3 H- Φ 0 ΓT φ H- O 3 Ω
H- 01 <j 01 P. H. 0 CQ H- i Φ tr IQ Φ 3 r 01 P. Hi _r ø Ω P. 0 tr P. iQ 0 φ tr
0 T ) Φ in H- 01 J ø Ω J σi φ H H- Φ Ω ø H 0 - 3
3 0 l-i 3 O - Hi TJ Hi 01 0 0 ΓT Ω 0 rr ; r-i 01 rr TJ 0 π H tr H 0 H- O tr O H pi o <; φ 0 o 0 tr o H P. tr 01 0 P. VD H- Φ Pi tr Hi PJ tr PJ Hi 01 ø * : tr Ω H Pi
H ? ø in 0 CO H O K Pi 0 Φ H- K 00 3 < rr 01 rr o 01 H- w H- -i IQ Pi Pi 0
01 Φ rr -J H rr Pi CO 0 0 rr l-i IQ P. Hi to Φ tr - H- H- 0 0 0 Φ 0 01 tr tr N ø H tQ
O 01 H- PI H- •- o φ Hi μ- Φ 0 0 H- 0 01 3 φ tQ O φ 01 TJ Φ • ; 01 O Pi H- p. H 0
H in H 0 S3 o ΓT - Φ 0 0 TJ 01 01 0 0 -J pi H 0 0 • μ. φ 01 01 J H- 1 01 pi o H Φ Ξ Pi
0 H- IQ 0 H -J tr Φ tr ø n Φ IQ Ω o rr ^ φ 01 01 0 l-i Φ IQ Ω Φ o H- Pi 0 IQ
Pi 0 ΓT o Φ Φ H- o Φ tr P. t- - Φ P) ΓT __ 0 Hi IQ 01 0 P) p. H r-i 0 rr Φ
01 01 H- P. 01 H > H- φ H- 01 0 0 rr F- 0 o r-i H- Hi Ω Pi H- • H φ TJ IQ H- O
0 φ P. 01 rr P. 0 Ω 01 Φ Hi P. o o 01 φ r-i Φ rr w Pi H- tr 01 3 H O P. - H i-i rr H- 01 Φ rr 01 Φ TJ 0 tQ rr ø 0 φ φ φ φ Λ φ IQ i μ. ι-3 Φ ø 0 0 Pi O Pi tr ΓT . 01 l-i O S3 01 0 01 P. rr Φ rr ΓT 01 H P. ø ø ?r . l-i 01 H tr P. Ω ΓT Hi TJ H 0 φ PJ Ω 0 H i Ω H H- H- 0 φ 01 H- O tr Ω Ω Φ tr H- 0 tr φ pi tr Pi φ rr φ o 3 Pi P. tr K Ω 0 rr l-i TJ 0 0 Hi 01 IQ H- Pi ι-{ Ω rr l-i ι-i 0 *< H Ω 0 l-i 01 tr t P. Pi -
01 H H H- ΓT ΓT Ω H- O tQ Hi Ω Pi tr Ω 01 rr F- rr 0 01 Φ 3 Pi tr rr S3 Φ Pi Φ Hi 0 H- rr
Φ φ ΓT tr 0 H- tr tr 01 o ΓT K ΓT o Φ tr P. i r-i 0 Φ ø S3 01 w Pi o ΓT 01 tr ø >. Φ ii O φ Φ 01 H tr H- H 0 TJ tQ Φ P tr ΓT H P. pi tr l-i pi tr H- Hi φ Ω rr tr J
01 Hi 01 01 Φ 0 01 01 φ 3 H- tr J W rr 0 0 01 φ 0 rr H l-i 0 01 H- Pi Ω Pi
H * H- tr ø 01 ΓT
O o • 0 P 01 Φ φ H tr H 3 o ; H- P. rr 0 01 Ω tr H φ 01 i
N K P. P) O H- rr 01 rr P. tQ >< o H H- Pi φ TJ tr 01 tr ) H- 01 rr o H- r-i H- ΓT
H- 0 ø ΓT H tr o H- H- Φ 01 H H- Φ 01 H Φ Ω Ω Hi P. . Hi 01 Ω rr i rr tr P. tr
P. 0 3 ΓT φ -i 0 0 H- Ω 01 L-t. 01 Φ o O CQ O O H- ι-i rr n PJ w pi φ φ CQ φ 0 ΓT 01 tr 01 0 <J 0 fu Hi Pi P) O pi 01 3 3 0 rr n φ J IQ rr 01 O tr P. ΓT 0 <! ΓT CQ
CQ 01 ø TJ tr ΓT 0 0 φ 0 0 rr H- : tQ 01 o TJ rr H- 01 tr rr P i Φ o H- 0 φ
Ω Φ 01 rr φ H- 0 01 S3 H- 0 a P. ϋ Ω H- 0 01 Φ φ <! o Pi H 01 H φ H Φ rr Pi S3 0
H H- H- H tQ Φ tr 0 ΓT to 0 0 rr rr P. φ 01 H- H H- 0 φ H 0 01 01 Ω 0 IQ tr 3
F- H- o Ω H H tr H- ΓT μ. Ω TJ K ø o H- P. φ ø tQ O IQ • H W ~ O tr pi ø tr 0 0 Pi H- o Ω o o tf o H 01 Ω P- 01 l-i 0 rr ø Φ Φ tr TJ J rr rr <1 01
Φ 01 H 3 l-i H- Hi tr 0 3 O O 3 Pi w 0 Pi Pi Φ ~^ H ι-3 rr 01 S3 H- φ H " φ ΓT
P. 3 H- φ rr Pi n J <! ι-i Pi S3 ϋ Hi Λ Ω ι-{ J tr ΓT tr 0 i-i Pi τ Φ
0 P) 01 ΓT TJ ■ 01 tr ΓT 00 H H- • ^ TJ rr 0 0 3 Pi ø tr Φ l-i H- Φ J H- Φ Ω Φ ς_ . tr
0* tr 0 Φ Φ l-i H- φ J 01 0 o H- P. ι-i 0 0 Φ H H- Pi 01 01 H H Ω 01 Hi ΓT 01 Φ Φ
Φ H- P. 0 P. φ 01 <! <! 3 - Ω H- H tr o 3 0 Pi l-i n 0 Ω 01 Φ tr φ F- Φ H- Pi <!
K H 01 01 φ Φ Pi TJ in J 0 tr Φ Ω Hi φ P. 0 H φ Pi H Φ 01 IQ i-i 01 3 Φ 01
Φ Φ Ω 0 J φ 3 H H ι-i 1 rr tQ Φ Φ φ Ω H- φ P Ω <! H O Pi Pi 01 01 . Φ H ΓT o H <J 0 O Pi J H o Φ 0 CQ φ tr rr 0 01 rr Φ H H ι-i 01 Φ H- H- ΓT O O
TJ J 3 i rr K H H <J • P. r TJ 01 01 P. pi tr tQ 01 Φ 0 ø Φ CQ & tQ H1 B tr J TJ H
H tr TJ S3 H- 01 Φ K 0 μ. * ø Φ o 0 Φ Hi i ΓT H rr H- 0 0 • TJ φ l-i φ Φ φ 0 H μ- H P. Φ 0 P. 01 Φ tr K Ω H- 0 ? 0 tr Pi μ- J CQ φ 01 0 0 P. P.
Hi ø Φ rr Pi Pi Ω φ i H- φ o H rr • tr Ω w H φ P. H- φ r-i O 01 0 ø ι-3 rr t i tr φ Φ X tr tr ø O P. P. rr H Ω H- o i J Φ >< J3 ø 01 φ Ω i tr H- H pi H-
H 01 H- H 3 F- ; pi ø o Ω H H <! 3 01 P. TJ 3 TJ H- P. Φ l-i φ tr φ 0
P) ΓT φ TJ Ω ΓT 0 ) S3 ι-3 PJ H tr φ ø 0 Pi tr φ iQ Φ <: oo 3 01 tr i <: pi Pi tr Φ CQ H- rr rr ι-i tr Ω <: o 01 rr Φ rr H- O ø ø rr Pi ESI _ 01 H- rr
H ø 01 Ω ΓT Φ • H- 0 ϋ H- H- Φ ΓT pi 01 tr 0 ø Pi Φ 0 Φ H- o • 3 tr
*< P. TJ rr Φ Φ tQ Pi Pi rr ΓT Φ tr P. Hi tr H- Φ P> P. ø S ø o o rr Φ
H 0 Φ H p. tQ 0 O 0 H rr H- co H- H
0 Ω rr H 01 Φ Φ rr tr 0 i 0 Pi
CQ Φ tr Pi Φ - • rr Pi 01 0 Φ Φ φ ϋ
Φ . ) tr 01 01
01 ø Φ φ
a 16x16 pixel matrix it is not suitable for use as a fingerprint sensor, since the resolution is unsufficient .
US 5,608,395 describes a telegraph key connected to a computer for writing text. The characters are organized in a hierarchy for demanding a minimum memory for choosing each character. This solution is also to complicated and large and does not have the advantage of using existing sensors in modile phones or similar.
The above illustrates the present situation for information/communication devices (such as cellular phones) , where complex text input is cumbersome as such input has to be generated through the limited keyboard of fig. 1. The next generation of cellular phones comprises so-called WAP phones with Internet access. In general this development calls for increased displays, for better readability of more complex information. Preferably increased display size should not increase the cell phone size. The most viable way to increase display size without increasing the phone size will be to reduce the keyboard size to maximum one row of keys, but still enabling complex text input to the cellular phone. None of the above solutions will function satisfactorily with such a minimal "keyboard" , as illustrated in fig.2.
Identical problems are encountered for small handheld PCs (so-called palmtops) and for PDAs. Also for these devices it is a general desire to increase the display size, without increasing the overall dimensions of the device. This can only be achieved by using minimum keyboard size. Various solutions have been implemented to eliminate the keyboard, but they are all associated with serious negative effects . One solution is to provide the palmtop or PDA with a touch-screen, but such screens are more expensive than regular displays. Another known solution is to provide the palmtop or PDA with a special pen to write on the screen. However, such pens are expensive, they may easily be lost, and they generally require that writing is done according to predefined sequences of sign elements that must be drawn within fairly narrow boundaries of shape.
Similar problems are also encountered for set-top boxes for television sets connected to cable TV for pay-per-view applications. For such set-top boxes the TV screen may be used as communication interface (e.g. for search for information and ordering of films) but this requires a keyboard. Such an extra keyboard for the TV increases the costs, and represents yet another external device that normally clashes with the design of the TV, and needs to be stored nearby the TV. The ideal solution would be to have a single-button keyboard incorporated in the se -top box, which may be used both for input of complex text and for identity verification, e.g. if minors shall be barred from ordering X-rated movies, etc.
Similar problems are also encountered for automobiles increasingly being equipped with computers for navigation purposes, for selection of entertainment, etc. Such applications require communication interface between the driver and the on-board computer. In a car the use of a keyboard is not tempting as its use will distract the driver's attention from the traffic situation, and may be hazardous. Apparently voice control could be an elegant solution, but this seems to be impractical due to the general noise level in a car. It will also require implementation of voice commands in many languages, as most car models are made for the international market, thereby requiring extensive memory capacity in the onboard computer, which in turn adds logistics requirements and costs.
For laptop PCs the problem is different, as they normally have integrated full-fledged QWERTY keyboard. As one of their primary functions is to enable fast and complex text input, replacing the keyboard with single-button text input device would be counterproductive. However, such laptops are normally furnished with a cursor navigation control in the form of a touch-pad. It is highly desirable to provide these laptops with fingerprint sensor for access control, both for securing sensitive information contents and to discourage theft of such expensive devices. In this context it will be desirable to combine such a touch-pad and fingerprint sensor, if technically possible, for cost and space reasons . Thus it is an objective of this invention to provide a sign generator for information and communication devices equipped with a display, as outlined above. Such sign generator shall be capable of generating complex text input in a fast and convenient way through a single-button
"keyboard" . It shall further be able to execute accurate cursor control on the display providing full touch-pad functionality, and shall incorporate fingerprint scanning for authentication. This objective is obtained by a sign generator based on combining a fingerprint sensor having navigation means, with analysing/interpreting means and translation means as described in claims 1 and 9.
The invention will be described below by way of examples and with reference to the accompanying drawings . Figure 1 illustrates a traditional reduced keyboard for cellular phones, with multi-character keys.
Figure 2 illustrates schematically an information/- communication device, equipped with a large display and a single sign-generator key as part of a minimum "keyboard" . Figure 3 illustrates the invention schematically.
Figure 4 illustrates categories of finger movements in two dimensions.
Figure 5 illustrates how to operate text input by selecting characters on the display, by finger commands. Figure 6 illustrates the stroke hierarchy for Chinese signs, and the representation of reduced strokes on a small keyboard.
Figure 7 tabulates stroke/sign hierarchy of Chinese signs. Figure 8 illustrates how to operate in calculation mode by finger commands on a palmtop PC.
Figure 9 illustrates a typical example of embodiment in set-top boxes.
Figure 10 illustrates a typical example of embodiment in automobiles.
First the principle of the invention will be described, followed by description of some typical applications. The principle of the invention is illustrated schematically in fig. 3. A touch sensitive switch 1, in the form of a _ co to H I-1 o iπ o in o in
ΓT tr φ H- TJ tr Ω H tr Ω TJ rr Ω tr S3 01 tr
__J Φ X IQ Φ Pi i d Φ 0 ri tr 0 Φ φ •<: Φ
T p ø K ø 0 S3 H- 3 Φ Φ 3 rr H 01
H- H 3 O H- P. 01 Φ ø 3 P. TJ S3 H rr Pi
Ω Φ TJ H d H φ 01 tQ i Φ Ω H Φ Φ
Pi IQ H Φ P. H- P. ΓT 0 Hi d ι-3 Φ Φ Pi 3 01 1-3
H H- Φ P. 01 0 K P. H- 0 tr rr 0 CQ H- tr
01 iQ tr H φ 01 0 0 φ Φ 3 φ ft rr H *< H- CQ . φ φ T rr H- T
H- φ _ O 0 0 3 H- P. Ω Ω Ω Φ t H H rr
3 H ø K 0 Hi Pi H- 01 ι-3 rr d tr H φ H φ O
Φ φ p. tQ Ω ΓT rr tr H H- 0 i H- ø
P. 3 Φ ΓT Ω Φ Φ H- d 0 H O P. ϋ d Ω
H d Pi H tr H- P. H 3 ø Φ i P. F- φ 0 tr μ- P) Hi *< φ P. Φ Φ 01 H- Ω Ω CQ 01 tQ
3 01 rr Φ Hi P- > rr TJ rr rr Ω H- d 01
H- 3 tr tr H- 0 H- 01 01 φ H- Φ tr O 01 Hi Φ
ΓT TJ φ Φ Pi 0 ΓT 0 i rr K O H Φ 0 rr Hi ø
01 φ 01 0 Hi Pi Φ 01 Φ Pi μ- ø 01 rr 0 Φ 01
. ri 01 Ω O H P. 3 Ω d --~-. S Φ H. rr H-
H- pi H rr H. Pi Ω P. Ω 01 Φ Ω O rr o tQ i tr 3 ΓT P) Ω o Pi H- φ rr rr 0 H-
P. Φ 01 Φ pi O 01 01 o H rr rr iQ ø H- tr Ω <
01 5 01 ΓT 0 H- 3 P. 3 Φ 0 O Φ tr Φ
. H- TJ μ. Ω rr tQ TJ μ.
_ ι-i 0 Pi tQ 01 rr ø tr Hi H O 0" H 0 0 O tr P. 01 01
Φ H H- φ 0 Φ P) H- tQ P. ϋ i φ TJ ø φ S3 rr 0 Φ P. 01 H 01 μ- 0 Φ ϋ 0 H-
S3 P. Φ Ω 3 . φ rr
Ω Φ P. 01 ϋ Pi 01 rr
Φ P Hi O d pi 01 o o 01 μ. H- rr H- Ω
Φ Pi P) H- 3 Hi *< CO TJ IQ O μ- rr tr
0 P. 01 0 3 H- H P. •g 3 Φ 0 P. d H-
H- Φ 0 ΓT tr IQ d Φ Pi 01
Pi ϋ pi 0 <! H
01 rr Pi P. 0 tr Φ 0 S3 Hi φ H- ϋ * H- H φ μ. H- H- Φ pi H- d 01 H- d 3
IQ o 01 H Ω H- H H 0 0 tr P. 0 Hi 01 Pi
0 ø φ H- Pi 01 tQ 01 φ IQ Φ 01 S3 *
01 TJ 3 rr S3 0 J P. TJ O rr H-
• H Pi H- H- μ. O tr 0 rr 01 tr φ H tr rr μ- o H rr O rr H Φ - p. 01 ø" Φ Φ ri μ. P. φ Ω ø ι-3 0 P CQ ø Ω φ Φ H rr H- Φ Φ tr
P) IQ ΓT tr p. 0 0 rr 3 Φ ≤3 O H Hi H- tr Φ 3 P. IQ T 01 Ω Φ P. H- rr
H P. Pi Φ H rr TJ rr rr Φ CQ rr 0 H CQ φ H- Ω *< < d 01 φ 0 _ φ ø O tQ 0
01 O H- Φ tr ii H s_
P. tr φ 01
H Ω P. Pi Ω . ?J o S3 Φ P. H rr H-
O Φ H Φ tQ <! H H Hi tr O rr H- tr 3
P. 0 01 O ΓT H- μ. S3 •<; ii S3 01 rr H- TJ φ 0 d H- φ 3 0 H- . Φ rr O 01 H
Hi Φ Hi π P. P- ii H- IQ rr 3 01 Φ μ. ø φ
H- Ω O tr d ø rr Φ tr Φ • ø 0 Ω Ω 01
0 rr K Φ ø Φ Φ rr 01 K i tQ tr Pi rr
Φ 01 ø i-i tr 01 ø Φ 01
01 Φ ΓT fi Hi 0 H- 01 φ Hi
3 Ω 0 d ø 0 i 01 " 0
P> rr H ri H- Q tr rr li
*< H- C rr 0 Pi tr 3 d tr IQ 01 φ
0 φ
Figure imgf000009_0001
Table 1
Figure imgf000010_0001
The time limits of Table 1 above may of course be chosen otherwise. A particular embodiment of the invention is to set the above ranges dynamically to adapt to the user's skills and his learning curve in using the invention. This may be done by registering the e.g.' 50 last commands of each type, and calculating the arithmetic mean and standard deviation. The statistics may be based upon any written text or a predetermined learning sequence, and may be used to shift the category definitions according to the speed of the user, and thus also adapt as the user learns the system and increases his input speed.
The touch-sensitive switch 1 may in its simplest form be a simple on and off touch sensitive switch. However, this is insufficient relative to the objective of the invention to provide combined user authentication by finger print biometrics, accurate cursor control and fast, versatile and flexible text input, all served by the very same single- button sensor. The preferred embodiment of the invention must therefore provide a fingerprint sensor with navigation means where the switch is also capable of registering lateral finger movements on the switch. A known sensor is described in EP 735.502, which describes a line shaped fingerprint sensor. The fingerprint sensor described in this patent publication scans the fingerprint, and in order to be able to analyse the finger print, is able to detect the finger movement across the sensor in one dimension; <Up> and <Down>. Such one-dimensional finger movement detection may be expanded to two-dimensional finger registering by arranging some of the sensor elements as per fig. 4. This may for example be obtained by using two orthogonal sensors of the type shown in the EP publication mentioned above. The ω to to H I-1 o in o in o in
Hi 01 Pi P) Pi Hi Ω ø 01 <1 μ- μ- TJ Ω μ- Ω 01 Ω Ω 3 Ω 0 tr 3 rr H Hi rr Hi μ- μ- 0 H 0 μ- 0 φ rr Φ co ø β 9) ø d Φ Pi μ- 0 Pi Hi φ o 9i 9i μ- tr μ- Q tQ 0 rr P. ø 3 Φ li ri <1 Ji 0 rr 3 ø rr ri <! rr <! TJ rr ø 9i UQ
0 rr Φ iQ 3 a ø CQ i Φ TJ Φ T 01 Φ Ω Φ Φ 9J Ω Φ 01 Φ iQ ΓT ø
01 tr ii ri φ P Ω 9) TJ ø 0 tr ri ϋ 0 IQ ø 3 tQ d 3 *— ' ri φ ϋ . — φ ø ι-3 Φ ii ø Hi rr rr TJ rr 01 φ TJ Φ H CO d H φ d 3 3 φ 9) H 9i Φ
- ii Pi tr TJ P. d ø μ- H μ- Φ 01 i tr β H 91 ø H d & ø H ri rr Φ ϋ Ω ii ϋ H μ- d CQ 3 Φ φ S3 Ω μ- ri rr μ- < μ- rr Φ 3 Φ μ- φ 3 μ- Φ d 01 Φ μ- Ω ø rr 9i rr ø μ- tr 01 01 Φ Φ ø 01 μ- Hi 0 H rr 9) <! i 01 3 rr 3 rr Pi μ- tr P. 9) CQ rr Φ 3 CQ 3 φ iQ μ- <J β H
Ω * Φ 0 Φ 3 H φ 3 ; tr Pi ø Φ Φ rr μ- tr Pi P. O . — . φ p. . — tr 0 φ 01
• ø i ø P) ø 3 ø H tr μ- <! <! O Hi ø Ω rr iQ 01 φ 01 tr 3 H rr ø Ω d 01 d Φ o Pi rr Hi o φ ø rr μ- Φ 0 li rr S3 H Φ • P. rr
1-3 Φ o *< 01 P. rr H rr Hi <! 0 H ø 9) d ø 3 d - μ- d P. H H tr P. 01 ø μ- rr Φ Ω ø d 91 <l β φ O 3 rr Ω μ- o rr Pi
Φ CO Φ μ- Pi 01 ϋ 01 tr rr d -• Ω Ω 3 rr ø μ- Ω rr ø Hi rr tr W ti 3 H d rr μ- 01 ø rr Φ μ- φ tr tr ii P. iQ tr tr rr Hi o tr S3 φ O Φ
H iQ ^ iQ tr ii ø Φ Pi pi o* 1 01 9J 9i 1 Φ 01 0 β ΓT μ- Ω <! Ω tr 01 ø 0 pi 0 μ- iQ μ- H μ- 01 φ ø μ- rr 01 — 01 φ 01 μ- 01 rr Φ O β
TJ 1 S3 3 01 Ω 01 ø μ- H Hi ø φ iQ 01 ø μ- φ pi Φ 3 φ μ- 3 3 μ- Ω
0 tr tr φ μ- rr Ω ΓT ø μ- φ 0 β H rr d 0 ø 0 01 TJ Φ d Φ 5" H Pi rr Pi φ Pi Ω ø Φ d β TJ Hi ø P. 01 φ Pi ø ø 01 Pi rr 01 μ- li Pi 0 0 μ- P. rr
01 H 0 ri X 3 μ- β 0 iQ μ- 0 rr μ- μ- H tr O ø o 3 ø 01 rr ø Φ
3 Φ φ 01 φ Φ φ T rr rr 0 φ Hi rr Ω μ- rr 3 rr : Φ ri tQ <! Φ P. 9) Hi tQ
0 P. H 3 H μ- Ω H 0 μ- φ d μ- Φ μ- 01 μ- *• H μ- 9i d Ω rr μ- d
P. rr Ω φ μ- TJ Φ <1 3 rr 0 <! 01 ø <! 9J μ- li φ P. 01 Ω Hi Pi μ- ø ii
Φ H tr Pi 3 01 H X Φ o μ- Ω Ω φ φ 0 φ ø <! μ- 0 0 rr d tQ μ-
01 Pi Φ 0 Φ μ- P. o o ΓT d 3 01 iQ P. Φ Hi ø ϋ 0 3 Φ ø Φ Φ
Figure imgf000011_0001
0 ø P) Hi Hi S φ 0 3 μ- 01 Hi Φ 01 CQ β ii μ- IQ φ 0 d IQ 01 ri 01
Pi tQ P. tr rr μ- μ- μ- CQ CQ 3 d S3 Pi φ φ S3 μ- H rr 0 3 rr < O
H ø Φ Φ W Φ ø rr • Pi ø μ- tr 0 rr 0 μ- ø Pi μ- tQ 91 Φ Φ φ r rr Ω O
Φ Pi Hi d Φ p. iQ tr rr 0 - rr 91 01 01 Pi rr rr rr Ω Φ ø H 3 μ. " d Hi tQ Pi 01 Hi <! φ μ- s d P. Ω O tr Ω Φ μ- 9J K ø rr 1 φ Φ Φ 3
01 Φ ø φ μ- μ. ø d Pi tr μ- . d H tr ri d H 0 01 Ω ø 01 H 3 H tr H rr rr φ ø ϋ tr 01 01 Ω . Hi φ TJ ø 3 3 H rr Φ 9i PI o μ- rr tr H Ω φ Φ φ ΓT S3 01 Ω ii rr o r * rr o 01 ^-- d 0 rr
S3 0 tr φ φ ι-3 o Pi o H TJ μ- Hi π Hi o φ Pi 9i <! φ o Ω μ- Hi P. Φ
0 TJ μ- >< 3 Pi 3 Ω <! 01 β φ H μ- d μ- rr rr ø TJ Φ ii W pi ø • 01 H
0 01 rr φ tr 3 tr Φ Φ Ω ri H ø ø tr TJ pi P. 01 3 Ω S3 ø Pi
01 rr Hi ii ø H Pi ii H rr tQ rr tQ φ H ΓT φ 0 pi μ- Pi Pi *l H
Ω α μ- Pi rr Φ 0 3 <: β rr CQ φ μ- φ μ- μ- 01 ø Hi H 01 P. μ- Φ tr ^- μ- ø ø P. o rr φ H ø- φ H ø ii μ- 01 O TJ H rr Ω φ rr P. iQ μ- Hi φ Φ 01 iQ 01 d to 01 P. tr Pi Φ Φ H Φ ø μ- ø φ 9) • Pi ø S3 μ- ΓT μ-
3 TJ φ H Hi • φ φ <J 3 P. Ω ø Φ rr μ- H • d rr tr ø
P iQ H ii P) tr μ- d Φ d d φ iQ 3 P. Φ Hi Pi μ- |J^ φ iQ rr • P) rr rr Φ CO Hi μ- 01 tr <! Hi 3 ø Φ ri H Hi rr H3 Ω 0 ri φ μ- • : Ω μ- tr H 0 rr μ- ø ι_ι. 3 Φ μ- 3 rr P Pi Pi 9i H φ Φ " μ- ø Pi H
Ω O 0 d Φ d Ω d ø Ω H φ 0 3 ø 9i μ- 0 ri H ii Φ H Φ tr
Pi tr s 3 ø S3 tr tQ H Φ Ω H φ iQ 0 O Hi 01 Φ rr μ- rr 01 Ω rr Hi rr *< 3
H μ- o 3 μ- P) Φ ø Λ ΓT ø φ P. ø μ- H tr ø tr φ ø O μ- o
H ø Pi 9i 3 ø pi < ϋ Pi ø μ- μ- rr H 01 ø t μ- φ tQ φ H ø tr <
*< φ Φ 0 φ <! ι-3 0 μ- μ- <! TJ 01 rr tQ • ø 3 9) Φ 91 φ
CQ - P. Pi φ tr Hi μ- Ω ø ϋ Φ H Ω μ- O Φ φ Hi <1 Pi ϋ φ 01 01 3 μ- φ o. ø ø μ- μ- P. 0 CQ φ φ 0 ø H Pi μ- Φ * ii μ- Φ ø 01 rr 01 ø 3 P- o 3 ø ri ø H rr rr Ω rr . μ- μ- ø iQ rr 3 Hi 3 rr 01 TJ iQ o 9) φ rr d d φ tr Pi rr Pi tr Φ ϋ 9) φ Ω H Ω r ΓT ø 01 ø H Φ ø t 0 Φ μ- 0 ϋ μ- 01 9)
P. Pi - P. ø P. rr o H rr Φ CQ rr
Table 2 Finger Command Structure
Figure imgf000012_0001
Figure imgf000012_0002
Edit Text Commands
Home of Text <Slanted Up Toggle to/ rom See Screen Field Left> Edit Mode Manip . Commands
End of Text <Slanted Down Mark n <Long Tap> + __ Field Right> characters <Short Taps> left
Move one <Finger Left> Mark __ words <Long Tap> + _ι position left left <Finger Left> Scroll left <Finger Left Shift marked <Long Tap> - Hold> letters' case
Move one <Fmger Delete marked <Extra Long position Right> character (s) Tap> right
Scroll right <Finger Right Copy marked <Double Tap> - Hold> character (s) One line up <Fmger Up> Paste marked Two <Double character (s) Taps>
Scroll up <Fmger Up Insert space <Short Tap> Hold> right of cursor
One line down <Fmger Down> Write to right Exit Edit to of cursor Input Mode
Scroll down <Finger Down - Hold>
Global Commands Sign Language Commands
Shift Input <Circular <Circuϊar Finger Move> brings Mode Finger Move> up Command Field w/ Sign
Language Mode. <Double Tap> to select. Then use <Finger
Down/Up> for Chinese,
Japanese or Korean signs
Toggle Edit See Screen Text Commands
End of Text Two <Extra Input Long Tap> This embodiment of the invention, comprising a single- button input device for multiple input modes uses "universally defined" finger command structures embedded in the translation means, ensuring that the sign generator provides the required input type in the respective input modes of the information/communication devices. The input modes are arranged in a hierarchy. Level 1 is shown in Table 3a. This is the overall mode level, where input mode alternative is set by the information/communication device. There is a fourth mode in addition to the three modes shown in Table 3a, namely Sleep Mode for minimum power consumption while sensor do not need to be active.
Table 3a MODE LEVEL 1
Automatically set by the Device
Figure imgf000014_0001
Table 3b MODE LEVEL 2 User selected by Finger Commands from Text Input Modes
Figure imgf000014_0002
The Finger Movement Categories defined in Table l combined with the sensor element configuration as per fig. 4 and the Finger Command Structure per Table 2 and the input
Figure imgf000015_0001
ϋ TJ rr H rr β 3 Ω 3 9) CQ 01 Ω ø rr φ 1*. α < Hi Ω 3 Φ 3 rr rr 9i P. P. rr rr μ- tr 3 < 3
Φ d tr . tr o μ- Pi 0 H φ rr d 01 tr X μ- d φ μ- d Φ • d ø" Φ d TJ Φ μ- Φ tr ø β ø φ O iQ 01 φ Φ Φ p. TJ P. rr H 9i 3 φ Φ P) ø S3 ϋ Φ 3 Pi IQ P. Φ *< TJ 01 ϋ X Φ TJ rr H ii P. ø μ- ι-3 ø ϋ P. μ- φ Φ Φ ϋ 3 ri 3 iQ ø rr H TJ 0 • Φ tr Φ H Ω φ rr β rr rr 01 Φ μ- rr Ω tr H rr • ϋ Ω rr 9i rr TJ Φ μ- P. ii CQ 01 d μ- H Ω Pl rr d μ- Pi 01
H μ- tr μ- 3 Hi φ Pi 0 ΓT 0 P. Φ H ri tr1 Ω μ- n , — , μ- pi IQ H Ω μ- rr μ- μ- 0 ι-3 1 rr
Φ o (U o μ- H _>: i μ- IQ P. O X Φ φ P u> 01 Φ> S IT1 ø H • tr Pi TJ H 0 01 tQ ø* Hi μ- f^
P. ø ii < H TJ tr rr d Φ Φ rr π Hi H • μ- O Φ iQ Pl Φ rr rr •<: TJ TJ Φ 01 Φ 0 H i 01 φ oi d tr1 Φ μ- ø ø Hi 01 rr O rr ø Pi <! H Pi μ- μ- 0 H ø φ 0 μ- O
H rr Ω rr 01 rr 01 p) ø <1 Φ μ- μ- " 3 V 9J ι-3 iQ li . — . Φ Φ Hi d d O rr 91 Φ ø β Ω rr Pi
Φ tr rr Pi μ- rr Φ Hi ii φ rr ø Φ 3 ø tr H CO H I Pi Ω μ- ø ø 0 !< H 01 rr rr ; rr rr φ Φ K tr S3 rr μ- 0" μ- 9J H tr TJ Pi Pi P. Φ < Pi tr tr 01 Φ ϋ 01 tr Pi d μ- μ- Φ rr ri rr μ- Pi μ- ø Φ Ω φ rr i Φ ø ø 0 ø φ 0 O H β H 01 . O rr * : rr H H O pi tQ φ ø 01 01 0 o tr H μ- H rr 01 P. P. tr 0 H tQ H rr 01 H rr Hi tr Ω μ- μ- ø ø d ii 01 M rr ø H 01 Pi p. ø Hi Φ • φ O 01 ΓT Φ rr μ- ΓT t ø φ o O O S 01 Pi ii φ 01 Hi 01 Φ rr ϋ IQ d Hi H O Λ H φ μ- 01 ø O d H Φ rr tr 0 ø μ- i P. μ-
._ ri tr Ω μ- O rr P) Pi oo ri d H3 rr CO μ- i Ω 3 0 S3 Pi X tr 01 μ- rr H rr φ Hi Φ
Pi ϋ ø rr Hi rr ri Ω . rr ri tr S3 H H N 91 rr Φ ι-3 ø H Pi Φ φ ø ri H μ- < H CQ
Pi Λ 01 0 iQ d φ rr rr Φ Ω Φ μ- μ- ø PI O 3 H tr 01 Pi 01 ø φ O tQ d μ- φ ø α H φ rr H 01 Φ 1 X tr 01 H Ω 0 ø 91 φ CQ tr μ- μ- TJ TJ μ- 01 01 H Φ tr ø Ω X )
P. o tr H H μ- tr 01 μ- rr 9) ø H rr rr rr <! 01 pi H iQ ø tr H ø d φ H 0 φ Φ μ- CQ
0 Φ μ- ø Φ tQ iQ 0 O μ- β Φ 9i Φ P. tQ Φ ø O Φ <! ri Φ Φ d . tr
P. tr Φ ø P. TJ Φ 01 . tr IQ rr 01 0 ri P. H Ω H μ- Φ 1 Hi 0 φ oi P. H i Hi μ- TJ μ- H ø iQ d ø P. 0 Φ ; Φ 01 Φ O Φ 01 ω tQ μ- φ Ω ø μ- 9i Φ H Φ
01 φ S3 rr φ μ- Φ rr in 0 rr φ Hi 0 Ω TJ CO Pi Φ iQ d rr ι-3 iQ tr rr 3 rr μ- H
TJ tr rr ø ϋ 01 H 01 tr Hi d Φ tr μ- TJ μ- <! rr H * 0 S3 M μ- tr ø <! μ- d tr rr
H ι-3 li tr i rr TJ P) μ- Hi Φ φ F ø φ φ μ- Pi 01 Φ μ- TJ d Φ 01 ø ø μ- : H3 H
Pi Pi o Φ Pi ø μ- H rr O μ- ø P. Pi fd H 0 O <: rr pi H to rr H ø 01 •T. iQ 01 01
: TJ ø ø Ω Pi μ- Hi H tQ μ- Pi rr rr μ- P. μ- ø Φ 01 pi • tr μ- Φ tr μ- rr O μ- 01 tQ < P. M 9i <: ø H φ ø rr φ μ- tr tQ 01 φ in 3, rr 01 0 ^ ø rr ϋ Hi Hi H ø V tr Φ H μ- tQ rr ø H TJ O Hi ø Φ tr ø Hi ri d ι-3 9i φ 01 Φ iQ Φ Pi β Φ tQ rr K ? Pi ø tr CQ ø Pi rr tr rr μ- rr Φ ϋ * 01 φ X P. Φ X rr ø μ- 01 d rr Φ 01 01 iQ rr φ rr Ω rr 01 0 H rr V • : H φ 3 01 Φ H P. pi H ri rr Φ Ω ø μ- 0 rr μ- Φ Φ Φ ϋ O tr H Φ ii •<; H H TJ 01 9i rr 3 91 Pl rr TJ ω
ΓT o Ω TJ ΓT H H X 01 Pi 3 3 μ- rr rr Pi μ> Hi P. μ- ø" d "<J Ω H φ Hi TJ S3 O μ- μ. 0 Pi rr pi 01 ø- φ Φ rr φ rr 3 O Hi rr ø o μ- 01 Ω φ ø 01 Φ IQ X O H μ- O ø tr o rr μ- tr rr H Φ Ω rr H Φ 91 P. rr rr Φ 01 •- ø tr oo i ii 01 rr H Φ rr ii Φ ø 3 TJ *< 0 9r> ø Φ tr μ- rr rr rr φ 01 0 Φ Φ ϋ H tQ μ- H Φ Φ Φ H 01 tQ 3 0 i tr φ Q rr Hi μ- Φ tr Ω P. rr X 01 Pi Pi Φ Hi Pi H tr 3 0 Pl μ- 01 P) rr rr H • ; J rr CO φ •μ- d H φ rr 9i 01 d rr rr 01 H rr 0 *<! •<! rr H μ- J3 O S3 tr 0 S3 μ- tr tr S3 3 H 01 H ø μ- tr Pi μ- P. O rr Pl 01 TJ 3 μ- 9) P. tr O rr pi φ μ- PJ Φ rr 01 P. O ø rr 0 rr μ- 0 d TJ Ω tr Pi rr O H TJ ø Φ H 01 01 <: *< P> rr H Ω μ- rr Hi Φ ø ø d rr tr 0 P. ø φ d Φ - CQ tr β H rr H μ- Φ 01 H
P. Ω pr rr H μ- μ- Hi φ TJ li 3 rr O Φ 01 rr TJ Pi rr Ω pi f X O μ- H μ- tr φ μ- H Ω φ ø Pi Hi _r rr tr β 3 3 S3 ii CQ Φ tr tr * tr a tr 0 pi Pi Hi ø d
01 » P. 0 tr H ø μ- Φ tr φ tr rr ri Φ rr 9i Φ μ- tr rr ϋ Φ O ^ Φ 01 P. rr 3 IQ S3
TJ 0 d Pi P. rr H φ li Φ d Pi i tr 0 Φ N d H ø Pi μ- rr μ- TJ rr H 01
H 01 3 ø H tr rr H Ω H 3 tr 0 Φ P. ø d S3 Pi 01 rr Φ 0 f Ω Hi ii tQ ø H tr Φ
Pi φ μ- Hi 9) φ P. O < 9i μ- d 01 01 ø 0 0 Φ Φ P. Pi P d d Φ Φ φ 1 Hi
*< H p. μ- rr Ω CO 01 Hi Φ 0 N P. ø Φ rr rr 01 H X S3 rr H H t 0 H 01 tr β
Φ P. Φ tr rr Pi 3 Φ μ- ϋ d Φ ø ιP« Λ tr Pi μ- H φ rr μ- Pi μ- H Φ Φ φ 01 β H
LΠ Ω H H Φ Φ <; pi rr
• ø rr P. rr ø - 3 • rr CO Φ H ø PI Ω H ø d 01 ϋ rr d μ- rr H φ p. H ϋ μ- μ. rr 5" Φ H rr rr μ- H 3 S3 Pi rr Hi ø rr μ- • 01 • rr μ- rr Ω ri PJ pi Φ I-I P. 91 Ω Hi μ- μ- ø μ- H Φ rr Φ tQ O
H_ ø £ tr Φ 01 tr 91 Φ H 0 H 0 P. ø O μ- d O TJ 01 ø φ P- μ- ii rr H ø
0" iQ s! μ- W φ P. μ- H Ω P. 01 Φ rr 3 iQ - tr rr φ CQ rr ø ø ø S3 μ- rr ø 01 Φ Φ μ rr P. Φ 3 • t μ- 3 rr tr IQ X I
01 rr Φ Ω H rr Hi tr i O rr ø φ ^ tr rr tr ø tr *< tr O μ- 0 in Hi Ω 3 ii !
Φ φ ϋ 01 P. Pi tr 01
w > to t H H in o in o in o in φ Ω tQ Ω Pi 3 n Ω μ- 91 φ Ω 9i P. Ω 01 01 H Ω α 3 1-3 TJ oi O Λ oi Hi rr tr 91 P. Ω H rr S3 <! 01
<J Pi PJ O 01 O β φ ø 0 Φ β μ- Φ S S Pi 0 d d Pi Φ φ ϋ •A φ μ- tr d S3 d tr Hi 0* μ- Φ φ φ TJ 3 3 <! H H TJ H φ H rr CQ H μ- μ- TJ 3 S3 P. TJ ϋ TJ μ- rr ø Φ H 9i S3 9) Φ TJ ri H
0 Pi φ ø1 rr Φ 01 H ø Φ H H tr TJ H (T rr 01 3 ø φ 01 μ- 91 rr ø oi iQ P. • ; ø H tr Φ rr φ tr 01 μ- P 01 d 0 rr & IQ 0 Φ H ø Ω Ω V 91 V V O ii O iQ ^ φ P. 01 91 Φ TJ CQ μ- Ω rr H . ø TJ ii H β *< H ø 9J H tr tr TJ ■ 0 tr P. 9i Φ H Φ Ω d Ω rr tr Φ Φ 01 Ω fo Φ PJ rr *<! PJ φ H P. 9) • : rr β H tr 01 rr tr H rr S3 01 tr 9i μ- li H3 Pl - O r_ ii 01 01 01 H μ- ri μ> P. μ- 01 φ . — . μ- 01 Φ Hi μ- tr Φ Hi Φ 9i μ- μ- H d
O O tr 3 O rr 91 Ω rr d 01 Hi rr _ d φ tϋ H H φ K 0 rr 01 ø
0 Hi μ- S3 Φ f * ø TJ TJ <! TJ 9) d TJ rr 5 o H φ TJ μ- Ω TJ ø μ- oi d φ 3 rr 01 rr μ- 01
IQ 01 μ- rr μ- rr tr Φ Hi μ- tr rr tr d Λ Φ 0 ø Ω iQ μ- 3 P. Hi O tr CQ d Hi φ 9i - li rr Ω ø ii o ii d ø o μ- S3 d rr β H iQ 0 3 Pi tr 3 μ- <! φ ø μ- H ø
Φ Φ 0" φ d 0 H tQ ø O μ- ø 9i d Φ φ j Ω Pi T rr TJ rr P. ø φ tr rr ø φ rr pi 0 X — - P. H φ Pi • Φ ø TJ Φ ø rr 0 ι-3 ii tr rr ^ μ- V H tr μ- iQ 01 ø Φ d μ- iQ Ω o
P. Pi 0 tr rr Φ • rr tr rr Ω 91 Φ β rr • Φ H Φ φ ø φ ΓT 3
01 φ 3 ø rr S3 3 μ- 0 tr ι-3 01 tr tr Φ ø* Φ tr Ω 3 tr Pi Φ ii tr X 3 3 ϋ μ- 9i μ- ii TJ 3 tr μ- O rr <! Φ tr Φ ! tr H3 φ μ- H o β Φ H Φ iQ CQ Ω μ- rr o o rr d rr ø μ- H φ φ P. CO Φ Φ rr μ- tr ø Ω CQ Ω Φ 3 01 — • μ- S3 rr 01 01 < <! tr ø ø μ-
IQ ø Φ H H tr φ • 01 CQ Hi 01 Φ rr Φ d 3 Φ P. H IQ < μ- μ- rr Ω φ φ Φ TJ Ω
H tQ O Φ Ω μ- 01 μ- μ- H rr 3 to Pi ii 3 0 φ . Φ rr O μ- Hi tr 01 Hi 91
Φ P. 0 tr Ω 9i 0 H tQ μ- rr ø Hi ø Ω H φ TJ 0 91 ø rr 01 Ω ø H μ- 9i 91 91 O μ- H
1 Hi φ CQ •<: O 01 ø Hi ø iQ tr iQ μ- 01 (o β X li P. 3 *<: Φ ΓT rr tr H ø ri tr H ii φ H tr β 3 rr 1 ø Φ Φ ø φ rr H rr μ- K Pi Φ d Hi iQ Pi μ- 01 TJ H *<
0 H O Ω iQ TJ ii rr iQ H iQ H μ- 91 01 0 01 •<! tr tr ti μ- H ι-3 O φ Ω 01 μ- tr P. P. rr H ø O μ- μ- Φ O tr Φ iQ 01 φ O ii μ- μ- P. φ Φ * 01 μ- ø • tr ø H ΓT ø Pi O 01 rr 01 3 < ø K H Φ ø φ μ- TJ ϋ μ- ø J3 ø Λ Pi ø tQ φ Φ Hi tQ tr S3 rr S3 d μ- rr 3 φ φ Φ ø iQ ϋ 01 TJ TJ iQ 0 β rr Φ Hi Pi 01 φ H rr μ- H μ- H Φ ø d ø 0 M 91 01 P. H3 01 β H Φ ø μ- Pl 3 tr ø Hi Φ ø μ- iQ Φ H Hi 01 tr ø ø φ rr
TJ Pi 0 9) •<! 01 9i K ø d rr o o rr rr ø Pi rr ø pi H Ω Φ μ- iQ O 3 Ω ^
01 0 rr P. 9) Hi tr 01 φ rr 9i iQ rr S3 tr P. 0 s3 3 Ω ø Φ iQ μ- rr Ω rr cr Q Φ Ω o <! μ- " μ- rr Φ ø μ- H rr ii 0 rr φ ø φ φ φ . — . d Φ Φ * ii φ ø d tr 0 01 tr K. tr Hi Φ ø Φ iQ 01 Hi ø Φ φ li d ø tr ø S3 01 Φ H 0 3 φ H S3 Φ pi 9i H d 01 ø <! ø 9i iQ 3 S3 ii φ μ- o Hi tr tr Ω 01 Λ rr P. ^-, 0 3 H μ- 0 H rr H
1 Φ rr 0 Ω φ __ pi μ- ii o < 91 o 9) Φ o 91 M μ- Ω Φ pi 0 μ- rr p. H 0 P> tr rr rr iQ ii tr Ω Ω K Pi 01 ø 01 μ- 9i 3 Φ 01 li CQ ø ø LQ X 3 9i O . Γ 1 ø 01 ø Ω Φ Pi Ω Ω φ tr H tr
Φ 01 Pi rr 0 . φ rr 01 rr φ K pr 01 φ rr Φ 01 3 IQ Φ P. φ iQ tr 01 ii φ rr φ Φ Φ ø 9> rr μ- H Ω rr 01 Ω d rr Φ 91 9) rr φ ϋ 3 • H 01 H μ- iQ Φ ø rr
Φ rr O 9) d H3 01 9i rr ii H rr Pl Ω β ø" Ω 3 Pi rr rr i 01 tr rr K Φ o 4 φ 03 rr Ω ri μ- ΓT ø rr 3 S3 rr H tr μ- tr Ω rr φ β pi 0 S3 0 Hi M 0 91 d φ ri ri X φ Φ tr
Pi H tr 01 Φ 3 d rr d H Φ rr Ω φ tr Φ d rr *< H IQ 0 P. O > Φ H P. rr ø H 91 rr μ- Φ Pi tr Φ ø d Q >< 01 3 Ω μ- d i ii 01 Φ rr 01 ø 01 0 CQ CQ H
O ΓT Hi Ω 0 Pl Φ T P. 01 01 Pi φ <! tr 0 H Ω Λ TJ Λ P. 01 rr P. ø Φ H ri 0 • 9J ϋ *< μ- d ø Pi μ- H S3 01 μ- Φ rr rr H Φ Φ IQ Φ O f 9J φ • l 01 9i μ- <! Φ H Ω ø ϋ ii 3 01 Pi Hi 9i H 01 ø Φ Ω μ- H 0 O Ω μ- S3 ri ϋ r_r" Φ l_l. tQ - H3 rr
9) < 01 01 Φ S3 * 0 f Φ 01 X o Ω β Λ CQ H rr 01 S 0 μ- ø O tr rr Φ Φ ϋ β β tr Φ rr 0 φ tQ d φ ø μ- H Φ Φ Ω 0 rr 0 Pi H H μ- Pi 0 Φ IQ 9) Pi tQ rr φ Ω ri 9i 01 μ- 9i Φ H tr P. ø ø li Λ 01 rr Pi P. TJ O ri rr H 9) X <J TJ Ω 3 H Φ tr 0 CQ rr H rr ϋ Ω
Φ rr μ- ø μ- Ω 3 d H H H rr Φ V __ 0 ι-3 Φ H Φ Ω μ- O φ Ω β CQ
H Hi μ- rr Ω Φ O tr IQ Φ β 3 TJ ø o * ii ø P. rr P * — * Ω u tr ϋ d Hi rr Pi P. o CQ Φ
Φ H O φ O ø ø pi . T o H s: H TJ 9i I μ- μ- TJ . tr f Φ O ø μ- K Φ rr tr Φ ø ø Ω Pi H 3 iQ Pl φ tr rr 01 tr tr rr <! V i φ Ω H TJ 3 Hi Ω P. ii
*« X Ω rr Φ H φ • Φ φ rr φ tr rr φ o * • : Λ φ s. K Hi tr H H 91 o φ φ tr μ- O μ- μ- O H 01 rr • Φ ø φ 0 rr ø O "_ ι-3 Pi o 91 rr P μ- μ- ø 03 01 S3 i ø rr Hi tr CQ 3 O Hi O d tr IQ Pl φ 0 Hi μ- Φ Λ 0 H Ω V ϋ Hi ø P. μ- H tQ tr μ- TJ H ^-, μ- 0 *< • Hi rr rr tQ μ- ø X P. P. rr Pi rr iQ rr β 91 Φ rr
H H CQ ø o tr tr μ- 0 tQ rr O φ O Ω 01 rr μ- TJ Ω rr ø tr μ- φ β iQ rr CO S3 ri rr φ φ 01 tQ φ 0 ϋ H rr μ- tr 0 rr d φ rr X Ω φ tr 3 tr tr φ ii CQ oi Φ tr ø φ ø o Φ
*< tr H Φ CO Φ Φ i H μ- 0 01 ϋ H ø 01
enabling the use of a large display as exemplified in fig. 2 still maintaining full functionality.
The next example of this embodiment of the invention, demonstrates text input by Chinese signs on a cellular phone. Each sign of a sign-based language like e.g. Chinese is composed of strokes (and components thereof) . Although there are hundreds of thousands of signs in such a language, it is possible to enter such signs by a QWERTY keyboard, because individual strokes can be assigned to the various keys and each sign is composed of a strict sequence of strokes. As more signs are entered in a certain sequence the resulting optional signs are gradually limited until finally the wanted sign is uniquely defined. ZiCorp has taken this approach one step further by their Zi 8™ method. It consists of a new level of so-called reduced strokes that represents the 29 basic strokes by 8 reduced strokes. These eight reduced strokes of Zi 8™ can thereby be represented by the limited keys of a reduced keyboard, similar to how the alphabetic letters are represented on such a keyboard in fig. 1. The corresponding representation of the Zi 8™ reduced strokes on such a reduced keyboard is shown in fig. 6b, while fig. 6a shows the hierarchy of reduced strokes, basic strokes, components and finally Chinese signs. As seen from fig. 6a the hierarchy comprises 4 or 3 levels, pending if components are considered as an independent level or not. By the Zi 8™ method it is therefore possible to generate Chinese signs from a reduced keyboard as per fig. 6b, but it is even more cumbersome than entering a alphabet-based text by multiple key presses (per fig. 2, simply because the hierarchy in a sign-based language comprises more levels. An elegant solution to resolve this problem by another preferred embodiment of the invention is to use the single- button sign-generator method by using the touch-sensitive switch 1 combined with finger commands and a Finger Command Structure embedded in the translation means 4. The invention can be used in two input modes for generating e.g. Chinese signs; either by stroke selection from vertical selection fields on the display, or by directly drawing the components on the sensor switch 1 with two-dimensional registering of OJ w to to μ> I-1 in o in o in o in
01 P. rr Ω Φ 01 Ω f rr rr Ω rr N 3 3 tr β rr 3 ι-3 i 0 μ- Ω 3 P. > <! Hi o Hi μ- rr P. rr d Pi Hi rr d tr tr μ- o φ tr " tr tr μ- o Φ μ- ø tr o 9i TJ 0 ø 0 o φ o Φ μ- K μ- ø O μ- tr H 0 μ- ri ø Φ pi 0* tQ 3 Hi φ Φ pi Φ P. i 01 rr φ P. TJ TJ rr TJ 0 <! Hi • ϋ ø Pl iQ TJ 01 φ P. ø d Φ H o ø TJ rr H oo φ ø μ- Φ V Φ μ- ø 0 φ 91 rr iQ Φ ø Hi TJ Ω iQ
W rr Pi i d V S3 01 pi Ω 3 . 01 01 H pi . Pi H rr rr V β 1^ μ- φ ri rr μ- H rr O 01 φ
Φ Pi Pi Ω μ- Ω 0 pi Φ Ω d φ H H ϋ Φ H tr Ω ii in iQ Pi CO ϋ
Ω tr rr o 3 Φ H
01 3 0 Φ d ø H rr ø CQ *χ] S3 H tr rr trJ t 01 Φ 3 H H rr Φ Pi rr 9J 3 : μ. Pi TJ tP
Ω H φ φ 3 0 H rr Φ Φ rr rr d μ- φ Φ Φ ^ • <1 0 1 H • H Ω o 0 IQ 0 d ø 3 d Φ ϋ ø TJ rr Φ Ω ϋ Φ ϋ H H Ω ii 0 Φ P. Ω Ω d ø P. in tr 0 03 0 Φ δ
9i ri rr 0 Λ P. rr 0 0 H rr tr ø Hi 0 ι-3 ø Φ H tr (-3 0 CQ 3 03 o Φ . *< H Φ 0 <!
0 i d 01 01 01 T- Φ 01 rr X μ- μ- μ- Pi μ- tr rr 01 0 *< tr 3 Φ 3 S3 S3 μ- Pl 0 Ω Φ
P. μ- Hi Φ d μ- Φ μ- tr P. Φ Φ ø H o rr rr ø rr φ ø Ω φ r 3 H Pi μ- „-, -3 Hi 3 rr rr Φ rr μ- 3
0 Hi rr rr ø pi r d CQ 01 Φ ø 01 tQ tr Pi ^-, X 3 91 Φ 0 rr tr Φ 0" μ- TJ μ- 01 φ rr tQ Hi 01 μ- • iQ 01 tr Hi • rr Pi <! φ φ ø H Φ S3 o β 0 Ω P. Ω Φ . Φ ø β d μ- ø tr μ- rr d φ μ- Pi ri Pi H O φ H 03 H • μ- <! 03 i rr tr μ- tQ ø iQ rr ø CQ d rr φ rr IQ Φ tr ø H H Ω 01 Φ rr t 0 ri ω ø* CQ Φ ^ CQ oi μ- Φ μ- Λ ø φ Hi 03 d Pi φ ø- μ- TJ tr ^ Ω i ^ μ- 01 Ω S3 ri • φ ø ϋ Hi 0 Co rr tQ rr H tr 3 Φ •
0 Ω Pi Φ JO 01 Ω ϋ φ Φ 0 ø μ. 0 μ- rr — - iQ μ- ø H d tr tr * Φ Hi
01 rr -J tr μ- 01 ii μ- rr Φ 01 tQ rr φ iQ 3 rr rr ø" s Φ Φ P) μ- ^ Φ Ω i 5* μ- ι-3
Φ tr . ø φ tQ ri CQ 01 < φ rr Φ tr 03 ø 3 Ω tr φ 3 0 ø" ø H Hi 0 O ø d 3 0 Φ 0 tr
H Φ H <! TJ tr tr d rr Φ Φ H tr μ- φ 1 91 0* φ Pi ø μ- rr P. μ- rr " CO ø 3 P 01 Pi IQ Φ ι-3 Φ φ φ ^ rr t ϋ ø ii Φ φ rr 01 • tr 0 rr 03 Φ rr ø S3 φ Φ μ- rr 3 01 3 0 . P. φ rr 01 tr TJ ø ϋ V Φ d rr Ω tr Pi P. H Pi tr rr H S3 H P. ø tr CO φ 91 μ- Φ ϋ H tr rr Φ H rr rr - ?? μ- μ- ΓT P. Φ 01 M 01 φ ø Φ tr Hi 03 μ- Pi Φ Φ > — ' H 0 TJ P. pi
Φ ϋ Φ μ- Hi tr rr φ ø Ω μ- φ Φ φ Φ Λ ø rr 3 Φ μ- H α 01 P. β 3 rr ϋ ø Ω 01 d μ- φ d o . IQ pi ø Hi pi H P. rj Ω rr Φ pi ø rr H co o φ Pl rr tr 01 H μ- d rr φ Ω tr Φ ø iQ u H iQ pi H φ rr μ- o Φ P. rr 01 iQ tr S3 φ tr i Pi r ø <! Φ ,_,
Hi rr pi 0 . 01 P. ι-3 rr ø r Ω tr H 0 0 li μ- S3 Φ φ P. rr 0 01 Hi Φ 01 S3 rr φ ø li CΓ d H rr P. Pi μ- iQ tr tr 01 O H Φ rr φ 9i IQ Hi 03 Ω Ω μ- H μ- d μ- 9i μ- μ- rr 01
H H P μ- d σi 3 01 μ- Φ φ Φ ø rr H μ- 0 0 φ μ- tr 01 rr Hi 01 t-i U3 0 p. 01 H ø tr H
Φ Φ Ω ø φ pi φ TJ <! H φ 0 O IQ ri H rr o a Ω μ- μ- TJ rr φ ø H μ- φ H iQ φ Ω Φ rr IQ 01 • H Φ 0 tr φ 01 Pi ø Λ 0 3 1 μ- -> tr ø ø H tr Hi rr 03 ΓT O a
Ω d Φ ø- Pi 01 01 Pi Ω 01 Φ rr σ 9) o μ- Φ Ω tQ 91 Φ rr 3 TJ tr rr "_ 3 0
9i Hi H rr μ- ! φ 01 rr ø rr μ- 03 o CQ d ø Φ φ Pi Φ • : V O t* H ΓT φ tr μ- TJ μ-
0 tr tr φ Hi ϋ μ- μ- Ω <! Φ β Φ S3 iQ Hi rr • ii " P. 9i 91 tr Φ ø ri H rr 01 Φ o 3 ri rr μ- Ω d tr 3 Φ rr tr 01 0 μ- _ Ω Ω ^ d μ> φ rr ; φ P. iQ μ- Φ
01 tr Φ S3 d Pi tr ø rr ø Pi rr H V tr ø CO . ι-3 μ- Ω f ϋ o ~. μ- φ 01 φ 03 01 φ rr tr Φ ϋ H. φ iQ tr 01 01 ^ Ω μ- Φ , — , Φ iQ μ- • — ' tr ri d 9i μ- ø μ- Ω 01 φ H μ- μ- pi <! Φ Ω φ Φ rr Hi rr tr ø Φ κ» Φ IQ μ- Ω 3 rr N rr rr 03 φ Ω H ø rr
TJ N iQ 01 φ tr Ω H ø O μ- ri Ω 91 CQ H3 • J S ϋ ø μ- 01 H 3 μ- d d ø- 9i H H φ π iQ tr μ- ϋ μ- n Ω ^ d ? φ o d i J CQ Pi 1 ø Φ Pi 0 ø Φ H d H μ- Ω d pi
0 Ω Ω 0 ϋ Ω T Φ H * ø 9) rr TJ • tr 0 Ω tr tr 0 rr 01 TJ ri β tr rr 3 pi rr ø oo β 0 μ- H Ω H 01 P. Φ rr Ω tr 03 φ rr d pi rr H ^-, P. Pi Pi tr β tr CQ H Φ μ- 3 φ i TJ 01 Ω <J CQ Φ 3 d pi rr Φ V C-4 01 3 CQ tr μ- Ω H H μ- 03 91 Pi Pi P. 0 Pi TJ rr μ- rr o Φ 01 3 Ω Ω 01 tr μ- Φ Pi Ω 3 φ Φ ø H Λ TJ Hi Φ tr ø H 0 0 pi 0"
H i ø ii 3 ø 3 TJ PJ φ o tr ! ø ii rr H TJ m rr Pi P. iQ o O tr Ω rr H Φ μ- S3 P. ii Φ φ Φ iQ Ω TJ μ- 9i d 0 φ N μ- H to i ø tr ø Ω oi Ω μ- Pi d rr 01 TJ μ- Hi rr
< P. ? ii φ μ- ø P. P. H Hi Λ rr 03 9i 0 Φ P. t1 o ?f H tr 3 Hi IQ φ tr rr μ- CO μ- Ω φ 0 μ- Φ μ- ø ø P. 01 Φ rr tJ tr Φ 0 rr Φ 01 Pi 3 β S3 Ω Φ 3 H. μ- 3 P. O tr Φ rr Ω Pi
H Ω 01 CQ 01 rr rr μ- Λ 01 01 o Φ rr 01 o 01 rr 01 Λ
•- 0 3 TJ μ- β rr pi o <! o 0 H ii β rr
Φ φ i ø •x) rr TJ β 01 H Φ Φ μ- D tQ pi 03 H 5 ø φ P. P rr 3 i φ H P. β H Φ μ- P. μ- tQ μ- o d rr tr K 91 Ω - TJ iQ o β 0 O φ 91 P. 01 Φ 01 φ 03 Ω Pi IQ ø tr Pi oo ø ø ø d H φ o rr o ø ø pi i rr li Pi rr • rr Hi rr N O φ 01 Φ iQ 01 P. Φ P. Hi μ- 0 ^ rr 1 tr IQ tr d 01 Hi tr rr TJ O φ d β ii rr ii Pl φ Φ μ- rr ø O Hi o tr tr H Φ Hi Φ H T. μ- Φ tr H Φ ii 0 H 03 μ- tr φ TJ ii H ø tr ι-3 Ω rr ø μ- ii H Pi Φ 01 μ- ii μ- rr φ φ 0 H rr φ Φ rr Φ
Φ tr φ μ- Φ CQ Φ Pi Φ tr ri Φ 0 CQ a φ ø tr H Φ ø rr K 03 li ø Ω TJ P. μ- rr rr 3 9i β Φ H iQ Φ P. X Ω tr d d
V 01 0 IQ P. P. φ rr Φ Φ Hi d tr ϋ Φ
hierarchy.
The preferred embodiment of the invention for this mode (sign-based language text) will, however, be to draw the Zi 8™ reduced strokes directly on the sensor. The required finger movement categories, and their sequence for combined movements needs to be embedded in the finger command structure of the translation means. A further enhancement will be to embed the required finger commands for all the 29 basic strokes directly in the finger command structure, to skip one level of the hierarchy of fig. 6a. When the number of basic strokes, and their sequence, has limited the alternative Chinese signs corresponding to this stroke sequence to some extent, the candidate signs may be displayed in an option field placed horizontally over the command field 9. The most frequently used of the candidate signs should be displayed first. When the user sees the wanted sign in the option field he may switch to this field by finger command 10 <Slanted Down Left> and then move <Finger Right> until wanted sign is marked, and then <Double Tap>. In any case the signs generated by the sign-generator system above may then be given to a language program of ZiCorp or similar to provide a functional package for sign- based languages. This embodiment of the invention simply represents an alternative method of inputting such strokes or components to complete language programs, as alternative to keyboard such as illustrated in fig. 6b.
Accordingly this embodiment of the invention enables generating even complex text composed from Chinese signs by a single sign-generator button. It is therefore possible to shrink reduced keyboard sets, as per fig. 1, to a single sign-generator switch, as per fig. 2, without loosing functionality in generating complex text messages, and with vastly improved speed and convenience. The above examples were described for use with cellular phones, but is equally applicable to palmtop PCs and PDAs.
Fig. 8 illustrates another input mode that the Finger Command Structure of the translation means 4 can accommodate. This example pertains to mathematical calculation on a palmtop PC, but may as well be embodied in cellular phones or PDAs. For such calculations the applicable Finger Command Structure set will be limited to taps on multiple selection fields as per Table 1, while lateral finger movements is reserved for cursor control. Fig. 8a illustrates a palmtop PC set to Calculation Mode (arithmetic) in which mode the display 5 contains another type of vertical selection field 16 and another horizontal selection field 17. The vertical selection field 16 contains all numbers from 0 to 9, plus decimal point (,) as illustrated in fig. 8b. The horizontal selection field 17 comprises in this mode the arithmetic operators (+, -, * , /) plus Clear All (CA11) , Clear Memory (Mclear) , add to memory (M+) , subtract from memory (M") , square root (v) and nth power (n) , etc as illustrated in fig. 8c. In this mode the lateral finger commands are mainly reserved for cursor control. This means that when the finger is moved laterally over the sensor 1, the cursor moves accordingly on the display 5. An arithmetic formula such as "972 * 3 = ?" is generated on the display by moving the cursor over number "9" in the vertical selection field 16 and <Double Tap> for selection, cursor is then moved to "7" and selected, the cursor then moved to "2" and selected. The cursor is then moved by lateral finger command to the "*" sign of the horizontal field and selected by <Double Tap>, then back to the vertical selection field 16 over number "3" and selected by <Double Tap>. The user then presses <Extra Long Tap> which produces "=" on the display, starts the calculation and presents the result "2.916" in the display. Other character subsets of the vertical selection field 16 may be incorporated. Navigation by fingerprints inside the selection fields may be initiated by finger command <Short Tap> when cursor is positioned within the vertical selection field to temporarily disengage the cursor control by finger commands . Then the user may shift character sets of the vertical selection field 16 by <Finger Left> or <Finger Right> commands (as per fig. 5b) . When the new character set has been activated the cursor control by lateral finger commands on the switch 1 can be re-engaged by pressing another <Short Tap>. Similarly the horizontal selection field may be changed to other subsets of mathematical operators by placing the cursor in the horizontal selection field, pressing <Short Tap> to disengage the cursor control, use finger commands <Finger Up> or <Finger Down> to select other subsets, and finally press <Short Tap> to re-engage the cursor control by lateral finger commands. This embodiment of the invention enables a versatile and flexible calculation mode on the display, still operated by a single-button switch 1.
By the embodiment of the invention described above for cellular phones, palmtop PCs and PDAs, the combined fingerprint sensor with navigation means, and interpretation/- analysing means to identify finger commands on the sensor and a finger command structure embedded in the translation means, enables the use of a single-button keypad to enter complex text via the display in a convenient and versatile way. The same sensor is also used for finger scanning for access control by user authentication to protect personal and privileged information on the device. The invention thereby enables a cost-efficient solution with a large display and a minimum keyboard, yet enhancing the versatility for the user.
Further application of the invention is illustrated by another embodiment of the invention for set-top boxes for television sets for pay-TV, etc. For this embodiment the invention using a combined fingerprint sensor with touch-pad functionality enables identity verification of the user. By enrolling the fingerprints of the family, minors can be prevented from ordering X-rated movies, etc. At the same time the combined fingerprint sensor and cursor control enable complex communication via the TV screen, by the use of a minimum keypad, eliminating the need to hook up a full- fledged QWERTY keyboard to the TV. This embodiment of the invention is illustrated in Fig. 9. The set-top box 18 may contain an On/Off button 19, two function keys (Accept/- Reject) 20 and 21, and the switch 1 with navigation means. By finger commands on the switch 1 the user may position the cursor in dedicated communication fields on the TV screen 22. The communication fields may comprise; search for titles, order selection, user profile of family members (access to X-rated movies or not) and similar for other services. The Finger Commands for this application may be a significantly reduced instruction set, as compared to the comprehensive Finger Command Structure exemplified in Table 2. The analysing/interpretation and translation means of fig. 3 may be embedded in a chip integrated in the set-top box 18.
Yet another embodiment of the invention is for Driver's interaction with the onboard computer in a car, as illu- strated in fig. 10. The combined fingerprint sensor/navigation means will act as an intelligent key preventing anybody than the authorised and enrolled users to ignite the engine, as theft protection. This application requires encryption of the sensor communication with the onboard computer and its engine control, to prevent by-pass by hackers/thieves. The sensor 1 may be located on the steering wheel 23 or on the gear stick knob 25, as per fig. 10. In addition to access control the sensor with navigation means may be used by the driver to communicate with the onboard computer, for GPS navigation display, for audio system control etc. Circular finger motions (clockwise and counterclockwise) according to the Finger Command Structure of Table 2 may change mode, e.g. from ignition (access control) to GPS navigation control and audio system control. When selecting audio system control, <finger .up> and <finger down> movements may change radio channels, switch between tracks on CDs, etc. If two sensors 1 are mounted on the steering wheel 23, the left sensor may be used for entertainment (audio systems, etc.) while the right switch may be used for gear shift, where upward finger strokes represent gearshift upwards, and downwards finger strokes represent gearshift downwards. The finger commands on the switch 1 will be the driver's input device to the onboard computer while the interface will be presented on a display 24 mounted in the car's dashboard. The display 24 shall preferably be menu-driven for convenient operation in a hierarchy of functions, as indicated by a typical opening screen of the dashboard display 24.
Yet another embodiment of the invention is for Laptop PCs, not illustrated by any figure. For this application the need to eliminate the keyboard is not a prioritised issue, as a full-fledged QWERTY keyboard provides higher input speed than a single button input key, and keyboard input is the main input form to laptop PCs. However, laptop PCs normally comprises a touch-pad to eliminate the need for an external mouse. Also laptop PC producers are looking for fingerprint biometrics for access control user authentication by biometrics to protect any privileged and sensitive information that the laptop may comprise. Instead of incorporating both a touch-pad and a fingerprint , sensor, the fingerprint sensor with navigation means according to the invention will combine both. functions into one single switch. The invention thus uses a fingerprint sensor as touch- sensitive switch 1 that has the ability to register finger connections on the sensor and the duration of such touches, as well as lateral finger movements and their directions and type of movement. Such a sensor with navigation means as described above is supplemented with sets of finger movement categories and sequences thereof in the interpretation/- analysing means 2. This is combined with sets of Finger Command Structures (as per Table 2) embedded in the translation means 4. This preferred embodiment of the invention enables a multi-function single-button input key which combines several functions;
Fingerprint scanning for user authentication for access control . A powerful text input device where sets of extensive finger commands supports convenient and fast input of complex text/signs/characters in a versatile and flexible manner for text input of alphabetic languages and sign-based languages, as well as enabling input to special operations like calculations etc.
The sensor's registration of lateral finger movements enable accurate cursor control either as part of text input sequences via the display, or for stand-alone cursor control through a single-button input device for multiple functionality, thereby integrating touch-pad functionality in the single device.
Thereby the invention enables reduction of the device's traditional keyboard as per fig. 1 towards devices with a large display and a minimum keyboard as per fig.2 without loosing versatility and flexibility even with complex inputs.
The invention also eliminates the need for large keyboards for input to/interfacing with set-top boxes and for onboard computers in automobiles. The compact sensor may be fitted in small spaces, e.g. on the knob of the gear- stick in a car, etc.

Claims

C l a i m s
1. Method for generating complex text input by sequences of finger touches on a single sign generator in cellular phones including a display and a sign generator, the sign generator including a finger touch sensitive sensor being adapted to sense movements in at least one dimension, analysing means, and translation means, • measuring omni-directional finger movements across the sensor in two dimensions, using the analysing means for categorising omnidirectional finger movements across the sign generator according to predefined sets of finger movement sequences including directional and touch/no-touch finger movement sequences, using the translating means including uniquely defined command table for translating the categorised finger movements into signals controlling the display as results of the finger movements on the sensor.
2. Method according to claim 1, wherein the sensor is sensitive to movements in two dimensions.
3. Method according to claim 1, wherein the categories are ordered in a hierarchy, a first categorised finger movement thus selecting a first set of signs, the second categorised movement selecting a sign or subgroup from the first set of signs.
4. Method according to claim 3 , wherein the hierarchy has at least three levels.
5. Method according to claim 4, wherein the categories define a Chinese sign set.
6. Method according to claim 2, wherein the finger movements control cursor movements on the display within the selected table of characters, signs or commands.
7. Method according to claim 6, wherein at least one finger movement controls the selection of the desired character, sign or command which the cursor has been moved to within the selected table.
8. Method according to claim 1, wherein at least two of the categorised movements is related to a control signal for the display, said display indicating at least one list of signs and said control signal indicating scrolling and choosing in said list or lists.
9. Sensor system comprising fingerprint scanner sensor with the ability to detect finger touches as well as lateral finger movements, storing means containing predetermined categories of finger movements and sequences thereof and sets of finger command structures, enabling a multi-function tool for fingerprint scanning, text/character input in multiple modes, and cursor control, all by finger commands on a single sensor.
PCT/NO2001/000384 2000-09-27 2001-09-20 Method and system for inputting characters WO2002028067A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001292451A AU2001292451A1 (en) 2000-09-27 2001-09-20 Method and system for inputting characters

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NO20004863 2000-09-27
NO20004863A NO315777B1 (en) 2000-09-27 2000-09-27 Method and system for obtaining a user interface against an electrical device

Publications (1)

Publication Number Publication Date
WO2002028067A1 true WO2002028067A1 (en) 2002-04-04

Family

ID=19911624

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NO2001/000384 WO2002028067A1 (en) 2000-09-27 2001-09-20 Method and system for inputting characters

Country Status (3)

Country Link
AU (1) AU2001292451A1 (en)
NO (1) NO315777B1 (en)
WO (1) WO2002028067A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005043451A2 (en) * 2003-08-05 2005-05-12 Pedersen Steinar System for identification of a person
WO2007084078A1 (en) * 2006-04-22 2007-07-26 Simlab Inventions & Consultancy Private Limited A keyboard for a mobile phone or other portable communication devices
WO2007121977A2 (en) * 2006-04-22 2007-11-01 Ident Technology Ag Control system for a vehicle cockpit
WO2008138695A1 (en) * 2007-05-11 2008-11-20 Continental Automotive Gmbh Shift lever head
EP2219135A1 (en) * 2009-01-23 2010-08-18 Shining Union Limited USB fingerprint scanner with touch sensor
US8471679B2 (en) * 2008-10-28 2013-06-25 Authentec, Inc. Electronic device including finger movement based musical tone generation and related methods
US8594391B2 (en) 2004-05-06 2013-11-26 Avago Technologies General Ip (Singapore) Pte. Ltd. Finger-based identification systems and methods
GB2507777A (en) * 2012-11-09 2014-05-14 David Rawcliffe Conversion of combinations of gestures into character input, using restricted gesture set
WO2014206505A1 (en) 2013-06-26 2014-12-31 Steinar Pedersen Improvements in or relating to user authentication
US9104306B2 (en) 2010-10-29 2015-08-11 Avago Technologies General Ip (Singapore) Pte. Ltd. Translation of directional input to gesture
CN106790988A (en) * 2016-11-23 2017-05-31 惠州Tcl移动通信有限公司 Fingerprint sensor false triggering control method and system are prevented based on mobile terminal
US10510097B2 (en) 2011-10-19 2019-12-17 Firstface Co., Ltd. Activating display and performing additional function in mobile terminal with one-time user input

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4758979A (en) * 1985-06-03 1988-07-19 Chiao Yueh Lin Method and means for automatically coding and inputting Chinese characters in digital computers
DE19528734A1 (en) * 1995-08-04 1997-02-06 Siemens Ag Transceiver handset for telecommunication device - has display, loudspeaker, microphone, and input arrangement, which is comprised of touch panel in matrix form including keys for inputting numbers
US5608395A (en) * 1994-06-22 1997-03-04 The Hugh Macmillan Rehabilitation Centre Simplified computer access system
EP0924948A1 (en) * 1997-12-16 1999-06-23 Siemens Aktiengesellschaft Radio communications terminal device with a navigation key
EP0927949A2 (en) * 1997-12-29 1999-07-07 SAMSUNG ELECTRONICS Co. Ltd. Character-recognition system for a mobile radio communication terminal and method thereof
EP0929028A2 (en) * 1998-01-13 1999-07-14 STMicroelectronics, Inc. Capacitive semiconductor user input device
US5977948A (en) * 1996-02-16 1999-11-02 Nishibori; Masahiro Input processing system for characters
EP0969644A1 (en) * 1998-07-02 2000-01-05 Nokia Mobile Phones Ltd. Electronic apparatus with fingerprint recognition
EP0973123A1 (en) * 1998-07-17 2000-01-19 Lucent Technologies Inc. Finger sensor operating technique
US6057540A (en) * 1998-04-30 2000-05-02 Hewlett-Packard Co Mouseless optical and position translation type screen pointer control for a computer system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4758979A (en) * 1985-06-03 1988-07-19 Chiao Yueh Lin Method and means for automatically coding and inputting Chinese characters in digital computers
US5608395A (en) * 1994-06-22 1997-03-04 The Hugh Macmillan Rehabilitation Centre Simplified computer access system
DE19528734A1 (en) * 1995-08-04 1997-02-06 Siemens Ag Transceiver handset for telecommunication device - has display, loudspeaker, microphone, and input arrangement, which is comprised of touch panel in matrix form including keys for inputting numbers
US5977948A (en) * 1996-02-16 1999-11-02 Nishibori; Masahiro Input processing system for characters
EP0924948A1 (en) * 1997-12-16 1999-06-23 Siemens Aktiengesellschaft Radio communications terminal device with a navigation key
EP0927949A2 (en) * 1997-12-29 1999-07-07 SAMSUNG ELECTRONICS Co. Ltd. Character-recognition system for a mobile radio communication terminal and method thereof
EP0929028A2 (en) * 1998-01-13 1999-07-14 STMicroelectronics, Inc. Capacitive semiconductor user input device
US6057540A (en) * 1998-04-30 2000-05-02 Hewlett-Packard Co Mouseless optical and position translation type screen pointer control for a computer system
EP0969644A1 (en) * 1998-07-02 2000-01-05 Nokia Mobile Phones Ltd. Electronic apparatus with fingerprint recognition
EP0973123A1 (en) * 1998-07-17 2000-01-19 Lucent Technologies Inc. Finger sensor operating technique

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005043451A2 (en) * 2003-08-05 2005-05-12 Pedersen Steinar System for identification of a person
WO2005043451A3 (en) * 2003-08-05 2006-03-23 Pedersen Steinar System for identification of a person
US8594391B2 (en) 2004-05-06 2013-11-26 Avago Technologies General Ip (Singapore) Pte. Ltd. Finger-based identification systems and methods
WO2007121977A3 (en) * 2006-04-22 2008-04-17 Ident Technology Ag Control system for a vehicle cockpit
WO2007121977A2 (en) * 2006-04-22 2007-11-01 Ident Technology Ag Control system for a vehicle cockpit
WO2007084078A1 (en) * 2006-04-22 2007-07-26 Simlab Inventions & Consultancy Private Limited A keyboard for a mobile phone or other portable communication devices
WO2008138695A1 (en) * 2007-05-11 2008-11-20 Continental Automotive Gmbh Shift lever head
US8471679B2 (en) * 2008-10-28 2013-06-25 Authentec, Inc. Electronic device including finger movement based musical tone generation and related methods
EP2219135A1 (en) * 2009-01-23 2010-08-18 Shining Union Limited USB fingerprint scanner with touch sensor
US9104306B2 (en) 2010-10-29 2015-08-11 Avago Technologies General Ip (Singapore) Pte. Ltd. Translation of directional input to gesture
US10510097B2 (en) 2011-10-19 2019-12-17 Firstface Co., Ltd. Activating display and performing additional function in mobile terminal with one-time user input
US10896442B2 (en) 2011-10-19 2021-01-19 Firstface Co., Ltd. Activating display and performing additional function in mobile terminal with one-time user input
US11551263B2 (en) 2011-10-19 2023-01-10 Firstface Co., Ltd. Activating display and performing additional function in mobile terminal with one-time user input
GB2507777A (en) * 2012-11-09 2014-05-14 David Rawcliffe Conversion of combinations of gestures into character input, using restricted gesture set
WO2014206505A1 (en) 2013-06-26 2014-12-31 Steinar Pedersen Improvements in or relating to user authentication
CN106790988A (en) * 2016-11-23 2017-05-31 惠州Tcl移动通信有限公司 Fingerprint sensor false triggering control method and system are prevented based on mobile terminal

Also Published As

Publication number Publication date
NO20004863D0 (en) 2000-09-27
AU2001292451A1 (en) 2002-04-08
NO315777B1 (en) 2003-10-20
NO20004863L (en) 2002-04-02

Similar Documents

Publication Publication Date Title
KR101192279B1 (en) Integrated Keypad System
US7395506B2 (en) Spy-resistant keyboard
US6130665A (en) Touch screen handling
US7787666B2 (en) Sensing data input
US6507336B1 (en) Keyboard for a handheld computer
AU2007225655B2 (en) System for input to information processing device
WO2002028067A1 (en) Method and system for inputting characters
US20020109677A1 (en) Touchpad code entry system
US20060075250A1 (en) Touch panel lock and unlock function and hand-held device
US20060084482A1 (en) Electronic hand-held device with a back cover keypad and a related method
WO2005064447A2 (en) Electronic device with finger sensor for character entry and associated methods
JP2007141029A (en) Portable information device
WO2007137111A2 (en) Handheld electronic device with data entry and/or navigation controls on the reverse side of the display
US20020190960A1 (en) Method for controlling computer cursor based on identification of user fingerprint
US20150025876A1 (en) Integrated keypad system
EP3472689B1 (en) Accommodative user interface for handheld electronic devices
US20060209031A1 (en) Hand held communications computer and keyboard
WO2002027455A1 (en) Method and generator for inputting characters
US8416193B2 (en) Method of visualizing an input location
US20040136149A1 (en) Portable computer having a hidden keyboard structure
AU2013206233B2 (en) Input processing system for information processing device
KR100645581B1 (en) Information input device in vehicle
AU2011247861A1 (en) Integrated keypad system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP