CA2007411A1 - Advanced user interface - Google Patents

Advanced user interface

Info

Publication number
CA2007411A1
CA2007411A1 CA2007411A CA2007411A CA2007411A1 CA 2007411 A1 CA2007411 A1 CA 2007411A1 CA 2007411 A CA2007411 A CA 2007411A CA 2007411 A CA2007411 A CA 2007411A CA 2007411 A1 CA2007411 A1 CA 2007411A1
Authority
CA
Canada
Prior art keywords
input
user interface
application program
advanced user
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA2007411A
Other languages
French (fr)
Other versions
CA2007411C (en
Inventor
Evon Constantine Greanias
Guy Francis Verrier
Gordon Wayne Arbeitman
Alan Richard Tannenbaum
Yu Larry An
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CA2007411A1 publication Critical patent/CA2007411A1/en
Application granted granted Critical
Publication of CA2007411C publication Critical patent/CA2007411C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/10—Program control for peripheral devices
    • G06F13/105—Program control for peripheral devices where the programme performs an input/output emulation function
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45504—Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
    • G06F9/45508—Runtime interpretation or emulation, e g. emulator loops, bytecode interpretation
    • G06F9/45512—Command shells
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer

Abstract

An advanced user interface for use with a computer system operating on an integrated operating environment.
The integrated operating environment allows a plurality of application programs to be running simultaneously, one of which is designated the active application program to which all input data is directed. The advanced user interface allows a user to select among user-friendly input devices to operate any application program according to his individual preferences without change to the application program code. The advanced user interface includes alternate input modules which translate the input signals transmitted from the various input devices into input messages useable by the rest of the interface. The advanced user interface also includes interface profiles which contain mappings of the input messages against corresponding commands useable by the application programs, the integrated operating environment or other modules of the advanced user interface itself. An environment link module refers to the interface profiles and matches the input message against the corresponding command for the application program active at the time the input signal was transmitted and send the corresponding command to that application program.
CA002007411A 1989-04-28 1990-01-09 Advanced user interface Expired - Fee Related CA2007411C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US344,879 1989-04-28
US07/344,879 US5157384A (en) 1989-04-28 1989-04-28 Advanced user interface

Publications (2)

Publication Number Publication Date
CA2007411A1 true CA2007411A1 (en) 1990-10-28
CA2007411C CA2007411C (en) 1998-04-21

Family

ID=23352455

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002007411A Expired - Fee Related CA2007411C (en) 1989-04-28 1990-01-09 Advanced user interface

Country Status (5)

Country Link
US (1) US5157384A (en)
EP (1) EP0394614B1 (en)
JP (1) JPH0320812A (en)
CA (1) CA2007411C (en)
DE (1) DE69026417T2 (en)

Families Citing this family (230)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5252951A (en) * 1989-04-28 1993-10-12 International Business Machines Corporation Graphical user interface with gesture recognition in a multiapplication environment
JPH03163623A (en) * 1989-06-23 1991-07-15 Articulate Syst Inc Voice control computor interface
JPH0778782B2 (en) * 1989-07-19 1995-08-23 インターナショナル・ビジネス・マシーンズ・コーポレーシヨン Interactive computer system and apparatus and method for adapting use environment thereof
US5276816A (en) * 1990-12-31 1994-01-04 International Business Machines Corporation Icon object interface system and method
US5497319A (en) * 1990-12-31 1996-03-05 Trans-Link International Corp. Machine translation and telecommunications system
US5606702A (en) * 1991-03-30 1997-02-25 International Business Machines Corporation Method for specifying user interfaces and programming system running a multiple user interface computer
JPH0520274A (en) * 1991-07-10 1993-01-29 Canon Inc Electronic information equipment
JP2695542B2 (en) * 1991-07-12 1997-12-24 財団法人ニューメディア開発協会 Information processing device that uses and acquires user information
US5301326A (en) * 1991-09-24 1994-04-05 Microsoft Corporation Method and system for controlling the execution of an application program
US5825865A (en) * 1991-10-04 1998-10-20 Motorola, Inc. Temporary message routing and destination selection
JPH0736142B2 (en) * 1991-10-10 1995-04-19 インターナショナル・ビジネス・マシーンズ・コーポレイション Method and information processing apparatus for recognizing movement stop of movement instruction means
CA2076466C (en) * 1991-10-21 2002-01-15 Alan R. Tannenbaum Method for buffering high bandwidth data from an input device
US5848187A (en) * 1991-11-18 1998-12-08 Compaq Computer Corporation Method and apparatus for entering and manipulating spreadsheet cell data
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
JP3286339B2 (en) 1992-03-25 2002-05-27 株式会社リコー Window screen control device
US5404524A (en) * 1992-04-03 1995-04-04 International Business Machines Corporation System for identifying attached input pointing devices, loading associated software routines, and interacting with anyone input pointing device while disabling the others
US5317695A (en) * 1992-04-03 1994-05-31 International Business Machines Corporation Method and system for permitting communication between a data processing system and input pointing devices of multiple types
US5818800A (en) * 1992-04-06 1998-10-06 Barker; Bruce J. Voice recording device having portable and local modes of operation
US5508821A (en) * 1992-04-09 1996-04-16 Matsushita Electric Industrial Co., Ltd. Image scanner and image forming apparatus with an interface for connection with an external computer
CA2089784C (en) * 1992-04-15 1996-12-24 William Joseph Anderson Apparatus and method for disambiguating an input stream generated by a stylus-based user interface
EP0566293B1 (en) * 1992-04-15 2003-07-16 Xerox Corporation Graphical drawing and editing systems and methods therefor
US5889236A (en) * 1992-06-08 1999-03-30 Synaptics Incorporated Pressure sensitive scrollbar feature
US5942733A (en) * 1992-06-08 1999-08-24 Synaptics, Inc. Stylus input capacitive touchpad sensor
US6239389B1 (en) 1992-06-08 2001-05-29 Synaptics, Inc. Object position detection system and method
DE69324067T2 (en) 1992-06-08 1999-07-15 Synaptics Inc Object position detector
US5880411A (en) 1992-06-08 1999-03-09 Synaptics, Incorporated Object position detector with edge motion feature and gesture recognition
US5861583A (en) 1992-06-08 1999-01-19 Synaptics, Incorporated Object position detector
US6028271A (en) 1992-06-08 2000-02-22 Synaptics, Inc. Object position detector with edge motion feature and gesture recognition
FR2696258B1 (en) * 1992-09-25 1994-10-28 Sextant Avionique Device for managing a human-machine interaction system.
FR2696574B1 (en) * 1992-10-06 1994-11-18 Sextant Avionique Method and device for analyzing a message supplied by means of interaction with a human-machine dialogue system.
EP0593386A3 (en) * 1992-10-16 1996-07-31 Ibm Method and apparatus for accessing touch screen desktop objects via fingerprint recognition
US5442376A (en) * 1992-10-26 1995-08-15 International Business Machines Corporation Handling multiple command recognition inputs in a multi-tasking graphical environment
US5561811A (en) * 1992-11-10 1996-10-01 Xerox Corporation Method and apparatus for per-user customization of applications shared by a plurality of users on a single display
EP0606811A3 (en) * 1992-12-28 1995-06-21 Ibm Employing a preferred object handler.
US5502803A (en) * 1993-01-18 1996-03-26 Sharp Kabushiki Kaisha Information processing apparatus having a gesture editing function
US5890122A (en) * 1993-02-08 1999-03-30 Microsoft Corporation Voice-controlled computer simulateously displaying application menu and list of available commands
CA2157910A1 (en) * 1993-03-10 1994-09-15 Bruce Barker Data entry device
CA2115210C (en) * 1993-04-21 1997-09-23 Joseph C. Andreshak Interactive computer system recognizing spoken commands
US5638501A (en) 1993-05-10 1997-06-10 Apple Computer, Inc. Method and apparatus for displaying an overlay image
US5614926A (en) * 1993-05-17 1997-03-25 Sharp Kabushiki Kaisha Word processor with a handwriting text processing function
WO1995003574A1 (en) * 1993-07-19 1995-02-02 Taligent, Inc. Dynamic linking system
US5581670A (en) * 1993-07-21 1996-12-03 Xerox Corporation User interface having movable sheet with click-through tools
CA2124624C (en) * 1993-07-21 1999-07-13 Eric A. Bier User interface having click-through tools that can be composed with other tools
CA2124505C (en) * 1993-07-21 2000-01-04 William A. S. Buxton User interface having simultaneously movable tools and cursor
JPH0792993A (en) * 1993-09-20 1995-04-07 Fujitsu Ltd Speech recognizing device
US5583761A (en) * 1993-10-13 1996-12-10 Kt International, Inc. Method for automatic displaying program presentations in different languages
JP2813728B2 (en) * 1993-11-01 1998-10-22 インターナショナル・ビジネス・マシーンズ・コーポレイション Personal communication device with zoom / pan function
US5375084A (en) * 1993-11-08 1994-12-20 International Business Machines Corporation Selectable interface between memory controller and memory simms
JP2710547B2 (en) * 1994-02-15 1998-02-10 インターナショナル・ビジネス・マシーンズ・コーポレイション Graphical user interface
US5542069A (en) * 1994-03-02 1996-07-30 Sun Microsystems, Inc. Method and apparatus for simulating input events in a windowed environment
US5681220A (en) * 1994-03-18 1997-10-28 International Business Machines Corporation Keyboard touchpad combination in a bivalve enclosure
US5613137A (en) * 1994-03-18 1997-03-18 International Business Machines Corporation Computer system with touchpad support in operating system
KR970702523A (en) * 1994-04-21 1997-05-13 에리카 린들리 그래험 더튼 INTERFACE DEVICE AND METHOD
US6496872B1 (en) * 1994-05-16 2002-12-17 Apple Computer, Inc. Computer system for automatically instantiating tasks designated by a user
US5748980A (en) * 1994-05-27 1998-05-05 Microsoft Corporation System for configuring a computer system
US6763454B2 (en) 1994-05-27 2004-07-13 Microsoft Corp. System for allocating resources in a computer system
US5787246A (en) * 1994-05-27 1998-07-28 Microsoft Corporation System for configuring devices for a computer system
US5655148A (en) * 1994-05-27 1997-08-05 Microsoft Corporation Method for automatically configuring devices including a network adapter without manual intervention and without prior configuration information
US5570113A (en) * 1994-06-29 1996-10-29 International Business Machines Corporation Computer based pen system and method for automatically cancelling unwanted gestures and preventing anomalous signals as inputs to such system
US6137473A (en) * 1994-09-02 2000-10-24 Nec Corporation System and method for switching control between a host computer and a remote interface device
US5867106A (en) * 1994-09-02 1999-02-02 Packard Bell Nec Password switch to override remote control
US6092117A (en) * 1994-09-02 2000-07-18 Packard Bell Nec System and method for automatically reconnecting a wireless interface device to a host computer
US5974558A (en) * 1994-09-02 1999-10-26 Packard Bell Nec Resume on pen contact
US6292181B1 (en) * 1994-09-02 2001-09-18 Nec Corporation Structure and method for controlling a host computer using a remote hand-held interface device
US6209034B1 (en) 1994-09-02 2001-03-27 Nec Corporation Remote keyboard macros activated by hot icons
US6262719B1 (en) 1994-09-02 2001-07-17 Packard Bell Nec, Inc. Mouse emulation with a passive pen
WO1996009579A1 (en) * 1994-09-22 1996-03-28 Izak Van Cruyningen Popup menus with directional gestures
JP3399665B2 (en) * 1994-11-04 2003-04-21 シャープ株式会社 Information processing device
US5630159A (en) * 1994-12-29 1997-05-13 Motorola, Inc. Method and apparatus for personal attribute selection having delay management method and apparatus for preference establishment when preferences in a donor device are unavailable
US5761420A (en) * 1995-02-28 1998-06-02 Johnson; William Method and apparatus for telephone proof of documents
US5706456A (en) * 1995-04-18 1998-01-06 Unisys Corporation Application specific graphical user interface (GUI) that is window programmable and capable of operating above a windows operating system GUI
US5802388A (en) * 1995-05-04 1998-09-01 Ibm Corporation System and method for correction and confirmation dialog for hand printed character input to a data processing system
DE69620062T2 (en) * 1995-07-07 2002-11-14 Sun Microsystems Inc Data access implementation of device driver interface
US6668244B1 (en) * 1995-07-21 2003-12-23 Quartet Technology, Inc. Method and means of voice control of a computer, including its mouse and keyboard
US5857172A (en) * 1995-07-31 1999-01-05 Microsoft Corporation Activation control of a speech recognizer through use of a pointing device
US5864815A (en) * 1995-07-31 1999-01-26 Microsoft Corporation Method and system for displaying speech recognition status information in a visual notification area
US5761641A (en) * 1995-07-31 1998-06-02 Microsoft Corporation Method and system for creating voice commands for inserting previously entered information
US5748191A (en) * 1995-07-31 1998-05-05 Microsoft Corporation Method and system for creating voice commands using an automatically maintained log interactions performed by a user
US5790889A (en) * 1995-08-11 1998-08-04 Dell U.S.A., L.P. Method of selecting pointing device in a computer comprising responsive to a reconfiguration event, indentifying all connected pointing devices and selecting one of the devices
US5787285A (en) * 1995-08-15 1998-07-28 International Business Machines Corporation Apparatus and method for optimizing applications for multiple operational environments or modes
US6289312B1 (en) * 1995-10-02 2001-09-11 Digital Equipment Corporation Speech interface for computer application programs
US5805777A (en) * 1995-10-11 1998-09-08 Eastman Kodak Company Extended printer control interface
US6018806A (en) * 1995-10-16 2000-01-25 Packard Bell Nec Method and system for rebooting a computer having corrupted memory using an external jumper
US5996082A (en) * 1995-10-16 1999-11-30 Packard Bell Nec System and method for delaying a wake-up signal
US7512671B1 (en) * 1995-10-16 2009-03-31 Nec Corporation Computer system for enabling a wireless interface device to selectively establish a communication link with a user selectable remote computer
US5990875A (en) * 1995-10-16 1999-11-23 Packard Bell Nec Double pen up event
US6924790B1 (en) 1995-10-16 2005-08-02 Nec Corporation Mode switching for pen-based computer systems
US6664982B1 (en) 1995-10-16 2003-12-16 Nec Corporation Multi-user on-screen keyboard
US6279153B1 (en) 1995-10-16 2001-08-21 Nec Corporation Multi-user flash ROM update
US6005533A (en) * 1995-10-16 1999-12-21 Packard Bell Nec Remote occlusion region
US6108727A (en) * 1995-10-16 2000-08-22 Packard Bell Nec System having wireless interface device for storing compressed predetermined program files received from a remote host and communicating with the remote host via wireless link
US6148344A (en) * 1995-10-16 2000-11-14 Nec Corporation System and method for enabling an IPX driver to accommodate multiple LAN adapters
US6126327A (en) * 1995-10-16 2000-10-03 Packard Bell Nec Radio flash update
JP3434105B2 (en) * 1995-11-28 2003-08-04 富士通株式会社 Macro program management device
US6300936B1 (en) 1997-11-14 2001-10-09 Immersion Corporation Force feedback system including multi-tasking graphical host environment and interface device
US5823782A (en) * 1995-12-29 1998-10-20 Tinkers & Chance Character recognition educational system
US5838972A (en) * 1996-02-09 1998-11-17 Sun Microsystems, Inc. Method and apparatus for dynamically loading an input run-time module and an output run-time module
USRE38286E1 (en) 1996-02-15 2003-10-28 Leapfrog Enterprises, Inc. Surface position location system and method
USRE39881E1 (en) 1996-02-15 2007-10-16 Leapfrog Enterprises, Inc. Surface position location system and method
US5898422A (en) * 1996-05-31 1999-04-27 International Business Machines Corporation Method and system for recognition of pointers
US5841994A (en) * 1996-06-14 1998-11-24 Texas Instruments Incorporated Portable computer with multiple zoom port interface
GB2315139A (en) * 1996-07-06 1998-01-21 Ibm Selecting operations in an object-oriented user interface
US5867153A (en) 1996-10-30 1999-02-02 Transaction Technology, Inc. Method and system for automatically harmonizing access to a software application program via different access devices
US5873064A (en) * 1996-11-08 1999-02-16 International Business Machines Corporation Multi-action voice macro method
US6654955B1 (en) * 1996-12-19 2003-11-25 International Business Machines Corporation Adding speech recognition libraries to an existing program at runtime
US6297805B1 (en) 1997-08-29 2001-10-02 Xerox Corporation Multiple interacting computers interfaceable through a physical manipulatory grammar
US6243074B1 (en) 1997-08-29 2001-06-05 Xerox Corporation Handedness detection for a physical manipulatory grammar
US6243075B1 (en) 1997-08-29 2001-06-05 Xerox Corporation Graspable device manipulation for controlling a computer display
US6268857B1 (en) 1997-08-29 2001-07-31 Xerox Corporation Computer user interface using a physical manipulatory grammar
US6297838B1 (en) 1997-08-29 2001-10-02 Xerox Corporation Spinning as a morpheme for a physical manipulatory grammar
US6678744B2 (en) * 1997-10-09 2004-01-13 Ericsson Inc. Application wrapper methods and systems
US8020095B2 (en) 1997-11-14 2011-09-13 Immersion Corporation Force feedback system including multi-tasking graphical host environment
US6160540A (en) * 1998-01-12 2000-12-12 Xerox Company Zoomorphic computer user interface
US20070177804A1 (en) * 2006-01-30 2007-08-02 Apple Computer, Inc. Multi-touch gesture dictionary
US9292111B2 (en) 1998-01-26 2016-03-22 Apple Inc. Gesturing with a multipoint sensing device
US7614008B2 (en) 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
US9239673B2 (en) 1998-01-26 2016-01-19 Apple Inc. Gesturing with a multipoint sensing device
US8479122B2 (en) 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US6509913B2 (en) 1998-04-30 2003-01-21 Openwave Systems Inc. Configurable man-machine interface
US6438523B1 (en) 1998-05-20 2002-08-20 John A. Oberteuffer Processing handwritten and hand-drawn input and speech input
US6263375B1 (en) * 1998-08-31 2001-07-17 International Business Machines Corp. Method for creating dictation macros
US7002552B1 (en) 1999-04-06 2006-02-21 Microsoft Corporation Computer input device with digit support and natural position actuators
WO2000016187A1 (en) * 1998-09-14 2000-03-23 Microsoft Corporation Input device with forward/backward control
US7206747B1 (en) 1998-12-16 2007-04-17 International Business Machines Corporation Speech command input recognition system for interactive computer display with means for concurrent and modeless distinguishing between speech commands and speech queries for locating commands
US6192343B1 (en) 1998-12-17 2001-02-20 International Business Machines Corporation Speech command input recognition system for interactive computer display with term weighting means used in interpreting potential commands from relevant speech terms
US8275617B1 (en) 1998-12-17 2012-09-25 Nuance Communications, Inc. Speech command input recognition system for interactive computer display with interpretation of ancillary relevant speech query terms into commands
US6233560B1 (en) 1998-12-16 2001-05-15 International Business Machines Corporation Method and apparatus for presenting proximal feedback in voice command systems
US6937984B1 (en) 1998-12-17 2005-08-30 International Business Machines Corporation Speech command input recognition system for interactive computer display with speech controlled display of recognized commands
US6963937B1 (en) 1998-12-17 2005-11-08 International Business Machines Corporation Method and apparatus for providing configurability and customization of adaptive user-input filtration
US6570555B1 (en) * 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US6336149B1 (en) * 1999-01-26 2002-01-01 Glenn W. Preston Macro recording and playback device independent of operating system or application software and method of using same
US7966078B2 (en) 1999-02-01 2011-06-21 Steven Hoffberg Network media appliance system and method
US7116310B1 (en) * 1999-04-06 2006-10-03 Microsoft Corporation Application programming interface that maps input device controls to software actions
US6727884B1 (en) * 1999-04-06 2004-04-27 Microsoft Corporation System and method for mapping input device controls to software actions
US6965368B1 (en) * 1999-04-06 2005-11-15 Microsoft Corporation Game control device having genre data
US6711620B1 (en) 1999-04-14 2004-03-23 Matsushita Electric Industrial Co. Event control device and digital broadcasting system
JP4528384B2 (en) * 1999-07-08 2010-08-18 マイクロソフト コーポレーション Display device for graphical user interface for voice input
US6598169B1 (en) * 1999-07-26 2003-07-22 Microsoft Corporation System and method for accessing information made available by a kernel mode driver
US7016835B2 (en) * 1999-10-29 2006-03-21 International Business Machines Corporation Speech and signal digitization by using recognition metrics to select from multiple techniques
US7028264B2 (en) * 1999-10-29 2006-04-11 Surfcast, Inc. System and method for simultaneous display of multiple information sources
US6724403B1 (en) 1999-10-29 2004-04-20 Surfcast, Inc. System and method for simultaneous display of multiple information sources
US7987431B2 (en) 1999-10-29 2011-07-26 Surfcast, Inc. System and method for simultaneous display of multiple information sources
GB9930851D0 (en) * 1999-12-24 2000-02-16 Koninkl Philips Electronics Nv Apparatus control system and method
US6642942B1 (en) * 2000-03-07 2003-11-04 Intel Corporation Method and system for configuring among call processing applications in a call processing system
US7058888B1 (en) * 2000-04-25 2006-06-06 Microsoft Corporation Multi-modal text editing correction
US6661405B1 (en) 2000-04-27 2003-12-09 Leapfrog Enterprises, Inc. Electrographic position location apparatus and method
US6668156B2 (en) 2000-04-27 2003-12-23 Leapfrog Enterprises, Inc. Print media receiving unit including platform and print media
US6750978B1 (en) * 2000-04-27 2004-06-15 Leapfrog Enterprises, Inc. Print media information system with a portable print media receiving unit assembly
EP1348161A1 (en) * 2000-11-27 2003-10-01 Nokia Corporation Method and system providing a mediation function
DE60117676T2 (en) * 2000-12-29 2006-11-16 Stmicroelectronics S.R.L., Agrate Brianza A method for easily extending the functionality of a portable electronic device and associated portable electronic device
US7916124B1 (en) 2001-06-20 2011-03-29 Leapfrog Enterprises, Inc. Interactive apparatus using print media
US6608618B2 (en) 2001-06-20 2003-08-19 Leapfrog Enterprises, Inc. Interactive apparatus using print media
EP1286261A1 (en) * 2001-08-13 2003-02-26 Alcatel Method, control interface module, intermediate modules and so equipped network management system for the operation of a control interface module
EP1321852A1 (en) * 2001-10-03 2003-06-25 C O2W3 Sas Modular logic platform
US9189467B1 (en) 2001-11-07 2015-11-17 Apple Inc. Method and apparatus for annotating an electronic document
GB2400969A (en) * 2002-02-06 2004-10-27 Leapfrog Entpr Inc Write on interactive apparatus and method
EP1388786A1 (en) * 2002-03-15 2004-02-11 Alcatel User interface for interaction with a computer
AU2003241298A1 (en) * 2002-04-22 2003-11-03 Thomson Licensing S.A. Remote key manager
US7099893B2 (en) * 2002-06-28 2006-08-29 Sap Aktiengesellschaft Recording application user actions for application testing
US8682636B2 (en) * 2002-08-30 2014-03-25 Sap Ag Non-client-specific testing of applications
US20040063078A1 (en) * 2002-09-30 2004-04-01 Marcus Brian I. Electronic educational toy appliance
US20040229195A1 (en) * 2003-03-18 2004-11-18 Leapfrog Enterprises, Inc. Scanning apparatus
US8745541B2 (en) * 2003-03-25 2014-06-03 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7068262B2 (en) * 2003-06-09 2006-06-27 Leapfrog Enterprises, Inc. Writing stylus for electrographic position location apparatus
AU2003266983A1 (en) * 2003-08-14 2005-03-07 Docomo Communications Laboratories Europe Gmbh Direct data input
US20050055647A1 (en) * 2003-09-05 2005-03-10 Chung-Hui Chen System and method for switching software functions
MXPA06007945A (en) * 2004-01-13 2007-01-26 Univ Toledo Noninvasive birefringence compensated sensing polarimeter.
US8170945B2 (en) 2004-01-15 2012-05-01 Bgc Partners, Inc. System and method for providing security to a game controller device for electronic trading
US7207885B2 (en) 2004-01-15 2007-04-24 Espeed, Inc. System and method for using a game controller device for electronic trading
US7458029B2 (en) * 2004-01-15 2008-11-25 Microsoft Corporation System and process for controlling a shared display given inputs from multiple users using multiple input modalities
US8469808B2 (en) 2004-01-15 2013-06-25 Bgc Partners, Inc. System and method for managing a game controller device for electronic trading
US7707039B2 (en) 2004-02-15 2010-04-27 Exbiblio B.V. Automatic modification of web pages
US8442331B2 (en) 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US7812860B2 (en) 2004-04-01 2010-10-12 Exbiblio B.V. Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device
US10635723B2 (en) 2004-02-15 2020-04-28 Google Llc Search engines and systems with handheld document data capture devices
US7345681B2 (en) * 2004-02-17 2008-03-18 Microsoft Corporation Pen data capture and injection
US20060067576A1 (en) * 2004-03-17 2006-03-30 James Marggraff Providing a user interface having interactive elements on a writable surface
US20060125805A1 (en) * 2004-03-17 2006-06-15 James Marggraff Method and system for conducting a transaction using recognized text
WO2008028674A2 (en) 2006-09-08 2008-03-13 Exbiblio B.V. Optical scanners, such as hand-held optical scanners
US9143638B2 (en) 2004-04-01 2015-09-22 Google Inc. Data capture from rendered documents using handheld device
US7990556B2 (en) 2004-12-03 2011-08-02 Google Inc. Association of a portable scanner with input/output and storage devices
US20060081714A1 (en) 2004-08-23 2006-04-20 King Martin T Portable scanning device
US7894670B2 (en) 2004-04-01 2011-02-22 Exbiblio B.V. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US9116890B2 (en) 2004-04-01 2015-08-25 Google Inc. Triggering actions in response to optically or acoustically capturing keywords from a rendered document
US20060098900A1 (en) 2004-09-27 2006-05-11 King Martin T Secure data gathering from rendered documents
US8146156B2 (en) 2004-04-01 2012-03-27 Google Inc. Archive of text captures from rendered documents
US8620083B2 (en) 2004-12-03 2013-12-31 Google Inc. Method and system for character recognition
US8874504B2 (en) 2004-12-03 2014-10-28 Google Inc. Processing techniques for visual capture data from a rendered document
US8489624B2 (en) 2004-05-17 2013-07-16 Google, Inc. Processing techniques for text capture from a rendered document
US8346620B2 (en) 2004-07-19 2013-01-01 Google Inc. Automatic modification of web pages
US8381135B2 (en) 2004-07-30 2013-02-19 Apple Inc. Proximity detector in handheld device
US7653883B2 (en) 2004-07-30 2010-01-26 Apple Inc. Proximity detector in handheld device
US7167675B2 (en) * 2004-10-15 2007-01-23 Leapfrog Enterprises, Inc. Magnetic switch and apparatus including magnetic switch
US7922099B1 (en) 2005-07-29 2011-04-12 Leapfrog Enterprises, Inc. System and method for associating content with an image bearing surface
US7883420B2 (en) 2005-09-12 2011-02-08 Mattel, Inc. Video game systems
US7936339B2 (en) * 2005-11-01 2011-05-03 Leapfrog Enterprises, Inc. Method and system for invoking computer functionality by interaction with dynamically generated interface regions of a writing surface
EP1865410A1 (en) * 2006-06-09 2007-12-12 Delta Electronics, Inc. Human-machine interface system with device bridge and method for designing and operating the same
US8261967B1 (en) 2006-07-19 2012-09-11 Leapfrog Enterprises, Inc. Techniques for interactively coupling electronic content with printed media
US8130194B1 (en) * 2006-12-18 2012-03-06 Imi Innovations, Inc. Non-mouse devices that function via mouse-like messages
US20080228618A1 (en) 2007-03-15 2008-09-18 Noviello Joseph C System And Method For Providing An Operator Interface For Displaying Market Data, Trader Options, And Trader Input
US7631124B2 (en) * 2007-04-06 2009-12-08 Microsoft Corporation Application-specific mapping of input device elements
US20090046064A1 (en) * 2007-08-17 2009-02-19 Microsoft Corporation Pointing device for control of a graphical display or application
US8638363B2 (en) 2009-02-18 2014-01-28 Google Inc. Automatically capturing information, such as capturing information using a document-aware device
US20090161575A1 (en) * 2007-12-19 2009-06-25 Research In Motion Limited Long Term Evolution User Equipment Multi-Packet Data Network Connectivity Control
US20090187847A1 (en) * 2008-01-18 2009-07-23 Palm, Inc. Operating System Providing Consistent Operations Across Multiple Input Devices
FR2933211B1 (en) * 2008-06-26 2010-11-26 Airbus France INTERACTION DEVICE WITH A DISPLAY SYSTEM, IN PARTICULAR FOR AN AVIONIC DISPLAY SYSTEM
US20100095250A1 (en) * 2008-10-15 2010-04-15 Raytheon Company Facilitating Interaction With An Application
KR101185093B1 (en) * 2008-12-19 2012-09-21 한국전자통신연구원 Project management device and method for architecture modeling tool of application software on AUTOSAR
WO2010105246A2 (en) 2009-03-12 2010-09-16 Exbiblio B.V. Accessing resources based on capturing information from a rendered document
US8447066B2 (en) 2009-03-12 2013-05-21 Google Inc. Performing actions based on capturing information from rendered documents, such as documents under copyright
US8421761B2 (en) * 2009-08-26 2013-04-16 General Electric Company Imaging multi-modality touch pad interface systems, methods, articles of manufacture, and apparatus
US9081799B2 (en) 2009-12-04 2015-07-14 Google Inc. Using gestalt information to identify locations in printed information
US9323784B2 (en) 2009-12-09 2016-04-26 Google Inc. Image search using text-based elements within the contents of images
US9092128B2 (en) 2010-05-21 2015-07-28 Apple Inc. Method and apparatus for managing visual information
US8392935B2 (en) 2011-03-28 2013-03-05 Google Inc. Uniform event handling across multiple computing devices
US8151279B1 (en) * 2011-03-28 2012-04-03 Google Inc. Uniform event handling across multiple computing devices
US20130139113A1 (en) * 2011-11-30 2013-05-30 Microsoft Corporation Quick action for performing frequent tasks on a mobile device
KR101322952B1 (en) * 2012-02-24 2013-10-29 주식회사 팬택 Apparatus and method that manage processing of motion realization in portable terminal
US9274622B2 (en) * 2012-09-11 2016-03-01 Microsoft Technology Licensing, Llc Device specific data in a unified pointer message
CN102999340B (en) * 2012-11-28 2016-08-31 百度在线网络技术（北京）有限公司 The edit methods of a kind of interface of input method and device
DE102014200782A1 (en) * 2014-01-17 2015-07-23 Bayerische Motoren Werke Aktiengesellschaft Operating a vehicle according to the desire of a vehicle occupant
EP3149558A4 (en) * 2014-05-29 2017-12-20 Hewlett-Packard Development Company, L.P. User account switching interface
US10078382B2 (en) * 2014-09-04 2018-09-18 Home Box Office, Inc. Unified input and invoke handling
US10044591B2 (en) 2014-09-04 2018-08-07 Home Box Office, Inc. Two-way remote communication system for testing a client device program
JP6138737B2 (en) * 2014-10-02 2017-05-31 株式会社アスタリスク Mobile terminal and keyboard application program
US10168895B2 (en) * 2015-08-04 2019-01-01 International Business Machines Corporation Input control on a touch-sensitive surface
US10636074B1 (en) * 2015-09-18 2020-04-28 Amazon Technologies, Inc. Determining and executing application functionality based on text analysis
US20200050540A1 (en) * 2018-08-10 2020-02-13 International Business Machines Corporation Interactive automation test
TWI709071B (en) * 2018-12-27 2020-11-01 英屬開曼群島商敦泰電子有限公司 Touch pad driving system and method
CN113094188A (en) * 2021-03-30 2021-07-09 网易（杭州）网络有限公司 System message processing method and device

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4451895A (en) * 1980-07-17 1984-05-29 Telesis Corporation Of Delaware, Inc. Interactive computer aided design system
JPS5968037A (en) * 1982-09-21 1984-04-17 Canon Inc Input device
DE3243679A1 (en) * 1982-11-25 1984-05-30 Preh Elektro Feinmechanik TERMINAL OF A DATA PROCESSING SYSTEM
US4726065A (en) * 1984-01-26 1988-02-16 Horst Froessl Image manipulation by speech signals
US4587630A (en) * 1984-02-15 1986-05-06 Hewlett-Packard Company Intelligent programmable touchscreen system
US4689761A (en) * 1984-08-14 1987-08-25 Metaphor Computer Systems Multiple independent input peripherals
US4972496A (en) * 1986-07-25 1990-11-20 Grid Systems Corporation Handwritten keyboardless entry computer system
JPS63172325A (en) * 1987-01-10 1988-07-16 Pioneer Electronic Corp Touch panel controller
US4903012A (en) * 1987-01-20 1990-02-20 Alps Electric Co., Ltd. Coordinate system input device providing registration calibration and a mouse function
JPS63298426A (en) * 1987-05-29 1988-12-06 Hitachi Ltd Menu selecting and processing system
US4896290A (en) * 1987-08-24 1990-01-23 Wang Laboratories, Inc. Method for routing events from key strokes in a multi-processing computer systems
US4908612A (en) * 1987-09-29 1990-03-13 Penguin Products, Inc. Computer input-output device
US4931950A (en) * 1988-07-25 1990-06-05 Electric Power Research Institute Multimedia interface and method for computer system

Also Published As

Publication number Publication date
DE69026417T2 (en) 1996-11-14
US5157384A (en) 1992-10-20
EP0394614B1 (en) 1996-04-10
CA2007411C (en) 1998-04-21
EP0394614A3 (en) 1992-09-02
DE69026417D1 (en) 1996-05-15
EP0394614A2 (en) 1990-10-31
JPH0580009B2 (en) 1993-11-05
JPH0320812A (en) 1991-01-29

Similar Documents

Publication Publication Date Title
CA2007411A1 (en) Advanced user interface
TW339428B (en) Method and apparatus for simplifying active window selection, application activation, and shared command execution in a multiapplication environment
ATE175285T1 (en) CHIP INTERFACE ARRANGEMENT
TW357303B (en) Method for accessing information on a host computer from a client computer
GB2282244B (en) Integrated circuit
EP2081094A3 (en) Motion control systems
ES8707808A1 (en) Data transfer control.
KR870700198A (en) Distributed Control Switching System and Call Processing Method in the System
GB2325320A (en) Fast access to a shared resource on a computer bus
EP0368655A3 (en) Communication system using a common memory
EP0242879A3 (en) Data processor with wait control allowing high speed access
EP0357075A3 (en) Data control device and system using the same
EP0066983A3 (en) Method of and apparatus for controlling the display of video signal information
JPS559213A (en) Communication control unit
WO1998043172A3 (en) Access control system
EP0216170A3 (en) Storage management method and system in a multiprocessor environment
TW225593B (en) Integrated control system for distributed processing
JPS56159759A (en) Selecting method for input and output equipment of multiple computer system
JPS6436243A (en) Time unifying system in local area network
JPS6488878A (en) System simulation device
JPS63314045A (en) Communication controller
EP0195091A3 (en) Method of controlling automatic drawing machine
GB9706490D0 (en) A controller system for managing a distributed network
JPS56120244A (en) Network synchronism damp system
TW340929B (en) The peripheral controlling system

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed