WO2006055674A2 - A customizable touch input module for an electronic device - Google Patents
A customizable touch input module for an electronic device Download PDFInfo
- Publication number
- WO2006055674A2 WO2006055674A2 PCT/US2005/041612 US2005041612W WO2006055674A2 WO 2006055674 A2 WO2006055674 A2 WO 2006055674A2 US 2005041612 W US2005041612 W US 2005041612W WO 2006055674 A2 WO2006055674 A2 WO 2006055674A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- sensor
- interface
- user interface
- finger sensor
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03547—Touch pads, in which fingers can move on a surface
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
- H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
- H04M1/27467—Methods of retrieving data
- H04M1/2747—Scrolling on a display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/033—Indexing scheme relating to G06F3/033
- G06F2203/0338—Fingerprint track pad, i.e. fingerprint sensor used as pointing device tracking the fingertip image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/033—Indexing scheme relating to G06F3/033
- G06F2203/0339—Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/26—Devices for calling a subscriber
- H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
- H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
- H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
- H04M1/27453—Directories allowing storage of additional subscriber data, e.g. metadata
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/22—Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector
Definitions
- the present invention relates to electronic input devices. More particularly, the present invention relates to systems for and methods of customizing fingerprint sensors and mechanical controls to provide inputs to electronic devices.
- Finger sensors are now used on an ever increasing number of electronic devices. On some electronic devices, for example, finger sensors have replaced mechanical controls, such as buttons and knobs.
- the use of finger sensors to replace mechanical controls has several drawbacks. For example, finger sensors do not have the tactile feel that users of electronic devices, such as electronic games, enjoy. These users enjoy the feel of pushing a button, turning a steering wheel, or twisting a dial.
- many applications require some actions that are better enabled with a finger sensor while others are better served by mechanical controls such as dials, slide switches, and the like.
- One alternative to using exclusively finger sensors or exclusively mechanical controls is to combine the two.
- Systems that combine finger sensors and mechanical controls use the two independently.
- the finger sensor is used to perform one function and the mechanical control is used to perform a second, independent function.
- the number of functions, along with the lack of interaction, provided by such independent controls is inadequate for many applications.
- a first input module that combines a finger sensor and a push button to operate a mobile telephone must have two interfaces that independently translate the outputs from the finger sensor and the push button into data usable by applications executing on the mobile telephone.
- a second input module that combines a finger sensor and a switch to operate a digital camera must have separate interfaces that independently translate the outputs from the finger sensor and the switch into data usable by applications executing on the digital camera.
- the present invention is directed to systems for and methods of customizing device interfaces.
- the device interfaces couple interface modules, which comprise a user interface having a finger sensor and mechanical components, to an underlying electronic device.
- any number of user interfaces are able to be selected, based on their look and function, and are coupled to an electronic device.
- a user thus has more options in selecting how to use an electronic device.
- this customization allows a manufacturer to increase the number of functions that the electronic device, controlled using the user interface, can perform.
- the user interface is able to be customized so that applications executing on the electronic device are able to recognize and differentiate between more combinations of inputs from the user interface.
- a system for providing an input to an electronic device comprises a user interface for receiving user input, coupled to a device interface.
- the user interface comprises a finger sensor and a mechanical input component.
- the device interface is configured to selectively map an output of the user interface to an input for the electronic device.
- the mechanical input component includes any one or more of a push button, a scroll wheel, a joy stick, a touch pad, a switch, a dial, and a pressure sensor.
- the input for the electronic device corresponds to a cooperative mapping of the output of the finger sensor and the output of the mechanical input component.
- the input for the electronic device corresponds to a function supported by an application program executing on the electronic device.
- the function includes any one of scrolling through a list of telephone numbers, selecting a telephone number, and automatically dialing a selected telephone number.
- the electronic device is a game device, and the function includes any one of generating a computer game display and controlling the game display.
- the electronic device is a digital camera, and the function includes any one of focusing the digital camera and capturing a picture on the digital camera.
- the user interface and the device interface are configured to form an integrated module with the electronic device.
- the device interface comprises a memory containing a sequence of executable program instructions for mapping the output of the user interface to the input for the electronic device.
- the device interface comprises an application specific integrated circuit configured to map the output of the user interface to the input for the electronic device.
- system further comprises an authentication unit coupled to the finger sensor.
- the authentication unit authenticates a user using finger image data read by the finger sensor.
- the input for the electronic device depends on a context of the application program.
- the finger sensor is a swipe sensor, such as an optical sensor, a thermal sensor, or a capacitive sensor.
- the finger sensor is a placement sensor.
- the user interface further comprises any one or more of an LED, an LCD panel, a back light, and a speaker.
- the system further comprises an electronic device coupled to the device interface.
- the electronic device is any device controllable by the user interface, such as a mobile telephone, a portable computer, a digital camera, a portable game system, a game controller, a personal digital assistant, a digital audio player, and a digital video player.
- a system comprises an electronic device, a finger sensor for receiving a first input to control the electronic device, and a mechanical input portion for receiving a second input to control the electronic device.
- the finger sensor and the mechanical input portion are configured to operate cooperatively with each other to control the electronic device.
- a method of configuring an electronic system comprises selecting a user interface comprising a finger sensor and a mechanical component; selecting an electronic device; and configuring a device interface between the output for controlling an application executing on the electronic device.
- Figure l is a schematic perspective view of a mobile telephone having a customizable interface module for scrolling through a list of telephone numbers and automatically dialing a selected telephone number in accordance with the present invention.
- Figure 2 shows the relationship between a user interface, a customizable device interface, and an application program executing on the mobile telephone of Figure 1 in accordance with the present invention.
- Figure 3 shows a table illustrating the mapping between the components of the interface module of Figure 1 and the corresponding function within the application program that each performs.
- Figure 4 shows a display screen and a customizable interface module of a mobile telephone that executes a computer game emulating a racing car in accordance with the present invention.
- Figure 5 shows a table illustrating the mapping between the components of the interface module of Figure 4 and the corresponding function within the computer game that each performs.
- Figure 6 shows a display screen and a customizable interface module of a digital camera in accordance with the present invention.
- Figure 7 shows a table illustrating the mapping between the components of the interface module of Figure 6 and the corresponding function that each performs on the digital camera.
- Figure 8 shows an architecture comprising a customizable device interface in accordance with one embodiment of the present invention.
- Figure 9 is a flow chart depicting the steps to configure a customizable device interface in accordance with the present invention.
- FIGS 10-14 show face plates having various interface modules, configurations, and shapes and used with customizable device interfaces in accordance with the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
- an electronic housing containing a user interface is able to be integrated with any number of electronic devices, such as a mobile telephone, a digital camera, a game device, and a game controller.
- the user interface contains input components, including a finger sensor and one or more mechanical input components, such as a push button, a scroll wheel, a joy stick, a touch pad, a dial, and a pressure sensor.
- the user interface is configured to provide to a host system electronic signals, data, and control information corresponding to electronic signals, data, and control information generated by a user input device.
- the user interface also contains output components such as speakers, light emitting diode (LED) displays, and liquid crystal displays (LCDs).
- a user is able to select a housing to suit his particular needs, select an electronic device, and then have an interface between the housing and the electronic device customized so that the user interface provides the functions needed or supported by the electronic device and the applications running on it.
- a user is thus able to select housings based on their look and feel, the types and number of input components they have, or any other criteria.
- Embodiments of the present invention are able to be used with many application programs including, but not limited to, a telephone application program, a game application program, and a digital camera application program, all of which support various functions.
- the telephone application program supports the functions of displaying a list of telephone numbers, scrolling through the list, selecting a telephone number in the list, and automatically dialing the selected telephone number.
- a user is able to choose a product with a desirable housing having a finger sensor and a push button as part of the user interface.
- the user selects a mobile telephone as the electronic device because he wishes to use the electronic device to store phone lists and then dial phone numbers selected from the phone list.
- a first device interface between the user interface and the mobile phone is then customized so that the finger sensor is used to scroll through the phone list and the push button is used to automatically dial a selected telephone number.
- the user selects a second product with a housing having the same user interface, but selects a digital camera as the electronic device, having different requirements of the user interface.
- the finger sensor is now used to focus the lens of the digital camera.
- customizing the device interface in accordance with the present invention comprises mapping each component of a user interface (e.g., an output of a finger sensor, of a push button, of a scroll wheel, etc.) to a particular function used by the electronic device or an application executing on the electronic device.
- this mapping is performed by software but alternatively is performed by hardware components such as an application specific integrated circuit (ASIC).
- ASIC application specific integrated circuit
- the present invention allows device interfaces to be customized when the electronic device is assembled, allowing the electronic devices to be paired with any number of suitable housings having any number of device interfaces. This flexibility reduces production time and costs and eliminates the need for a universal device interface that may not be optimal to fit a particular application. This mapping also allows greater flexibility in what functions the user interface can support. For example, a finger sensor and a mechanical input component are able to be mapped to more functions.
- swiping a finger sensor on the user interface maps to one function (e.g., authenticate the identity of a user, verifying that he has the right to use a mobile telephone), swiping the finger sensor while pressing a push button maps to another function (e.g., scroll through a phone list displayed on the mobile telephone), and pressing the push button alone maps to another function (e.g., dial a selected telephone number).
- one function e.g., authenticate the identity of a user, verifying that he has the right to use a mobile telephone
- a push button maps to another function
- another function e.g., scroll through a phone list displayed on the mobile telephone
- pressing the push button alone e.g., dial a selected telephone number
- Figure 1 shows a mobile telephone 100 having a customizable device interface in accordance with the present invention.
- the customizable device interface has been customized to allow the mobile telephone 100 to control a telephone application program executing on the mobile telephone 100.
- the exemplary interface allows a user. to scroll through a phone list, select a telephone number, and automatically dial the selected telephone number, hi other embodiments, the customizable device interface is customized to perform other tasks, such as to control a computer game executing on the mobile telephone 100.
- the mobile telephone 100 has a lid 105 coupled to a hand set 113.
- the lid 105 contains a display screen 101 displaying a list of names and corresponding home and telephone numbers generated by the telephone application program.
- the hand set 113 comprises a user interface module 110 and a bottom section 115, which contains a number pad 116.
- the user interface module 110 comprises a user interface 106 and a customized device interface (not shown).
- the device interface couples the user interface 106 to the telephone application program. As described in more detail below, the device interface is customized in accordance with the present invention.
- the user interface 106 comprises user interface components including a finger sensor 102, a left arrow button 103, and a right arrow button 104. Each user interface component is mapped to a function executed by the telephone application program.
- Figure 2 shows the relationship between the user interface 106, the telephone application program 119, and a customizable device interface 117 operationally coupling the user interface 106 to the telephone application program.
- the customizable device interface 117 receives signals, data, control and status information, or any combination of these (collectively, component output data) from the user interface 106 and translates the component output data into application input data recognized by the telephone application program 119, thereby allowing a user to use the finger sensor 102 to scroll through the list of names shown on the display screen 101 and to select a name from the list of names by, for example, swiping or tapping his finger on the finger sensor 102.
- the customizable device interface 117 then receives component output data from the left arrow button 103 or the right arrow button 104 that is translated into application input data that perform the function of automatically dialing a telephone number corresponding to the selected name. For example, the user presses the left arrow button 103 to have the mobile telephone 100 automatically dial the home phone number corresponding to the selected name. Alternatively, the user presses the right arrow button 104 to have the mobile telephone 100 automatically dial the office number corresponding to the selected name.
- Table 1 in Figure 3 shows the relationship between the components of the user interface 106 in Figure 1 and the function that each is configured to perform.
- Table 1 contains rows 251, 252, and 253.
- Row 251 shows that the finger sensor 102 is used to generate component output data that the telephone application program interprets as application input data corresponding to movement by a scroll wheel.
- the finger sensor 102 is thus said to emulate (e.g., is mapped to) a scroll wheel.
- the list of user names is scrolled up or down, depending on the direction of the swipe.
- Device emulation using a finger sensor is described in more detail in U.S. Patent Application Serial No.
- row 252 shows that the left-arrow button 103 is mapped to the function of selecting the left-most telephone number (home telephone number) corresponding to the highlighted name.
- the right- arrow button 104 is mapped to the function of selecting the right-most telephone number (office telephone number) corresponding to the highlighted name.
- mappings e.g., translations
- ASIC application specific integrated circuit
- an original equipment manufacturer is able to use the same user interface 106, package it in a different housing, and use it in another product, such as an electronic game.
- the OEM merely customizes a device interface in accordance with the present invention to package a selected housing containing a user interface with any number of electronic devices.
- Figure 4 illustrates one example of how the user interface 106 is used in a different product, requiring that the input components be mapped to different functions.
- Figure 4 shows a portion of a mobile phone 120' having a device interface that has been customized differently from the device interface described in Figure 1.
- a user interface module 110' comprises the user interface 106 and a customizable device interface (not shown).
- the customizable device interface of Figure 4 has been customized to map the components of the user interface 106 to the functions used to simulate a racing car game.
- the device interface of Figure 4 has been customized so that the component output data generated by the finger sensor 102 is now used to emulate a steering wheel and gas pedal of a racing car for a racing car game executing on the mobile phone 120'.
- a user traces his finger along a surface of the finger sensor 102 to simulate the turning of a steering wheel for the racing car traveling along a driving course displayed on a display screen 122, which is mounted on the lid 105.
- the user is also able to change the pressure of his finger on the finger sensor 102 to emulate the pressure on an accelerator of the racing car.
- the user is able to press the left- arrow button 103 to emulate up-shifting and the right- arrow button 104 to emulate down-shifting of the gears of the racing car.
- Figure 5 shows Table 2, which illustrates the mapping performed by the customized device interface on the mobile telephone 120.
- Table 2 contains rows 221, 222, and 223, with each component shown in the left column of each row being mapped to a function in the corresponding right column.
- row 221 illustrates that the finger sensor 102 of the mobile telephone 120 is mapped to the function of emulating a steering wheel and gas pedal
- row 222 illustrates that the left-arrow button 103 is mapped to the function of shifting the gears of the racing car up
- row 223 illustrates that the right-arrow button 104 is mapped to the function of shifting the gears of the racing car down.
- Figures 1 and 4 show a single user interface 106 used on the same electronic device (a mobile telephone), it will be appreciated that a single user interface is able to be mounted on any number of electronic devices and customized in accordance with the present invention to perform functions for operating the electronic device or an application executing on it. Moreover, as described below, user interfaces having any combination of user interface components are able to be customized in accordance with the present invention.
- Figure 6 shows a digital camera 250 comprising a top portion 255 and an interface module 257.
- the top portion 255 contains a display screen 251 and the user interface module 257 contains a user interface 258.
- the user interface 258 contains as user interface components the finger sensor 102, the left-arrow button 103, the right-arrow button 104, and a push button 256.
- identical elements are used in Figures 1, 4, and 6 to highlight that similar or identical interface components are able to be customized to perform different functions depending, for example, on the device that the interface module is ultimately used.
- Figure 7, containing Table 3, contains rows 261-266 showing how interface components in Figure 6 map to camera-related functions. Multiple elements can be activated simultaneously (e.g., pressing the left-arrow button 103 and the push button 256 simultaneously) to perform specific functions.
- row 261 indicates that pressing the finger sensor 102 will control the focus of the digital camera 250 by, for example, translating (mapping) component output data into application input data used by a camera application program executing on the digital camera 250.
- Row 262 indicates that pressing the left-arrow button 103 zooms the focus on the digital camera 250 in.
- Row 263 indicates that pressing the right-arrow button 104 zooms the focus on the digital camera 250 out.
- Row 264 indicates that pressing the push button 256 snaps a picture on the digital camera 250.
- Row 265 indicates that pressing a finger on the finger sensor 102 while pressing the left-arrow button 103 adjusts the lighting for the digital camera 250. By pressing the finger sensor 102 and the left-arrow button 103 simultaneously to perform a function, the two are said to function cooperatively. And row 266 indicates that pressing a finger on the finger sensor 102 while pressing the right-arrow button 104 adjusts the speed for the digital camera 250.
- the mobile telephone 100 of Figure 1 is configured to operate as a mobile telephone, as a digital camera, or both.
- the mobile phone is able to be used with a customized device interface so that it supports the functions of a mobile telephone, a digital camera, another electronic device, or any combination of these.
- the present invention is also able to map activating (e.g., pressing or swiping) a finger sensor, a mechanical button, or both, to a function depending on the context. For example, when an electronic device is first powered on, a finger sensor is able to be mapped to the function of authenticating the user to determine whether he is to be allowed access to the electronic device. Later, when the electronic device is executing a game program, the finger sensor can be mapped to emulate a steering wheel.
- activating e.g., pressing or swiping
- FIG. 2 shows a general overview of the architecture for one embodiment of the present invention
- Figure 8 gives a more detailed view of a customized architecture 300 for practicing the invention using the Symbian OSTM for mobile telephones.
- the customized architecture 300 allows an application program (such as a telephone application program) to communicate with peripheral hardware devices 317, such as a finger sensor or mechanical components of a user interface such as the user interface 106 of Figure 1.
- the customized architecture 300 comprises peripheral hardware 317 comprising any one or more of a finger sensor, a left-arrow button, a right-arrow button, a push button, a joy stick, a jog dial, a scroll wheel, a pressure sensitive button, a touch screen, etc.
- the peripheral hardware 317 is coupled to a kernel extension 311, a kernel 309, and a device driver 315.
- the kernel 309 provides the basic operating system functions, including providing access to necessary peripherals such as timers.
- the kernel extension 311 extends the functioning of the kernel 309 by allowing the operating system to access the peripheral hardware 317.
- the kernel 309 in turn is coupled to the device driver 315 and to a user library 307 that allows application programs (including threads 301 and 303) to access the functions of the kernel 307.
- the user library is coupled to the application thread 301 and to a customized device API 305 that is also coupled to the application thread 303.
- the customized device API 305 corresponds to a customized device interface in accordance with the present invention.
- the customized device API 305 translates a function normally associated with a user interface component into a function required by an application program.
- the system function associated with the finger sensor is mapped to a function associated with the steering wheel.
- the architecture 300 passes messages to signify the occurrence of a steering wheel movement
- the finger sensor's component output data is mapped to a message that the application thread 303 recognizes as generated by a steering wheel.
- the architecture can use event generation or other methods to recognize the occurrence of a steering wheel movement.
- a finger sensor is used to emulate a steering wheel to be used on game device.
- a user swipes his finger on a finger sensor that forms part of the peripheral hardware 317, which the device driver 315 uses to generate component output data.
- the kernel 309 in conjunction with the user library 307 translates this component output data to application input data (e.g., a system function) recognizable as that generated by a finger sensor.
- the customized device API 305 translates this application input data into that recognizable as generated by a steering wheel.
- This application input data is then transmitted to the application thread 303, such as a car racing application program, which uses the input data to emulate turning the steering wheel.
- the customized device API 305 is able to be loaded when a device containing the customized architecture 300 is configured, such as at an OEM.
- a single component such as the user interface 106, is able to be installed on many different products, and the mapping of its input components determined when the functioning of (e.g., the application programs executing on) the electronic device is determined.
- the input module 106 Figure 1
- a customized device API can be loaded when the mobile phone is assembled so that the functioning of the input module 106 corresponds to that shown in Table 1 of Figure 3.
- a customized device API can be loaded when the game device is assembled so that the functioning of the input module 106 corresponds to that shown in Table 2 of Figure 5.
- the customized device API 305 is able to be configured according to the present invention to allow a single input module to be used in a variety of products using a variety of packages.
- Figure 9 is a flow chart 350 showing the steps used to customize a device interface in accordance with one embodiment of the present invention.
- a face plate having a user interface is selected based, for example, on its look and feel.
- the functions that the underlying electronic device is used to perform is selected, hi this step, for example, the application of the underlying device can be the emulation of a racing car, telephone and address book functions such as scrolling through a phone list and dialing telephone numbers, etc.
- the mapping of the user interface components to the function of each component is determined, such as shown in Tables 1-3.
- a customized device API (e.g., element 305 in Figure 10) is configured to reflect the mapping determined in the step 355.
- the customized API is loaded onto the electronic device, such as a mobile telephone, a game device, a digital camera, etc.
- the device driver 315 is used to map component output data into data that is ultimately recognized by the application thread 303 as application input data for a function supported by the application thread 303.
- the device driver is implemented as an ASIC.
- Figures 10-14 show several housings each having a corresponding user interface coupled to a device interface customized in accordance with the present invention. Each device interface is able to be customized for use on any number of electronic devices in accordance with the present invention.
- Figure 10 shows a housing 411 having a face containing user interface components that include four push buttons 401-404 and a button 411 that also supports a finger sensor 405.
- the user interface components are able to be configured to perform a variety of functions.
- the finger sensor 405 is used to authenticate a user (such as by using an authentication module well known in the art), scroll through a phone list, or emulate a steering wheel.
- a user is able to swipe or place a finger on the finger sensor 405, push the button 411, or do both simultaneously, all to perform a corresponding function.
- Figure 11 shows a housing 420 having a face containing user interface components that include a finger sensor 421 and push buttons 423, 425, 427, and 429.
- Figure 12 shows a housing 430 having a face containing user interface components that include a finger sensor 431, a speaker 435, and push buttons 437-439.
- Figure 13 shows a housing 450 having a face containing user interface components that include a first finger sensor 451, a second finger sensor 452, an LED bank 454, and push buttons 456, 458, 460, and 461.
- Figure 14 shows a housing 500 having a face containing user interface components that include a finger sensor 501, push buttons 502-505, a scroll wheel 525, a jog dial 515, a joy stick 520, and a push button 530.
- housings used in accordance with the present invention can have any combination of size and shape selected for their look and feel or using other criteria.
- output displays such as the speaker 435 ( Figure 12) and LED bank 454 ( Figure 13) are coupled to user input components such as finger sensors and push buttons to indicate, for example, that a button has been pushed
- the speakers are coupled to audio outputs such as when the underlying electronic device is a game system.
- the speakers are able to emulate sounds generated by the game, such as bombs exploding, etc.
- the LED bank 454 can be used to simulate explosions and other features of the game.
- the output displays are also mapped to user interface components, to outputs generated by an application executing on an electronic device, or any combination of these.
- a system and method in accordance with the present invention thus allow OEMs to use off-the-shelf application programs and device drivers, merely requiring that they customize the device interface. Such minimum modifications save time and money and allow electronic devices to use any number of ready-made application programs and device drivers on the market.
- Systems and methods in accordance with the present invention also offer more combinations of interface components to be mapped to functions executable on the electronic device.
- the number of functions supported by, and thus the capabilities of, the electronic device is extended.
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP05849717A EP1812927A2 (en) | 2004-11-17 | 2005-11-15 | A customizable touch input module for an electronic device |
JP2007543214A JP2008521136A (en) | 2004-11-17 | 2005-11-15 | Input system and electronic system configuration method |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US62916904P | 2004-11-17 | 2004-11-17 | |
US60/629,169 | 2004-11-17 | ||
US11/058,514 | 2005-02-14 | ||
US11/058,514 US20060103633A1 (en) | 2004-11-17 | 2005-02-14 | Customizable touch input module for an electronic device |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2006055674A2 true WO2006055674A2 (en) | 2006-05-26 |
WO2006055674A3 WO2006055674A3 (en) | 2006-11-16 |
Family
ID=36385774
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2005/041612 WO2006055674A2 (en) | 2004-11-17 | 2005-11-15 | A customizable touch input module for an electronic device |
Country Status (4)
Country | Link |
---|---|
US (1) | US20060103633A1 (en) |
EP (1) | EP1812927A2 (en) |
JP (1) | JP2008521136A (en) |
WO (1) | WO2006055674A2 (en) |
Families Citing this family (169)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7190251B2 (en) * | 1999-05-25 | 2007-03-13 | Varatouch Technology Incorporated | Variable resistance devices and methods |
US8645137B2 (en) | 2000-03-16 | 2014-02-04 | Apple Inc. | Fast, language-independent method for user authentication by voice |
US7474772B2 (en) * | 2003-06-25 | 2009-01-06 | Atrua Technologies, Inc. | System and method for a miniature user input device |
US7587072B2 (en) * | 2003-08-22 | 2009-09-08 | Authentec, Inc. | System for and method of generating rotational inputs |
US7697729B2 (en) * | 2004-01-29 | 2010-04-13 | Authentec, Inc. | System for and method of finger initiated actions |
EP1714271A2 (en) * | 2004-02-12 | 2006-10-25 | Atrua Technologies, Inc. | System and method of emulating mouse operations using finger image sensors |
US7831070B1 (en) | 2005-02-18 | 2010-11-09 | Authentec, Inc. | Dynamic finger detection mechanism for a fingerprint sensor |
KR100617821B1 (en) * | 2005-02-24 | 2006-08-28 | 삼성전자주식회사 | User interfacing apparatus and method |
US8231056B2 (en) * | 2005-04-08 | 2012-07-31 | Authentec, Inc. | System for and method of protecting an integrated circuit from over currents |
US7505613B2 (en) * | 2005-07-12 | 2009-03-17 | Atrua Technologies, Inc. | System for and method of securing fingerprint biometric systems against fake-finger spoofing |
US7571015B2 (en) * | 2005-07-14 | 2009-08-04 | Perception Digital Limited | Personal audio player |
US8677377B2 (en) | 2005-09-08 | 2014-03-18 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US7940249B2 (en) * | 2005-11-01 | 2011-05-10 | Authentec, Inc. | Devices using a metal layer with an array of vias to reduce degradation |
US7684953B2 (en) * | 2006-02-10 | 2010-03-23 | Authentec, Inc. | Systems using variable resistance zones and stops for generating inputs to an electronic device |
US20070290992A1 (en) * | 2006-06-16 | 2007-12-20 | Creative Technology Ltd | Control interface for media player |
US7885436B2 (en) * | 2006-07-13 | 2011-02-08 | Authentec, Inc. | System for and method of assigning confidence values to fingerprint minutiae points |
US9235274B1 (en) | 2006-07-25 | 2016-01-12 | Apple Inc. | Low-profile or ultra-thin navigation pointing or haptic feedback device |
US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
KR101147773B1 (en) * | 2006-11-28 | 2012-05-25 | 엘지전자 주식회사 | Mobile communication device and mothod for controlling the same |
US8542211B2 (en) * | 2007-01-03 | 2013-09-24 | Apple Inc. | Projection scan multi-touch sensor array |
US8970503B2 (en) * | 2007-01-05 | 2015-03-03 | Apple Inc. | Gestures for devices having one or more touch sensitive surfaces |
US8144129B2 (en) * | 2007-01-05 | 2012-03-27 | Apple Inc. | Flexible touch sensing circuits |
US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US8390649B2 (en) * | 2007-04-30 | 2013-03-05 | Hewlett-Packard Development Company, L.P. | Electronic device input control system and method |
JP4260215B1 (en) | 2007-08-29 | 2009-04-30 | 任天堂株式会社 | Imaging device |
US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
US9785330B1 (en) | 2008-02-13 | 2017-10-10 | Apple Inc. | Systems for and methods of providing inertial scrolling and navigation using a fingerprint sensor calculating swiping speed and length |
US8996376B2 (en) | 2008-04-05 | 2015-03-31 | Apple Inc. | Intelligent text-to-speech conversion |
TWI360775B (en) * | 2008-04-22 | 2012-03-21 | Htc Corp | Method and apparatus for operating user interface |
US10496753B2 (en) | 2010-01-18 | 2019-12-03 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
CN101581988A (en) * | 2008-05-16 | 2009-11-18 | 鸿富锦精密工业(深圳)有限公司 | Mouse and computer system |
JP4181211B1 (en) * | 2008-06-13 | 2008-11-12 | 任天堂株式会社 | Information processing apparatus and startup program executed therein |
US8130275B2 (en) * | 2008-06-13 | 2012-03-06 | Nintendo Co., Ltd. | Information-processing apparatus, and storage medium storing a photographing application launch program executed by information-processing apparatus |
US20100030549A1 (en) | 2008-07-31 | 2010-02-04 | Lee Michael M | Mobile device having human language translation capability with positional feedback |
JP4600548B2 (en) * | 2008-08-27 | 2010-12-15 | ソニー株式会社 | REPRODUCTION DEVICE, REPRODUCTION METHOD, AND PROGRAM |
US8848100B2 (en) | 2008-10-01 | 2014-09-30 | Nintendo Co., Ltd. | Information processing device, information processing system, and launch program and storage medium storing the same providing photographing functionality |
KR20100111351A (en) * | 2009-04-07 | 2010-10-15 | 삼성전자주식회사 | Input device for portable device and method thereof |
US9858925B2 (en) | 2009-06-05 | 2018-01-02 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US10241752B2 (en) | 2011-09-30 | 2019-03-26 | Apple Inc. | Interface for a virtual digital assistant |
US10241644B2 (en) | 2011-06-03 | 2019-03-26 | Apple Inc. | Actionable reminder entries |
US20120311585A1 (en) | 2011-06-03 | 2012-12-06 | Apple Inc. | Organizing task items that represent tasks to perform |
US9431006B2 (en) | 2009-07-02 | 2016-08-30 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
WO2011008861A2 (en) * | 2009-07-14 | 2011-01-20 | Eatoni Ergonomics, Inc | Keyboard comprising swipe-switches performing keyboard actions |
US8432367B2 (en) * | 2009-11-19 | 2013-04-30 | Google Inc. | Translating user interaction with a touch screen into input commands |
US20110167350A1 (en) * | 2010-01-06 | 2011-07-07 | Apple Inc. | Assist Features For Content Display Device |
US8866347B2 (en) | 2010-01-15 | 2014-10-21 | Idex Asa | Biometric image sensing |
US8791792B2 (en) | 2010-01-15 | 2014-07-29 | Idex Asa | Electronic imager using an impedance sensor grid array mounted on or about a switch and method of making |
US8421890B2 (en) | 2010-01-15 | 2013-04-16 | Picofield Technologies, Inc. | Electronic imager using an impedance sensor grid array and method of making |
US10705794B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
US10553209B2 (en) | 2010-01-18 | 2020-02-04 | Apple Inc. | Systems and methods for hands-free notification summaries |
US10679605B2 (en) | 2010-01-18 | 2020-06-09 | Apple Inc. | Hands-free list-reading by intelligent automated assistant |
US8682667B2 (en) | 2010-02-25 | 2014-03-25 | Apple Inc. | User profiling for selecting user specific voice input processing information |
US20120092279A1 (en) | 2010-10-18 | 2012-04-19 | Qualcomm Mems Technologies, Inc. | Touch sensor with force-actuated switched capacitor |
US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
US8994660B2 (en) | 2011-08-29 | 2015-03-31 | Apple Inc. | Text correction processing |
US9553959B2 (en) | 2011-12-29 | 2017-01-24 | Elwha Llc | Customized hardware selection for a mobile phone |
US8391934B1 (en) * | 2011-12-29 | 2013-03-05 | Elwha Llc | Customized hardware selection for a mobile phone |
US9354748B2 (en) | 2012-02-13 | 2016-05-31 | Microsoft Technology Licensing, Llc | Optical stylus interaction |
US9360893B2 (en) | 2012-03-02 | 2016-06-07 | Microsoft Technology Licensing, Llc | Input device writing surface |
US9134807B2 (en) | 2012-03-02 | 2015-09-15 | Microsoft Technology Licensing, Llc | Pressure sensitive key normalization |
USRE48963E1 (en) | 2012-03-02 | 2022-03-08 | Microsoft Technology Licensing, Llc | Connection device for computing devices |
US9075566B2 (en) | 2012-03-02 | 2015-07-07 | Microsoft Technoogy Licensing, LLC | Flexible hinge spine |
US8873227B2 (en) | 2012-03-02 | 2014-10-28 | Microsoft Corporation | Flexible hinge support layer |
US9426905B2 (en) | 2012-03-02 | 2016-08-23 | Microsoft Technology Licensing, Llc | Connection device for computing devices |
US8935774B2 (en) | 2012-03-02 | 2015-01-13 | Microsoft Corporation | Accessory device authentication |
US9064654B2 (en) | 2012-03-02 | 2015-06-23 | Microsoft Technology Licensing, Llc | Method of manufacturing an input device |
US9870066B2 (en) | 2012-03-02 | 2018-01-16 | Microsoft Technology Licensing, Llc | Method of manufacturing an input device |
US9483461B2 (en) | 2012-03-06 | 2016-11-01 | Apple Inc. | Handling speech synthesis of content for multiple languages |
US20130279769A1 (en) | 2012-04-10 | 2013-10-24 | Picofield Technologies Inc. | Biometric Sensing |
US9024910B2 (en) | 2012-04-23 | 2015-05-05 | Qualcomm Mems Technologies, Inc. | Touchscreen with bridged force-sensitive resistors |
US9280610B2 (en) | 2012-05-14 | 2016-03-08 | Apple Inc. | Crowd sourcing information to fulfill user requests |
US20130300590A1 (en) | 2012-05-14 | 2013-11-14 | Paul Henry Dietz | Audio Feedback |
US9721563B2 (en) | 2012-06-08 | 2017-08-01 | Apple Inc. | Name recognition system |
US9063693B2 (en) | 2012-06-13 | 2015-06-23 | Microsoft Technology Licensing, Llc | Peripheral device storage |
US9684382B2 (en) | 2012-06-13 | 2017-06-20 | Microsoft Technology Licensing, Llc | Input device configuration having capacitive and pressure sensors |
US9459160B2 (en) | 2012-06-13 | 2016-10-04 | Microsoft Technology Licensing, Llc | Input device sensor configuration |
US9073123B2 (en) | 2012-06-13 | 2015-07-07 | Microsoft Technology Licensing, Llc | Housing vents |
US20130346636A1 (en) * | 2012-06-13 | 2013-12-26 | Microsoft Corporation | Interchangeable Surface Input Device Mapping |
US9495129B2 (en) | 2012-06-29 | 2016-11-15 | Apple Inc. | Device, method, and user interface for voice-activated navigation and browsing of a document |
US8964379B2 (en) | 2012-08-20 | 2015-02-24 | Microsoft Corporation | Switchable magnetic lock |
US8907914B2 (en) * | 2012-08-31 | 2014-12-09 | General Electric Company | Methods and apparatus for documenting a procedure |
US9547647B2 (en) | 2012-09-19 | 2017-01-17 | Apple Inc. | Voice-based media searching |
SG2012072161A (en) * | 2012-09-27 | 2014-04-28 | Creative Tech Ltd | An electronic device |
US9176538B2 (en) | 2013-02-05 | 2015-11-03 | Microsoft Technology Licensing, Llc | Input device configurations |
US10578499B2 (en) | 2013-02-17 | 2020-03-03 | Microsoft Technology Licensing, Llc | Piezo-actuated virtual buttons for touch surfaces |
WO2014197334A2 (en) | 2013-06-07 | 2014-12-11 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
WO2014197336A1 (en) | 2013-06-07 | 2014-12-11 | Apple Inc. | System and method for detecting errors in interactions with a voice-based digital assistant |
US9582608B2 (en) | 2013-06-07 | 2017-02-28 | Apple Inc. | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
WO2014197335A1 (en) | 2013-06-08 | 2014-12-11 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
CN110442699A (en) | 2013-06-09 | 2019-11-12 | 苹果公司 | Operate method, computer-readable medium, electronic equipment and the system of digital assistants |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
US9483171B1 (en) * | 2013-06-11 | 2016-11-01 | Amazon Technologies, Inc. | Low latency touch input rendering |
US9448631B2 (en) | 2013-12-31 | 2016-09-20 | Microsoft Technology Licensing, Llc | Input device haptics and pressure sensing |
US10120420B2 (en) | 2014-03-21 | 2018-11-06 | Microsoft Technology Licensing, Llc | Lockable display and techniques enabling use of lockable displays |
US9785630B2 (en) | 2014-05-30 | 2017-10-10 | Apple Inc. | Text prediction using combined word N-gram and unigram language models |
US9842101B2 (en) | 2014-05-30 | 2017-12-12 | Apple Inc. | Predictive conversion of language input |
US9760559B2 (en) | 2014-05-30 | 2017-09-12 | Apple Inc. | Predictive text input |
US10078631B2 (en) | 2014-05-30 | 2018-09-18 | Apple Inc. | Entropy-guided text prediction using combined word and character n-gram language models |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
EP3480811A1 (en) | 2014-05-30 | 2019-05-08 | Apple Inc. | Multi-command single utterance input method |
US9430463B2 (en) | 2014-05-30 | 2016-08-30 | Apple Inc. | Exemplar-based natural language processing |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US10659851B2 (en) | 2014-06-30 | 2020-05-19 | Apple Inc. | Real-time digital assistant knowledge updates |
US10324733B2 (en) | 2014-07-30 | 2019-06-18 | Microsoft Technology Licensing, Llc | Shutdown notifications |
US10446141B2 (en) | 2014-08-28 | 2019-10-15 | Apple Inc. | Automatic speech recognition based on user feedback |
US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US10789041B2 (en) | 2014-09-12 | 2020-09-29 | Apple Inc. | Dynamic thresholds for always listening speech trigger |
US9424048B2 (en) | 2014-09-15 | 2016-08-23 | Microsoft Technology Licensing, Llc | Inductive peripheral retention device |
US9668121B2 (en) | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
US9886432B2 (en) | 2014-09-30 | 2018-02-06 | Apple Inc. | Parsimonious handling of word inflection via categorical stem + suffix N-gram language models |
US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
US9646609B2 (en) | 2014-09-30 | 2017-05-09 | Apple Inc. | Caching apparatus for serving phonetic pronunciations |
US10552013B2 (en) | 2014-12-02 | 2020-02-04 | Apple Inc. | Data detection |
US9865280B2 (en) | 2015-03-06 | 2018-01-09 | Apple Inc. | Structured dictation using intelligent automated assistants |
US10567477B2 (en) | 2015-03-08 | 2020-02-18 | Apple Inc. | Virtual assistant continuity |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
US9899019B2 (en) | 2015-03-18 | 2018-02-20 | Apple Inc. | Systems and methods for structured stem and suffix language models |
US9842105B2 (en) | 2015-04-16 | 2017-12-12 | Apple Inc. | Parsimonious continuous-space phrase representations for natural language processing |
US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
US10416799B2 (en) | 2015-06-03 | 2019-09-17 | Microsoft Technology Licensing, Llc | Force sensing and inadvertent input control of an input device |
US10222889B2 (en) | 2015-06-03 | 2019-03-05 | Microsoft Technology Licensing, Llc | Force inputs and cursor control |
US10127220B2 (en) | 2015-06-04 | 2018-11-13 | Apple Inc. | Language identification from short strings |
US10101822B2 (en) | 2015-06-05 | 2018-10-16 | Apple Inc. | Language input correction |
US9578173B2 (en) | 2015-06-05 | 2017-02-21 | Apple Inc. | Virtual assistant aided communication with 3rd party service in a communication session |
US11025565B2 (en) | 2015-06-07 | 2021-06-01 | Apple Inc. | Personalized prediction of responses for instant messaging |
US10255907B2 (en) | 2015-06-07 | 2019-04-09 | Apple Inc. | Automatic accent detection using acoustic models |
US10186254B2 (en) | 2015-06-07 | 2019-01-22 | Apple Inc. | Context-based endpoint detection |
EP3106897A1 (en) * | 2015-06-19 | 2016-12-21 | Centre National d'Etudes Spatiales | Gnss receiver with an on-board capability to implement an optimal error correction mode |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US9697820B2 (en) | 2015-09-24 | 2017-07-04 | Apple Inc. | Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks |
US11010550B2 (en) | 2015-09-29 | 2021-05-18 | Apple Inc. | Unified language modeling framework for word prediction, auto-completion and auto-correction |
US10366158B2 (en) | 2015-09-29 | 2019-07-30 | Apple Inc. | Efficient word encoding for recurrent neural network language models |
US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US10061385B2 (en) | 2016-01-22 | 2018-08-28 | Microsoft Technology Licensing, Llc | Haptic feedback for a touch input device |
US10446143B2 (en) | 2016-03-14 | 2019-10-15 | Apple Inc. | Identification of voice inputs providing credentials |
US9934775B2 (en) | 2016-05-26 | 2018-04-03 | Apple Inc. | Unit-selection text-to-speech synthesis based on predicted concatenation parameters |
US9972304B2 (en) | 2016-06-03 | 2018-05-15 | Apple Inc. | Privacy preserving distributed evaluation framework for embedded personalized systems |
US10249300B2 (en) | 2016-06-06 | 2019-04-02 | Apple Inc. | Intelligent list reading |
US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
DK179309B1 (en) | 2016-06-09 | 2018-04-23 | Apple Inc | Intelligent automated assistant in a home environment |
US10067938B2 (en) | 2016-06-10 | 2018-09-04 | Apple Inc. | Multilingual word prediction |
US10192552B2 (en) | 2016-06-10 | 2019-01-29 | Apple Inc. | Digital assistant providing whispered speech |
US10586535B2 (en) | 2016-06-10 | 2020-03-10 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US10490187B2 (en) | 2016-06-10 | 2019-11-26 | Apple Inc. | Digital assistant providing automated status report |
US10509862B2 (en) | 2016-06-10 | 2019-12-17 | Apple Inc. | Dynamic phrase expansion of language input |
DK179049B1 (en) | 2016-06-11 | 2017-09-18 | Apple Inc | Data driven natural language event detection and classification |
DK179415B1 (en) | 2016-06-11 | 2018-06-14 | Apple Inc | Intelligent device arbitration and control |
DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
DK179343B1 (en) | 2016-06-11 | 2018-05-14 | Apple Inc | Intelligent task discovery |
US10043516B2 (en) | 2016-09-23 | 2018-08-07 | Apple Inc. | Intelligent automated assistant |
US10593346B2 (en) | 2016-12-22 | 2020-03-17 | Apple Inc. | Rank-reduced token representation for automatic speech recognition |
WO2018201067A1 (en) * | 2017-04-27 | 2018-11-01 | Magic Leap, Inc. | Light-emitting user input device |
DK201770439A1 (en) | 2017-05-11 | 2018-12-13 | Apple Inc. | Offline personal assistant |
DK179496B1 (en) | 2017-05-12 | 2019-01-15 | Apple Inc. | USER-SPECIFIC Acoustic Models |
DK179745B1 (en) | 2017-05-12 | 2019-05-01 | Apple Inc. | SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT |
DK201770431A1 (en) | 2017-05-15 | 2018-12-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
DK201770432A1 (en) | 2017-05-15 | 2018-12-21 | Apple Inc. | Hierarchical belief states for digital assistants |
DK179549B1 (en) | 2017-05-16 | 2019-02-12 | Apple Inc. | Far-field extension for digital assistant services |
JP2019074799A (en) * | 2017-10-12 | 2019-05-16 | 富士通コネクテッドテクノロジーズ株式会社 | Display controller, display control method and display control program |
EP3593198B1 (en) | 2018-03-07 | 2023-03-08 | Magic Leap, Inc. | Visual tracking of peripheral devices |
USD918176S1 (en) | 2018-07-24 | 2021-05-04 | Magic Leap, Inc. | Totem controller having an illumination region |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020109671A1 (en) * | 2001-02-15 | 2002-08-15 | Toshiki Kawasome | Input system, program, and recording medium |
US6664951B1 (en) * | 1999-07-07 | 2003-12-16 | Matsushita Electric Industrial Co., Ltd. | Mobile communication terminal equipment and touch panel switch used therein |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0173972B1 (en) * | 1984-08-30 | 1991-02-27 | Nec Corporation | Pre-processing system for pre-processing an image signal succession prior to identification |
GB8914235D0 (en) * | 1989-06-21 | 1989-08-09 | Tait David A G | Finger operable control devices |
JPH1069346A (en) * | 1996-08-28 | 1998-03-10 | Alps Electric Co Ltd | Coordinate input device and its control method |
US6259804B1 (en) * | 1997-05-16 | 2001-07-10 | Authentic, Inc. | Fingerprint sensor with gain control features and associated methods |
US5943052A (en) * | 1997-08-12 | 1999-08-24 | Synaptics, Incorporated | Method and apparatus for scroll bar control |
US6408087B1 (en) * | 1998-01-13 | 2002-06-18 | Stmicroelectronics, Inc. | Capacitive semiconductor user input device |
US6278443B1 (en) * | 1998-04-30 | 2001-08-21 | International Business Machines Corporation | Touch screen with random finger placement and rolling on screen to control the movement of information on-screen |
US6404900B1 (en) * | 1998-06-22 | 2002-06-11 | Sharp Laboratories Of America, Inc. | Method for robust human face tracking in presence of multiple persons |
GB9814398D0 (en) * | 1998-07-02 | 1998-09-02 | Nokia Mobile Phones Ltd | Electronic apparatus |
US6256022B1 (en) * | 1998-11-06 | 2001-07-03 | Stmicroelectronics S.R.L. | Low-cost semiconductor user input device |
US6822639B1 (en) * | 1999-05-25 | 2004-11-23 | Silverbrook Research Pty Ltd | System for data transfer |
US7142840B1 (en) * | 2003-02-20 | 2006-11-28 | Sprint Spectrum L.P. | Method and system for multi-network authorization and authentication |
US7088220B2 (en) * | 2003-06-20 | 2006-08-08 | Motorola, Inc. | Method and apparatus using biometric sensors for controlling access to a wireless communication device |
-
2005
- 2005-02-14 US US11/058,514 patent/US20060103633A1/en not_active Abandoned
- 2005-11-15 WO PCT/US2005/041612 patent/WO2006055674A2/en not_active Application Discontinuation
- 2005-11-15 JP JP2007543214A patent/JP2008521136A/en not_active Withdrawn
- 2005-11-15 EP EP05849717A patent/EP1812927A2/en not_active Withdrawn
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6664951B1 (en) * | 1999-07-07 | 2003-12-16 | Matsushita Electric Industrial Co., Ltd. | Mobile communication terminal equipment and touch panel switch used therein |
US20020109671A1 (en) * | 2001-02-15 | 2002-08-15 | Toshiki Kawasome | Input system, program, and recording medium |
Also Published As
Publication number | Publication date |
---|---|
US20060103633A1 (en) | 2006-05-18 |
WO2006055674A3 (en) | 2006-11-16 |
JP2008521136A (en) | 2008-06-19 |
EP1812927A2 (en) | 2007-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060103633A1 (en) | Customizable touch input module for an electronic device | |
US20060181521A1 (en) | Systems for dynamically illuminating touch sensors | |
CN105353912B (en) | It touches and power sensor device and the quick display of power | |
JP5114415B2 (en) | Customizer for mobile devices | |
US8775964B2 (en) | Method and mobile terminal device for mapping a virtual user input interface to a physical user input interface | |
CN101479824B (en) | Input device with display button and portable electronic device having the same | |
KR101206694B1 (en) | Human interface input acceleration system | |
JP5922481B2 (en) | Multi-function handheld device | |
KR101035814B1 (en) | Portable electronic device and method for controlling same | |
WO2011024462A1 (en) | Input device and method for controlling input device | |
JP5519020B2 (en) | Input device and control method of input device | |
JP5718475B2 (en) | Tactile presentation device | |
JP5555612B2 (en) | Tactile presentation device | |
CN101809527A (en) | Electronic equipment with rigidity input surface of piezoelectricity sense of touch | |
KR20080042931A (en) | A method of remapping the input elements of a hand-held device | |
CN106953950A (en) | Electronic equipment with side wall display | |
CN106774865A (en) | Integrated haptic control apparatus and touch-sensitive display | |
CN100432912C (en) | Mobile electronic apparatus, display method, program and graphical interface thereof | |
TW201025085A (en) | Keyboard formed from a touch display, method of endowing a touch display with a keyboard function, and a device with functions of keyboard or writing pad input and image output | |
JP2011187087A (en) | Input device and control method for the same | |
CN1760805A (en) | Remote control module for controlling mutimedia computer remotely | |
KR20070092393A (en) | Method for application of touch key sensor in mobile phone | |
JP2001000315A (en) | Operation display device for cooker |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KN KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2005849717 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007543214 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2005849717 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2005849717 Country of ref document: EP |