WO2001086920A2 - Apparatus and method for the kinematic control of hand-held devices - Google Patents

Apparatus and method for the kinematic control of hand-held devices Download PDF

Info

Publication number
WO2001086920A2
WO2001086920A2 PCT/IB2001/000851 IB0100851W WO0186920A2 WO 2001086920 A2 WO2001086920 A2 WO 2001086920A2 IB 0100851 W IB0100851 W IB 0100851W WO 0186920 A2 WO0186920 A2 WO 0186920A2
Authority
WO
WIPO (PCT)
Prior art keywords
hand
display
held
movement
information
Prior art date
Application number
PCT/IB2001/000851
Other languages
French (fr)
Other versions
WO2001086920A3 (en
Inventor
Zvi Lapidot
Original Assignee
Zvi Lapidot
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zvi Lapidot filed Critical Zvi Lapidot
Priority to AU2001256576A priority Critical patent/AU2001256576A1/en
Publication of WO2001086920A2 publication Critical patent/WO2001086920A2/en
Publication of WO2001086920A3 publication Critical patent/WO2001086920A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the invention is directed to hand-held portable devices comprising at least one movement measuring means capable of controlling one or more functions of the device as well as controlling the presentation of information in the display of the device.
  • the movement measure means sense the movement of the device or its position relative to another object.
  • the invention also relates to a method for the kinematic control of a portable hand-held device by moving the device and measuring the movement of the device or its position relative to another object by movement measurement means.
  • the invention provides a hand-held portable device and method for conveniently controlling the function of the hand-held device and the presentation of information in the display of the device.
  • Hand-held portable devices such as cellular phones, cellular radios, personal communicators, beepers, GPS units and others, are decreasing in size and becoming more versatile in function.
  • cellular telephones and personal communicators are used to transmit and receive data, documents , text, and pictures , to connect to the Internet, for e-commerce and other applications.
  • their small physical dimensions make it difficult to control their multiple functions using traditional approaches such as a keyboard.
  • keyboard refers here to any arrangement of buttons that can be pushed, joystick, touchpad and the like. This problem becomes more severe as the device dimensions shrink, for example when a cellular phone becomes as small as a wristwatch.
  • These devices usually have a small display, and it is often desired to use this display to present large amounts of information such as pictures or documents .
  • the traditional approach to the control of hand-held devices and the information presentation in their displays is to use specialized keys, e.g., for turning the device and various functions on or off, for selecting items from a menu, or for scrolling the information presented in the display.
  • the traditional approach has several limitations : in a small device there may not be sufficient space for conveniently locating multiple keys, and the use of multiple keys may be confusing and difficult to remember.
  • the new method improves upon existing methods by reducing the number of keys required to control the device and the information presented in its display, and by making the control simpler and easier to learn and to remember .
  • movement of a portable hand-held device is used to control various functions of the device and the information presented in its display.
  • the term "hand-held” is used here to refer to any portable device that may be moved, translated or rotated, by the user during the operation of the device, including, for example, a device that may be worn as a wristwatch rather than held in hand during its operation.
  • the invention also relates to hand-held remote control units that are used to control the function of other devices that are not by themselves portable, such as a TV set, video player or a DVD unit.
  • the device is equipped with elements that measure the movement of the entire device (e.g. accelerometers) or its position relative to other objects (e.g.
  • a menu presents a number of alternative functions to choose from, and the selection of an option from the menu is performed by operating a keyboard, for example by pressing buttons, or moving a cursor to a desired position in the display.
  • the selection of items from a menu can be obtained by moving the entire portable device in a particular direction. For example, two options to select from may be presented in the display, one on the left side of the display and the second on the right side. A movement of the device to the left will select the first option, and movement to the right will select the second optio .
  • Movements can also be used to control the presentation of information in the display.
  • the display may show a small portion of a document.
  • the document may contain text, pictures , graphics and will typically be too large to be presented all at once within the display of the hand-held device. Movements of the device in space will change the displayed information to show different portions of the document. If the device is moved to the right, for example, then the displayed information will be changed accordingly, showing a new portion of the document to the right of the previously presented location. Moving the device closer or further from the user, or in a perpendicular direction to the display, will zoom the image in and out, changing the resolution of the presented image or the size of the displayed text or picture .
  • Figure 1 shows a schematic diagram of a hand-held device in accordance with the invention.
  • Figures 2 to 4 illustrate the kinematic control of a hand-held device in accordance with the invention .
  • Figure 5 illustrates an enabling means to avoid accidental activation of the hand-held device.
  • FIG. 6 shows a schematic block diagram illustrating an embodiment of practicing the invention .
  • the hand-held device of the invention is equipped with elements for measuring the movements of the entire device, e.g. by three accelerometers that measure the acceleration along three independent directions .
  • the position of the device relative to other objects can be measured, e.g. by using a small camera mounted on the device.
  • a small camera mounted on the device.
  • Such a camera can take a sequence of pictures of static nearby objects, for example, a tabletop and use these pictures to determine the position or the movement of the camera with respect to such objects.
  • the measured movements of the device are used for two purposes . One is for controlling different functions of the device using motion commands instead of, or in combination with, the operation of other input devices such as a keyboard.
  • the second purpose is to control the information presented in the display of the device.
  • Additional mechanisms can be added to avoid unwanted changes in the information presented in the display, or unwanted activation of control functions , by small movements of the device, caused for example by small instabilities of the hand holding the device. For example, it can be arranged that when the movements are small in terms of overall change in position, or when the speed or acceleration of the movement are below critical pre-defined values (that correspond to small unintended movement) , such movements will be ignored and will not be used to change the information presented in the display or to activate control functions of the device .
  • Figure . 1 shows a schematic diagram of a hand-held device such as a cellular telephone, and the notation used for describing directions of motion.
  • the x and y directions are in the plane of the device and its display, and the z direction is perpendicular to this plane. Since the display is usually facing the user, the z direction is normally in a direction that brings the device closer to, or further away from, the user.
  • Figures 2 , 3 , 4 illustrate the use of the invention to control the presentation of information in the display of a hand-held device.
  • Figure 2 is a schematic representation of a document 201 and a virtual window 202 which is a part of the document selected by the algorithm that controls the presentation of information in the device's display. This selected part is shown in the Figure as an outlined window placed over the document and selecting a part thereof.
  • the document may contain text, graphics, still or moving pictures, and any combination thereof.
  • the document or a large part of it is typically stored temporarily in a memory unit of the hand-held device. For example, the user may use a cellular phone to access information via the Internet. Information from the Internet will then be downloaded and stored temporarily in the device's memory.
  • FIG. 202 contains the portion of the document currently presented in the display of the hand-held device.
  • the content of the window 202 is currently presented in the display 204 of the hand-held device 203.
  • Figure 3 illustrates in a schematic form how the display of information from a document is controlled by moving the hand-held device.
  • Device 303 and display 304 are the same as device 203 and display 204 in Figure 2. The device is now moved to a new position, in this example down and to the right in the Figure.
  • Figure 303-A shows device 303 in its new position, following the movement
  • 304-A shows the display in its new position, following the movement.
  • This movement of the device is sensed by the elements that measure the acceleration, velocity or position of the device, and it is used to issue a command to change the information presented in the display 304-A.
  • the change of information in the display will depend in general on the direction and magnitude of the movement of the device from its previous position to its new position, including in general both translation in space and rotational movements .
  • Figure 4 shows in a schematic form the use of movement to zoom in and out of the document.
  • Moving the device in the z direction for example in a direction closer to the viewer, will cause a zoom-in of the information presented in the display.
  • this will typically mean increasing the size of the viewed text, and at the same time decreasing the portion of the document presented in the display.
  • zoom-in will increase the magnification of the presented image and will typically decrease the portion of the picture shown in the display.
  • Movement in the opposite direction, along the z-axis but for example away from the viewer will cause a zoom-put of the image.
  • this will typically mean reducing the front size in the displayed text, while showing at the same time a larger portion of text in the display.
  • this zoom-out will decrease the magnification of the presented image, usually allowing the presentation of additional parts of a larger picture, but at a reduced magnification.
  • the rate of change in magnification can be related to the speed or acceleration of the movement of the hand-held device, so that, for example, the rate of zoom can be increased by increasing the speed of motion of the device itself.
  • a document 401 is shown.
  • a selected part of this document shown as window 402 was presented in the display unit prior to a movement of the device in the direction of the z-axis .
  • the device was then moved along the x-axis, for example causing it to move closer to the eyes of the person holding the device.
  • Figure 403 illustrates the device in its new position following the movement along the z-axis direction, and 404 is the display of device 403.
  • the movement is measured and used to issue a command to change the information displayed in the display unit 404 of device 403.
  • the information presented in the display unit 404 following the last movement of the device is shown schematically in window 402-A. This window is smaller than window 402.
  • the information contained within this window will be displayed in the display 404 at a larger magnification than the presentation of this information prior to the movement of the device, and typically a smaller part of the document will be displayed at the increased magnification. In this manner, movements of the device along the z-axis direction cause zoom in and out of the information presented in the display of the hand-held device.
  • the use of the movement to control the device or its display may be conditioned on the activation of an enabling switch.
  • the hand-held device is designated as 501; 502 the display of the device; and 503 is in this particular example a 3?position switch.
  • Figure 504 shows a magnified view of the same 3?position switch. At one position of the switch 503 (shown also in 504) marked by N (for Neutral condition) , the use of movements to control functions of the device or its display unit is disabled, and movements of the device will not be used to control the device or the information presented in its display.
  • switch 503 can be spring?loaded in such a way, that its natural position, in the lack of any external force, is the neutral position N. Positions C and D are achieved by pressing the switch against the spring.
  • Figure 6 shows a schematic block diagram of the apparatus described.
  • the apparatus contains elements for measuring the acceleration, velocity, or position of the hand?held device.
  • the movement measurements are obtained by three accelerometers shown as 601?A, 601?B, 601?C in the drawing.
  • the three accelerometers measure the acceleration of the device along three independent directions. Additional accelerometers can be used, for example for precise measurements of rotational movements of the device.
  • the acceleration measurements are fed into a processor 602 in the drawing, that can be a special processor, or a processor such as a microprocessor that is used for other purposes in the hand?held device .
  • the processor performs time integration of the acceleration measurements to obtain velocity measurements of the device, and also time integration of the velocity measurements to obtain measurements of the position of the device at any desired time. These integration functions can alternatively be performed by a dedicated processor connected to the accelerometers rather then processor 602.
  • the processor 602 is connected to a display control unit 603 that controls the information presented in the display 604.
  • the display control unit 603 is also connected to display buffer 605 that contains at any given time the information selected to be displayed in the display 604.
  • the memory unit 606 is used to store a larger image, such as a full document or a part of it, and a selected part of the document stored in memory unit 606 is transferred to buffer 605 to be displayed in the display 604.
  • the same memory 606 is also used to store recent movements of the device. This information can be used by the processor 602 to allow smooth update of the display over time, or for ignoring small movements of the device.
  • the same memory unit 606 can also store other information such as recent commands issued by the user of the device.
  • the processor receives input also from control keys shown together as keyboard 607 , that may include a control switch such as shown in Figure 5, switch 503, as well as other keys, control buttons, joystick and the like.
  • Processor 602 uses the movements of the device together with information from control keyboard 607 to issue command signals to the display control unit 603, and to issue command signals to the device control unit 608, for example, for turning the device itself or different functions of the device on or off.

Abstract

A portable hand-held device and method is presented for the kinematic control of hand-held, devices. including the control of their function, and the control of the information presented in the display of a portable device. The control is obtained by moving the entire hand-held device. The movement or the position of the device is sensed e.g. by accelerometers or a small camera mounted on the device. Specific movements are then used e.g. to turn the device on and off, to scroll the information presented in a device's display, or to zoom the image in or out.

Description

APPARATUS AND METHOD FOR THE KINEMATIC CONTROL OF HANDHELD DEVICES BACKGROUND OF THE INVENTION 1. Field of the Invention The invention is directed to hand-held portable devices comprising at least one movement measuring means capable of controlling one or more functions of the device as well as controlling the presentation of information in the display of the device. The movement measure means sense the movement of the device or its position relative to another object. The invention also relates to a method for the kinematic control of a portable hand-held device by moving the device and measuring the movement of the device or its position relative to another object by movement measurement means. Advantageously, the invention provides a hand-held portable device and method for conveniently controlling the function of the hand-held device and the presentation of information in the display of the device. 2. Description of the Prior Art
Hand-held portable devices such as cellular phones, cellular radios, personal communicators, beepers, GPS units and others, are decreasing in size and becoming more versatile in function. For example, cellular telephones and personal communicators are used to transmit and receive data, documents , text, and pictures , to connect to the Internet, for e-commerce and other applications. At the same time, their small physical dimensions make it difficult to control their multiple functions using traditional approaches such as a keyboard. As used herein, the term "keyboard" refers here to any arrangement of buttons that can be pushed, joystick, touchpad and the like. This problem becomes more severe as the device dimensions shrink, for example when a cellular phone becomes as small as a wristwatch. These devices usually have a small display, and it is often desired to use this display to present large amounts of information such as pictures or documents .
The traditional approach to the control of hand-held devices and the information presentation in their displays is to use specialized keys, e.g., for turning the device and various functions on or off, for selecting items from a menu, or for scrolling the information presented in the display. The traditional approach has several limitations : in a small device there may not be sufficient space for conveniently locating multiple keys, and the use of multiple keys may be confusing and difficult to remember.
It is therefore the object of the present invention to provide improved hand-held portable devices and a method for conveniently controlling the function of such devices and the presentation of information in their display. The new method improves upon existing methods by reducing the number of keys required to control the device and the information presented in its display, and by making the control simpler and easier to learn and to remember . SUMMARY OF THE INVENTION
In accordance with the present invention, movement of a portable hand-held device is used to control various functions of the device and the information presented in its display. The term "hand-held" is used here to refer to any portable device that may be moved, translated or rotated, by the user during the operation of the device, including, for example, a device that may be worn as a wristwatch rather than held in hand during its operation. The invention also relates to hand-held remote control units that are used to control the function of other devices that are not by themselves portable, such as a TV set, video player or a DVD unit. In accordance with the invention, the device is equipped with elements that measure the movement of the entire device (e.g. accelerometers) or its position relative to other objects (e.g. with a small camera mounted on the device) . Specific movements are used, in addition to the possible use of control keys, to control different functions of the device. For example, lifting a cellular phone will activate it to respond to a calling signal, putting it back down will terminate the call . A small shaking movement of the device will turn it on if it is in the off state, and turn it off if it is in the on state .
Another example of the many advantages of the invention is selection from a menu. In the traditional approach, a menu presents a number of alternative functions to choose from, and the selection of an option from the menu is performed by operating a keyboard, for example by pressing buttons, or moving a cursor to a desired position in the display. According to the present invention, the selection of items from a menu can be obtained by moving the entire portable device in a particular direction. For example, two options to select from may be presented in the display, one on the left side of the display and the second on the right side. A movement of the device to the left will select the first option, and movement to the right will select the second optio .
Movements can also be used to control the presentation of information in the display. For example, the display may show a small portion of a document. The document may contain text, pictures , graphics and will typically be too large to be presented all at once within the display of the hand-held device. Movements of the device in space will change the displayed information to show different portions of the document. If the device is moved to the right, for example, then the displayed information will be changed accordingly, showing a new portion of the document to the right of the previously presented location. Moving the device closer or further from the user, or in a perpendicular direction to the display, will zoom the image in and out, changing the resolution of the presented image or the size of the displayed text or picture .
BRIEF DESCIRPTION OF THE DRAWINGS
For a better understanding of the present invention, reference will now be made, by way of example, to the accompanying drawings , in which : Figure 1 shows a schematic diagram of a hand-held device in accordance with the invention.
Figures 2 to 4 illustrate the kinematic control of a hand-held device in accordance with the invention . Figure 5 illustrates an enabling means to avoid accidental activation of the hand-held device.
Figure 6 shows a schematic block diagram illustrating an embodiment of practicing the invention . DESCRIPTION OF THE INVENTION The hand-held device of the invention is equipped with elements for measuring the movements of the entire device, e.g. by three accelerometers that measure the acceleration along three independent directions . Alternative, or in addition, the position of the device relative to other objects can be measured, e.g. by using a small camera mounted on the device. Such a camera can take a sequence of pictures of static nearby objects, for example, a tabletop and use these pictures to determine the position or the movement of the camera with respect to such objects. The measured movements of the device are used for two purposes . One is for controlling different functions of the device using motion commands instead of, or in combination with, the operation of other input devices such as a keyboard. The second purpose is to control the information presented in the display of the device.
Additional mechanisms can be added to avoid unwanted changes in the information presented in the display, or unwanted activation of control functions , by small movements of the device, caused for example by small instabilities of the hand holding the device. For example, it can be arranged that when the movements are small in terms of overall change in position, or when the speed or acceleration of the movement are below critical pre-defined values (that correspond to small unintended movement) , such movements will be ignored and will not be used to change the information presented in the display or to activate control functions of the device . These functions are further explained with reference to the drawings .
Figure . 1 shows a schematic diagram of a hand-held device such as a cellular telephone, and the notation used for describing directions of motion. The x and y directions are in the plane of the device and its display, and the z direction is perpendicular to this plane. Since the display is usually facing the user, the z direction is normally in a direction that brings the device closer to, or further away from, the user.
Figures 2 , 3 , 4 illustrate the use of the invention to control the presentation of information in the display of a hand-held device. Figure 2 is a schematic representation of a document 201 and a virtual window 202 which is a part of the document selected by the algorithm that controls the presentation of information in the device's display. This selected part is shown in the Figure as an outlined window placed over the document and selecting a part thereof. The document may contain text, graphics, still or moving pictures, and any combination thereof. The document or a large part of it is typically stored temporarily in a memory unit of the hand-held device. For example, the user may use a cellular phone to access information via the Internet. Information from the Internet will then be downloaded and stored temporarily in the device's memory. In this example the information contained in the entire document cannot be all presented at once in the display of the hand-held device. Window 202 contains the portion of the document currently presented in the display of the hand-held device. The content of the window 202 is currently presented in the display 204 of the hand-held device 203. Figure 3 illustrates in a schematic form how the display of information from a document is controlled by moving the hand-held device. Device 303 and display 304 are the same as device 203 and display 204 in Figure 2. The device is now moved to a new position, in this example down and to the right in the Figure. Figure 303-A shows device 303 in its new position, following the movement, and 304-A shows the display in its new position, following the movement. This movement of the device is sensed by the elements that measure the acceleration, velocity or position of the device, and it is used to issue a command to change the information presented in the display 304-A. The change of information in the display will depend in general on the direction and magnitude of the movement of the device from its previous position to its new position, including in general both translation in space and rotational movements .
This is shown schematically by the movement of the window 302, corresponding to window 202 in Figure 2, to a new position 302-A over the document 301. The new information from the document corresponding to the part of the document within the new position of the window 302-A is now presented in the display 304-A. In this manner, physical movement of the band-held device in space corresponds to movements over the document showing at each time a part of the document, as if a real window was moved in a related manner over the document. The document 301can be scanned and different parts can be viewed by moving the hand-held device in space. The movement of the window over the document 301 can correspond exactly to, be proportional to, or be related in other ways to the movement of the hand-held device . The rate of change of information in the display can be related to the speed or acceleration of the device itself, so that, for example, the document can be scanned faster by increasing the speed of movement of the handheld device itself.
Figure 4 shows in a schematic form the use of movement to zoom in and out of the document. Moving the device in the z direction, for example in a direction closer to the viewer, will cause a zoom-in of the information presented in the display. For a text document, this will typically mean increasing the size of the viewed text, and at the same time decreasing the portion of the document presented in the display. For a picture image, zoom-in will increase the magnification of the presented image and will typically decrease the portion of the picture shown in the display. Movement in the opposite direction, along the z-axis but for example away from the viewer, will cause a zoom-put of the image. For a text image, this will typically mean reducing the front size in the displayed text, while showing at the same time a larger portion of text in the display. For a picture image, this zoom-out will decrease the magnification of the presented image, usually allowing the presentation of additional parts of a larger picture, but at a reduced magnification. The rate of change in magnification (rate of zoom-in or zoom-out) can be related to the speed or acceleration of the movement of the hand-held device, so that, for example, the rate of zoom can be increased by increasing the speed of motion of the device itself.
In Figure 4, a document 401 is shown. A selected part of this document shown as window 402 was presented in the display unit prior to a movement of the device in the direction of the z-axis . The device was then moved along the x-axis, for example causing it to move closer to the eyes of the person holding the device. Figure 403 illustrates the device in its new position following the movement along the z-axis direction, and 404 is the display of device 403. The movement is measured and used to issue a command to change the information displayed in the display unit 404 of device 403. The information presented in the display unit 404 following the last movement of the device is shown schematically in window 402-A. This window is smaller than window 402. The information contained within this window will be displayed in the display 404 at a larger magnification than the presentation of this information prior to the movement of the device, and typically a smaller part of the document will be displayed at the increased magnification. In this manner, movements of the device along the z-axis direction cause zoom in and out of the information presented in the display of the hand-held device.
To avoid accidental activation of the device by movement that is not intended by the user to function as a command to the device or its display, the use of the movement to control the device or its display may be conditioned on the activation of an enabling switch. This is shown in Figure 5. The hand-held device is designated as 501; 502 the display of the device; and 503 is in this particular example a 3?position switch. Figure 504 shows a magnified view of the same 3?position switch. At one position of the switch 503 (shown also in 504) marked by N (for Neutral condition) , the use of movements to control functions of the device or its display unit is disabled, and movements of the device will not be used to control the device or the information presented in its display. The same switch is used in this example also to select between the control of device functions and control of its display. In position C (for λControl' ) of switch 503 (shown also in 504) , movements of the device are used to control different functions such as turning the device on or off. At this position, movements of the device will not be used to control the display. In position D (for ^Display' ) of the switch 503, shown also in 504, movements of the device are used to control the presentation of information in the display, as illustrated by examples in Figures 3 and 4. Switch 503 can be spring?loaded in such a way, that its natural position, in the lack of any external force, is the neutral position N. Positions C and D are achieved by pressing the switch against the spring. Figure 6 shows a schematic block diagram of the apparatus described. In general, the apparatus contains elements for measuring the acceleration, velocity, or position of the hand?held device. In the example shown, the movement measurements are obtained by three accelerometers shown as 601?A, 601?B, 601?C in the drawing. The three accelerometers measure the acceleration of the device along three independent directions. Additional accelerometers can be used, for example for precise measurements of rotational movements of the device. The acceleration measurements are fed into a processor 602 in the drawing, that can be a special processor, or a processor such as a microprocessor that is used for other purposes in the hand?held device . The processor performs time integration of the acceleration measurements to obtain velocity measurements of the device, and also time integration of the velocity measurements to obtain measurements of the position of the device at any desired time. These integration functions can alternatively be performed by a dedicated processor connected to the accelerometers rather then processor 602.
The processor 602 is connected to a display control unit 603 that controls the information presented in the display 604. The display control unit 603 is also connected to display buffer 605 that contains at any given time the information selected to be displayed in the display 604. The memory unit 606 is used to store a larger image, such as a full document or a part of it, and a selected part of the document stored in memory unit 606 is transferred to buffer 605 to be displayed in the display 604. The same memory 606 is also used to store recent movements of the device. This information can be used by the processor 602 to allow smooth update of the display over time, or for ignoring small movements of the device. The same memory unit 606 can also store other information such as recent commands issued by the user of the device.
The processor receives input also from control keys shown together as keyboard 607 , that may include a control switch such as shown in Figure 5, switch 503, as well as other keys, control buttons, joystick and the like. Processor 602 uses the movements of the device together with information from control keyboard 607 to issue command signals to the display control unit 603, and to issue command signals to the device control unit 608, for example, for turning the device itself or different functions of the device on or off.
It is to be understood that the present invention is not limited to the embodiments described above, but encompass any and all embodiments within the scope of the following claims .

Claims

1. A hand-held portable device comprising at least one movement measuring means capable of controlling one or more functions of the device.
2. A hand-held portable device comprising a display for information and at least one movement measuring means capable of controlling the information presented in the display of the device.
3. The hand-held portable device according to claim 1 or 2 , wherein the movement measuring means senses the movement of the device or its position relative to another object.
4. The hand-held portable device according to claim 1 or 2 , wherein the movement measuring means is an accelerometer .
5. The hand-held portable device according to claim 1 or 2, wherein the movement measuring means is a camera.
6. The hand-held portable device according to claim 1 or 2 , wherein the movement measuring means is selected from the group consisting of an accelerometer, a camera and combinations of both.
7. The hand-held portable device according to claim 1 or 2, wherein the device is a remote control unit.
8. The hand-held portable device according to claim 1 or 2 further comprising a keyboard capable of controlling one or more functions of the device in combination with the measuring means .
9. The hand-held portable device according to claim 1 or 2 further comprising an enabling means for avoiding unwanted activation of the device.
10. A hand-held portable device comprising a display for presenting information and at least one movement measuring means capable of controlling one or more functions of the device and the presentation of information on the screen.
11. The hand-held portable device according to claim 10, wherein the movement measuring means senses the movement of the device or its position relative to another object.
12. The hand-held portable device according to claim 10, wherein the movement measuring means is an accelerometer.
13. The hand-held portable device according to claim 10, wherein the movement measuring means is a camera.
14. The hand-held portable device according to claim 10, wherein the movement measuring means is selected from the group consisting of an accelerometer, a camera and combinations of both.
15. The hand-held portable device according to claim 10, wherein the device is a remote control unit.
16. The hand-held portable device according to claim 10 further comprising a keyboard capable of controlling one or more functions of the device in combination with the measuring means .
17. The hand-held portable device according to claim 10 further comprising an enabling means for avoiding unwanted activation of the device.
18. A method for the kinematic control of a portable hand-held device comprising moving the hand-held device and measuring the movement of the device or its position relative to another object by one or more movement measuring means capable of controlling one or more functions of the device.
19. A method for the kinematic control of a portable hand-held device having a display for information comprising moving the hand-held device and measuring the movement of the device or its position relative to another object by one or more movement measuring means capable of controlling the presentation of information on the display.
20. A method for the kinematic control of a portable hand-held device having a display for information comprising moving the hand-held device and measuring the movement of the device or its position relative to another object by one or more movement measuring means capable of controlling one or more functions of the device and the presentation of information on the screen.
PCT/IB2001/000851 2000-05-12 2001-05-11 Apparatus and method for the kinematic control of hand-held devices WO2001086920A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001256576A AU2001256576A1 (en) 2000-05-12 2001-05-11 Apparatus and method for the kinematic control of hand-held devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US20372000P 2000-05-12 2000-05-12
US60/203,720 2000-05-12

Publications (2)

Publication Number Publication Date
WO2001086920A2 true WO2001086920A2 (en) 2001-11-15
WO2001086920A3 WO2001086920A3 (en) 2002-05-02

Family

ID=22755038

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2001/000851 WO2001086920A2 (en) 2000-05-12 2001-05-11 Apparatus and method for the kinematic control of hand-held devices

Country Status (2)

Country Link
AU (1) AU2001256576A1 (en)
WO (1) WO2001086920A2 (en)

Cited By (70)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004032053A1 (en) * 2002-10-03 2004-04-15 Nokia Corporation A mobile device for displaying information content
WO2004066615A1 (en) * 2003-01-22 2004-08-05 Nokia Corporation Image control
WO2005026865A2 (en) * 2003-09-09 2005-03-24 Siemens Aktiengesellschaft Input device for a data processing system
EP1524588A1 (en) * 2003-10-15 2005-04-20 Sony Ericsson Mobile Communications AB User input device for a portable electronic device
WO2005055568A1 (en) * 2003-12-08 2005-06-16 Siemens Aktiengesellschaft Mobile telephone with movement-dependent display representation
EP1578090A1 (en) * 2004-03-16 2005-09-21 Myorigo OY A mobile device with wide-angle optics and a radiation sensor
WO2005103863A2 (en) 2004-03-23 2005-11-03 Fujitsu Limited Distinguishing tilt and translation motion components in handheld devices
EP1587286A3 (en) * 2004-04-14 2006-02-08 Nec Corporation Portable terminal, response message transmitting method and server
WO2005093550A3 (en) * 2004-03-01 2006-04-13 Apple Computer Methods and apparatuses for operating a portable device based on an accelerometer
WO2006056311A1 (en) * 2004-11-26 2006-06-01 Eastman Kodak Company Method of automatic navigation directed towards regions of interest of an image
EP1703706A1 (en) * 2005-02-23 2006-09-20 Samsung Electronics Co., Ltd. Apparatus and method for controlling menu navigation in a terminal by using an inertial sensor in said terminal
EP1722296A1 (en) * 2005-05-12 2006-11-15 Samsung Electronics Co., Ltd. Portable terminal having motion-recognition capability and motion recognition method therefor
EP1724663A1 (en) * 2005-05-20 2006-11-22 Samsung Electronics Co., Ltd. Portable terminal for measuring reference tilt and method of measuring reference tilt using the same
US7173604B2 (en) 2004-03-23 2007-02-06 Fujitsu Limited Gesture identification of controlled devices
US7176888B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Selective engagement of motion detection
US7176887B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Environmental modeling for motion controlled handheld devices
US7176886B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Spatial signatures
US7180501B2 (en) 2004-03-23 2007-02-20 Fujitsu Limited Gesture based navigation of a handheld user interface
US7180502B2 (en) 2004-03-23 2007-02-20 Fujitsu Limited Handheld device with preferred motion selection
US7180500B2 (en) 2004-03-23 2007-02-20 Fujitsu Limited User definable gestures for motion controlled handheld devices
EP1759746A2 (en) * 2005-09-01 2007-03-07 Nintendo Co., Ltd. Information processing system and program
SG131745A1 (en) * 2002-08-23 2007-05-28 Sony Corp Movement-compensated visual display
EP1818768A2 (en) * 2006-01-19 2007-08-15 High Tech Computer Corp. Display controller with a motion sensor on a portable electronic device
US7280096B2 (en) 2004-03-23 2007-10-09 Fujitsu Limited Motion sensor engagement for a handheld device
EP1843563A1 (en) * 2006-04-04 2007-10-10 Samsung Electronics Co.,Ltd. Apparatus and method for automatic display control in mobile terminal
KR100772909B1 (en) 2006-05-30 2007-11-05 삼성전자주식회사 Image browsing method and apparatus using the same
WO2007133257A1 (en) * 2006-05-17 2007-11-22 Sony Ericsson Mobile Communications Ab Electronic equipment with screen pan and zoom functions using motion
US7301527B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Feedback based user interface for motion controlled handheld devices
US7301528B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Distinguishing tilt and translation motion components in handheld devices
US7301526B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Dynamic adaptation of gestures for motion controlled handheld devices
US7301529B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Context dependent gesture response
US7307228B2 (en) 2000-10-02 2007-12-11 Apple Inc. Method and apparatus for detecting free fall
EP1903425A1 (en) * 2005-07-08 2008-03-26 Mitsubishi Electric Corporation Touch panel display device and portable apparatus
US7365737B2 (en) 2004-03-23 2008-04-29 Fujitsu Limited Non-uniform gesture precision
US7365735B2 (en) 2004-03-23 2008-04-29 Fujitsu Limited Translation controlled cursor
US7365736B2 (en) 2004-03-23 2008-04-29 Fujitsu Limited Customizable gesture mappings for motion controlled handheld devices
EP1927383A1 (en) * 2006-12-01 2008-06-04 Nintendo Co., Ltd. Storage medium having game program stored thereon and game apparatus
WO2008075082A1 (en) * 2006-12-21 2008-06-26 Symbian Software Limited Mobile device and method of operation thereof
EP1947549A1 (en) * 2007-01-19 2008-07-23 Nintendo Co., Limited Storage medium having acceleration data processing program stored thereon, storage medium having game program stored thereon, and acceleration data processing apparatus
EP1961466A1 (en) * 2007-02-23 2008-08-27 Nintendo Co., Limited Computer-readable storage medium having stored therein information processing program and information processing apparatus
US7424385B2 (en) * 2005-05-12 2008-09-09 Samsung Electronics Co., Ltd. Portable terminal having motion detection function and motion detection method therefor
EP1762287A3 (en) * 2005-09-12 2008-09-24 Nintendo Co., Ltd. Information processing program
WO2008128087A1 (en) * 2007-04-13 2008-10-23 Keynetik, Inc. A force sensing apparatus and method to determine the radius of rotation of a moving object
US20090297062A1 (en) * 2005-03-04 2009-12-03 Molne Anders L Mobile device with wide-angle optics and a radiation sensor
US20090305727A1 (en) * 2005-03-04 2009-12-10 Heikki Pylkko Mobile device with wide range-angle optics and a radiation sensor
EP2133773A1 (en) * 2007-03-27 2009-12-16 NEC Corporation Information processing terminal, method for controlling information processing terminal, and program
CN1926496B (en) * 2004-03-01 2010-08-04 苹果公司 Methods and apparatuses for operating a portable device based on an accelerometer
US20100275166A1 (en) * 2007-12-03 2010-10-28 Electronics And Telecommunications Research Institute User adaptive gesture recognition method and user adaptive gesture recognition system
US7840040B2 (en) * 2005-09-30 2010-11-23 Siemens Medical Solutions Usa, Inc. Method and apparatus for controlling ultrasound imaging systems having positionable transducers
US7903084B2 (en) 2004-03-23 2011-03-08 Fujitsu Limited Selective engagement of motion input modes
EP2341412A1 (en) * 2009-12-31 2011-07-06 Sony Computer Entertainment Europe Limited Portable electronic device and method of controlling a portable electronic device
US7990365B2 (en) 2004-03-23 2011-08-02 Fujitsu Limited Motion controlled remote controller
US8157651B2 (en) 2005-09-12 2012-04-17 Nintendo Co., Ltd. Information processing program
CN1586067B (en) * 2002-02-07 2012-12-12 罗伯特·博施有限公司 Hand-operated device
US8392340B2 (en) 2009-03-13 2013-03-05 Apple Inc. Method and apparatus for detecting conditions of a peripheral device including motion, and determining/predicting temperature(S) wherein at least one temperature is weighted based on detected conditions
US8531571B1 (en) * 2009-08-05 2013-09-10 Bentley Systmes, Incorporated System and method for browsing a large document on a portable electronic device
EP2549357A3 (en) * 2011-07-19 2013-12-18 Honeywell International Inc. Device for displaying an image
US20130342455A1 (en) * 2012-06-20 2013-12-26 Samsung Electronics Co., Ltd Display apparatus, remote controlling apparatus and control method thereof
US8624838B2 (en) * 2004-07-15 2014-01-07 Vodafone Group Plc Electronic apparatus
US8692764B2 (en) 2004-03-23 2014-04-08 Fujitsu Limited Gesture based user interface supporting preexisting symbols
US8708822B2 (en) 2005-09-01 2014-04-29 Nintendo Co., Ltd. Information processing system and program
KR101497195B1 (en) * 2004-03-01 2015-02-27 애플 인크. Methods and apparatuses for operating a portable device based on an accelerometer
US8994644B2 (en) 2007-01-26 2015-03-31 Apple Inc. Viewing images with tilt control on a hand-held device
WO2017019390A1 (en) * 2015-07-27 2017-02-02 Berger Jordan A Universal keyboard
US9563202B1 (en) 2012-06-29 2017-02-07 Monkeymedia, Inc. Remote controlled vehicle with a head-mounted display apparatus
US9579586B2 (en) 2012-06-29 2017-02-28 Monkeymedia, Inc. Remote controlled vehicle with a handheld display device
US9727095B2 (en) 2001-05-16 2017-08-08 Apple Inc. Method, device and program for browsing information on a display
US10051298B2 (en) 1999-04-23 2018-08-14 Monkeymedia, Inc. Wireless seamless expansion and video advertising player
US10402089B2 (en) 2015-07-27 2019-09-03 Jordan A. Berger Universal keyboard
US11266919B2 (en) 2012-06-29 2022-03-08 Monkeymedia, Inc. Head-mounted display for navigating virtual and augmented reality

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5602566A (en) * 1993-08-24 1997-02-11 Hitachi, Ltd. Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
EP0805389A2 (en) * 1996-04-30 1997-11-05 Sun Microsystems, Inc. Tilt-scrolling on the sunpad
EP0825514A2 (en) * 1996-08-05 1998-02-25 Sony Corporation Information processing device and method for inputting information by operating the overall device with a hand
WO1998014863A2 (en) * 1996-10-01 1998-04-09 Philips Electronics N.V. Hand-held image display device
EP0907278A2 (en) * 1997-09-16 1999-04-07 Nokia Mobile Phones Ltd. Mobile radio telephone
GB2336747A (en) * 1998-04-22 1999-10-27 Nec Corp Hand held communication terminal and method of scrolling display screen of the same.
WO2000025293A1 (en) * 1998-10-23 2000-05-04 Raphael Cohen Pen-input device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5602566A (en) * 1993-08-24 1997-02-11 Hitachi, Ltd. Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
EP0805389A2 (en) * 1996-04-30 1997-11-05 Sun Microsystems, Inc. Tilt-scrolling on the sunpad
EP0825514A2 (en) * 1996-08-05 1998-02-25 Sony Corporation Information processing device and method for inputting information by operating the overall device with a hand
WO1998014863A2 (en) * 1996-10-01 1998-04-09 Philips Electronics N.V. Hand-held image display device
EP0907278A2 (en) * 1997-09-16 1999-04-07 Nokia Mobile Phones Ltd. Mobile radio telephone
GB2336747A (en) * 1998-04-22 1999-10-27 Nec Corp Hand held communication terminal and method of scrolling display screen of the same.
WO2000025293A1 (en) * 1998-10-23 2000-05-04 Raphael Cohen Pen-input device

Cited By (115)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10051298B2 (en) 1999-04-23 2018-08-14 Monkeymedia, Inc. Wireless seamless expansion and video advertising player
US7688306B2 (en) 2000-10-02 2010-03-30 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
US9829999B2 (en) 2000-10-02 2017-11-28 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
US7307228B2 (en) 2000-10-02 2007-12-11 Apple Inc. Method and apparatus for detecting free fall
US8698744B2 (en) 2000-10-02 2014-04-15 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
US9921666B2 (en) 2000-10-02 2018-03-20 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
US7541551B2 (en) 2000-10-02 2009-06-02 Apple Inc. Method and apparatus for detecting free fall
US7351925B2 (en) 2000-10-02 2008-04-01 Apple Inc. Method and apparatus for detecting free fall
US9727095B2 (en) 2001-05-16 2017-08-08 Apple Inc. Method, device and program for browsing information on a display
CN1586067B (en) * 2002-02-07 2012-12-12 罗伯特·博施有限公司 Hand-operated device
SG131745A1 (en) * 2002-08-23 2007-05-28 Sony Corp Movement-compensated visual display
WO2004032053A1 (en) * 2002-10-03 2004-04-15 Nokia Corporation A mobile device for displaying information content
CN1301487C (en) * 2002-10-03 2007-02-21 诺基亚公司 A mobile device for displaying information content
WO2004066615A1 (en) * 2003-01-22 2004-08-05 Nokia Corporation Image control
WO2005026865A3 (en) * 2003-09-09 2006-02-16 Siemens Ag Input device for a data processing system
WO2005026865A2 (en) * 2003-09-09 2005-03-24 Siemens Aktiengesellschaft Input device for a data processing system
EP1524588A1 (en) * 2003-10-15 2005-04-20 Sony Ericsson Mobile Communications AB User input device for a portable electronic device
WO2005055568A1 (en) * 2003-12-08 2005-06-16 Siemens Aktiengesellschaft Mobile telephone with movement-dependent display representation
CN1926496B (en) * 2004-03-01 2010-08-04 苹果公司 Methods and apparatuses for operating a portable device based on an accelerometer
WO2005093550A3 (en) * 2004-03-01 2006-04-13 Apple Computer Methods and apparatuses for operating a portable device based on an accelerometer
AU2005225977B2 (en) * 2004-03-01 2010-03-11 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
KR101497195B1 (en) * 2004-03-01 2015-02-27 애플 인크. Methods and apparatuses for operating a portable device based on an accelerometer
US7567818B2 (en) 2004-03-16 2009-07-28 Motionip L.L.C. Mobile device with wide-angle optics and a radiation sensor
EP1578090A1 (en) * 2004-03-16 2005-09-21 Myorigo OY A mobile device with wide-angle optics and a radiation sensor
US7365735B2 (en) 2004-03-23 2008-04-29 Fujitsu Limited Translation controlled cursor
US11119575B2 (en) 2004-03-23 2021-09-14 Fujitsu Limited Gesture based user interface supporting preexisting symbols
US7180502B2 (en) 2004-03-23 2007-02-20 Fujitsu Limited Handheld device with preferred motion selection
US7280096B2 (en) 2004-03-23 2007-10-09 Fujitsu Limited Motion sensor engagement for a handheld device
US7180501B2 (en) 2004-03-23 2007-02-20 Fujitsu Limited Gesture based navigation of a handheld user interface
US7176886B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Spatial signatures
US20140191954A1 (en) * 2004-03-23 2014-07-10 Fujitsu Limited Gesture Based User Interface Supporting Preexisting Symbols
US7301527B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Feedback based user interface for motion controlled handheld devices
US7301528B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Distinguishing tilt and translation motion components in handheld devices
US7301526B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Dynamic adaptation of gestures for motion controlled handheld devices
US7301529B2 (en) 2004-03-23 2007-11-27 Fujitsu Limited Context dependent gesture response
US7176887B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Environmental modeling for motion controlled handheld devices
US7176888B2 (en) 2004-03-23 2007-02-13 Fujitsu Limited Selective engagement of motion detection
US7173604B2 (en) 2004-03-23 2007-02-06 Fujitsu Limited Gesture identification of controlled devices
US7365737B2 (en) 2004-03-23 2008-04-29 Fujitsu Limited Non-uniform gesture precision
US7180500B2 (en) 2004-03-23 2007-02-20 Fujitsu Limited User definable gestures for motion controlled handheld devices
US7365736B2 (en) 2004-03-23 2008-04-29 Fujitsu Limited Customizable gesture mappings for motion controlled handheld devices
US8692764B2 (en) 2004-03-23 2014-04-08 Fujitsu Limited Gesture based user interface supporting preexisting symbols
WO2005103863A2 (en) 2004-03-23 2005-11-03 Fujitsu Limited Distinguishing tilt and translation motion components in handheld devices
WO2005103863A3 (en) * 2004-03-23 2006-01-26 Fujitsu Ltd Distinguishing tilt and translation motion components in handheld devices
KR100853605B1 (en) * 2004-03-23 2008-08-22 후지쯔 가부시끼가이샤 Distinguishing tilt and translation motion components in handheld devices
US7990365B2 (en) 2004-03-23 2011-08-02 Fujitsu Limited Motion controlled remote controller
CN100440102C (en) * 2004-03-23 2008-12-03 富士通株式会社 Distinguishing tilt and translation motion components in handheld devices
US7903084B2 (en) 2004-03-23 2011-03-08 Fujitsu Limited Selective engagement of motion input modes
EP1587286A3 (en) * 2004-04-14 2006-02-08 Nec Corporation Portable terminal, response message transmitting method and server
US7657252B2 (en) 2004-04-14 2010-02-02 Nec Corporation Portable terminal, response message transmitting method and server
US8624838B2 (en) * 2004-07-15 2014-01-07 Vodafone Group Plc Electronic apparatus
FR2878641A1 (en) * 2004-11-26 2006-06-02 Eastman Kodak Co METHOD OF AUTOMATICALLY AUTOMATIC NAVIGATION TOWARDS REGIONS OF INTEREST OF AN IMAGE
WO2006056311A1 (en) * 2004-11-26 2006-06-01 Eastman Kodak Company Method of automatic navigation directed towards regions of interest of an image
EP2302880A1 (en) * 2005-02-23 2011-03-30 Samsung Electronics Co., Ltd. Apparatus and method for controlling menu navigation in a terminal by using an inertial sensor in said terminal
EP1703706A1 (en) * 2005-02-23 2006-09-20 Samsung Electronics Co., Ltd. Apparatus and method for controlling menu navigation in a terminal by using an inertial sensor in said terminal
US20090297062A1 (en) * 2005-03-04 2009-12-03 Molne Anders L Mobile device with wide-angle optics and a radiation sensor
US20090305727A1 (en) * 2005-03-04 2009-12-10 Heikki Pylkko Mobile device with wide range-angle optics and a radiation sensor
CN100418042C (en) * 2005-05-12 2008-09-10 三星电子株式会社 Portable terminal having motion-recognition capability and motion recognition method therefor
EP1722296A1 (en) * 2005-05-12 2006-11-15 Samsung Electronics Co., Ltd. Portable terminal having motion-recognition capability and motion recognition method therefor
US7735025B2 (en) 2005-05-12 2010-06-08 Samsung Electronics Co., Ltd Portable terminal having motion-recognition capability and motion recognition method therefor
US7424385B2 (en) * 2005-05-12 2008-09-09 Samsung Electronics Co., Ltd. Portable terminal having motion detection function and motion detection method therefor
EP1724663A1 (en) * 2005-05-20 2006-11-22 Samsung Electronics Co., Ltd. Portable terminal for measuring reference tilt and method of measuring reference tilt using the same
US7890289B2 (en) 2005-05-20 2011-02-15 Samsung Electronics Co., Ltd Portable terminal for measuring reference tilt and method of measuring reference tilt using the same
EP1903425A4 (en) * 2005-07-08 2010-12-22 Mitsubishi Electric Corp Touch panel display device and portable apparatus
EP1903425A1 (en) * 2005-07-08 2008-03-26 Mitsubishi Electric Corporation Touch panel display device and portable apparatus
US8487882B2 (en) 2005-07-08 2013-07-16 Rpx Corporation Touch-panel display device and portable equipment
EP1759746A3 (en) * 2005-09-01 2008-09-24 Nintendo Co., Ltd. Information processing system and program
EP1759746A2 (en) * 2005-09-01 2007-03-07 Nintendo Co., Ltd. Information processing system and program
EP2078547A1 (en) * 2005-09-01 2009-07-15 Nintendo Co., Ltd. Information processing system and program
US8708822B2 (en) 2005-09-01 2014-04-29 Nintendo Co., Ltd. Information processing system and program
EP1762287A3 (en) * 2005-09-12 2008-09-24 Nintendo Co., Ltd. Information processing program
US8157651B2 (en) 2005-09-12 2012-04-17 Nintendo Co., Ltd. Information processing program
US7840040B2 (en) * 2005-09-30 2010-11-23 Siemens Medical Solutions Usa, Inc. Method and apparatus for controlling ultrasound imaging systems having positionable transducers
EP1818768A2 (en) * 2006-01-19 2007-08-15 High Tech Computer Corp. Display controller with a motion sensor on a portable electronic device
EP1818768A3 (en) * 2006-01-19 2009-04-01 High Tech Computer Corp. Display controller with a motion sensor on a portable electronic device
US10908702B2 (en) 2006-04-04 2021-02-02 Samsung Electronics Co., Ltd. Apparatus and method for automatic display control of a video image in mobile terminal
US8284215B2 (en) 2006-04-04 2012-10-09 Samsung Electronics Co., Ltd. Apparatus and method for automatic display control in mobile terminal
US9508307B2 (en) 2006-04-04 2016-11-29 Samsung Electronics Co., Ltd Apparatus and method for automatic display control in mobile terminal
EP1843563A1 (en) * 2006-04-04 2007-10-10 Samsung Electronics Co.,Ltd. Apparatus and method for automatic display control in mobile terminal
US10001846B2 (en) 2006-04-04 2018-06-19 Samsung Electronics Co., Ltd Apparatus and method for automatic display control in mobile terminal
US10514778B2 (en) 2006-04-04 2019-12-24 Samsung Electronics Co., Ltd Apparatus and method for automatic display control in mobile terminal
WO2007133257A1 (en) * 2006-05-17 2007-11-22 Sony Ericsson Mobile Communications Ab Electronic equipment with screen pan and zoom functions using motion
US8149214B2 (en) 2006-05-30 2012-04-03 Samsung Electronics Co., Ltd. Method, medium and apparatus browsing images
US8866741B2 (en) 2006-05-30 2014-10-21 Samsung Electronics Co., Ltd. Method, medium and apparatus for browsing images
KR100772909B1 (en) 2006-05-30 2007-11-05 삼성전자주식회사 Image browsing method and apparatus using the same
US7980951B2 (en) 2006-12-01 2011-07-19 Nintendo Co., Ltd. Storage medium having game program stored thereon and game apparatus
EP1927383A1 (en) * 2006-12-01 2008-06-04 Nintendo Co., Ltd. Storage medium having game program stored thereon and game apparatus
WO2008075082A1 (en) * 2006-12-21 2008-06-26 Symbian Software Limited Mobile device and method of operation thereof
EP1947549A1 (en) * 2007-01-19 2008-07-23 Nintendo Co., Limited Storage medium having acceleration data processing program stored thereon, storage medium having game program stored thereon, and acceleration data processing apparatus
US8994644B2 (en) 2007-01-26 2015-03-31 Apple Inc. Viewing images with tilt control on a hand-held device
EP1961466A1 (en) * 2007-02-23 2008-08-27 Nintendo Co., Limited Computer-readable storage medium having stored therein information processing program and information processing apparatus
EP2133773A4 (en) * 2007-03-27 2011-12-21 Nec Corp Information processing terminal, method for controlling information processing terminal, and program
EP2133773A1 (en) * 2007-03-27 2009-12-16 NEC Corporation Information processing terminal, method for controlling information processing terminal, and program
US7966146B2 (en) 2007-04-13 2011-06-21 Keynetik, Inc. Force sensing apparatus and method to determine the radius of rotation of a moving object
WO2008128087A1 (en) * 2007-04-13 2008-10-23 Keynetik, Inc. A force sensing apparatus and method to determine the radius of rotation of a moving object
US20100275166A1 (en) * 2007-12-03 2010-10-28 Electronics And Telecommunications Research Institute User adaptive gesture recognition method and user adaptive gesture recognition system
US8392340B2 (en) 2009-03-13 2013-03-05 Apple Inc. Method and apparatus for detecting conditions of a peripheral device including motion, and determining/predicting temperature(S) wherein at least one temperature is weighted based on detected conditions
US8531571B1 (en) * 2009-08-05 2013-09-10 Bentley Systmes, Incorporated System and method for browsing a large document on a portable electronic device
EP2341412A1 (en) * 2009-12-31 2011-07-06 Sony Computer Entertainment Europe Limited Portable electronic device and method of controlling a portable electronic device
EP2549357A3 (en) * 2011-07-19 2013-12-18 Honeywell International Inc. Device for displaying an image
US20130342455A1 (en) * 2012-06-20 2013-12-26 Samsung Electronics Co., Ltd Display apparatus, remote controlling apparatus and control method thereof
US9223416B2 (en) 2012-06-20 2015-12-29 Samsung Electronics Co., Ltd. Display apparatus, remote controlling apparatus and control method thereof
US8988342B2 (en) * 2012-06-20 2015-03-24 Samsung Electronics Co., Ltd. Display apparatus, remote controlling apparatus and control method thereof
US9658617B1 (en) 2012-06-29 2017-05-23 Monkeymedia, Inc. Remote controlled vehicle with a head-mounted display
US9791897B2 (en) 2012-06-29 2017-10-17 Monkeymedia, Inc. Handheld display device for navigating a virtual environment
US9782684B2 (en) 2012-06-29 2017-10-10 Monkeymedia, Inc. Remote controlled vehicle with a handheld display device
US9919233B2 (en) 2012-06-29 2018-03-20 Monkeymedia, Inc. Remote controlled vehicle with augmented reality overlay
US9656168B1 (en) 2012-06-29 2017-05-23 Monkeymedia, Inc. Head-mounted display for navigating a virtual environment
US9612627B2 (en) 2012-06-29 2017-04-04 Monkeymedia, Inc. Head-mounted display apparatus for navigating a virtual environment
US9579586B2 (en) 2012-06-29 2017-02-28 Monkeymedia, Inc. Remote controlled vehicle with a handheld display device
US10596478B2 (en) 2012-06-29 2020-03-24 Monkeymedia, Inc. Head-mounted display for navigating a virtual environment
US9563202B1 (en) 2012-06-29 2017-02-07 Monkeymedia, Inc. Remote controlled vehicle with a head-mounted display apparatus
US11266919B2 (en) 2012-06-29 2022-03-08 Monkeymedia, Inc. Head-mounted display for navigating virtual and augmented reality
US10402089B2 (en) 2015-07-27 2019-09-03 Jordan A. Berger Universal keyboard
WO2017019390A1 (en) * 2015-07-27 2017-02-02 Berger Jordan A Universal keyboard

Also Published As

Publication number Publication date
AU2001256576A1 (en) 2001-11-20
WO2001086920A3 (en) 2002-05-02

Similar Documents

Publication Publication Date Title
WO2001086920A2 (en) Apparatus and method for the kinematic control of hand-held devices
US10095316B2 (en) Scrolling and zooming of a portable device display with device motion
US10318017B2 (en) Viewing images with tilt control on a hand-held device
US20020158908A1 (en) Web browser user interface for low-resolution displays
US6400376B1 (en) Display control for hand-held data processing device
JP5815275B2 (en) Portable terminal device and program
EP1667471B1 (en) Portable communication device with three dimensional display
FI117488B (en) Browsing information on screen
JP5920869B2 (en) INPUT CONTROL DEVICE, INPUT CONTROL METHOD, AND INPUT CONTROL PROGRAM
US20030001863A1 (en) Portable digital devices
WO2010016409A1 (en) Input apparatus, input method, and recording medium on which input program is recorded
JPH07271505A (en) Image display controller
JP2008508628A (en) Pressure-controlled navigation on a touch screen
JP2003316502A (en) Terminal equipment and character input method
JP2003202620A (en) Image capturing device
WO2005096134A1 (en) A terminal for navigating documents
KR101139455B1 (en) Mobile Communication System and Controlling Method for the Same
KR101332708B1 (en) Mobile terminal and case with rear side auxiliary touch input device
EP1550026A1 (en) Cursor for electronic devices
JP6058900B2 (en) Information processing system, control device, image display method, and information processing program
EP2289063B1 (en) Information presentation device
KR100795450B1 (en) Image control
KR100747541B1 (en) Mobile Communication Terminal Of Displaying Object Dependent On Gravity
CN111373359A (en) Electronic device capable of changing display portion of image
JP5901295B2 (en) Mobile terminal device having enlarged display function, enlarged display control method, and program

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP