WO2007113828A2 - User interface functionalities - Google Patents

User interface functionalities Download PDF

Info

Publication number
WO2007113828A2
WO2007113828A2 PCT/IL2007/000433 IL2007000433W WO2007113828A2 WO 2007113828 A2 WO2007113828 A2 WO 2007113828A2 IL 2007000433 W IL2007000433 W IL 2007000433W WO 2007113828 A2 WO2007113828 A2 WO 2007113828A2
Authority
WO
WIPO (PCT)
Prior art keywords
input device
function
computer input
electromagnetic radiation
operative
Prior art date
Application number
PCT/IL2007/000433
Other languages
French (fr)
Other versions
WO2007113828A3 (en
Inventor
Sarah Michelle Lipman
Robert Michael Lipman
Ken Zwiebel
Original Assignee
Power2B Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Power2B Inc. filed Critical Power2B Inc.
Publication of WO2007113828A2 publication Critical patent/WO2007113828A2/en
Priority to PCT/IL2008/000355 priority Critical patent/WO2008111079A2/en
Publication of WO2007113828A3 publication Critical patent/WO2007113828A3/en
Priority to US15/130,899 priority patent/US10534496B2/en
Priority to US16/713,909 priority patent/US11586317B2/en
Priority to US18/111,252 priority patent/US20230205350A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03542Light pens for emitting or receiving light
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0428Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations

Definitions

  • the present invention relates to user interfaces generally and more particularly to user interface functionalities.
  • the present invention seeks to provide improved user interfaces and user interface functionalities, particularly useful for displays, such as those employed with computers, televisions, personal communicators and other mobile devices.
  • a computer input device including at least one sensor operative to sense at least one position coordinate of at least one object with respect to a user- selectable electromagnetic radiation impingement pattern and object position responsive circuitry responsive at least partially to the at least one position coordinate and to the position of the user-selectable electromagnetic radiation impingement pattern for actuating at least one interactive function.
  • the at least one sensor is operative to sense the position of the user-selectable electromagnetic radiation impingement pattern with respect to a surface of the computer input device.
  • the at least one sensor is operative to sense a metric of the separation between the at least one object and the user-selectable electromagnetic radiation impingement pattern.
  • the metric has a Z component and at least one of an X component and a Y component.
  • a computer input device including at least one sensor operative to sense at least two of X, Y, Z, theta and phi position coordinates of an object with respect to at least one input surface and object position responsive circuitry responsive at least partially to a Z position coordinate together with at least one of the X, Y, theta and phi position coordinates for actuating at least one interactive function.
  • the at least one input surface is a display surface.
  • the at least one input surface is at least partially outside a display surface.
  • the at least one interactive function includes one or more of the following functions: a selecting function, a zooming function, a lock-on function, a link actuating function, a muting function, a menu actuation function, a sub-menu actuation function, a map browsing function, an application launching function, a web navigation function, a document navigation function, a picture enlargement function, a mouseover function, a highlighting function, a cursor control function, an on-off function, a gaming function, a scrolling function, a handwriting recognition function, a rotation function, a page turning function and a panning function.
  • a selecting function a zooming function, a lock-on function, a link actuating function, a muting function, a menu actuation function, a sub-menu actuation function, a map browsing function, an application launching function, a web navigation function, a document navigation function, a picture enlargement function, a mouseover function, a highlighting
  • the at least one sensor is also operative to sense a sequence of the at least one position coordinate of the at least one object with respect to a user- selectable electromagnetic radiation impingement pattern.
  • the at least one sensor is operative to sense at least one position coordinate of at least one electromagnetic radiation emitting object with respect to a user-selectable electromagnetic radiation impingement pattern emitted therefrom.
  • the at least one sensor is operative to sense at least one position coordinate of at least one electromagnetic radiation reflecting object with respect to a user-selectable electromagnetic radiation impingement pattern reflected therefrom.
  • the at least one electromagnetic radiation emitting object is a remote control device including at least one collimated LED electromagnetic radiation emitter.
  • the at least one sensor is also operative to sense a sequence of the at least two of X, Y, Z, theta and phi position coordinates of an object with respect to at least one input surface.
  • the object is an electromagnetic radiation emitting object and the at least one sensor is operative to sense the at least two position coordinates with respect to a user-selectable electromagnetic radiation impingement pattern emitted from the object.
  • the object is an electromagnetic radiation reflecting object and the at least one sensor is operative to sense the at least two position coordinates with respect to a user-selectable electromagnetic radiation impingement pattern reflected from the object.
  • the electromagnetic radiation emitting object is a remote control device including at least one collimated LED electromagnetic radiation emitter.
  • the at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation reflecting objects.
  • the at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation reflecting objects.
  • the at least one sensor is operative to sense relative positions of at least two electromagnetic radiation reflecting objects.
  • the at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation emitting objects.
  • the at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation emitting objects.
  • the at least one sensor is operative to sense relative positions of at least two electromagnetic radiation emitting objects.
  • the at least one sensor is operative to sense at least one position coordinate of at least two fingers.
  • the at least one sensor is operative to sense changes over time of at least one position coordinate of at least two fingers.
  • the at least one sensor is operative to sense relative positions of at least two fingers.
  • FIGS. IA, IB, 1C, ID. IE, IF 5 IG and IH are simplified pictorial illustrations of user interface functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • FIGS. 2A, 2B 5 2C, 2D, 2E 5 2F 5 2G 5 2H 5 21, 2J 5 2K 5 2L 5 2M 5 2N 5 20 and 2P are simplified pictorial illustrations of browsing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • FIGS. 3A 5 3B 5 3C 5 3D, 3E 5 3F and 3 G are simplified pictorial illustrations of document viewing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • FIGs. 4A, 4B 5 4C 5 4D 5 4E and 4F are simplified pictorial illustrations of gaming functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 5A, 5B 5 5C, 5D 5 5E 5 5F 5 5G and 5H are simplified pictorial illustrations of contact management functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 6A 5 6B 5 6C 5 6D, 6E 5 6F and 6G are simplified pictorial illustrations of contact management functionality of a mobile device constructed and operative in accordance with another preferred embodiment of the present invention
  • Figs. 7A 5 7B 5 7C 5 7D 5 7E 5 7F and 7G are simplified pictorial illustrations of picture viewing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 8A 5 8B 5 8C 5 8D 5 8E 5 8F 5 8G and 8H are simplified pictorial illustrations of interactive television functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 9 A, 9B 5 9C, 9D, 9E, 9F and 9G are simplified pictorial illustrations of map browser functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 1OA 1OB, 1OC and 1OD are simplified pictorial illustrations of an ultra-mobile PC input device having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention
  • Fig. 11 is a simplified illustration of a remote control device useful in the embodiments of Figs. 1OC and 10D;
  • Figs. 12 A, 12B and 12C are simplified illustrations of point and highlight, cursor feedback and mouseover feedback functionalities constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 13A and 13B are simplified illustrations of point and click and z- axis click functionalities
  • Figs. 14A, 14B, 14C, 14D, 14E and 14F are simplified illustrations of various functionalities constructed and operative in accordance with a preferred embodiment of the present invention.
  • Figs. 15 A, 15B, 15C and 15D are simplified illustrations of functionality for gaming constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 16 A, 16B and 16C are simplified illustrations of interactive television functionality constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 17A, 17B and 17C are simplified illustrations of navigation functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • Figs. 18A and 18B are simplified illustrations of zoom and playback functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • Fig. 19 is a simplified illustration of handwriting recognition functionality constructed and operative in accordance with a preferred embodiment of the present invention
  • Figs. 2OA and 2OB are a simplified illustrations of simultaneous multiple input responsive functionalities constructed and operative in accordance with a preferred embodiment of the present invention
  • Fig. 21 is a simplified illustration of simultaneous multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • Fig. 22 is a simplified illustration of input size/shape responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention
  • Fig. 23 is a simplified illustration of multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • the present invention provides a computer input device including at least one sensor operative to sense at least one position coordinate of an object with respect to a user-selectable electromagnetic radiation impingement pattern and object position responsive circuitry responsive at least partially to the at least one position coordinate and to the position of the user-selectable electromagnetic radiation impingement pattern for actuating at least one interactive data selection function.
  • Figs. IA, IB, 1C, ID, IE, IF, IG and IH illustrate user interface functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 100 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 102 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 104 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 106 operatively associated with the mobile device 100.
  • Fig. IA shows pointer 106 aimed at keyboard 104 and not aimed at display screen 102, which display screen, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality.
  • display screen 102 typically displays an array of application launch icons 108.
  • Fig. IB shows pointer 106 located at a first distance Dl from display screen 102, such that an electromagnetic radiation beam 110 emitted thereby impinges on display screen 102 and defines an impingement pattern 112 that is generally centered on a first application launch icon 114, even though it may also partially impinge on other icons.
  • the functionality of the mobile device 100 causes icon 114 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 116.
  • Fig. 1C shows pointer 106 located at a second distance D2 from display screen 102, less than Dl, such that an impingement pattern 118 of electromagnetic radiation beam 110 is smaller than the impingement pattern 112 of electromagnetic radiation beam shown in Fig. IB, although the beam 110 remains generally centered on icon 114.
  • the functionality of the mobile device 100 causes icon 114 to appear in a further enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 120, which in this case is larger than the form designated by reference numeral 116. This enables icon 114 to be readily identified by a user.
  • the transition from the relative orientation of the pointer 106 and the display screen 102 in Fig. IB to that of Fig. 1C creates zooming-in feedback for the user.
  • Fig. ID shows pointer 106 located at a third distance D3 from display screen 102, less than D2, which preferably is selected as a locking threshold distance LT. It is seen that an impingement pattern 122 of electromagnetic radiation beam 110 is smaller than the impingement pattern 118 of electromagnetic radiation beam shown in Fig. 1C, although the beam 110 remains generally centered on icon 114.
  • the functionality of the mobile device 100 causes icon 114 to appear in a further enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 124, which in this case is larger than the form designated by reference numeral 120.
  • the size of icon 114 is locked, for example in the form indicated by reference numeral 124, and remains the same even if the pointer 106 is subsequently moved further away from the display screen 102, for example to a distance D4 which is greater than LT as shown in Fig. IE, or is subsequently aimed in a different direction.
  • a distance D4 which is greater than LT as shown in Fig. IE, or is subsequently aimed in a different direction.
  • the functionality of the mobile device 100 causes sub-icons 126, 128 and 130 to appear, preferably in propinquity to the icon 114 impinged upon by electromagnetic radiation beam 110.
  • Fig. IG shows pointer 106 located at a sixth distance D6 from display screen 102, which may be greater or less than or equal to D5, such that an impingement pattern 132 of electromagnetic radiation beam 110 is generally centered on one of the sub-icons, for example sub-icon 126.
  • the functionality of the mobile device 100 causes sub-icon 126 to appear in a visually sensibly emphasized form, as indicated by reference numeral 134. This enables sub-icon 126 to be readily identified by a user.
  • a selection function is actuated, which may be considered akin to the click of a conventional mouse.
  • Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • an icon such as icon 114 (Fig. IG) launches an application at an initial or default launch stage
  • sub-icons such as sub-icons 126, 128 and 130 (Fig. IG) may be used to both launch the application and to actuate a given functional stage thereof.
  • icon 114 represents an email application and if the user selects sub-icon 126, as illustrated in Fig. IG, the email application is launched and an email message template 136 is displayed, as shown in Fig. IH.
  • Figs. IA - IH may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described hereinbelow with reference to Figs. 2A - 23.
  • Figs. 2A, 2B, 2C, 2D, 2E, 2F, 2G, 2H, 21, 2J, 2K, 2L, 2M 5 2N, 20 and 2P which illustrate browsing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 200 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 202 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 204 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 206 operatively associated with the mobile device 200.
  • Fig. 2A shows pointer 206 aimed at display screen 202 and located at a distance DWl from display screen 202 as described hereinabove with reference to Figs. IA - IG, such that an impingement pattern 208 of an electromagnetic radiation beam 210 is generally centered on one of a plurality of sub-icons, for example sub-icon 216.
  • the functionality of the mobile device 200 causes sub-icon 216 to appear in a visually sensibly emphasized form, as indicated by reference numeral 218.
  • a selection threshold ST or touches the display screen 202 a selection function is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • the sub-icons may be used to launch a web browser application showing various user-selectable, pre-selected web pages. For example, if a user selects sub-icon 216, the web browser is launched and the web page of CNN.com appears. As a further example, if sub-icon 220 is selected the web browser is launched and the web page of Google.com is loaded and if sub-icon 222 is selected, the web browser is launched and the web page ofUSPTO.gov is fetched.
  • Fig. 2B shows the result of selection of sub-icon 216.
  • Fig. 2C shows pointer 206 located at a distance DW3 from display screen 202, such that an electromagnetic radiation beam 210 emitted thereby impinges on display screen 202 and defines an impingement pattern 232 having a center, which preferably is indicated by a cursor 234 or other visual indicator.
  • Fig. 2D shows pointer 206 located at a distance DW4, less than DW3, from display screen 202. It is seen that an impingement pattern 236 of electromagnetic radiation beam 210 is smaller than the impingement pattern 232 of electromagnetic radiation beam 210 shown in Fig. 2C. It is seen that the image of the CNN.com web page is enlarged and the portion thereof designated by the cursor 234 remains visible.
  • the transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2C to that of Fig. 2D creates zooming-in feedback for the user. Conversely, the transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2D to that of Fig. 2C creates zooming-out feedback for the user.
  • Fig. 2E shows pointer 206 located at a distance DW5 from display screen 202, which is slightly greater than a predetermined locking threshold distance LT. It is seen that an impingement pattern 238 of electromagnetic radiation beam 210 is smaller than the impingement pattern 236 of electromagnetic radiation beam 210 shown in Fig. 2D. It is seen that the image of the CNN.com web page is further enlarged and the portion designated by the cursor 234 remains visible. The transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2D to that of Fig. 2E creates further zooming-in feedback for the user.
  • Fig. 2F shows pointer 206 located at a distance DW6 from display screen
  • the impingement pattern 240 of electromagnetic radiation beam 210 is smaller than the impingement pattern 238 of electromagnetic radiation beam 210 shown in Fig. 2E. It is seen that the image of the CNN.com web page is further enlarged and the frame which encloses the portion of the web page designated by the cursor 234 preferably generally fills the display screen 202.
  • Reference numeral 242 indicates filling the width of the screen with an image frame by enlarging or reducing the image as necessary, not exceeding predetermined maximum or minimum percentage.
  • Reference numeral 244 indicates filling the width of the screen with a text frame, which can be vertically scrolled. The font size of the text is determined in accordance with pre-defined parameters. Right/left and up/down scrolling are available as appropriate, as is described hereinbelow.
  • the degree of enlargement and the screen view area both locked, for example in the forms indicated by reference numerals 242 and 244, and remain the same even if the pointer 206 is subsequently moved further away from the display screen 202, for example to a distance DW7 which is greater than LT as shown in Fig. 2G, or is subsequently aimed in a different direction.
  • the browser functionality is in a locked state, as described hereinabove, if the cursor 234 is located in propinquity to a hyperlink, as shown in Fig.
  • the link may appear in a visually sensibly emphasized form, as indicated by reference numeral 246, enabling the link to be readily identified by a user.
  • an additional selection function is actuated, which may be considered akin to the click of a conventional mouse.
  • Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • Figs. 2J - 2P illustrate tool-bar/tab functionality in a web-browsing environment, such as that illustrated in Figs. 2A - 21.
  • Fig. 2J illustrates a stage in web-browsing similar to that shown in Fig. 2E, Fig. 2J being distinguished from Fig. 2E in that a tool bar 250 including a plurality of icons, preferably including a zoom navigator icon 252, is provided.
  • Other functional icons which may be provided include, for example, an icon for restoring an image to full-page view, an icon for going back a page, an icon for going forward a page, an icon for navigating to a predetermined web page, an icon which creates a bookmark and an icon navigating to a selectable list of bookmarked web addresses.
  • Fig. 2K shows zoom navigator icon 252 (Fig. 2J), being impinged upon by the electromagnetic radiation beam 210 having an impingement pattern 254 when the pointer 206 is at a distance DW9 from display screen 202. This impingement causes the appearance of icon 252 (Fig. 2J) to be enlarged, as designated by reference numeral 256.
  • Fig. 2M shows the pointer 206 moved even closer to display screen 202, to a distance DWI l, which is equal to or less than an actuating threshold AT.
  • This positioning of pointer 206 actuates functionality of the zoom navigator icon 252, which, for example, causes maximum zooming out of the displayed web page. Further in or out zooming can readily be achieved by aiming the pointer 206 at the web page and changing the distance between the pointer 206 and the screen 202.
  • Fig. 2N shows impingement of the electromagnetic radiation beam 210 on a search engine tab, such as a GOOGLE® tab 266 (Fig. 2M), causing the appearance of the tab to be enlarged, as designated by reference numeral 268.
  • a search engine tab such as a GOOGLE® tab 266 (Fig. 2M)
  • Fig. 2O shows the pointer 206 moved even closer to display screen 202, to a distance DW12, which is equal to or less than actuating threshold AT.
  • This positioning of pointer 206 actuates the functionality of the search engine tab 266, which, for example, launches the GOOGLE search engine, as designated by reference numeral 270.
  • Fig. 2P shows impingement of the electromagnetic radiation beam 210 on a multi-function bookmarks tab 272 (Fig. 20) which causes a sub-menu 274 to appear on display 202.
  • the above-mentioned functionalities allow icons or buttons to be unobtrusively present when not in use, and grow and gain prominence in the display as desired.
  • the icons are sufficiently visibly enlarged to enable greater user discrimination, and to determine more easily if the icon does in fact represent the desired function.
  • the icons are very usable. This also allows a greater number of functional icons to be practically available in a limited space. It is appreciated that the functionality shown in Figs. 2A - 2P enables convenient viewing of a web page without requiring reformatting of the web page to optimally fit a mobile device or provision of a pre-optimized web page.
  • Figs. 2A - 2P may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - IH and 3A - 23.
  • Figs. 3A, 3B, 3C 5 3D, 3E 5 3F and 3G illustrate document viewing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 300 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 302 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 304 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 306 operatively associated with the mobile device 300.
  • Fig. 3 A shows pointer 306 aimed at display screen 302 and located at a distance DVl from display screen 302, such that an impingement pattern 308 of an electromagnetic radiation beam 310 is generally centered on one of a plurality of sub- icons, for example sub-icon 316.
  • the functionality of the mobile device 300 causes sub-icon 316 to appear in a visually sensibly emphasized form, as indicated by reference numeral 318.
  • a selection threshold STor touches the display 302
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • sub- icons such as sub-icons 316, 320 and 322 (Fig.
  • a document viewing application may be used to launch a document viewing application showing various user-selectable, pre-selected documents. For example, if a user selects sub-icon 316, the document viewer is launched and document associated with the selected sub-icon appears.
  • Fig. 3B shows the result of selection of sub-icon 316. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
  • locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
  • Figs. 3 C and 3D illustrate forward page turning functionality which is preferably provided in accordance with a preferred embodiment of the present invention.
  • a relatively fast forward page turning function is provided, typically going from page 1, as shown in Fig. 3B, to page 10, as shown in Fig. 3C.
  • Fig. 3C illustrates forward page turning functionality
  • a relatively slow forward page turning function is provided, typically going from page 1, as shown in Fig. 3B, to page 2, as shown in Fig. 3D.
  • a hook pattern designated by reference numeral 332 provides a backward page turning functionality.
  • the pointer distance difference functionality described above with reference to Figs. 3 C and 3D preferably also is operative for the backward page turning functionality of Fig. 3E and other types of pattern dependent functionalities.
  • Pointer motion pattern functionalities of the type described hereinabove with reference to Figs. 3 C - 3E may use any suitable type of pattern recognition software, such as, for example, Graffiti TM, which is commercially available from U.S. Robotics of Schaumburg, IL.
  • Figs. 3F and 3G illustrate scrolling functionality which is preferably provided in accordance with a preferred embodiment of the present invention.
  • Fig. 3F when the pointer 306 is located at a relatively large distance from the display screen 302 such as DV5, and is moved upward or downward along the page, as designated respectively by reference numerals 334 and 336, a relatively fast upward or downward scrolling function is provided.
  • the speed of the scrolling is preferably dependent on the distance of the pointer 306 from the display screen 302, preferably such that when the pointer 306 is closer, the scrolling is slower.
  • Fig. 3G it is seen that upward and downward scrolling hot spots, respectively designated by reference numerals 338 and 340 may be provided and may be visible or invisible. Impingement of an electromagnetic radiation beam on one of the hot spots 338 or 340 provides scrolling in a corresponding direction. It is appreciated that scrolling hot spots are not necessarily limited to up and down scrolling hot spots but may include side-to-side and diagonal and any direction hot spots as well.
  • the speed of scrolling may be responsive to the distance of the pointer 306 from the screen 302, such as being a function of the size of the impingement location area, such as that designated by reference numeral 342, which produces downward scrolling as indicated by arrow 344.
  • speed of a function is a positive function of the closeness of the pointer to the screen.
  • Figs. 3 A - 3 G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 2P and 4A - 23.
  • Figs. 4A, 4B, 4C, 4D, 4E and 4F are illustrations of gaming functionality of a gaming device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the gaming device is a mobile gaming device 400, such as a Playstation Portable Gaming
  • the gaming device 400 is retrofitted by having mounted thereon a clip- on attachment 401 including a transparent plate 402 having sensors (not shown) associated therewith and electronic circuitry (not shown).
  • the transparent plate 402 of the clip-on attachment 401 preferably overlies a display screen (not shown) of the gaming device 400.
  • the electronic circuitry is preferably connected to circuitry of the gaming device via a USB connection 403.
  • the electronic circuitry of clip-on attachment 401 preferably has implemented therein the electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with the transparent plate 402 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size described hereinabove with reference to Figs. IA - 3G.
  • a keyboard 404 may be provided as part of the gaming device 400 but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 406 operatively associated with the gaming device 400.
  • Figs. 4A and 4B together illustrate a shooting functionality which becomes more focused and intense as pointer 406 moves closer to transparent plate 402. It is appreciated that any other one or more suitable variable, such as action speed, field of view, type of weapon and angle of attack may be a function of distance of the pointer 406 from the screen.
  • Fig. 4A shows pointer 406 aimed at the transparent plate 402 such that shooting is directed in the direction of an electromagnetic radiation beam 410 emitted by pointer 406.
  • Figs. 4B and 4C together illustrate an aiming aspect of the shooting functionality produced by reorienting the pointer 406 with respect to the transparent plate 402.
  • Figs. 4D and 4E illustrate a sword fighting functionality, wherein the Z- axis movement of pointer 406 towards and away from the transparent plate 402 is expressed in corresponding Z-axis movement of a sword in virtual 3-dimensional space.
  • Figs. 4E and 4F together illustrate a three-dimensional sword motion aspect of the sword fighting functionality which is produced by reorienting the pointer 406 with respect to the transparent plate 402 in three dimensions.
  • the distance and angular orientation of the pointer 406 preferably are sensible by the gaming device 400 based on the shape and size of the impingement pattern of the electromagnetic radiation beam 410 on transparent plate 402. It is appreciated that movement of the pointer 406 in one or more direction may be employed either for corresponding movement of an object in virtual space or for any other functionality.
  • Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
  • locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
  • tool-bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided.
  • Figs. 4A - 4F may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. 1 A - 3 G and 5A - 23.
  • Figs. 5A, 5B, 5C, 5D, 5E, 5F, 5G and 5H are illustrations of contact management functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 500 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 502 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 504 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 506 operatively associated with the mobile device 500.
  • Fig. 5A shows pointer 506 aimed at display screen 502 and located at a distance CMl from display screen 502, such that an impingement pattern 508 of an electromagnetic radiation beam 510 is generally centered on a contact manager icon 516.
  • the functionality of the mobile device 500 causes icon 516 to appear in a visually sensibly emphasized form, as indicated by reference numeral 518.
  • the pointer 506 is located at a distance CM2 from display screen 502 which is equal to or less than a selection threshold ST, or touches the display 502, a selection function is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. For example, if a user selects icon 516, the contact manager is launched.
  • Fig. 5B shows the result of selection of icon 516. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
  • locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
  • Fig. 5C illustrates highlighting a contact entry line by aiming the pointer 506 such that electromagnetic radiation beam 510 impinges thereon, when the pointer 506 is located at a distance CM3 from the display screen 502.
  • Fig. 5D shows the pointer 506 aimed at the same location and now located at a distance CM4 from display screen 502, which is equal to or less than a predetermined drop list threshold DLT.
  • This causes a sub-menu 520 to appear on display screen 502.
  • the sub-menu 520 typically includes contact details corresponding to a given contact entry line. These may include, for example, an email address, a fax number, a mobile telephone number, a VOIP number and a home page URL. Pointing the pointer 506 at one of the items on the sub-menu 520 results in the highlighting of that item, as shown in Fig. 5E.
  • the pointer 506 is brought even closer to the display screen 502, such as to a distance CM5, equal to or less than selection threshold ST, a function associated with that item is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • Fig. 5F it is seen that pointer 506 is aimed at a contact person's name and the entire contact entry line illuminated or otherwise highlighted, when the pointer is located at a distance CM6 from the display screen 502.
  • Fig. 5G shows the pointer aimed at the same location and now located at a distance CM7 from the display screen 502, which is equal to or less than a predetermined expanded data threshold EDT.
  • EDT expanded data threshold
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • the function is display of a V-card associated with the contact.
  • Figs. 5A - 5H may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 4F and 6A - 23.
  • Figs. 6A, 6B, 6C, 6D, 6E, 6F and 6G are illustrations of contact management functionality of a mobile device constructed and operative in accordance with another preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 600 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 602 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 604 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 606 operatively associated with the mobile device 600.
  • Fig. 6A shows pointer 606 aimed at display screen 602 and located at a distance VMl from display screen 602 such that an impingement pattern 608 of an electromagnetic radiation beam 610 is generally centered on a contact manager icon 616.
  • the functionality of the mobile device 600 causes icon 616 to appear in a visually sensibly emphasized form, as indicated by reference numeral 618.
  • the pointer 606 when, as shown in Fig. 6B, the pointer 606 is located at a distance VM2 from display screen 602 which is equal to or less than a selection threshold ST, or touches the display 602, a selection function is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • the contact manager is launched.
  • Fig. 6B shows the result of selection of icon 616, which is a contact word entry form.
  • Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided. Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • Fig. 6C illustrates entry of a contact word, BURGER, and aiming the pointer such that electromagnetic radiation beam 610 impinges thereon, when the pointer is located at a distance VM3 from the display screen 602.
  • Fig. 6D shows the pointer 606 aimed at the same location and now located at a distance VM4 from display screen 602, which is equal to or less than a predetermined selection threshold ST.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • the arrangement of contact identifiers is preferably of the type provided by ThinkMap Inc. as described at www.thinkmap.com.
  • the contact identifiers are typically grouped as to their general relationship with the contact word.
  • Elizabeth Burger, Sally Burger, Nathan Burger, Jed Burger appear as possibly related persons, and Burger King, McDonalds and Wendy's appear as burger purveyors and Burger, Idaho; Hamburg, Germany and Burger Ave., Passaic New Jersey, appear as geographical designations.
  • Pointing the pointer 606 at one of the contact identifiers results in the highlighting of that item, as shown in Fig. 6E. If, while pointing at the same location, the pointer 606 is brought even closer to the display screen 602, such as to a distance VM5, a function associated with that contact identifier is actuated. For example, if the pointer is aimed at Burger Avenue, as seen in Fig. 6F, Burger Avenue is placed at the center of the screen and arranged around it are contact identifiers associated with Burger Avenue, such as the names of various businesses located on Burger Avenue and names of adjacent streets. The other contact identifiers may still appear on the screen, typically in a very small, but zoomable, format. Referring now to Fig. 6G, which shows pointer 606 aimed at Burger
  • Fig. 6G the functionality of Figs. 6 A - 6G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. 1 A - 5H and 7A - 23.
  • Figs. 7A, 7B, 7C, 7D, 7E, 7F and 7G 5 illustrate picture viewer functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 700 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 702 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 704 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • Fig. 7A shows pointer 706 aimed at keyboard 704 and not aimed at display screen 702, which display screen, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality.
  • display screen 702 typically displays an array of application launch icons 708.
  • FIG. 7B shows pointer 706 located at a first distance PVl from display screen 702, such that an electromagnetic radiation beam 710 emitted thereby impinges on display screen 702 and defines an impingement pattern 712 that is generally centered on a first application launch icon 714, even though it may also partially impinge on other icons.
  • the functionality of the mobile device 700 causes icon 714 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 716.
  • icon 714 is a picture viewer application icon.
  • the pointer 706 is located at a distance PV2 from display screen 702 which is equal to or less than a selection threshold ST or touches the display 702, a selection function is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • Fig. 7B the picture viewer is launched.
  • Fig. 7C shows the result of selection of icon 714, which is an array of picture thumbnails 718.
  • Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
  • locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
  • tool bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided.
  • Fig. 7D illustrates pointing at one of the picture thumbnails such that electromagnetic radiation beam 710 impinges thereon, when the pointer is located at a distance PV3 from the display screen 702, thus producing a slight enlargement of the picture thumbnail on which the electromagnetic radiation beam 710 impinges and optionally display an identifier of the picture thumbnail.
  • Fig. 7E shows the pointer 706 aimed at the same location and now located at a distance PV4 from display screen 702, which produces yet further enlargement of the picture thumbnail 718.
  • the transition from the relative orientation of the pointer 706 and the display screen 702 in Fig. 7D to that of Fig. 7E creates zooming- in feedback for the user.
  • the transition from the relative orientation of the pointer 706 and the display screen 702 in Fig. 7E to that of Fig. 7D creates zooming-out feedback for the user. It is appreciated that the ability to quickly enlarge and reduce pictures on the screen allows for rapid review of a large number of possibly similar pictures without requiring individual selection and exit from each picture.
  • Fig. 7E shows the pointer 706 aimed at the same location and now located at a distance PV4 from display screen 702, which produces yet further enlargement of the picture thumbnail 718.
  • FIG. 7F shows the pointer 706 aimed at the same location and now located at a distance PV5 from display screen 702, which is equal to or less than a predetermined locking distance threshold LT, which locks the extent of enlargement of the picture thumbnail 718 notwithstanding further movement of the pointer.
  • a drop-down menu 720 is displayed, providing options for various picture related functions, such as sending via MMS, sending via email, printing and editing.
  • Fig. 7G shows pointer 706 located at a distance PV6 from display screen 702, preferably less than PV5, which preferably is a selection threshold distance ST.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. It is seen that the impingement pattern 722 of electromagnetic radiation beam 710 is smaller than the impingement pattern of electromagnetic radiation beam shown in Fig. 7F.
  • a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback.
  • the pointer is located at distance PV6 and is aimed at a menu item on the drop-down-menu 720, the corresponding function is actuated. For example, if the printing function is selected, the picture is downloaded to a printer.
  • Figs. 7A - 7G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 6G and 8A - 23.
  • Figs. 8 A, 8B, 8C, 8D, 8E, 8F, 8G and 8H illustrate interactive television functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 800 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 802 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 804 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 806 operatively associated with the mobile device 800.
  • Fig. 8A shows pointer 806 aimed at keyboard 804 and not aimed at display screen 802, which display screen 802, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality.
  • display screen 802 typically displays an array of application launch icons 808.
  • Fig. 8B shows pointer 806 located at a first distance ITl from display screen 802, such that an electromagnetic radiation beam 810 emitted thereby impinges on display screen 802 and defines an impingement pattern 812 that is generally centered on a first application launch icon 814, even though it may also partially impinge on other icons.
  • the functionality of the mobile device 800 causes icon 814 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 816.
  • icon 814 is an interactive television application icon.
  • the pointer 806 when, as shown in Fig. 8C, the pointer 806 is located at a distance IT2 from display screen 802 which is equal to or less than a selection threshold ST or touches the display 802, a selection function is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • Fig. 8B For example, if a user selects icon 814 (Fig. 8B), the interactive television viewer is launched.
  • Fig. 8C shows the result of selection of icon 814, which is a television picture. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs.
  • locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
  • Fig. 8D illustrates pointing at a location 816 on the television picture such that electromagnetic radiation beam 810 impinges thereon, when the pointer is located at a distance IT3 from the display screen
  • the visibly sensible indication only appears on regions of the picture which have a selectably actuatable functionality.
  • the selectably actuatable functionality may be, for example, display of related information, such as player statistics, enhanced detail, or a link to a related web site.
  • Fig. 8E illustrates additional functionality wherein an icon 818 is visibly or invisibly superimposed on the television picture and impingement of the electromagnetic radiation beam 810 thereon causes a drop-down menu 820 to be displayed, providing options for various content related functions, such as purchasing a product, placing a bet, recording content, requesting further information and linking to a related web site.
  • Fig. 8F shows pointer 806 located at a distance IT4 from display screen 802, preferably less than IT3, which preferably is a selection threshold distance ST. It is seen that the impingement pattern 822 of electromagnetic radiation beam 810 is smaller than the impingement pattern of electromagnetic radiation beam shown in Fig. 8D.
  • a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback. Alternatively, selection may be accomplished by a predetermined change in the Z-distance of the pointer from the screen.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • Fig. 8G shows the pointer 806 aimed at location 816 and now located at a distance IT5 from display screen 802, which produces enlargement of the television picture in a way such that the impinged upon location remains visible.
  • the transition from the relative orientation of the pointer 806 and the display screen 802 in Fig. 8D to that of Fig. 8 G creates zooming-in feedback for the user.
  • the transition from the relative orientation of the pointer 806 and the display screen 802 in Fig. 8G to that of Fig. 8D creates zooming-out feedback for the user.
  • Fig. 8H shows the pointer 806 aimed at location 816 and now located at a distance IT6 from display screen 802, which is equal to or less than a predetermined locking distance threshold LT, which locks the extent of enlargement of the television picture notwithstanding further movement of the pointer.
  • FIG. 8A - 8H enables interactive television operation with a minimum or zero buttons on a user control.
  • Figs. 8A - 8H may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 7G and 9A - 23.
  • Figs. 9A, 9B 5 9C, 9D, 9E, 9F and 9G illustrate user interface functionality of a mobile device constructed and operative in accordance with a further preferred embodiment of the present invention.
  • the mobile device is a mobile computer and/or communicator 900 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 902 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size.
  • a keyboard 904 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention.
  • an electromagnetic radiation emitting pointer 906 operatively associated with the mobile device 900.
  • Fig. 9A shows pointer 906 aimed at keyboard 904 and not aimed at display screen 902, which display screen, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality.
  • display screen 902 typically displays an array of application launch icons 908.
  • Fig. 9B shows pointer 906 located at a first distance MBl from display screen 902, such that an electromagnetic radiation beam 910 emitted thereby impinges on display screen 902 and defines an impingement pattern 912 that is generally centered on a first application launch icon 914, even though it may also partially impinge on other icons.
  • the functionality of the mobile device 900 causes icon 914 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 916.
  • icon 914 is a map browser application icon.
  • the pointer 906 is located at a distance MB2 from display screen 902 which is equal to or less than a selection threshold ST or touches the display 902, a selection function is actuated.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • the map browser is launched.
  • Fig. 9C shows the result of selection of icon 914, which is an extremely general map or aerial view 920, such as a map of North America which may be superimposed over a corresponding satellite image, typically shown in thumbnail size. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
  • locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
  • hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
  • tool bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided.
  • Fig. 9D illustrates pointing at a region on the map or image such that electromagnetic radiation beam 910 impinges thereon, when the pointer is located at a distance MB3 from the display screen 902, thus producing zooming in on the selected region of the map on which the electromagnetic radiation beam 910 impinges and optionally displaying appropriate text or icons, which identify items of interest, such as for example, historical sites, gas stations and shops or tagged locations.
  • Fig. 9E shows the pointer 906 aimed at the same location and now located at a distance MB4 from display screen 902, which produces yet further zooming in.
  • the transition from the relative orientation of the pointer 906 and the display screen 902 in Fig. 9E to that of Fig. 9D creates zooming-out feedback for the user.
  • the angle at which the pointer 906 is positioned with respect to the screen 902 may be used for selecting or controlling the angle of view of a map or image. It is appreciated that the angle of the pointer 906 is preferably sensible as the shape and orientation of an impingement pattern on the screen 902.
  • Fig. 9F shows the pointer 906 aimed at the same location and now located at a distance MB5 from display screen 902, which is equal to or less than predetermined locking distance threshold LT, which locks the extent of enlargement of the picture thumbnail notwithstanding further movement of the pointer.
  • a drop-down menu 922 is displayed, providing options for various location-related functions, such as dialing a telephone number of a place of business indicated on the map, obtaining directions to a historical site, finding the closest gas station and obtaining location-dependent coupons or sales offers.
  • Fig. 9G shows pointer 906 located at a distance MB6 from display screen 902, preferably less than MB5, which preferably is a selection threshold distance ST. It is seen that the impingement pattern 924 of electromagnetic radiation beam 910 is smaller than the impingement pattern of electromagnetic radiation beam shown in Fig. 9F.
  • a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback.
  • the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
  • the corresponding function is actuated. For example, if telephone dialing function is selected, a corresponding telephone number is dialed.
  • Figs. 9A - 9G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 8H and 1OA - 23.
  • Figs. 1OA, 1OB, 1OC and 1OD illustrate an ultra-mobile PC input device having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • an ultra-mobile PC input device 1000 such as an ASUS R2H, commercially available from ASUSTeK Computer Inc. of Taiwan, is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the ultra-mobile PC input device 1000 may be used together with a light emitting stylus 1002 of the type described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S.
  • Stylus 1002 produces an impingement pattern 1003, whose location, size and shape may be detected.
  • device 1000 may be equipped with an IR electromagnetic radiation source 1004, providing IR radiation in a region 1006 generally overlying a display screen 1008 thereof.
  • IR electromagnetic radiation source 1004 may be provided in various alternative embodiments as described in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1010, seen in enlargement II or a user's finger 1012, seen in enlargement III.
  • Stylus 1010 produces an impingement pattern 1013, whose location, size and shape may be detected.
  • Finger 1012 produces an impingement pattern 1014, whose location, size and shape may be detected.
  • a tablet PC input device 1020 such as an STYLISTIC ST5112 commercially available from Fujitsu, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • the tablet PC input device 1020 may be used together with a light emitting stylus 1022 of the type described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S.
  • Stylus 1022 produces an impingement pattern 1023, whose location, size and shape may be detected.
  • device 1020 may be equipped with an IR electromagnetic radiation source 1024, providing IR radiation in a region 1026 generally overlying a display screen 1028 thereof.
  • the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1030, seen in enlargement II or a user's finger 1032 seen in enlargement III.
  • Stylus 1030 produces an impingement pattern 1033, whose location, size and shape may be detected.
  • Finger 1032 produces an impingement pattern 1034, whose location, size and shape may be detected.
  • Fig 1OC shows a media display device 1040, such as an AQUOS 46"
  • LCD HDTV commercially available from Sharp or a PANASONIC TH-58PX600U plasma monitor, commercially available from Panasonic, configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • the media display device 1040 may be used together with a remote control unit 1042, such as that described hereinbelow with reference to Fig. 11.
  • Remote control unit 1042 produces an impingement pattern 1043, whose location, size and shape may be detected.
  • device 1040 may be equipped with an IR electromagnetic radiation source 1044, providing IR radiation in a region 1046 generally overlying a display screen 1048 thereof.
  • the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1050, seen in enlargement II or a user's finger 1052 seen in enlargement III.
  • Stylus 1050 produces an impingement pattern 1053, whose location, size and shape may be detected.
  • Finger 1052 produces an impingement pattern 1054, whose location, size and shape may be detected.
  • an interactive wall sized media display device 1060 such as for example, an PRODISC HOLOSCREEN or a PRODISC VISION 2000, commercially available from Prodisc Technology Incorporated, a TFT-LCD WALL, commercially available from Bomoon Electronics Co.
  • the interactive wall sized media display device 1060 may be used together with a remote control unit 1062, such as that described hereinbelow with reference to Fig. 11.
  • Remote control unit 1062 produces an impingement pattern 1063, whose location, size and shape may be detected.
  • device 1060 may be equipped with an IR electromagnetic radiation source 1064, providing IR radiation in a region 1066 generally overlying a display screen 1068 thereof.
  • the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1070, seen in enlargement II or a user's finger 1072, seen in enlargement III.
  • Stylus 1070 produces an impingement pattern 1073, whose location, size and shape may be detected.
  • Finger 1072 produces an impingement pattern 1074, whose location, size and shape may be detected.
  • Figs. 1OA - 1OD may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 9G and ll - 23.
  • Fig. 11 schematically illustrates a remote control unit 1100, which may be employed in the embodiments of Figs. 1OC and 1OD described hereinabove.
  • the remote control unit preferably comprises a housing 1102, on an outer surface 1104 of which is provided a finger operated actuation button 1106.
  • the actuation button 1106 operates electromagnetic radiation emitting apparatus 1108, which may be of various forms, some examples of which are shown in enlargements I, II, III, IV and V.
  • Enlargement I schematically shows a laser light emitter 1110, which may preferably be constructed and operative in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027; filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
  • Enlargement II illustrates the use of a LED 1112, with which is associated a collimator 1114.
  • Enlargement III illustrates the use of a LED 1116 together with one or more lenses 1118.
  • Enlargement IV illustrates the use of a collimated LED 1120, such a LED having a lens or other field limiting functionality that creates a directional and somewhat convergent propagation pattern.
  • Enlargement V illustrates the use of a LED 1122 associated with mirrors 1124.
  • Fig. 11 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 1OD and 12A - 23.
  • FIGs. 12 A, 12B and 12C are simplified illustrations of point and highlight, cursor feedback and mouseover feedback functionalities constructed and operative in accordance with a preferred embodiment of the present invention.
  • Figs. 12A - 12C illustrate an LCD type flat panel display. It is appreciated that flat panel displays of this type typically are constructed with anti-glare surface layers and thus do not readily reflect impinging radiation of the type emitted by laser pointers.
  • Fig. 12A shows the provision of a readily viewable cursor indication 1200 at a location corresponding to the location of a user-selectable electromagnetic radiation impingement pattern 1201 on a flat panel display 1202.
  • This functionality is provided by circuitry associated with the flat panel display 1202, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • a remote control unit 1204 of the general type described hereinabove with reference to Fig. 11, is employed together with the flat panel display 1202 in order to provide the cursor indication 1200.
  • utilization circuitry receiving inputs indicating the location of the impingement pattern 1201 and optionally the distance of the remote control unit 1204, generates cursor indication 1200, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1201 and whose size may be a function of the distance of the remote control unit 1204 from the flat panel display 1202 or may be a function of any other suitable user-controllable variable.
  • cursor indication 1200 As indicated in enlargements II and III respectively, light reflected from an object, such a stylus 1206 (enlargement II) or a user's finger or hand 1208 (enlargement III) impinges on the flat panel display 1202 in order to provide the cursor indication 1200.
  • Utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1201 and optionally the distance of the object, generates cursor indication 1200, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1201 and whose size may be a function of the distance of the object from the flat panel display 1202 or may be a function of any other suitable user-controllable variable.
  • the light reflected from the stylus 1206 or the user's finger or hand 1208 may be ambient light or may, for example, originate from an IR light source 1210 which illuminates a region 1212 in front of the flat panel display 1202.
  • Fig. 12B shows the provision of a readily viewable trajectory indication 1220 representing movement of the location of a user-selectable electromagnetic radiation impingement pattern 1221 on a flat panel display 1222.
  • This functionality is provided by circuitry (not shown) associated with the flat panel display 1222, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • a remote control unit 1224 of the general type described hereinabove with reference to Fig. 11, is employed together with the flat panel display 1222 in order to provide the trajectory indication 1220.
  • Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1221 and optionally the distance of the remote control unit 1224, generates trajectory indication 1220, which corresponds generally to the path of the electromagnetic radiation impingement pattern 1221 on the flat panel display 1222 and whose thickness, size or color may be a function of the distance of the remote control unit 1224 from the flat panel display 1222 or may be a function of any other suitable user-controllable variable.
  • the trajectory indication 1220 may be processed by the utilization circuitry employing paint or photo retouching software, such as ADOBE ILLUSTRATOR AND ADOBE PHOTOSHOP or handwriting recognition algorithms, such as that available to the trade from MyScript, and implemented commercially in the Nokia Digital Pen and the Logitech Digital Pen.
  • paint or photo retouching software such as ADOBE ILLUSTRATOR AND ADOBE PHOTOSHOP
  • handwriting recognition algorithms such as that available to the trade from MyScript, and implemented commercially in the Nokia Digital Pen and the Logitech Digital Pen.
  • the trajectory indication functionality is applicable to display screens of all sizes, for example those used in mobile communicators and ultra-mobile PCs.
  • the trajectory information and/or the processed data arising therefrom may be transmitted, using conventional technology, to another device or display. Alternatively, a selected portion or the entirety of a displayed image may be moved on the display in a manner corresponding to the trajectory of the remote control unit 1224.
  • Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1221 and optionally the distance of the stylus 1226 or the finger or hand 1228, generates trajectory indication 1220, which corresponds generally to the path of the electromagnetic radiation impingement pattern 1221 on the flat panel display 1222 and whose thickness, size or color may be a function of the distance of the stylus 1226 or the finger or hand 1228 from the flat panel display 1222 or may be a function of any other suitable user-controllable variable.
  • the light reflected from the stylus 1226 or the user's finger or hand 1228 may be ambient light or may, for example, originate from an IR light source 1230 which illuminates a region 1232 in front of the flat panel display 1222.
  • Fig. 12C shows the provision of a readily viewable mouseover indication 1240 at a location corresponding to the location of user-selectable electromagnetic radiation impingement pattern 1241 on a flat panel display 1242.
  • the mouseover indication is, for example, a black/white reversal of a selected icon.
  • the moveover indication may be any other suitable type of visually sensible change or auditory feedback.
  • circuitry associated with the flat panel display 1242 which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
  • a remote control unit 1244 of the general type described hereinabove with reference to Fig. 11, is employed together with the flat panel display 1242 in order to provide the mouseover indication 1240.
  • Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1241 and optionally the distance of the remote control unit 1244, generates mouseover indication 1240, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1241, whose size may be a function of the distance of the remote control unit 1244 from the flat panel display 1242 or may be a function of any other suitable user-controllable variable.
  • Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1241 and optionally the distance of the stylus 1246 or the finger or hand 1248, generates mouseover indication 1240, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1241 and whose size may be a function of the distance of the stylus 1246 or the finger or hand 1248 from the flat panel display 1242 or may be a function of any other suitable user-controllable variable.
  • the light reflected from the stylus or the user's finger or hand may be ambient light or may, for example, originate from an IR light source 1250 which illuminates a region 1252 in front of the flat panel display 1242.
  • Figs. 12A - 12C may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 11 and 13A - 23.
  • Figs. 13A and 13B are simplified illustrations of point and click and z-axis click functionalities constructed and operative in accordance with a preferred embodiment of the present invention.
  • Figs. 13 A and 13B illustrate an ultra-mobile PC input device 1300 of the type described hereinabove with reference to Fig. 1OA, having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • Fig. 13 A shows the provision of object position actuated point and click functionality at the location of a user-selectable electromagnetic radiation impingement pattern 1301 on an ultra-mobile PC input device 1300.
  • This functionality is provided by circuitry preferably incorporated in the device 1300, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • a light emitting stylus 1302 is employed together with the ultra-mobile PC input device 1300 in order to provide point functionality.
  • Utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1301 and the distance of the light emitting stylus 1302, optionally generates a visually sensible pointing indication 1304, which corresponds generally to the location of the electromagnetic radiation impingement pattern 1301 on the ultra-mobile PC input device 1300.
  • the presence of the pointing indication 1304 at an actuatable zone may produce a visually sensible mouseover effect, for example, reversal of white/black or a change of color of the pointing indication 1304.
  • a change in the position of the light emitting stylus 1302, such as bringing the stylus closer to the ultra-mobile PC device 1300, produces a click functionality, such as, for example, enlargement of an icon, launching of an application or requesting specific data.
  • Fig. 13B shows the provision of time actuated point and click functionality at the location of a user-selectable electromagnetic radiation impingement pattern on an ultra-mobile PC input device 1320.
  • This functionality is provided by circuitry preferably incorporated in the device 1320, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • a light emitting stylus 1322 is employed together with the ultra-mobile PC input device 1320 in order to provide point functionality.
  • Utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1321 and, optionally, the distance of the light emitting stylus 1322, optionally generates a visually sensible pointing indication 1324, which corresponds generally to the location of the electromagnetic radiation impingement pattern 1321 on the ultra-mobile PC input device 1320.
  • the presence of the pointing indication 1324 at an actuatable zone may produce a visually sensible mouseover effect, for example, reversal of white/black or a change of color of the pointing indication 1324.
  • Figs. 13 A - 13B may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 12C and 14A - 23.
  • FIGs. 14A, 14B, 14C, 14D, 14E and 14F are simplified illustrations of various functionalities constructed and operative in accordance with a preferred embodiment of the present invention.
  • Figs. 14A and 14B illustrate a flat panel display of the type described hereinabove with reference to Fig. 1OD, having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • Fig. 14A illustrates functionality for controlling a presentation on a display by user directed light impingement on the display.
  • This functionality is provided by circuitry, preferably incorporated in the flat panel display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • a presenter preferably employing a remote control unit 1400 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1400 such that an electromagnetic radiation impingement pattern 1401 emitted therefrom impinges upon a forward indication 1402, here shown in the form of an arrow appearing on a display 1404. This impingement causes the next presentation frame 1406 to be displayed.
  • Fig. 14B illustrates functionality for point and drag selection on a display by user directed light impingement on the display.
  • This functionality is provided by circuitry, preferably incorporated in a flat panel display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • a presenter preferably employing a remote control unit 1420 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1420 such that light emitted therefrom impinges upon a user-selected region of the display 1422, such that an electromagnetic radiation impingement pattern 1424 functions as a point selector, enabling the user to select a selection point indicated by a selection point indicator 1426.
  • the presenter can then drag the selection point indicator 1426, to define a selection area 1428.
  • the portion of the image located within the selection area 1428 may then be enlarged to fill the entire display as indicated at reference numeral 1430.
  • FIG. 14C illustrates functionality for drop down menu activation on a display by user directed light impingement on a display 1440.
  • This functionality is provided by circuitry, preferably incorporated in a flat panel display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • a user preferably employing a remote control unit 1442 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1442 such that an electromagnetic radiation impingement pattern 1444 emitted therefrom impinges upon a drop down menu icon 1446 on the display 1440 to function as a drop down menu activator.
  • Clicking on the icon 1446 causes the drop down menu 1448 to be displayed.
  • Fig. 14D illustrates functionality for pop out menu activation on a display by user directed light impingement on the display and/or on a peripheral frame thereof.
  • circuitry preferably incorporated in the display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
  • a user preferably employing a remote control unit 1450 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1450 such that light emitted therefrom impinges upon a "hot" zone 1452 of a display 1454 or of a peripheral frame 1456 thereof such that a light impingement pattern 1458 functions as a pop out menu activator.
  • a pop out menu 1460 is displayed.
  • the pop out menu may include various functions, such as, for example, a program pause functionality, links to relevant web sites, operating system functionalities, such as record, play, channel select and medium or content shift.
  • Fig. 14E illustrates functionality for animation activation on a display by user directed light impingement on the display and/or on a peripheral frame thereof.
  • This functionality is provided by circuitry, preferably incorporated in the display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • a presenter preferably employing a remote control unit 1470 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1470 such that light emitted therefrom impinges upon an "animation activation" zone 1472 of the display 1474, such that a light impingement pattern 1476 functions as an animation activator.
  • the animation is played, as seen figuratively in the enlargement at reference numeral 1478.
  • Fig. 14F illustrates functionality for 3D image rotation activation on a display by user directed light impingement on the display.
  • circuitry preferably incorporated in the display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
  • a user preferably employing a remote control unit 1480 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1480 such that light emitted therefrom impinges upon a portion of a displayed image 1482 containing 3 dimensional information, such that a light impingement pattern 1484 functions as a selection point actuator, which identifies the displayed image to be rotated.
  • the presenter can then drag the selection point with a movement, shown by an arrow 1486, which defines an axis 1488 and an extent of rotation.
  • the selected displayed image is then rotated accordingly.
  • the functionality of Fig. 14F may also be employed for 2D or 3D rotation. This functionality may find particularly utility when employed in a display providing 3D image perception, such as SHARP LL-151 -3D monitor.
  • Figs. 14A - 14F may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 13B and l5A - 23.
  • FIGs. 15 A, 15B, 15C and 15D illustrate functionality for gaming constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a display or in associated gaming apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • one or more players may control the movement and orientation of one or more avatars or other objects displayed on a display screen such as a flat display of the type described hereinabove with reference to Fig. 1OC or a CRT display.
  • Fig. 15A illustrates a player employing a light emitting stylus 1502, typically in the fanciful shape of an airplane, for controlling the motion of a displayed object, such as an airplane 1504, wherein three-dimensional mapping of the three- dimensional movement of the stylus 1502 to corresponding three-dimensional motion of the airplane 1504 is provided.
  • three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15 A.
  • Fig. 15A illustrates a player employing a light emitting stylus 1502, typically in the fanciful shape of an airplane, for controlling the motion of a displayed object, such as an airplane 1504, wherein three-dimensional mapping of the three- dimensional movement of the stylus 1502 to corresponding three-dimensional motion of the airplane 1504 is provided.
  • three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15 A.
  • Fig. 15B illustrates the player employing the light emitting stylus 1502 for controlling the motion of the displayed airplane 1504, wherein three-dimensional mapping of the three-dimensional movement of the stylus 1502 to corresponding the three-dimensional motion of the airplane is provided.
  • three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15B.
  • the user is seen flexing his wrist to effect pivoting of stylus 1502, producing a change in the detected shape and/or orientation of a corresponding impingement pattern 1506, which results in upward tilting of airplane 1504 and a change of the airplane's direction in virtual space.
  • Fig. 15C illustrates the player employing the light emitting stylus 1502 for controlling the motion of the displayed airplane 1504, wherein Z mapping of the three-dimensional movement of the stylus 1502 towards or away from a display screen to a corresponding change in the speed of the airplane is provided.
  • the user is stretching out his arm towards a display screen 1508, thereby decreasing the size of the corresponding impingement pattern 1506, which results in an increase in the virtual speed of the airplane 1504.
  • Fig. 15D illustrates a player virtually throwing a dart by moving a light emitting stylus 1522 in a throwing motion, wherein three-dimensional mapping of the movement of the stylus 1522 to corresponding three-dimensional motion of a virtual dart 1524 is provided.
  • three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15D.
  • the user's hand and arm execute a throwing motion, thereby changing the size, shape and orientation of a corresponding impingement pattern 1526 on a display screen 1528, which results in a virtual dart throw.
  • the absolute position of the stylus 1522 which is known by sensing the size and shape of the impingement pattern 1526, has importance in establishing the distance across which the virtual dart 1524 is thrown.
  • Figs. 15A - 15D may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 14F and l6A - 23.
  • FIGs. 16A, 16B and 16C illustrate interactive television functionality, constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a television or in associated interactive television apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • Fig. 16A illustrates a scenario wherein a user is watching a movie on a display 1600 and sees an image 1602 of a vehicle which is of interest to him.
  • the user preferably directs a remote control unit 1604 of the type described hereinabove with reference to Fig. 11 onto the displayed image 1602.
  • the vehicle has been previously designated as an interactive - enabled object.
  • impingement of a light beam from remote control unit 1604 on the image of the vehicle which produces a sensed impingement pattern 1606, causes the image of the vehicle to be highlighted as indicated by reference numeral 1608, providing visually sensible or auditory feedback to the user, alerting the user to the interactive designation of the image 1602.
  • clicking on the image 1602 (Fig. 16A) of the vehicle causes an advertisement 1610 to be displayed on display 1600, immediately or at an appropriate pre-scheduled commercial break in the movie.
  • a discount offer for the vehicle shown in image 1602 or a competing vehicle may be sent to the user's computer 1612, by email or any other suitable methodology.
  • a discount offer for the vehicle shown in image 1602 or a competing vehicle may be sent to the user's telephone 1614 by an SMS or other messaging functionality.
  • clicking on the image 1602 (Fig. 16A) of the vehicle causes a selection palette 1630 to be displayed on display 1600, immediately or at an appropriate pre-scheduled commercial break in the movie.
  • the selection palette may offer various models of the vehicle shown hi image 1602 or various options for purchase thereof.
  • User selection of one of the items appearing in the selection palette 1630 may cause a corresponding advertisement 1610 to be displayed on display 1600, as described hereinabove with reference to Fig. 16B.
  • clicking on an item in the selection palette 1630 or alternatively, clicking on the image 1602 by the user may effect purchase of the vehicle.
  • Figs. 16A - 16C may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 15D and l7A - 23.
  • Figs. 17 A, 17B and 17C illustrate display interface functionality, constructed and operative in accordance with a preferred embodiment of the present invention.
  • circuitry preferably incorporated in a display or in associated computer or control apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
  • a user preferably employing a remote control unit 1700 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1700 such that light emitted therefrom impinges upon a selectable item 1701, here "MY PICTURES" in a menu 1702 appearing on a display 1704, causing the selectable item 1701 to appear highlighted as indicated by reference numeral 1706.
  • a selectable item 1701 here "MY PICTURES"
  • the selectable item 1701 Upon clicking on the selectable item, as by one of the techniques described hereinabove with reference to Figs. 13A and 13B, the item is selected. The result of this selection is shown in Fig.
  • FIG. 17B which shows "thumbnails” of a plurality of selectable pictures 1708 together with an enlargement 1710 of a "thumbnail” 1712 which is impinged upon by light from the remote control unit 1700.
  • the "thumbnail” 1712 appears in a highlighted or other visually sensible form as indicated by reference numeral 1714.
  • Fig. 17C shows the result of selection of one of the selectable pictures, as by clicking using one of the techniques described hereinabove with reference to Figs. 13 A and 13B, which includes data 1716 regarding the selected picture or information regarding user options in connection therewith.
  • Figs. 17A - 17C are but one example of a navigation system which enables a user to efficiently select a function or content from among a great variety of options. It is appreciated that the illustrated "point and click" direct icon or item selectability provides a highly user-friendly interface as compared with conventional interfaces.
  • Figs. 17A - 17C may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 16C and l8A - 23.
  • Figs. 18A and 18B are simplified illustrations of zoom and playback functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a mobile device, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • Fig. 18A shows a user employing an ultra-mobile PC input device 1800 of the type described hereinabove with reference to Fig. 1OA, and typically a reflective stylus 1802, points on an object 1804, here a car, producing a zoomed in image of a portion of a displayed image appearing on device 1800 including that object.
  • the sensed shape and size of the impingement pattern 1806 may govern the shape and size of the zoomed in image.
  • Fig. 18B illustrates a zoom and replay functionality, wherein a user employing the input device 1800 and the reflective stylus 1802, points on the object 1804, here a car, automatically producing a replay of a zoomed in image of a portion of a displayed image appearing on device 1800 including that object and/or of an advertisement 1808 related to that object.
  • the sensed shape and size of the impingement pattern 1806 may govern the shape and size of the zoomed in image and/or the duration or speed of the replay.
  • Figs. 18A - 18B may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 17C and l9 - 23.
  • Fig. 19 is a simplified illustration of handwriting input functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a mobile device, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S.
  • a user typically employs a reflective stylus 1900 to "write" onto the display screen 1902 of a mobile telephone 1904 having some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No.
  • the movement of an impingement pattern 1906 over the display screen 1902 is sensed using the above-mentioned functionality and is employed as an input to conventional handwriting input circuitry, which may or may not reside on the mobile telephone 1904.
  • the handwriting input circuitry may be handwriting recognition circuitry, such as for example MYSCRIPT®, commercially available from Vision Objects S. A. in France or image archiving circuitry, such as, for example, Microsoft PAINT. It is appreciated that the above-mentioned functionality enables three- dimensional input recognition, such as recognition of gestures and enables various three-dimensional input responsive effects, such as line thickness variability to be provided.
  • Fig. 19 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 18B and 2OA - 23.
  • Figs. 2OA and 2OB are simplified illustrations of simultaneous multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a mobile device, such as a PDA which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • a sensed downward trajectory of an impingement pattern, as indicated by an arrow 2000, produced by a single finger may produce scrolling at a first speed, as indicated schematically by an arrow 2002, while a sensed downward trajectory of an impingement pattern, as indicated in Fig. 20B by an arrow 2004 of two mutually touching fingers, may produce scrolling at a second speed, faster than the first speed, as indicated schematically by an arrow 2006.
  • Figs. 2OA - 2OB may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 19 and 21 - 23.
  • FIG. 21 is a simplified illustration of simultaneous multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a mobile device such as a PDA, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the sensing functionality of the present invention is responsive to rotation of two mutually spaced fingers 2100 and 2102, moving in two separate trajectories for producing, for example, rotation of a picture 2104 resulting in a rotated picture 2106. It is appreciated that the functionality of Fig. 21 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 2OB and 22 - 23.
  • FIG. 22 is a simplified illustration of input size/shape responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a mobile device such as a cellular telephone, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
  • the input size/shape responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention may be employed to provide a very convenient on-off function, such as a quick telephone ringer mute function, which may be activated by detection of impingement pattern corresponding to laying of a hand 2200 of a user over generally the entire display area 2202 of a mobile telephone 2104.
  • a very convenient on-off function such as a quick telephone ringer mute function
  • the functionality of Fig. 22 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 21 and 23.
  • FIG. 23 illustrates multiple input responsive functionality for gaming constructed and operative in accordance with a preferred embodiment of the present invention.
  • This functionality is provided by circuitry, preferably incorporated in a display or in associated gaming apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S.
  • one or more players may each control the movement and orientation of one or more avatars or other objects displayed on a display screen 2300 such as a flat display of the type described hereinabove with reference to Fig. 1OC or a CRT display.
  • a display screen 2300 such as a flat display of the type described hereinabove with reference to Fig. 1OC or a CRT display.
  • the functionality thereof is able to distinguish between different electromagnetic radiation impingement patterns, such as patterns 2302 and 2304 produced by respective gaming control devices 2312 and 2314, as well as between their respective trajectories.
  • the functionality may employ different modulations or different beam shapes for this purpose, for example.
  • Fig. 23 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described hereinabove with reference to Figs. IA - 22. It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present invention includes both combinations and sub- combinations of various features described and shown herein and modifications and variations thereof which are not known in the prior art.

Abstract

A computer input device including at least one sensor operable to sense at least one position coordinate of at least one object (106) with respect to a user-selectable electromagnetic radiation impingement pattern (112) and object position responsive circuitry responsive at least partially to the at least one position coordinate and to the position of the user-selectable electromagnetic radiation impingement pattern for actuating at least one interactive function.

Description

USER INTERFACE FUNCTIONALITIES
FIELD OF THE INVENTION
The present invention relates to user interfaces generally and more particularly to user interface functionalities.
BACKGROUND OF THE INVENTION
The following published patent documents are believed to represent the current state of the art:
U.S. Patent Numbers: 6,404,416; 6,094,188; 6,081,255; 5,926,168; 5,892,501; 5,448,261; 5,227,985; 5,949,402; 5,959,617; 5,122,656; 5,506,605 and 4,320,292;
U.S. Patent Application Publication Numbers: 2001/0050672 and 2005/0156914;
PCT Patent Application Publication: WO02/043045, WO03/104965; WO 2005/094176; WO95/02801 and WO 2005/094176; Great Britain Patent Numbers: GB2299856 and GB2289756; and
European Patent Number: EP0572182.
SUMMARY OF THE INVENTION
The present invention seeks to provide improved user interfaces and user interface functionalities, particularly useful for displays, such as those employed with computers, televisions, personal communicators and other mobile devices.
There is thus provided in accordance with a preferred embodiment of the present invention a computer input device including at least one sensor operative to sense at least one position coordinate of at least one object with respect to a user- selectable electromagnetic radiation impingement pattern and object position responsive circuitry responsive at least partially to the at least one position coordinate and to the position of the user-selectable electromagnetic radiation impingement pattern for actuating at least one interactive function.
Preferably, the at least one sensor is operative to sense the position of the user-selectable electromagnetic radiation impingement pattern with respect to a surface of the computer input device. Alternatively or additionally, the at least one sensor is operative to sense a metric of the separation between the at least one object and the user-selectable electromagnetic radiation impingement pattern. Preferably, the metric has a Z component and at least one of an X component and a Y component.
There is also provided in accordance with another preferred embodiment of the present invention a computer input device including at least one sensor operative to sense at least two of X, Y, Z, theta and phi position coordinates of an object with respect to at least one input surface and object position responsive circuitry responsive at least partially to a Z position coordinate together with at least one of the X, Y, theta and phi position coordinates for actuating at least one interactive function. Preferably, the at least one input surface is a display surface.
Alternatively or additionally, the at least one input surface is at least partially outside a display surface.
Preferably, the at least one interactive function includes one or more of the following functions: a selecting function, a zooming function, a lock-on function, a link actuating function, a muting function, a menu actuation function, a sub-menu actuation function, a map browsing function, an application launching function, a web navigation function, a document navigation function, a picture enlargement function, a mouseover function, a highlighting function, a cursor control function, an on-off function, a gaming function, a scrolling function, a handwriting recognition function, a rotation function, a page turning function and a panning function.
Preferably, the at least one sensor is also operative to sense a sequence of the at least one position coordinate of the at least one object with respect to a user- selectable electromagnetic radiation impingement pattern.
Preferably, the at least one sensor is operative to sense at least one position coordinate of at least one electromagnetic radiation emitting object with respect to a user-selectable electromagnetic radiation impingement pattern emitted therefrom. Alternatively or additionally, the at least one sensor is operative to sense at least one position coordinate of at least one electromagnetic radiation reflecting object with respect to a user-selectable electromagnetic radiation impingement pattern reflected therefrom.
Preferably, the at least one electromagnetic radiation emitting object is a remote control device including at least one collimated LED electromagnetic radiation emitter.
Preferably, the at least one sensor is also operative to sense a sequence of the at least two of X, Y, Z, theta and phi position coordinates of an object with respect to at least one input surface. Preferably, the object is an electromagnetic radiation emitting object and the at least one sensor is operative to sense the at least two position coordinates with respect to a user-selectable electromagnetic radiation impingement pattern emitted from the object. Alternatively or additionally, the object is an electromagnetic radiation reflecting object and the at least one sensor is operative to sense the at least two position coordinates with respect to a user-selectable electromagnetic radiation impingement pattern reflected from the object. Preferably, the electromagnetic radiation emitting object is a remote control device including at least one collimated LED electromagnetic radiation emitter.
Preferably, the at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation reflecting objects. Alternatively or additionally, the at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation reflecting objects. Additionally or alternatively, the at least one sensor is operative to sense relative positions of at least two electromagnetic radiation reflecting objects.
Preferably, the at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation emitting objects. Alternatively or additionally, the at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation emitting objects. Additionally or alternatively, the at least one sensor is operative to sense relative positions of at least two electromagnetic radiation emitting objects.
Preferably, the at least one sensor is operative to sense at least one position coordinate of at least two fingers. Alternatively or additionally, the at least one sensor is operative to sense changes over time of at least one position coordinate of at least two fingers. Additionally or alternatively, the at least one sensor is operative to sense relative positions of at least two fingers.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:
Figs. IA, IB, 1C, ID. IE, IF5 IG and IH are simplified pictorial illustrations of user interface functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 2A, 2B5 2C, 2D, 2E5 2F5 2G5 2H5 21, 2J5 2K5 2L5 2M5 2N5 20 and 2P are simplified pictorial illustrations of browsing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 3A5 3B5 3C5 3D, 3E5 3F and 3 G are simplified pictorial illustrations of document viewing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 4A, 4B5 4C5 4D5 4E and 4F are simplified pictorial illustrations of gaming functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 5A, 5B5 5C, 5D5 5E5 5F5 5G and 5H are simplified pictorial illustrations of contact management functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 6A5 6B5 6C5 6D, 6E5 6F and 6G are simplified pictorial illustrations of contact management functionality of a mobile device constructed and operative in accordance with another preferred embodiment of the present invention; Figs. 7A5 7B5 7C5 7D5 7E5 7F and 7G are simplified pictorial illustrations of picture viewing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 8A5 8B5 8C5 8D5 8E5 8F5 8G and 8H are simplified pictorial illustrations of interactive television functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention; Figs. 9 A, 9B5 9C, 9D, 9E, 9F and 9G are simplified pictorial illustrations of map browser functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 1OA 1OB, 1OC and 1OD are simplified pictorial illustrations of an ultra-mobile PC input device having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention;
Fig. 11 is a simplified illustration of a remote control device useful in the embodiments of Figs. 1OC and 10D;
Figs. 12 A, 12B and 12C are simplified illustrations of point and highlight, cursor feedback and mouseover feedback functionalities constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 13A and 13B are simplified illustrations of point and click and z- axis click functionalities;
Figs. 14A, 14B, 14C, 14D, 14E and 14F are simplified illustrations of various functionalities constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 15 A, 15B, 15C and 15D are simplified illustrations of functionality for gaming constructed and operative in accordance with a preferred embodiment of the present invention; Figs. 16 A, 16B and 16C are simplified illustrations of interactive television functionality constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 17A, 17B and 17C are simplified illustrations of navigation functionality constructed and operative in accordance with a preferred embodiment of the present invention;
Figs. 18A and 18B are simplified illustrations of zoom and playback functionality constructed and operative in accordance with a preferred embodiment of the present invention;
Fig. 19 is a simplified illustration of handwriting recognition functionality constructed and operative in accordance with a preferred embodiment of the present invention; Figs. 2OA and 2OB are a simplified illustrations of simultaneous multiple input responsive functionalities constructed and operative in accordance with a preferred embodiment of the present invention;
Fig. 21 is a simplified illustration of simultaneous multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention;
Fig. 22 is a simplified illustration of input size/shape responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention; and Fig. 23 is a simplified illustration of multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The present invention provides a computer input device including at least one sensor operative to sense at least one position coordinate of an object with respect to a user-selectable electromagnetic radiation impingement pattern and object position responsive circuitry responsive at least partially to the at least one position coordinate and to the position of the user-selectable electromagnetic radiation impingement pattern for actuating at least one interactive data selection function.
Reference is now made to Figs. IA, IB, 1C, ID, IE, IF, IG and IH, which illustrate user interface functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 100 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 102 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 104 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 106 operatively associated with the mobile device 100. Fig. IA shows pointer 106 aimed at keyboard 104 and not aimed at display screen 102, which display screen, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality. In this arrangement, display screen 102 typically displays an array of application launch icons 108.
Fig. IB shows pointer 106 located at a first distance Dl from display screen 102, such that an electromagnetic radiation beam 110 emitted thereby impinges on display screen 102 and defines an impingement pattern 112 that is generally centered on a first application launch icon 114, even though it may also partially impinge on other icons. The functionality of the mobile device 100 causes icon 114 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 116.
Fig. 1C shows pointer 106 located at a second distance D2 from display screen 102, less than Dl, such that an impingement pattern 118 of electromagnetic radiation beam 110 is smaller than the impingement pattern 112 of electromagnetic radiation beam shown in Fig. IB, although the beam 110 remains generally centered on icon 114. The functionality of the mobile device 100 causes icon 114 to appear in a further enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 120, which in this case is larger than the form designated by reference numeral 116. This enables icon 114 to be readily identified by a user. The transition from the relative orientation of the pointer 106 and the display screen 102 in Fig. IB to that of Fig. 1C creates zooming-in feedback for the user.
Conversely, the transition from the relative orientation of the pointer 106 and the display screen 102 in Fig. 1C to that of Fig. IB creates zooming-out feedback for the user.
Fig. ID shows pointer 106 located at a third distance D3 from display screen 102, less than D2, which preferably is selected as a locking threshold distance LT. It is seen that an impingement pattern 122 of electromagnetic radiation beam 110 is smaller than the impingement pattern 118 of electromagnetic radiation beam shown in Fig. 1C, although the beam 110 remains generally centered on icon 114. The functionality of the mobile device 100 causes icon 114 to appear in a further enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 124, which in this case is larger than the form designated by reference numeral 120.
Preferably, in accordance with a preferred embodiment of the present invention, when the distance of the pointer 106 from display screen 102 is less than or equal to LT, the size of icon 114 is locked, for example in the form indicated by reference numeral 124, and remains the same even if the pointer 106 is subsequently moved further away from the display screen 102, for example to a distance D4 which is greater than LT as shown in Fig. IE, or is subsequently aimed in a different direction. hi accordance with a preferred embodiment of the present invention, as shown in Fig. IF, when pointer 106 is located at a fifth distance D5 from display screen 102, which may be greater or less than or equal to D3, which preferably is selected as a sub-icon presentation threshold distance SPT, the functionality of the mobile device 100 causes sub-icons 126, 128 and 130 to appear, preferably in propinquity to the icon 114 impinged upon by electromagnetic radiation beam 110. Fig. IG shows pointer 106 located at a sixth distance D6 from display screen 102, which may be greater or less than or equal to D5, such that an impingement pattern 132 of electromagnetic radiation beam 110 is generally centered on one of the sub-icons, for example sub-icon 126. The functionality of the mobile device 100 causes sub-icon 126 to appear in a visually sensibly emphasized form, as indicated by reference numeral 134. This enables sub-icon 126 to be readily identified by a user.
In accordance with a preferred embodiment of the present invention, as shown in Fig. IH, when the pointer 106 is located at a distance D7 from display screen 102, which is equal to or less than a selection threshold ST, or touches the display screen 102, a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
In accordance with a preferred embodiment of the present invention, where an icon, such as icon 114 (Fig. IG), launches an application at an initial or default launch stage, sub-icons, such as sub-icons 126, 128 and 130 (Fig. IG), may be used to both launch the application and to actuate a given functional stage thereof. For example, if icon 114 represents an email application and if the user selects sub-icon 126, as illustrated in Fig. IG, the email application is launched and an email message template 136 is displayed, as shown in Fig. IH.
It is appreciated that as shown in the above example, a single pointer movement from outside SPT to inside ST can replace multiple touch engagements required by prior art devices.
It is appreciated that the functionality of Figs. IA - IH may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described hereinbelow with reference to Figs. 2A - 23.
Reference is now made to Figs. 2A, 2B, 2C, 2D, 2E, 2F, 2G, 2H, 21, 2J, 2K, 2L, 2M5 2N, 20 and 2P, which illustrate browsing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 200 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 202 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 204 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 206 operatively associated with the mobile device 200.
Fig. 2A shows pointer 206 aimed at display screen 202 and located at a distance DWl from display screen 202 as described hereinabove with reference to Figs. IA - IG, such that an impingement pattern 208 of an electromagnetic radiation beam 210 is generally centered on one of a plurality of sub-icons, for example sub-icon 216.
The functionality of the mobile device 200 causes sub-icon 216 to appear in a visually sensibly emphasized form, as indicated by reference numeral 218. As discussed hereinabove with reference to Fig. IH, when the pointer 206 is located at a distance DW2 from display screen 202 which is equal to or less than a selection threshold ST or touches the display screen 202, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
In accordance with a preferred embodiment of the present invention, the sub-icons, such as sub-icons 216, 220 and 222, may be used to launch a web browser application showing various user-selectable, pre-selected web pages. For example, if a user selects sub-icon 216, the web browser is launched and the web page of CNN.com appears. As a further example, if sub-icon 220 is selected the web browser is launched and the web page of Google.com is loaded and if sub-icon 222 is selected, the web browser is launched and the web page ofUSPTO.gov is fetched.
Fig. 2B shows the result of selection of sub-icon 216.
Fig. 2C shows pointer 206 located at a distance DW3 from display screen 202, such that an electromagnetic radiation beam 210 emitted thereby impinges on display screen 202 and defines an impingement pattern 232 having a center, which preferably is indicated by a cursor 234 or other visual indicator.
Fig. 2D shows pointer 206 located at a distance DW4, less than DW3, from display screen 202. It is seen that an impingement pattern 236 of electromagnetic radiation beam 210 is smaller than the impingement pattern 232 of electromagnetic radiation beam 210 shown in Fig. 2C. It is seen that the image of the CNN.com web page is enlarged and the portion thereof designated by the cursor 234 remains visible. The transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2C to that of Fig. 2D creates zooming-in feedback for the user. Conversely, the transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2D to that of Fig. 2C creates zooming-out feedback for the user.
Fig. 2E shows pointer 206 located at a distance DW5 from display screen 202, which is slightly greater than a predetermined locking threshold distance LT. It is seen that an impingement pattern 238 of electromagnetic radiation beam 210 is smaller than the impingement pattern 236 of electromagnetic radiation beam 210 shown in Fig. 2D. It is seen that the image of the CNN.com web page is further enlarged and the portion designated by the cursor 234 remains visible. The transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2D to that of Fig. 2E creates further zooming-in feedback for the user.
Conversely, the transition from the relative orientation of the pointer 206 and the display screen 202 in Fig. 2E to that of Fig. 2D creates zooming-out feedback for the user. Fig. 2F shows pointer 206 located at a distance DW6 from display screen
202, which is equal to or less than a predetermined locking threshold distance LT. It is seen that the impingement pattern 240 of electromagnetic radiation beam 210 is smaller than the impingement pattern 238 of electromagnetic radiation beam 210 shown in Fig. 2E. It is seen that the image of the CNN.com web page is further enlarged and the frame which encloses the portion of the web page designated by the cursor 234 preferably generally fills the display screen 202.
The filling of the screen with a cursor-designated frame may be carried out in a variety of ways. Reference numeral 242 indicates filling the width of the screen with an image frame by enlarging or reducing the image as necessary, not exceeding predetermined maximum or minimum percentage. Reference numeral 244 indicates filling the width of the screen with a text frame, which can be vertically scrolled. The font size of the text is determined in accordance with pre-defined parameters. Right/left and up/down scrolling are available as appropriate, as is described hereinbelow.
Preferably, in accordance with a preferred embodiment of the present invention, when the distance of the pointer 206 is less than or equal to LT, the degree of enlargement and the screen view area both locked, for example in the forms indicated by reference numerals 242 and 244, and remain the same even if the pointer 206 is subsequently moved further away from the display screen 202, for example to a distance DW7 which is greater than LT as shown in Fig. 2G, or is subsequently aimed in a different direction. hi accordance with a preferred embodiment of the present invention, when the browser functionality is in a locked state, as described hereinabove, if the cursor 234 is located in propinquity to a hyperlink, as shown in Fig. 2H, the link may appear in a visually sensibly emphasized form, as indicated by reference numeral 246, enabling the link to be readily identified by a user. hi accordance with a preferred embodiment of the present invention, as shown in Fig. 21 when the pointer 206 is located at a distance DW8 from display screen 202 which is equal to less than selection threshold ST or touches the display 202, an additional selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
When the pointer 206 crosses the ST threshold, the link may be actuated and thus, for example, open a new web page, as shown in Fig. 21 or launch a program or initiate a download or other functionality. Reference is now made to Figs. 2J - 2P, which illustrate tool-bar/tab functionality in a web-browsing environment, such as that illustrated in Figs. 2A - 21. Fig. 2J illustrates a stage in web-browsing similar to that shown in Fig. 2E, Fig. 2J being distinguished from Fig. 2E in that a tool bar 250 including a plurality of icons, preferably including a zoom navigator icon 252, is provided. Other functional icons which may be provided include, for example, an icon for restoring an image to full-page view, an icon for going back a page, an icon for going forward a page, an icon for navigating to a predetermined web page, an icon which creates a bookmark and an icon navigating to a selectable list of bookmarked web addresses.
Fig. 2K shows zoom navigator icon 252 (Fig. 2J), being impinged upon by the electromagnetic radiation beam 210 having an impingement pattern 254 when the pointer 206 is at a distance DW9 from display screen 202. This impingement causes the appearance of icon 252 (Fig. 2J) to be enlarged, as designated by reference numeral 256.
As seen in Fig. 2L5 when the pointer 206 is moved closer to the display screen 202, typically to a distance DWlO from display screen 202, a smaller impingement pattern 258 results, and this causes further enlargement of icon 252, as designated by reference numeral 260.
Fig. 2M shows the pointer 206 moved even closer to display screen 202, to a distance DWI l, which is equal to or less than an actuating threshold AT. This positioning of pointer 206 actuates functionality of the zoom navigator icon 252, which, for example, causes maximum zooming out of the displayed web page. Further in or out zooming can readily be achieved by aiming the pointer 206 at the web page and changing the distance between the pointer 206 and the screen 202.
Fig. 2N shows impingement of the electromagnetic radiation beam 210 on a search engine tab, such as a GOOGLE® tab 266 (Fig. 2M), causing the appearance of the tab to be enlarged, as designated by reference numeral 268.
Fig. 2O shows the pointer 206 moved even closer to display screen 202, to a distance DW12, which is equal to or less than actuating threshold AT. This positioning of pointer 206 actuates the functionality of the search engine tab 266, which, for example, launches the GOOGLE search engine, as designated by reference numeral 270.
Fig. 2P shows impingement of the electromagnetic radiation beam 210 on a multi-function bookmarks tab 272 (Fig. 20) which causes a sub-menu 274 to appear on display 202.
It is appreciated that any of the icon and sub-icon functionalities described elsewhere herein may also be provided for tool bar or tab icons.
It will be appreciated that the above-mentioned functionalities allow icons or buttons to be unobtrusively present when not in use, and grow and gain prominence in the display as desired. At an intermediate zoom-in level, the icons are sufficiently visibly enlarged to enable greater user discrimination, and to determine more easily if the icon does in fact represent the desired function. When fully zoomed, the icons are very usable. This also allows a greater number of functional icons to be practically available in a limited space. It is appreciated that the functionality shown in Figs. 2A - 2P enables convenient viewing of a web page without requiring reformatting of the web page to optimally fit a mobile device or provision of a pre-optimized web page.
It is appreciated that the functionality of Figs. 2A - 2P may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - IH and 3A - 23.
Reference is now made to Figs. 3A, 3B, 3C5 3D, 3E5 3F and 3G, which illustrate document viewing functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 300 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 302 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 304 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 306 operatively associated with the mobile device 300.
Fig. 3 A shows pointer 306 aimed at display screen 302 and located at a distance DVl from display screen 302, such that an impingement pattern 308 of an electromagnetic radiation beam 310 is generally centered on one of a plurality of sub- icons, for example sub-icon 316.
The functionality of the mobile device 300 causes sub-icon 316 to appear in a visually sensibly emphasized form, as indicated by reference numeral 318. Similarly to that discussed hereinabove with reference to Fig. IH, when, as shown in Fig. 3B5 the pointer 306 is located at a distance DV2 from the display screen 302 which is equal to or less than a selection threshold STor touches the display 302, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. In accordance with a preferred embodiment of the present invention sub- icons, such as sub-icons 316, 320 and 322 (Fig. 3A) may be used to launch a document viewing application showing various user-selectable, pre-selected documents. For example, if a user selects sub-icon 316, the document viewer is launched and document associated with the selected sub-icon appears. Fig. 3B shows the result of selection of sub-icon 316. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
Additionally or alternatively, tool-bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided. Reference is now made to Figs. 3 C and 3D, which illustrate forward page turning functionality which is preferably provided in accordance with a preferred embodiment of the present invention. As seen in Fig. 3C, when the pointer 306 is located at a relatively large distance from the display screen 302 such as DV3, and is moved in a predetermined pattern such as a hook pattern, as designated by reference numeral 330, a relatively fast forward page turning function is provided, typically going from page 1, as shown in Fig. 3B, to page 10, as shown in Fig. 3C. As seen in Fig. 3D, when the pointer 306 is located at a relatively small distance from the display screen 302, such as DV4, which is less than DV3, and is moved in a predetermined pattern such as the hook pattern 330, as illustrated, a relatively slow forward page turning function is provided, typically going from page 1, as shown in Fig. 3B, to page 2, as shown in Fig. 3D.
It is appreciated that for distances between DV3 and DV4, a range of different speeds of page turning may be provided.
It is further appreciated that a similar motion in a different direction or a different motion may provide a different functionality. For example, as seen in Fig. 3 E, a hook pattern designated by reference numeral 332 provides a backward page turning functionality. The pointer distance difference functionality described above with reference to Figs. 3 C and 3D preferably also is operative for the backward page turning functionality of Fig. 3E and other types of pattern dependent functionalities.
Pointer motion pattern functionalities of the type described hereinabove with reference to Figs. 3 C - 3E may use any suitable type of pattern recognition software, such as, for example, Graffiti TM, which is commercially available from U.S. Robotics of Schaumburg, IL.
It is a particular feature of the present invention that, as distinguished from the prior art, contact between the pointer and the screen is not required and more importantly, the distance between the pointer and the screen may be used to control one or more aspects of the functionality, for example as described hereinabove in Figs. 3C and 3D wherein the speed of page turning is dependent on the distance from the screen.
It is a further particular feature of the present invention that the closer the pointer 306 is to the screen 302, the slower is the speed of the page turning functionality. Reference is now made to Figs. 3F and 3G, which illustrate scrolling functionality which is preferably provided in accordance with a preferred embodiment of the present invention. As seen in Fig. 3F, when the pointer 306 is located at a relatively large distance from the display screen 302 such as DV5, and is moved upward or downward along the page, as designated respectively by reference numerals 334 and 336, a relatively fast upward or downward scrolling function is provided. As discussed above, the speed of the scrolling is preferably dependent on the distance of the pointer 306 from the display screen 302, preferably such that when the pointer 306 is closer, the scrolling is slower.
Turning now to Fig. 3G, it is seen that upward and downward scrolling hot spots, respectively designated by reference numerals 338 and 340 may be provided and may be visible or invisible. Impingement of an electromagnetic radiation beam on one of the hot spots 338 or 340 provides scrolling in a corresponding direction. It is appreciated that scrolling hot spots are not necessarily limited to up and down scrolling hot spots but may include side-to-side and diagonal and any direction hot spots as well.
The speed of scrolling may be responsive to the distance of the pointer 306 from the screen 302, such as being a function of the size of the impingement location area, such as that designated by reference numeral 342, which produces downward scrolling as indicated by arrow 344.
It is a particular feature of an embodiment of the present invention that speed of a function, such as page turning or scrolling is a positive function of the closeness of the pointer to the screen. The present inventor has appreciated that inasmuch as increasing propinquity of the pointer to the screen indicates increasing imminence of a user selection, and increased importance of detail, minimizing the speed of functions such as page turning or scrolling enhances user efficiency and satisfaction.
It is appreciated that the functionality of Figs. 3 A - 3 G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 2P and 4A - 23.
Reference is now made to Figs. 4A, 4B, 4C, 4D, 4E and 4F, which are illustrations of gaming functionality of a gaming device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the gaming device is a mobile gaming device 400, such as a Playstation Portable Gaming
Device commercially available from Sony, which is configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT
Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No.
60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
The gaming device 400 is retrofitted by having mounted thereon a clip- on attachment 401 including a transparent plate 402 having sensors (not shown) associated therewith and electronic circuitry (not shown). The transparent plate 402 of the clip-on attachment 401 preferably overlies a display screen (not shown) of the gaming device 400. The electronic circuitry is preferably connected to circuitry of the gaming device via a USB connection 403. The electronic circuitry of clip-on attachment 401 preferably has implemented therein the electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with the transparent plate 402 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size described hereinabove with reference to Figs. IA - 3G.
A keyboard 404 may be provided as part of the gaming device 400 but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 406 operatively associated with the gaming device 400.
Figs. 4A and 4B together illustrate a shooting functionality which becomes more focused and intense as pointer 406 moves closer to transparent plate 402. It is appreciated that any other one or more suitable variable, such as action speed, field of view, type of weapon and angle of attack may be a function of distance of the pointer 406 from the screen. Fig. 4A shows pointer 406 aimed at the transparent plate 402 such that shooting is directed in the direction of an electromagnetic radiation beam 410 emitted by pointer 406.
Figs. 4B and 4C together illustrate an aiming aspect of the shooting functionality produced by reorienting the pointer 406 with respect to the transparent plate 402. Figs. 4D and 4E illustrate a sword fighting functionality, wherein the Z- axis movement of pointer 406 towards and away from the transparent plate 402 is expressed in corresponding Z-axis movement of a sword in virtual 3-dimensional space.
Figs. 4E and 4F together illustrate a three-dimensional sword motion aspect of the sword fighting functionality which is produced by reorienting the pointer 406 with respect to the transparent plate 402 in three dimensions.
It is noted with respect to the embodiment of Figs. 4A, 4B, 4C, 4D, 4E and 4F that the distance and angular orientation of the pointer 406 preferably are sensible by the gaming device 400 based on the shape and size of the impingement pattern of the electromagnetic radiation beam 410 on transparent plate 402. It is appreciated that movement of the pointer 406 in one or more direction may be employed either for corresponding movement of an object in virtual space or for any other functionality.
Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided. Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
Additionally or alternatively, tool-bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided.
It is appreciated that the functionality of Figs. 4A - 4F may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. 1 A - 3 G and 5A - 23.
Reference is now made to Figs. 5A, 5B, 5C, 5D, 5E, 5F, 5G and 5H, which are illustrations of contact management functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 500 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 502 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 504 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 506 operatively associated with the mobile device 500.
Fig. 5A shows pointer 506 aimed at display screen 502 and located at a distance CMl from display screen 502, such that an impingement pattern 508 of an electromagnetic radiation beam 510 is generally centered on a contact manager icon 516.
The functionality of the mobile device 500 causes icon 516 to appear in a visually sensibly emphasized form, as indicated by reference numeral 518. Similarly to that discussed hereinabove with reference to Fig. IH, when, as shown in Fig. 5B, the pointer 506 is located at a distance CM2 from display screen 502 which is equal to or less than a selection threshold ST, or touches the display 502, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. For example, if a user selects icon 516, the contact manager is launched.
Fig. 5B shows the result of selection of icon 516. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
Additionally or alternatively, tool bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided. Reference is now made to Fig. 5C, which illustrates highlighting a contact entry line by aiming the pointer 506 such that electromagnetic radiation beam 510 impinges thereon, when the pointer 506 is located at a distance CM3 from the display screen 502.
Fig. 5D shows the pointer 506 aimed at the same location and now located at a distance CM4 from display screen 502, which is equal to or less than a predetermined drop list threshold DLT. This causes a sub-menu 520 to appear on display screen 502. The sub-menu 520 typically includes contact details corresponding to a given contact entry line. These may include, for example, an email address, a fax number, a mobile telephone number, a VOIP number and a home page URL. Pointing the pointer 506 at one of the items on the sub-menu 520 results in the highlighting of that item, as shown in Fig. 5E. If, while pointing at the same location, the pointer 506 is brought even closer to the display screen 502, such as to a distance CM5, equal to or less than selection threshold ST, a function associated with that item is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
For example, if the pointer 506 is aimed at an email address, an email functionality is actuated and the email address is automatically inserted as designated by reference numeral 522. As another example, if the pointer 506 is aimed at a telephone number, the telephone number is dialed. Referring now to Fig. 5F, it is seen that pointer 506 is aimed at a contact person's name and the entire contact entry line illuminated or otherwise highlighted, when the pointer is located at a distance CM6 from the display screen 502. Fig. 5G shows the pointer aimed at the same location and now located at a distance CM7 from the display screen 502, which is equal to or less than a predetermined expanded data threshold EDT. This causes an expanded listing 530 to appear on screen 502 adjacent the person's name. The expanded list typically includes details relating to the person whose name appears in the contact line. These may include, for example, title, company name and name of spouse.
Pointing the pointer 506 at the expanded listing 530 and bringing the pointer 506 even closer to the display screen 502, such as to a distance CM8, equal to or less than selection threshold ST, causes a function associated with that contact to be actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. For example, as seen in Fig. 5H, the function is display of a V-card associated with the contact.
It is appreciated that the functionality of Figs. 5A - 5H may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 4F and 6A - 23.
Reference is now made to Figs. 6A, 6B, 6C, 6D, 6E, 6F and 6G, which are illustrations of contact management functionality of a mobile device constructed and operative in accordance with another preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 600 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 602 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 604 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 606 operatively associated with the mobile device 600.
Fig. 6A shows pointer 606 aimed at display screen 602 and located at a distance VMl from display screen 602 such that an impingement pattern 608 of an electromagnetic radiation beam 610 is generally centered on a contact manager icon 616.
The functionality of the mobile device 600 causes icon 616 to appear in a visually sensibly emphasized form, as indicated by reference numeral 618. Similarly to that discussed hereinabove with reference to Fig. IH, when, as shown in Fig. 6B, the pointer 606 is located at a distance VM2 from display screen 602 which is equal to or less than a selection threshold ST, or touches the display 602, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. For example, if a user selects icon 616 (Fig. 6A), the contact manager is launched. Fig. 6B shows the result of selection of icon 616, which is a contact word entry form. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided. Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided. Additionally or alternatively, tool bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided. Reference is now made to Fig. 6C, which illustrates entry of a contact word, BURGER, and aiming the pointer such that electromagnetic radiation beam 610 impinges thereon, when the pointer is located at a distance VM3 from the display screen 602. Fig. 6D shows the pointer 606 aimed at the same location and now located at a distance VM4 from display screen 602, which is equal to or less than a predetermined selection threshold ST. This causes a web-like array of related contact identifiers to appear. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
The arrangement of contact identifiers is preferably of the type provided by ThinkMap Inc. as described at www.thinkmap.com. The contact identifiers are typically grouped as to their general relationship with the contact word. Thus Elizabeth Burger, Sally Burger, Nathan Burger, Jed Burger appear as possibly related persons, and Burger King, McDonalds and Wendy's appear as burger purveyors and Burger, Idaho; Hamburg, Germany and Burger Ave., Passaic New Jersey, appear as geographical designations.
Pointing the pointer 606 at one of the contact identifiers results in the highlighting of that item, as shown in Fig. 6E. If, while pointing at the same location, the pointer 606 is brought even closer to the display screen 602, such as to a distance VM5, a function associated with that contact identifier is actuated. For example, if the pointer is aimed at Burger Avenue, as seen in Fig. 6F, Burger Avenue is placed at the center of the screen and arranged around it are contact identifiers associated with Burger Avenue, such as the names of various businesses located on Burger Avenue and names of adjacent streets. The other contact identifiers may still appear on the screen, typically in a very small, but zoomable, format. Referring now to Fig. 6G, which shows pointer 606 aimed at Burger
Avenue on the screen of Fig. 6F, locating the pointer at a distance VM6 from the display screen 602, equal to or less than selection threshold ST. This causes a function associated with Burger Avenue to be actuated. For example, as seen in Fig. 6G, the function is display of a map of Burger Avenue and the surrounding region. It is appreciated that the functionality of Figs. 6 A - 6G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. 1 A - 5H and 7A - 23.
Reference is now made to Figs. 7A, 7B, 7C, 7D, 7E, 7F and 7G5 which illustrate picture viewer functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 700 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 702 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 704 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 706 operatively associated with the mobile device 700. Fig. 7A shows pointer 706 aimed at keyboard 704 and not aimed at display screen 702, which display screen, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality. In this arrangement, display screen 702 typically displays an array of application launch icons 708. Fig. 7B shows pointer 706 located at a first distance PVl from display screen 702, such that an electromagnetic radiation beam 710 emitted thereby impinges on display screen 702 and defines an impingement pattern 712 that is generally centered on a first application launch icon 714, even though it may also partially impinge on other icons. The functionality of the mobile device 700 causes icon 714 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 716. In this case icon 714 is a picture viewer application icon. Similarly to that discussed hereinabove with reference to Fig. IH, when, as shown in Fig. 7C, the pointer 706 is located at a distance PV2 from display screen 702 which is equal to or less than a selection threshold ST or touches the display 702, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. For example, if a user selects icon 714 (Fig. 7B), the picture viewer is launched. Fig. 7C shows the result of selection of icon 714, which is an array of picture thumbnails 718. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided. Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided. Additionally or alternatively, tool bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided.
Reference is now made to Fig. 7D, which illustrates pointing at one of the picture thumbnails such that electromagnetic radiation beam 710 impinges thereon, when the pointer is located at a distance PV3 from the display screen 702, thus producing a slight enlargement of the picture thumbnail on which the electromagnetic radiation beam 710 impinges and optionally display an identifier of the picture thumbnail.
Fig. 7E shows the pointer 706 aimed at the same location and now located at a distance PV4 from display screen 702, which produces yet further enlargement of the picture thumbnail 718. The transition from the relative orientation of the pointer 706 and the display screen 702 in Fig. 7D to that of Fig. 7E creates zooming- in feedback for the user. Conversely, the transition from the relative orientation of the pointer 706 and the display screen 702 in Fig. 7E to that of Fig. 7D creates zooming-out feedback for the user. It is appreciated that the ability to quickly enlarge and reduce pictures on the screen allows for rapid review of a large number of possibly similar pictures without requiring individual selection and exit from each picture. Fig. 7F shows the pointer 706 aimed at the same location and now located at a distance PV5 from display screen 702, which is equal to or less than a predetermined locking distance threshold LT, which locks the extent of enlargement of the picture thumbnail 718 notwithstanding further movement of the pointer. Preferably, a drop-down menu 720 is displayed, providing options for various picture related functions, such as sending via MMS, sending via email, printing and editing.
Fig. 7G shows pointer 706 located at a distance PV6 from display screen 702, preferably less than PV5, which preferably is a selection threshold distance ST. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. It is seen that the impingement pattern 722 of electromagnetic radiation beam 710 is smaller than the impingement pattern of electromagnetic radiation beam shown in Fig. 7F.
In accordance with a preferred embodiment of the present invention, as shown in Fig. 7G, when the pointer 706 is located at distance PV6 from display screen 702 which is equal to less than the selection threshold ST or touches the display screen 702, a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback. hi accordance with the illustrated preferred embodiment of the present invention, when the pointer is located at distance PV6 and is aimed at a menu item on the drop-down-menu 720, the corresponding function is actuated. For example, if the printing function is selected, the picture is downloaded to a printer.
It is appreciated that the functionality of Figs. 7A - 7G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 6G and 8A - 23.
Reference is now made to Figs. 8 A, 8B, 8C, 8D, 8E, 8F, 8G and 8H, which illustrate interactive television functionality of a mobile device constructed and operative in accordance with a preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 800 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 802 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 804 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 806 operatively associated with the mobile device 800.
Fig. 8A shows pointer 806 aimed at keyboard 804 and not aimed at display screen 802, which display screen 802, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality. In this arrangement, display screen 802 typically displays an array of application launch icons 808.
Fig. 8B shows pointer 806 located at a first distance ITl from display screen 802, such that an electromagnetic radiation beam 810 emitted thereby impinges on display screen 802 and defines an impingement pattern 812 that is generally centered on a first application launch icon 814, even though it may also partially impinge on other icons. The functionality of the mobile device 800 causes icon 814 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 816. In this case icon 814 is an interactive television application icon.
Similarly to that discussed hereinabove with reference to Fig. IH, when, as shown in Fig. 8C, the pointer 806 is located at a distance IT2 from display screen 802 which is equal to or less than a selection threshold ST or touches the display 802, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
For example, if a user selects icon 814 (Fig. 8B), the interactive television viewer is launched. Fig. 8C shows the result of selection of icon 814, which is a television picture. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs.
2C - 2E may be provided.
Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
Additionally or alternatively, tool bar/tab functionality of the type described hereinabove with reference to Figs. 2 J - 2P may be provided. Reference is now made to Fig. 8D, which illustrates pointing at a location 816 on the television picture such that electromagnetic radiation beam 810 impinges thereon, when the pointer is located at a distance IT3 from the display screen
802, thus producing a visibly sensible indication of that location on which the electromagnetic radiation beam 810 impinges. Preferably, the visibly sensible indication only appears on regions of the picture which have a selectably actuatable functionality.
The selectably actuatable functionality may be, for example, display of related information, such as player statistics, enhanced detail, or a link to a related web site.
Fig. 8E illustrates additional functionality wherein an icon 818 is visibly or invisibly superimposed on the television picture and impingement of the electromagnetic radiation beam 810 thereon causes a drop-down menu 820 to be displayed, providing options for various content related functions, such as purchasing a product, placing a bet, recording content, requesting further information and linking to a related web site.
Fig. 8F shows pointer 806 located at a distance IT4 from display screen 802, preferably less than IT3, which preferably is a selection threshold distance ST. It is seen that the impingement pattern 822 of electromagnetic radiation beam 810 is smaller than the impingement pattern of electromagnetic radiation beam shown in Fig. 8D.
In accordance with a preferred embodiment of the present invention, as shown in Fig. 8F when the pointer 806 is located at distance IT4 from display screen 802 which is equal to less than a selection threshold ST or touches the display screen 802, a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback. Alternatively, selection may be accomplished by a predetermined change in the Z-distance of the pointer from the screen. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
In accordance with the illustrated preferred embodiment of the present invention, when the pointer is located at distance IT4 and is aimed at a menu item on the sub-menu 820 (Fig. 8E), the corresponding function is actuated. For example, if the betting function is selected, a betting menu 824 appears. Fig. 8G shows the pointer 806 aimed at location 816 and now located at a distance IT5 from display screen 802, which produces enlargement of the television picture in a way such that the impinged upon location remains visible. The transition from the relative orientation of the pointer 806 and the display screen 802 in Fig. 8D to that of Fig. 8 G creates zooming-in feedback for the user. Conversely, the transition from the relative orientation of the pointer 806 and the display screen 802 in Fig. 8G to that of Fig. 8D creates zooming-out feedback for the user.
Fig. 8H shows the pointer 806 aimed at location 816 and now located at a distance IT6 from display screen 802, which is equal to or less than a predetermined locking distance threshold LT, which locks the extent of enlargement of the television picture notwithstanding further movement of the pointer.
It is appreciated that even though the interactive television application described herein is illustrated in the context of mobile devices, it is equally applicable to stationary television receivers. The functionality of Figs. 8A - 8H enables interactive television operation with a minimum or zero buttons on a user control.
It is appreciated that the functionality of Figs. 8A - 8H may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 7G and 9A - 23.
Reference is now made to Figs. 9A, 9B5 9C, 9D, 9E, 9F and 9G, which illustrate user interface functionality of a mobile device constructed and operative in accordance with a further preferred embodiment of the present invention. Preferably the mobile device is a mobile computer and/or communicator 900 configured or retrofitted to have some or all of the functionality described herein and/or in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Preferably the mobile device includes some or all of electromagnetic radiation impingement pattern location, shape and size sensing functionality associated with a display screen 902 and user interface function selection functionality which is responsive to at least one of electromagnetic radiation impingement pattern location, shape and size. A keyboard 904 may be provided as part of the mobile device but may be obviated in accordance with a preferred embodiment of the present invention. There is preferably provided an electromagnetic radiation emitting pointer 906 operatively associated with the mobile device 900. Fig. 9A shows pointer 906 aimed at keyboard 904 and not aimed at display screen 902, which display screen, as noted above, includes electromagnetic radiation impingement pattern location and size sensing functionality. In this arrangement, display screen 902 typically displays an array of application launch icons 908.
Fig. 9B shows pointer 906 located at a first distance MBl from display screen 902, such that an electromagnetic radiation beam 910 emitted thereby impinges on display screen 902 and defines an impingement pattern 912 that is generally centered on a first application launch icon 914, even though it may also partially impinge on other icons. The functionality of the mobile device 900 causes icon 914 to appear in an enlarged or otherwise visually sensibly emphasized form, as indicated by reference numeral 916. In this case icon 914 is a map browser application icon. Similarly to that discussed hereinabove with reference to Fig. IH, when, as shown in Fig. 9C, the pointer 906 is located at a distance MB2 from display screen 902 which is equal to or less than a selection threshold ST or touches the display 902, a selection function is actuated. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less. For example, if a user selects icon 914 (Fig. 9B), the map browser is launched. Fig. 9C shows the result of selection of icon 914, which is an extremely general map or aerial view 920, such as a map of North America which may be superimposed over a corresponding satellite image, typically shown in thumbnail size. Zooming functionality of the type described hereinabove with reference to Figs. IB - IE or of the type described hereinabove with reference to Figs. 2C - 2E may be provided.
Additionally or alternatively, locking functionality of the type described hereinabove with reference to Figs. ID and IE or of the type described hereinabove with reference to Figs. 2F and 2G may be provided.
Additionally or alternatively, hyperlink functionality of the type described hereinabove with reference to Figs. 2H and 21 may be provided.
Additionally or alternatively, tool bar/tab functionality of the type described hereinabove with reference to Figs. 2J - 2P may be provided.
Additionally or alternatively, scrolling functionality of the type described hereinabove with reference to Figs. 3F and 3G may be provided. Reference is now made to Fig. 9D, which illustrates pointing at a region on the map or image such that electromagnetic radiation beam 910 impinges thereon, when the pointer is located at a distance MB3 from the display screen 902, thus producing zooming in on the selected region of the map on which the electromagnetic radiation beam 910 impinges and optionally displaying appropriate text or icons, which identify items of interest, such as for example, historical sites, gas stations and shops or tagged locations. Fig. 9E shows the pointer 906 aimed at the same location and now located at a distance MB4 from display screen 902, which produces yet further zooming in. Conversely, the transition from the relative orientation of the pointer 906 and the display screen 902 in Fig. 9E to that of Fig. 9D creates zooming-out feedback for the user. It is appreciated that the angle at which the pointer 906 is positioned with respect to the screen 902 may be used for selecting or controlling the angle of view of a map or image. It is appreciated that the angle of the pointer 906 is preferably sensible as the shape and orientation of an impingement pattern on the screen 902.
Fig. 9F shows the pointer 906 aimed at the same location and now located at a distance MB5 from display screen 902, which is equal to or less than predetermined locking distance threshold LT, which locks the extent of enlargement of the picture thumbnail notwithstanding further movement of the pointer. Preferably, a drop-down menu 922 is displayed, providing options for various location-related functions, such as dialing a telephone number of a place of business indicated on the map, obtaining directions to a historical site, finding the closest gas station and obtaining location-dependent coupons or sales offers.
Fig. 9G shows pointer 906 located at a distance MB6 from display screen 902, preferably less than MB5, which preferably is a selection threshold distance ST. It is seen that the impingement pattern 924 of electromagnetic radiation beam 910 is smaller than the impingement pattern of electromagnetic radiation beam shown in Fig. 9F.
In accordance with a preferred embodiment of the present invention, as shown in Fig. 9G when the pointer 906 is located at distance MB6 from display screen 902 which is equal to less than a selection threshold ST or touches the display screen 902, a selection function is actuated, which may be considered akin to the click of a conventional mouse. Actuation of the selection function is preferably accompanied by feedback to the user, such as visual, auditory or tactile feedback. Preferably, the selection threshold is defined as an extremely small distance from the display, typically 0.5 mm or less.
In accordance with the illustrated preferred embodiment of the present invention, when the pointer is located at distance MB6 and is aimed at a menu item on the sub-menu 922, the corresponding function is actuated. For example, if telephone dialing function is selected, a corresponding telephone number is dialed.
It is appreciated that the functionality of Figs. 9A - 9G may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 8H and 1OA - 23.
Reference is now made to Figs. 1OA, 1OB, 1OC and 1OD, which illustrate an ultra-mobile PC input device having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention. As seen in Fig. 1OA, an ultra-mobile PC input device 1000, such as an ASUS R2H, commercially available from ASUSTeK Computer Inc. of Taiwan, is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Accordingly, as seen in enlargement I of Fig. 1OA the ultra-mobile PC input device 1000 may be used together with a light emitting stylus 1002 of the type described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. Stylus 1002 produces an impingement pattern 1003, whose location, size and shape may be detected.
Additionally or alternatively, device 1000 may be equipped with an IR electromagnetic radiation source 1004, providing IR radiation in a region 1006 generally overlying a display screen 1008 thereof. IR electromagnetic radiation source 1004 may be provided in various alternative embodiments as described in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. hi such an embodiment or when sufficient ambient IR is present, the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1010, seen in enlargement II or a user's finger 1012, seen in enlargement III. Stylus 1010 produces an impingement pattern 1013, whose location, size and shape may be detected. Finger 1012 produces an impingement pattern 1014, whose location, size and shape may be detected.
Turning to Fig. 1OB, there is shown a tablet PC input device 1020, such as an STYLISTIC ST5112 commercially available from Fujitsu, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Accordingly, as seen in enlargement I of Fig. 1OB the tablet PC input device 1020 may be used together with a light emitting stylus 1022 of the type described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. Stylus 1022 produces an impingement pattern 1023, whose location, size and shape may be detected.
Additionally or alternatively, device 1020 may be equipped with an IR electromagnetic radiation source 1024, providing IR radiation in a region 1026 generally overlying a display screen 1028 thereof. In such an embodiment or when sufficient ambient IR is present, the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1030, seen in enlargement II or a user's finger 1032 seen in enlargement III. Stylus 1030 produces an impingement pattern 1033, whose location, size and shape may be detected. Finger 1032 produces an impingement pattern 1034, whose location, size and shape may be detected. Fig 1OC shows a media display device 1040, such as an AQUOS 46"
LCD HDTV commercially available from Sharp or a PANASONIC TH-58PX600U plasma monitor, commercially available from Panasonic, configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Accordingly, as seen in enlargement I of Fig. 1OC the media display device 1040 may be used together with a remote control unit 1042, such as that described hereinbelow with reference to Fig. 11. Remote control unit 1042 produces an impingement pattern 1043, whose location, size and shape may be detected. Additionally or alternatively, device 1040 may be equipped with an IR electromagnetic radiation source 1044, providing IR radiation in a region 1046 generally overlying a display screen 1048 thereof. In such an embodiment or when sufficient ambient IR is present, the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1050, seen in enlargement II or a user's finger 1052 seen in enlargement III. Stylus 1050 produces an impingement pattern 1053, whose location, size and shape may be detected. Finger 1052 produces an impingement pattern 1054, whose location, size and shape may be detected.
Turning now to Fig 10D, there is seen an interactive wall sized media display device 1060, such as for example, an PRODISC HOLOSCREEN or a PRODISC VISION 2000, commercially available from Prodisc Technology Incorporated, a TFT-LCD WALL, commercially available from Bomoon Electronics Co. of Seoul, Korea, or a display suitable for use with a PT-AE700U HOME CINEMA LCD PROJECTOR, commercially available from Panasonic, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Accordingly, as seen in enlargement I of Fig. 1OD the interactive wall sized media display device 1060 may be used together with a remote control unit 1062, such as that described hereinbelow with reference to Fig. 11. Remote control unit 1062 produces an impingement pattern 1063, whose location, size and shape may be detected.
Additionally or alternatively, device 1060 may be equipped with an IR electromagnetic radiation source 1064, providing IR radiation in a region 1066 generally overlying a display screen 1068 thereof. In such an embodiment or when sufficient ambient IR is present, the user interface functionality of the present invention may be responsive to the position of a passive object, such as a reflective stylus 1070, seen in enlargement II or a user's finger 1072, seen in enlargement III. Stylus 1070 produces an impingement pattern 1073, whose location, size and shape may be detected. Finger 1072 produces an impingement pattern 1074, whose location, size and shape may be detected.
It is appreciated that the functionality of Figs. 1OA - 1OD may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 9G and ll - 23.
Reference is now made to Fig. 11, which schematically illustrates a remote control unit 1100, which may be employed in the embodiments of Figs. 1OC and 1OD described hereinabove. As seen in Fig. 11, the remote control unit preferably comprises a housing 1102, on an outer surface 1104 of which is provided a finger operated actuation button 1106. The actuation button 1106 operates electromagnetic radiation emitting apparatus 1108, which may be of various forms, some examples of which are shown in enlargements I, II, III, IV and V. Enlargement I schematically shows a laser light emitter 1110, which may preferably be constructed and operative in accordance with the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027; filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Enlargement II illustrates the use of a LED 1112, with which is associated a collimator 1114. Enlargement III illustrates the use of a LED 1116 together with one or more lenses 1118. Enlargement IV illustrates the use of a collimated LED 1120, such a LED having a lens or other field limiting functionality that creates a directional and somewhat convergent propagation pattern. Enlargement V illustrates the use of a LED 1122 associated with mirrors 1124.
It is appreciated that the functionality of Fig. 11 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 1OD and 12A - 23.
Reference is now made to Figs. 12 A, 12B and 12C, which are simplified illustrations of point and highlight, cursor feedback and mouseover feedback functionalities constructed and operative in accordance with a preferred embodiment of the present invention. Figs. 12A - 12C illustrate an LCD type flat panel display. It is appreciated that flat panel displays of this type typically are constructed with anti-glare surface layers and thus do not readily reflect impinging radiation of the type emitted by laser pointers.
Fig. 12A shows the provision of a readily viewable cursor indication 1200 at a location corresponding to the location of a user-selectable electromagnetic radiation impingement pattern 1201 on a flat panel display 1202. This functionality is provided by circuitry associated with the flat panel display 1202, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. hi accordance with a preferred embodiment of the present invention, a remote control unit 1204, of the general type described hereinabove with reference to Fig. 11, is employed together with the flat panel display 1202 in order to provide the cursor indication 1200. As indicated in enlargement I, utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1201 and optionally the distance of the remote control unit 1204, generates cursor indication 1200, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1201 and whose size may be a function of the distance of the remote control unit 1204 from the flat panel display 1202 or may be a function of any other suitable user-controllable variable.
As indicated in enlargements II and III respectively, light reflected from an object, such a stylus 1206 (enlargement II) or a user's finger or hand 1208 (enlargement III) impinges on the flat panel display 1202 in order to provide the cursor indication 1200. Utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1201 and optionally the distance of the object, generates cursor indication 1200, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1201 and whose size may be a function of the distance of the object from the flat panel display 1202 or may be a function of any other suitable user-controllable variable. The light reflected from the stylus 1206 or the user's finger or hand 1208 may be ambient light or may, for example, originate from an IR light source 1210 which illuminates a region 1212 in front of the flat panel display 1202.
Fig. 12B shows the provision of a readily viewable trajectory indication 1220 representing movement of the location of a user-selectable electromagnetic radiation impingement pattern 1221 on a flat panel display 1222. This functionality is provided by circuitry (not shown) associated with the flat panel display 1222, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As indicated in enlargement I, a remote control unit 1224, of the general type described hereinabove with reference to Fig. 11, is employed together with the flat panel display 1222 in order to provide the trajectory indication 1220. Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1221 and optionally the distance of the remote control unit 1224, generates trajectory indication 1220, which corresponds generally to the path of the electromagnetic radiation impingement pattern 1221 on the flat panel display 1222 and whose thickness, size or color may be a function of the distance of the remote control unit 1224 from the flat panel display 1222 or may be a function of any other suitable user-controllable variable.
Optionally, the trajectory indication 1220 may be processed by the utilization circuitry employing paint or photo retouching software, such as ADOBE ILLUSTRATOR AND ADOBE PHOTOSHOP or handwriting recognition algorithms, such as that available to the trade from MyScript, and implemented commercially in the Nokia Digital Pen and the Logitech Digital Pen. Clearly, the trajectory indication functionality is applicable to display screens of all sizes, for example those used in mobile communicators and ultra-mobile PCs. Optionally, the trajectory information and/or the processed data arising therefrom may be transmitted, using conventional technology, to another device or display. Alternatively, a selected portion or the entirety of a displayed image may be moved on the display in a manner corresponding to the trajectory of the remote control unit 1224.
As indicated in enlargements II and III respectively, light reflected from an object, such as stylus 1226 (enlargement II) or a user's finger or hand 1228 (enlargement III) impinges on the flat panel display 1222, producing an impingement pattern 1221 which results in the provision of the trajectory indication 1220. Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1221 and optionally the distance of the stylus 1226 or the finger or hand 1228, generates trajectory indication 1220, which corresponds generally to the path of the electromagnetic radiation impingement pattern 1221 on the flat panel display 1222 and whose thickness, size or color may be a function of the distance of the stylus 1226 or the finger or hand 1228 from the flat panel display 1222 or may be a function of any other suitable user-controllable variable. The light reflected from the stylus 1226 or the user's finger or hand 1228 may be ambient light or may, for example, originate from an IR light source 1230 which illuminates a region 1232 in front of the flat panel display 1222.
Fig. 12C shows the provision of a readily viewable mouseover indication 1240 at a location corresponding to the location of user-selectable electromagnetic radiation impingement pattern 1241 on a flat panel display 1242. As illustrated in Fig. 12C, the mouseover indication is, for example, a black/white reversal of a selected icon. Alternatively, the moveover indication may be any other suitable type of visually sensible change or auditory feedback. This functionality is provided by circuitry associated with the flat panel display 1242, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As indicated in enlargement I, a remote control unit 1244, of the general type described hereinabove with reference to Fig. 11, is employed together with the flat panel display 1242 in order to provide the mouseover indication 1240. Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1241 and optionally the distance of the remote control unit 1244, generates mouseover indication 1240, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1241, whose size may be a function of the distance of the remote control unit 1244 from the flat panel display 1242 or may be a function of any other suitable user-controllable variable.
As indicated in enlargements II and III respectively, light reflected from an object, such as a stylus 1246 (enlargement II) or a user's finger or hand 1248 (enlargement III) impinges on the fiat panel display 1242, producing an impingement pattern 1241 which results in the provision of the mouseover indication 1240. Utilization circuitry (not shown), receiving inputs indicating the location of the impingement pattern 1241 and optionally the distance of the stylus 1246 or the finger or hand 1248, generates mouseover indication 1240, whose location corresponds generally to the location of the electromagnetic radiation impingement pattern 1241 and whose size may be a function of the distance of the stylus 1246 or the finger or hand 1248 from the flat panel display 1242 or may be a function of any other suitable user-controllable variable. The light reflected from the stylus or the user's finger or hand may be ambient light or may, for example, originate from an IR light source 1250 which illuminates a region 1252 in front of the flat panel display 1242.
It is appreciated that the functionality of Figs. 12A - 12C may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 11 and 13A - 23. Reference is now made to Figs. 13A and 13B, which are simplified illustrations of point and click and z-axis click functionalities constructed and operative in accordance with a preferred embodiment of the present invention. Figs. 13 A and 13B illustrate an ultra-mobile PC input device 1300 of the type described hereinabove with reference to Fig. 1OA, having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention.
Fig. 13 A shows the provision of object position actuated point and click functionality at the location of a user-selectable electromagnetic radiation impingement pattern 1301 on an ultra-mobile PC input device 1300. This functionality is provided by circuitry preferably incorporated in the device 1300, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As indicated in enlargement I, a light emitting stylus 1302 is employed together with the ultra-mobile PC input device 1300 in order to provide point functionality. Utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1301 and the distance of the light emitting stylus 1302, optionally generates a visually sensible pointing indication 1304, which corresponds generally to the location of the electromagnetic radiation impingement pattern 1301 on the ultra-mobile PC input device 1300. The presence of the pointing indication 1304 at an actuatable zone may produce a visually sensible mouseover effect, for example, reversal of white/black or a change of color of the pointing indication 1304. As indicated in enlargement II, a change in the position of the light emitting stylus 1302, such as bringing the stylus closer to the ultra-mobile PC device 1300, produces a click functionality, such as, for example, enlargement of an icon, launching of an application or requesting specific data.
Fig. 13B shows the provision of time actuated point and click functionality at the location of a user-selectable electromagnetic radiation impingement pattern on an ultra-mobile PC input device 1320. This functionality is provided by circuitry preferably incorporated in the device 1320, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As indicated in enlargement I, a light emitting stylus 1322 is employed together with the ultra-mobile PC input device 1320 in order to provide point functionality. Utilization circuitry (not shown) receiving inputs indicating the location of the impingement pattern 1321 and, optionally, the distance of the light emitting stylus 1322, optionally generates a visually sensible pointing indication 1324, which corresponds generally to the location of the electromagnetic radiation impingement pattern 1321 on the ultra-mobile PC input device 1320. The presence of the pointing indication 1324 at an actuatable zone may produce a visually sensible mouseover effect, for example, reversal of white/black or a change of color of the pointing indication 1324.
As indicated in enlargement II, maintaining the position of the light emitting stylus 1322 for at least a predetermined duration of time, such as 500 msec, produces a click functionality, produces a click functionality, such as, for example, enlargement of an icon, launching of an application or requesting specific data.
It is appreciated that the functionality of Figs. 13 A - 13B may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 12C and 14A - 23.
Reference is now made to Figs. 14A, 14B, 14C, 14D, 14E and 14F which are simplified illustrations of various functionalities constructed and operative in accordance with a preferred embodiment of the present invention. Figs. 14A and 14B illustrate a flat panel display of the type described hereinabove with reference to Fig. 1OD, having user interface functionality constructed and operative in accordance with a preferred embodiment of the present invention.
Fig. 14A illustrates functionality for controlling a presentation on a display by user directed light impingement on the display. This functionality is provided by circuitry, preferably incorporated in the flat panel display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 14A, a presenter, preferably employing a remote control unit 1400 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1400 such that an electromagnetic radiation impingement pattern 1401 emitted therefrom impinges upon a forward indication 1402, here shown in the form of an arrow appearing on a display 1404. This impingement causes the next presentation frame 1406 to be displayed.
Fig. 14B illustrates functionality for point and drag selection on a display by user directed light impingement on the display. This functionality is provided by circuitry, preferably incorporated in a flat panel display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 14B, a presenter, preferably employing a remote control unit 1420 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1420 such that light emitted therefrom impinges upon a user-selected region of the display 1422, such that an electromagnetic radiation impingement pattern 1424 functions as a point selector, enabling the user to select a selection point indicated by a selection point indicator 1426. The presenter can then drag the selection point indicator 1426, to define a selection area 1428. The portion of the image located within the selection area 1428 may then be enlarged to fill the entire display as indicated at reference numeral 1430. Fig. 14C illustrates functionality for drop down menu activation on a display by user directed light impingement on a display 1440. This functionality is provided by circuitry, preferably incorporated in a flat panel display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 14C, a user, preferably employing a remote control unit 1442 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1442 such that an electromagnetic radiation impingement pattern 1444 emitted therefrom impinges upon a drop down menu icon 1446 on the display 1440 to function as a drop down menu activator. Clicking on the icon 1446, as by one of the techniques described hereinabove with reference to Figs. 13 A and 13B, causes the drop down menu 1448 to be displayed. Fig. 14D illustrates functionality for pop out menu activation on a display by user directed light impingement on the display and/or on a peripheral frame thereof. This functionality is provided by circuitry, preferably incorporated in the display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 14D, a user, preferably employing a remote control unit 1450 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1450 such that light emitted therefrom impinges upon a "hot" zone 1452 of a display 1454 or of a peripheral frame 1456 thereof such that a light impingement pattern 1458 functions as a pop out menu activator. Upon clicking on a portion of the "hot" zone 1452, as by one of the techniques described hereinabove with reference to Figs. 13A and 13B, a pop out menu 1460 is displayed. The pop out menu may include various functions, such as, for example, a program pause functionality, links to relevant web sites, operating system functionalities, such as record, play, channel select and medium or content shift.
Fig. 14E illustrates functionality for animation activation on a display by user directed light impingement on the display and/or on a peripheral frame thereof. This functionality is provided by circuitry, preferably incorporated in the display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 14E, a presenter, preferably employing a remote control unit 1470 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1470 such that light emitted therefrom impinges upon an "animation activation" zone 1472 of the display 1474, such that a light impingement pattern 1476 functions as an animation activator. Upon clicking on a portion of the "animation activation" zone 1472, as by one of the techniques described hereinabove with reference to Figs. 13A and 13B, the animation is played, as seen figuratively in the enlargement at reference numeral 1478. Fig. 14F illustrates functionality for 3D image rotation activation on a display by user directed light impingement on the display. This functionality is provided by circuitry, preferably incorporated in the display, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 14F, a user, preferably employing a remote control unit 1480 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1480 such that light emitted therefrom impinges upon a portion of a displayed image 1482 containing 3 dimensional information, such that a light impingement pattern 1484 functions as a selection point actuator, which identifies the displayed image to be rotated. The presenter can then drag the selection point with a movement, shown by an arrow 1486, which defines an axis 1488 and an extent of rotation. The selected displayed image is then rotated accordingly. It is appreciated that the functionality of Fig. 14F may also be employed for 2D or 3D rotation. This functionality may find particularly utility when employed in a display providing 3D image perception, such as SHARP LL-151 -3D monitor.
It is appreciated that the functionality of Figs. 14A - 14F may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 13B and l5A - 23.
Reference is now made to Figs. 15 A, 15B, 15C and 15D, which illustrate functionality for gaming constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a display or in associated gaming apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Typically one or more players may control the movement and orientation of one or more avatars or other objects displayed on a display screen such as a flat display of the type described hereinabove with reference to Fig. 1OC or a CRT display.
Fig. 15A illustrates a player employing a light emitting stylus 1502, typically in the fanciful shape of an airplane, for controlling the motion of a displayed object, such as an airplane 1504, wherein three-dimensional mapping of the three- dimensional movement of the stylus 1502 to corresponding three-dimensional motion of the airplane 1504 is provided. By three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15 A. In Fig. 15 A, the user is seen twisting his wrist to effect a near rotation of stylus 1502, producing a change in the detected shape and/or orientation of a corresponding impingement pattern 1506, which results in tilting of airplane 1504 and a change of the airplane's direction in virtual space.
Fig. 15B illustrates the player employing the light emitting stylus 1502 for controlling the motion of the displayed airplane 1504, wherein three-dimensional mapping of the three-dimensional movement of the stylus 1502 to corresponding the three-dimensional motion of the airplane is provided. By three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15B. In Fig. 15B, the user is seen flexing his wrist to effect pivoting of stylus 1502, producing a change in the detected shape and/or orientation of a corresponding impingement pattern 1506, which results in upward tilting of airplane 1504 and a change of the airplane's direction in virtual space.
Fig. 15C illustrates the player employing the light emitting stylus 1502 for controlling the motion of the displayed airplane 1504, wherein Z mapping of the three-dimensional movement of the stylus 1502 towards or away from a display screen to a corresponding change in the speed of the airplane is provided. In Fig. 15C, the user is stretching out his arm towards a display screen 1508, thereby decreasing the size of the corresponding impingement pattern 1506, which results in an increase in the virtual speed of the airplane 1504. Fig. 15D illustrates a player virtually throwing a dart by moving a light emitting stylus 1522 in a throwing motion, wherein three-dimensional mapping of the movement of the stylus 1522 to corresponding three-dimensional motion of a virtual dart 1524 is provided. By three-dimensional movement is preferably meant any combination of at least three of X, Y, Z, theta and phi, as indicated in Fig. 15D. In Fig. 15D, the user's hand and arm execute a throwing motion, thereby changing the size, shape and orientation of a corresponding impingement pattern 1526 on a display screen 1528, which results in a virtual dart throw. In this embodiment the absolute position of the stylus 1522, which is known by sensing the size and shape of the impingement pattern 1526, has importance in establishing the distance across which the virtual dart 1524 is thrown.
It is appreciated that the functionality of Figs. 15A - 15D may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 14F and l6A - 23.
Reference is now made to Figs. 16A, 16B and 16C, which illustrate interactive television functionality, constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a television or in associated interactive television apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Fig. 16A illustrates a scenario wherein a user is watching a movie on a display 1600 and sees an image 1602 of a vehicle which is of interest to him. The user preferably directs a remote control unit 1604 of the type described hereinabove with reference to Fig. 11 onto the displayed image 1602. hi this case, the vehicle has been previously designated as an interactive - enabled object. Thus impingement of a light beam from remote control unit 1604 on the image of the vehicle, which produces a sensed impingement pattern 1606, causes the image of the vehicle to be highlighted as indicated by reference numeral 1608, providing visually sensible or auditory feedback to the user, alerting the user to the interactive designation of the image 1602.
As seen in Fig. 16B, clicking on the image 1602 (Fig. 16A) of the vehicle, as by one of the techniques described hereinabove with reference to Figs. 13 A and 13B, causes an advertisement 1610 to be displayed on display 1600, immediately or at an appropriate pre-scheduled commercial break in the movie. Additionally or alternatively and optionally simultaneously a discount offer for the vehicle shown in image 1602 or a competing vehicle, may be sent to the user's computer 1612, by email or any other suitable methodology. Additionally or alternatively and optionally simultaneously a discount offer for the vehicle shown in image 1602 or a competing vehicle, may be sent to the user's telephone 1614 by an SMS or other messaging functionality.
As seen in Fig. 16C, additionally or alternatively to the functionality described hereinabove with reference to Fig. 16B, clicking on the image 1602 (Fig. 16A) of the vehicle, as by one of the techniques described hereinabove with reference to Figs. 13 A and 13B, causes a selection palette 1630 to be displayed on display 1600, immediately or at an appropriate pre-scheduled commercial break in the movie. The selection palette may offer various models of the vehicle shown hi image 1602 or various options for purchase thereof. User selection of one of the items appearing in the selection palette 1630 may cause a corresponding advertisement 1610 to be displayed on display 1600, as described hereinabove with reference to Fig. 16B. Preferably, clicking on an item in the selection palette 1630 or alternatively, clicking on the image 1602 by the user may effect purchase of the vehicle.
It is appreciated that the functionality of Figs. 16A - 16C may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 15D and l7A - 23. Reference is now made to Figs. 17 A, 17B and 17C, which illustrate display interface functionality, constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a display or in associated computer or control apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 17A, a user, preferably employing a remote control unit 1700 of the type described hereinabove with reference to Fig. 11, aims the remote control unit 1700 such that light emitted therefrom impinges upon a selectable item 1701, here "MY PICTURES" in a menu 1702 appearing on a display 1704, causing the selectable item 1701 to appear highlighted as indicated by reference numeral 1706. Upon clicking on the selectable item, as by one of the techniques described hereinabove with reference to Figs. 13A and 13B, the item is selected. The result of this selection is shown in Fig. 17B, which shows "thumbnails" of a plurality of selectable pictures 1708 together with an enlargement 1710 of a "thumbnail" 1712 which is impinged upon by light from the remote control unit 1700. Preferably, the "thumbnail" 1712 appears in a highlighted or other visually sensible form as indicated by reference numeral 1714. Fig. 17C shows the result of selection of one of the selectable pictures, as by clicking using one of the techniques described hereinabove with reference to Figs. 13 A and 13B, which includes data 1716 regarding the selected picture or information regarding user options in connection therewith.
It is appreciated that the functionality of Figs. 17A - 17C are but one example of a navigation system which enables a user to efficiently select a function or content from among a great variety of options. It is appreciated that the illustrated "point and click" direct icon or item selectability provides a highly user-friendly interface as compared with conventional interfaces.
It is appreciated that the functionality of Figs. 17A - 17C may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 16C and l8A - 23.
Reference is now made to Figs. 18A and 18B, which are simplified illustrations of zoom and playback functionality constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a mobile device, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Fig. 18A shows a user employing an ultra-mobile PC input device 1800 of the type described hereinabove with reference to Fig. 1OA, and typically a reflective stylus 1802, points on an object 1804, here a car, producing a zoomed in image of a portion of a displayed image appearing on device 1800 including that object. The sensed shape and size of the impingement pattern 1806 may govern the shape and size of the zoomed in image.
Fig. 18B illustrates a zoom and replay functionality, wherein a user employing the input device 1800 and the reflective stylus 1802, points on the object 1804, here a car, automatically producing a replay of a zoomed in image of a portion of a displayed image appearing on device 1800 including that object and/or of an advertisement 1808 related to that object. The sensed shape and size of the impingement pattern 1806 may govern the shape and size of the zoomed in image and/or the duration or speed of the replay.
It is appreciated that the functionality of Figs. 18A - 18B may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. lA - 17C and l9 - 23.
Reference is now made to Fig. 19, which is a simplified illustration of handwriting input functionality constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a mobile device, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 19, a user typically employs a reflective stylus 1900 to "write" onto the display screen 1902 of a mobile telephone 1904 having some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
The movement of an impingement pattern 1906 over the display screen 1902 is sensed using the above-mentioned functionality and is employed as an input to conventional handwriting input circuitry, which may or may not reside on the mobile telephone 1904. The handwriting input circuitry may be handwriting recognition circuitry, such as for example MYSCRIPT®, commercially available from Vision Objects S. A. in Nantes, France or image archiving circuitry, such as, for example, Microsoft PAINT. It is appreciated that the above-mentioned functionality enables three- dimensional input recognition, such as recognition of gestures and enables various three-dimensional input responsive effects, such as line thickness variability to be provided.
It is appreciated the above-mentioned functionality obviates the need for the use of special paper and a complex and expensive input pen, as is required by conventional handwriting input techniques such as those of Anoto Group AB of Sweden.
It is appreciated that the functionality of Fig. 19 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 18B and 2OA - 23.
Reference is now made to Figs. 2OA and 2OB, which are simplified illustrations of simultaneous multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a mobile device, such as a PDA which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. As seen from a consideration of Figs. 2OA and 2OB, the sensing functionality of the present invention is able to distinguish between the presence of one and two fingers, even when the two fingers are touching one another. Thus, as seen in Fig. 2OA, a sensed downward trajectory of an impingement pattern, as indicated by an arrow 2000, produced by a single finger may produce scrolling at a first speed, as indicated schematically by an arrow 2002, while a sensed downward trajectory of an impingement pattern, as indicated in Fig. 20B by an arrow 2004 of two mutually touching fingers, may produce scrolling at a second speed, faster than the first speed, as indicated schematically by an arrow 2006.
It is appreciated that the functionality of Figs. 2OA - 2OB may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 19 and 21 - 23.
Reference is now made to Fig. 21, which is a simplified illustration of simultaneous multiple input responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a mobile device such as a PDA, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference. As seen from a consideration of Fig. 21, the sensing functionality of the present invention is responsive to rotation of two mutually spaced fingers 2100 and 2102, moving in two separate trajectories for producing, for example, rotation of a picture 2104 resulting in a rotated picture 2106. It is appreciated that the functionality of Fig. 21 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 2OB and 22 - 23.
Reference is now made to Fig. 22, which is a simplified illustration of input size/shape responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a mobile device such as a cellular telephone, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
As seen in Fig. 22, the input size/shape responsive functionality constructed and operative in accordance with a preferred embodiment of the present invention may be employed to provide a very convenient on-off function, such as a quick telephone ringer mute function, which may be activated by detection of impingement pattern corresponding to laying of a hand 2200 of a user over generally the entire display area 2202 of a mobile telephone 2104. It is appreciated that the functionality of Fig. 22 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described herein with reference to Figs. IA - 21 and 23.
Reference is now made to Fig. 23, which illustrates multiple input responsive functionality for gaming constructed and operative in accordance with a preferred embodiment of the present invention. This functionality is provided by circuitry, preferably incorporated in a display or in associated gaming apparatus, which is configured or retrofitted to have some or all of the functionality described hereinabove and/or in the teachings of one or more of the following applicants'/inventors' patent documents: Published PCT Patent Applications: WO 03/104965, WO 2005/094176 and WO 2007/029257, PCT Patent Application No. PCT/IL2007/000332, U.S. Provisional Patent Application No. 60/715,546, filed September 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027, filed November 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional Patent Application No. 60/789,188, filed April 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES and U.S. Patent Application Publication No. 2005/0156914, the disclosures of which are hereby incorporated by reference.
Typically one or more players may each control the movement and orientation of one or more avatars or other objects displayed on a display screen 2300 such as a flat display of the type described hereinabove with reference to Fig. 1OC or a CRT display. It is a particular feature of the present invention that the functionality thereof is able to distinguish between different electromagnetic radiation impingement patterns, such as patterns 2302 and 2304 produced by respective gaming control devices 2312 and 2314, as well as between their respective trajectories. The functionality may employ different modulations or different beam shapes for this purpose, for example.
It is appreciated that the functionality of Fig. 23 may be provided and/or used alone or in combination with any other suitable functionality, such as any one or more of the other functionalities described hereinabove with reference to Figs. IA - 22. It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described hereinabove. Rather the scope of the present invention includes both combinations and sub- combinations of various features described and shown herein and modifications and variations thereof which are not known in the prior art.

Claims

C L A I M S
1. A computer input device comprising: at least one sensor operative to sense at least one position coordinate of at least one object with respect to a user-selectable electromagnetic radiation impingement pattern; and object position responsive circuitry responsive at least partially to said at least one position coordinate and to the position of said user-selectable electromagnetic radiation impingement pattern for actuating at least one interactive function.
2. A computer input device according to claim 1 and wherein said at least one sensor is operative to sense the position of said user-selectable electromagnetic radiation impingement pattern with respect to a surface of said computer input device.
3. A computer input device according to claim 1 and wherein said at least one sensor is operative to sense a metric of the separation between said at least one object and said user-selectable electromagnetic radiation impingement pattern.
4. A computer input device according to claim 3 and wherein said metric has a Z component and at least one of an X component and a Y component.
5. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a selecting function.
6. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a zooming function.
7. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a lock-on function.
8. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a link actuating function.
9. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a muting function.
10. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a menu actuation function.
11. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a sub-menu actuation function.
12. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a map browsing function.
13. A computer input device according to any of the preceding claims and wherein said at least one interactive function is an application launching function.
14. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a web navigation function.
15. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a document navigation function.
16. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a picture enlargement function.
17. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a mouseover function.
18. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a highlighting function.
19. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a cursor control function.
20. A computer input device according to any of the preceding claims and wherein said at least one interactive function is an on-off function.
21. A computer input device according to any of the preceding claims and wherein said at least one sensor is also operative to sense a sequence of said at least one position coordinate of said at least one object with respect to a user-selectable electromagnetic radiation impingement pattern.
22. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a gaming function.
23. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a scrolling function.
24. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a handwriting recognition function.
25. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a rotation function.
26. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a page turning function.
27. A computer input device according to any of the preceding claims and wherein said at least one interactive function is a panning function.
28. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense at least one position coordinate of at least one electromagnetic radiation emitting object with respect to a user-selectable electromagnetic radiation impingement pattern emitted therefrom.
29. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense at least one position coordinate of at least one electromagnetic radiation reflecting object with respect to a user-selectable electromagnetic radiation impingement pattern reflected therefrom.
30. A computer input device according to claim 28 and wherein said at least one electromagnetic radiation emitting object is a remote control device including at least one collimated LED electromagnetic radiation emitter.
31. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation reflecting objects.
32. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation reflecting objects.
33. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense relative positions of at least two electromagnetic radiation reflecting objects.
34. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation emitting objects.
35. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation emitting objects.
36. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense relative positions of at least two electromagnetic radiation emitting objects.
37. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense at least one position coordinate of at least two fingers.
38. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense changes over time of at least one position coordinate of at least two fingers.
39. A computer input device according to any of the preceding claims and wherein said at least one sensor is operative to sense relative positions of at least two fingers.
40. A computer input device comprising: at least one sensor operative to sense at least two of X, Y, Z, theta and phi position coordinates of an object with respect to at least one input surface; and object position responsive circuitry responsive at least partially to a Z position coordinate together with at least one of said X, Y, theta and phi position coordinates for actuating at least one interactive function.
41. A computer input device according to claim 40 and wherein said at least one input surface is a display surface.
42. A computer input device according to claim 40 and wherein said at least one input surface is at least partially outside a display surface.
43. A computer input device according to any of claims 40-42 and wherein said at least one interactive function is a selecting function.
44. A computer input device according to any of any of claims 40-43 and wherein said at least one interactive function is a zooming function.
45. A computer input device according to any of claims 40-44 and wherein said at least one interactive function is a lock-on function.
46. A computer input device according to any of claims 40-45 and wherein said at least one interactive function is a link actuating function.
47. A computer input device according to any of claims 40-46 and wherein said at least one interactive function is a muting function.
48. A computer input device according to any of claims 40-47 and wherein said at least one interactive function is a menu actuation function.
49. A computer input device according to any of claims 40-48 and wherein said at least one interactive function is a sub-menu actuation function.
50. A computer input device according to any of claims 40-49 and wherein said at least one interactive function is a map browsing function.
51. A computer input device according to any of claims 40-50 and wherein said at least one interactive function is an application launching function.
52. A computer input device according to any of claims 40-51 and wherein said at least one interactive function is a web navigation function.
53. A computer input device according to any of claims 40-52 and wherein said at least one interactive function is a document navigation function.
54. A computer input device according to any of claims 40-53 and wherein said at least one interactive function is a picture enlargement function.
55. A computer input device according to any of claims 40-54 and wherein said at least one interactive function is a mouseover function.
56. A computer input device according to any of claims 40-55 and wherein said at least one interactive function is a highlighting function.
57. A computer input device according to any of claims 40-56 and wherein said at least one interactive function is a cursor control function.
58. A computer input device according to any of claims 40-57 and wherein said at least one interactive function is an on-off function.
59. A computer input device according to any of claims 40-58 and wherein said at least one sensor is also operative to sense a sequence of said at least two of X, Y5 Z, theta and phi position coordinates of an object with respect to at least one input surface.
60. A computer input device according to any of claims 40-59 and wherein said at least one interactive function is a gaming function.
61. A computer input device according to any of claims 40-60 and wherein said at least one interactive function is a scrolling function.
62. A computer input device according to any of claims 40-61 and wherein said at least one interactive function is a handwriting recognition function.
63. A computer input device according to any of claims 40-62 and wherein said at least one interactive function is a rotation function.
64. A computer input device according to any of claims 40-63 and wherein said at least one interactive function is a page turning function.
65. A computer input device according to any of claims 40-64 and wherein said at least one interactive function is a panning function.
66. A computer input device according to any of claims 40-65 and wherein said object is an electromagnetic radiation emitting object and said at least one sensor is operative to sense said at least two position coordinates with respect to a user-selectable electromagnetic radiation impingement pattern emitted from said object.
67. A computer input device according to any of claims 40-65 and wherein said object is an electromagnetic radiation reflecting object and said at least one sensor is operative to sense said at least two position coordinates with respect to a user- selectable electromagnetic radiation impingement pattern reflected from said object.
68. A computer input device according to claim 66 and wherein said electromagnetic radiation emitting object is a remote control device including at least one collimated LED electromagnetic radiation emitter.
69. A computer input device according to any of claims 40-68 and wherein said at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation reflecting objects.
70. A computer input device according to any of claims 40-69 and wherein said at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation reflecting objects.
71. A computer input device according to any of claims 40-70 and wherein said at least one sensor is operative to sense relative positions of at least two electromagnetic radiation reflecting objects.
72. A computer input device according to any of claims 40-71 and wherein said at least one sensor is operative to sense at least one position coordinate of at least two electromagnetic radiation emitting objects.
73. A computer input device according to any of claims 40-72 and wherein said at least one sensor is operative to sense changes over time of at least one position coordinate of at least two electromagnetic radiation emitting objects.
74. A computer input device according to any of claims 40-73 and wherein said at least one sensor is operative to sense relative positions of at least two electromagnetic radiation emitting objects.
75. A computer input device according to any of claims 40-74 and wherein said at least one sensor is operative to sense at least one position coordinate of at least two fingers.
76. A computer input device according to any of claims 40-75 and wherein said at least one sensor is operative to sense changes over time of at least one position coordinate of at least two fingers.
77. A computer input device according to any of claims 40-76 and wherein said at least one sensor is operative to sense relative positions of at least two fingers.
PCT/IL2007/000433 2006-04-03 2007-04-01 User interface functionalities WO2007113828A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/IL2008/000355 WO2008111079A2 (en) 2007-03-14 2008-03-13 Interactive devices
US15/130,899 US10534496B2 (en) 2007-03-14 2016-04-15 Interactive devices
US16/713,909 US11586317B2 (en) 2007-03-14 2019-12-13 Interactive devices
US18/111,252 US20230205350A1 (en) 2007-03-14 2023-02-17 Interactive devices

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US78918806P 2006-04-03 2006-04-03
US60/789,188 2006-04-03

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2007/000332 Continuation-In-Part WO2008111040A2 (en) 2005-05-18 2007-03-14 Displays and information input devices

Related Child Applications (3)

Application Number Title Priority Date Filing Date
PCT/IL2007/000332 Continuation WO2008111040A2 (en) 2005-05-18 2007-03-14 Displays and information input devices
US12/531,039 Continuation US8610675B2 (en) 2005-05-18 2008-03-13 Interactive devices
PCT/IL2008/000355 Continuation WO2008111079A2 (en) 2005-05-18 2008-03-13 Interactive devices

Publications (2)

Publication Number Publication Date
WO2007113828A2 true WO2007113828A2 (en) 2007-10-11
WO2007113828A3 WO2007113828A3 (en) 2009-04-16

Family

ID=38564073

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2007/000433 WO2007113828A2 (en) 2006-04-03 2007-04-01 User interface functionalities

Country Status (1)

Country Link
WO (1) WO2007113828A2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2105844A2 (en) * 2008-03-25 2009-09-30 LG Electronics Inc. Mobile terminal and method of displaying information therein
EP2105826A2 (en) * 2008-03-25 2009-09-30 LG Electronics Inc. Mobile terminal and method of displaying information therein
US20120188285A1 (en) * 2009-11-15 2012-07-26 Ram Friedlander Enhanced pointing interface
JP2013073366A (en) * 2011-09-27 2013-04-22 Nec Casio Mobile Communications Ltd Information processing device
EP2621185A1 (en) * 2012-01-24 2013-07-31 Funai Electric Co., Ltd. Remote control device
US8732620B2 (en) 2012-05-23 2014-05-20 Cyberlink Corp. Method and system for a more realistic interaction experience using a stereoscopic cursor
US8957855B2 (en) 2012-06-25 2015-02-17 Cyberlink Corp. Method for displaying a stereoscopic cursor among stereoscopic objects
EP3076272A3 (en) * 2015-03-31 2016-10-19 Fujitsu Limited Content display control method and system based on detecting the reflection of a beam of light
US10534496B2 (en) 2007-03-14 2020-01-14 Power2B, Inc. Interactive devices
US11556211B2 (en) 2005-05-18 2023-01-17 Power2B, Inc. Displays and information input devices

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793361A (en) * 1994-06-09 1998-08-11 Corporation For National Research Initiatives Unconstrained pointing interface for natural human interaction with a display-based computer system
US20050015691A1 (en) * 2001-03-07 2005-01-20 Kabushiki Kaisha Toshiba Semiconductor integrated circuit device and test method thereof
US20060044283A1 (en) * 2004-08-31 2006-03-02 Michiaki Eri Information processing apparatus and display control program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793361A (en) * 1994-06-09 1998-08-11 Corporation For National Research Initiatives Unconstrained pointing interface for natural human interaction with a display-based computer system
US20050015691A1 (en) * 2001-03-07 2005-01-20 Kabushiki Kaisha Toshiba Semiconductor integrated circuit device and test method thereof
US20060044283A1 (en) * 2004-08-31 2006-03-02 Michiaki Eri Information processing apparatus and display control program

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11556211B2 (en) 2005-05-18 2023-01-17 Power2B, Inc. Displays and information input devices
US10534496B2 (en) 2007-03-14 2020-01-14 Power2B, Inc. Interactive devices
US11586317B2 (en) 2007-03-14 2023-02-21 Power2B, Inc. Interactive devices
EP2105844A2 (en) * 2008-03-25 2009-09-30 LG Electronics Inc. Mobile terminal and method of displaying information therein
EP2105826A2 (en) * 2008-03-25 2009-09-30 LG Electronics Inc. Mobile terminal and method of displaying information therein
US20120188285A1 (en) * 2009-11-15 2012-07-26 Ram Friedlander Enhanced pointing interface
JP2013073366A (en) * 2011-09-27 2013-04-22 Nec Casio Mobile Communications Ltd Information processing device
EP2621185A1 (en) * 2012-01-24 2013-07-31 Funai Electric Co., Ltd. Remote control device
US8732620B2 (en) 2012-05-23 2014-05-20 Cyberlink Corp. Method and system for a more realistic interaction experience using a stereoscopic cursor
US8957855B2 (en) 2012-06-25 2015-02-17 Cyberlink Corp. Method for displaying a stereoscopic cursor among stereoscopic objects
EP3076272A3 (en) * 2015-03-31 2016-10-19 Fujitsu Limited Content display control method and system based on detecting the reflection of a beam of light
US9857918B2 (en) 2015-03-31 2018-01-02 Fujitsu Limited Content display control method and system

Also Published As

Publication number Publication date
WO2007113828A3 (en) 2009-04-16

Similar Documents

Publication Publication Date Title
WO2007113828A2 (en) User interface functionalities
US11422683B2 (en) System and methods for interacting with a control environment
US8384718B2 (en) System and method for navigating a 3D graphical user interface
US8760400B2 (en) Gui applications for use with 3D remote controller
US9569093B2 (en) Displays and information input devices
US20100050129A1 (en) 3D Graphical User Interface For Simultaneous Management Of Applications
US6788288B2 (en) Coordinate input device and portable information apparatus equipped with coordinate input device
US8624850B2 (en) Displays and information input devices
US20110072399A1 (en) Method for providing gui which generates gravity map to move pointer and display apparatus using the same
AU2008220514A1 (en) Multi-state unified pie user interface
US20100214246A1 (en) Apparatus and method for controlling operations of an electronic device
CN101788877A (en) Method for operating a space menu and electronic device with operating space menu
US11556211B2 (en) Displays and information input devices
Dachselt et al. Throw and tilt–seamless interaction across devices using mobile phone gestures
KR101561907B1 (en) Camera module of mobile terminal
Nakanishi et al. Intuitive substitute interface

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07736173

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07736173

Country of ref document: EP

Kind code of ref document: A2