WO2000025516A1 - Graphical menu items for a user interface menu of a video teleconferencing system - Google Patents

Graphical menu items for a user interface menu of a video teleconferencing system Download PDF

Info

Publication number
WO2000025516A1
WO2000025516A1 PCT/US1999/024612 US9924612W WO0025516A1 WO 2000025516 A1 WO2000025516 A1 WO 2000025516A1 US 9924612 W US9924612 W US 9924612W WO 0025516 A1 WO0025516 A1 WO 0025516A1
Authority
WO
WIPO (PCT)
Prior art keywords
video teleconferencing
image
menu item
teleconferencing system
menu
Prior art date
Application number
PCT/US1999/024612
Other languages
French (fr)
Inventor
Timothy J. Maroney
Ly-Huong Thi Pham
Mark Rolston
Ruth E. Kaufman
Original Assignee
Vtel Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vtel Corporation filed Critical Vtel Corporation
Priority to AU12162/00A priority Critical patent/AU1216200A/en
Publication of WO2000025516A1 publication Critical patent/WO2000025516A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Definitions

  • the invention relates generally to user interface menus, for example, user interface menus for operating video teleconferencing systems. More particularly, the invention relates to user interface menus with graphics for simplifying a user's operation of a video teleconferencing system.
  • Video and audio quality has improved, as has the capability to combine the basic video teleconferencing functionality with other functionalities, such as presentation software, desktop publishing applications, and networking.
  • video teleconferencing systems have progressed from being expensive novelty systems which were infrequently used, to moderately priced systems which were more often used but still located in a dedicated facility and shared by many users, to relatively inexpensive systems which one day may be as ubiquitous as the telephone is today.
  • the typical video teleconferencing system includes a large number of components and thus presents a large number of options to the user.
  • a system typically will include cameras and displays to support a bidirectional video link, and microphones and loudspeakers to support a bidirectional audio link. These components typically are manipulated by the user of the video teleconferencing system. For example, the user may adjust the position, zoom and picture quality of the various cameras; select between different image sources to provide images to the various displays, as well as adjusting the displays themselves; and also adjust volume and stereo effect for the microphones and loudspeakers.
  • the user typically will also have additional options for setting up the video teleconferencing system, such as setting defaults for the system, maintaining an address book, and options for setting up actual video teleconferencing calls. The user typically manipulates the various options via a user interface.
  • video teleconferencing systems become ubiquitous, an individual may use a video teleconferencing system only on an infrequent basis. For this reason, users of video teleconferencing systems may not be familiar with the options available to them and may not have the time to learn a complex user interface. Infrequent use also makes the user more likely to forget how to manipulate the user interface. This can make the use of video teleconferencing systems seem arcane or frustrating.
  • the user interface should be simple enough for everyone to use, preferably without extensive training.
  • a video teleconferencing system includes a display device, and a user interface menu suitable for display on the display device.
  • the user interface menu includes a plurality of menu items, and each menu item corresponds to one of a plurality of options for a user of the video teleconferencing system.
  • At least one menu item includes a graphic which is representative of the option corresponding to that menu item.
  • each of the options includes forming a communications link between the video teleconferencing system and any one of a plurality of other video teleconferencing systems.
  • At least one menu item includes a graphic which is representative of the remote video teleconferencing system corresponding to that menu item. The graphic may be an image captured by the remote video teleconferencing system.
  • the graphic may be provided as part of the caller i.d. information for the remote video teleconferencing system.
  • an image capture device such as a camera, captures images and provides these images to the video teleconferencing system.
  • the image capture device can be positioned in a plurality of positions.
  • Each of the options includes positioning the image capture device in one of a plurality of preset positions.
  • At least one menu item includes an image captured by the image capture device when positioned in the preset position corresponding to the menu item.
  • a position is automatically added as a preset position, including displaying a menu item corresponding to that position, responsive to the image capture device remaining in that position for longer than a predetermined length of time.
  • any of a plurality of image sources is capable of providing images to the video teleconferencing system.
  • Each of the options includes one of the image sources acting as a source of images for the video teleconferencing system.
  • At least one menu item includes an image provided by the image source corresponding to that menu item.
  • the present invention is particularly advantageous because the use of graphics, including images, to represent various options results in a simpler, more intuitive user interface menu simply because graphics often are more intuitive than other representations, such as text.
  • the preset positions could be represented by arbitrary labels such as preset position A, preset position B, etc., but this is non-intuitive and most users would have difficulty associating these labels with the actual preset positions and would also have difficulty later remembering which label corresponded to which preset position.
  • representing a preset position by an image captured by the image capture device while in the preset position in some sense allows the user to effectively preview the preset position, which is a more intuitive and useful representation.
  • the video teleconferencing system includes a control unit for coordinating the actions of the various components, including for displaying the user interface menu on the display device, forming communications links with other video teleconferencing systems, and receiving graphics from various sources for display on the display device.
  • a computer program product includes a computer readable storage medium for storing computer instructions for executing these actions.
  • FIG. 1 is a diagram of a video teleconferencing system 100 suitable for use with the present invention
  • FIG. 2 is a diagram of one embodiment of a user interface menu 200 in accordance with the present invention.
  • FIG. 3 is a flow diagram illustrating a method 300 for generating user interface menu 200
  • FIG. 4 is a diagram of a preferred embodiment of a user interface menu 400 for forming a communications link between video teleconferencing systems
  • FIG. 5 is a diagram of a preferred embodiment of a user interface menu 500 for selecting a preset position for an image capture device
  • FIG. 6 is a flow diagram illustrating a method 600 for generating user interface menu
  • FIG. 7 is a diagram of a preferred embodiment of a user interface menu 700 for selecting an image source for a video teleconferencing system.
  • FIG. 1 is a diagram of a video teleconferencing system 100 suitable for use with the present invention.
  • the video teleconferencing system 100 includes a control unit 110, display monitor 102, video camera 104, microphone 106, and loudspeaker 108.
  • the control unit 110 is coupled to each of the other devices and controls the video teleconferencing system 100, including the various devices.
  • Control unit 110 also includes electronic circuits to encode/decode and/or compress/decompress audio and image (including video) data, and to send and receive this data over communications links to other video teleconferencing systems (not shown).
  • the user interacts with control unit 110 via a remote control, keyboard, joystick, touchpad, touch screen, graphics tablet, and/or any number of other types of input devices.
  • control unit 110 includes a processor 120 and storage medium 122 containing software code to be executed on the processor.
  • the processor 120 is an Intel Pentium microprocessor and the storage medium 122 is memory for the microprocessor.
  • the control unit 110 may be based on more of an embedded architecture, in which the storage medium 122 might be, for example, flash memory or programmable logic.
  • the software code implements control of the video teleconferencing system 100, with the processor typically interfacing to the various other devices through auxiliary electronics and/or driver software in control unit 110.
  • the processor and software also control the formation of communications links with other video teleconferencing systems, preferably using ISDN, Internet, standard telephone, or ATM protocols.
  • Video teleconferencing system 100 is exemplary only. Other video teleconferencing systems can contain combinations of devices other than the one shown in FIG. 1. For example, any number of display devices 102, cameras 104, microphones 106 and loudspeakers 108 may be used. Alternately, not all of the devices shown in FIG. 1 need be used, and/or devices other than those shown in FIG. 1 may be used. For example, devices other than video camera 104 may be used to capture images; examples of such image capture devices include electronic still cameras and document readers. Furthermore, image sources other image capture devices may also be used to provide images to video teleconferencing system 100. Examples would include VCRs, DVD players, and computer applications which can produce images such as PowerPoint, Illustrator, or QuickTime video.
  • a sophisticated graphics tablet may have a display surface which receives graphics from control unit 110 and also a touch screen whereby the user can send commands to the control unit 110 by touching the various graphics displayed.
  • This type of device functions as both a display device and an input device.
  • Video teleconferencing system 100 is typically used for video teleconferencing. System 100 achieves this by forming a communications link between itself and other video teleconferencing systems. The users of the various video teleconferencing systems 100 then communicate with each other using the various devices coupled to the video teleconferencing systems.
  • the term "local" video teleconferencing system will be used to refer to the video teleconferencing system 100 which provides the frame of reference for this description. In other words, the user interface menus described below will be used for interfacing to the "local" video teleconferencing system.
  • the term “remote" video teleconferencing system then, will be used to refer to the video teleconferencing systems with which the local video teleconferencing system is communicating.
  • the terms “local” and “remote” are used solely to establish a frame of reference for purposes of clarity and are not meant to imply any physical proximity.
  • the "remote” video teleconferencing system need not be separated from the "local” video teleconferencing system by some minimum physical distance nor need it be situated in a remote physical location.
  • the local and remote video teleconferencing systems will sometimes be referred to by the equivalent descriptors "here” and “there,” respectively.
  • the typical video teleconferencing system by its very nature, includes a large number of devices and thus presents a large number of options to the user.
  • the user may adjust the position, zoom and picture quality of the various cameras 104; select between different image sources to provide images to the various displays 102, as well as adjusting the displays themselves; and also adjust volume and stereo effect for the microphones 106 and loudspeakers 108.
  • the user typically will also have additional options for setting up the video teleconferencing system, such as setting defaults for the system, maintaining an address book, and options for setting up communications links with other video teleconferencing systems.
  • the user manipulates these various options by interacting with control unit 110 using a user interface and an input device.
  • the user interface is a user interface menu 200 displayed on display device 102.
  • the user interface menu 200 includes a number of menu items 202A-202N (collectively, menu items 202).
  • Each menu item 202 corresponds to one of the options available to the user of the local video teleconferencing system.
  • the user selects between the available options by activating the corresponding menu item 202, for example by clicking on it or by touching it (e.g., in the case of touch screens).
  • At least one menu item 202B further includes a graphic 204B which represents the option corresponding to menu item 202B.
  • the graphic could be an icon, a logo, an image, a photograph, a video, or any other type of graphic element.
  • graphics is specifically intended to exclude elements which are solely textual. The use of graphics is beneficial because, in many instances, the visual identification of options is easier, quicker, and more intuitive, as will be illustrated by the examples below.
  • FIG. 3 is a flow diagram illustrating a method 300 for generating user interface menu 200.
  • control unit 110 displays 302 the menu items 202 on display device 102.
  • Control unit 110 also receives 304 graphic 204B and displays 306 it as part of menu item 202A.
  • Graphic 204B may be received from the same or different sources as the remainder of menu 200.
  • the various elements for menu items 202 and graphic 204B may be received by a processor separate from the one in control unit 110 and assembled by that processor into menu 200, which is then sent to control unit 110.
  • Control unit 110 then displays the previously composed menu 200 on display 102.
  • control unit 110 may receive the various menu items 202 from one source and the graphic 204B from another, with control unit 110 assembling the various elements into menu 200 and displaying the resulting menu on display 102.
  • FIG. 4 is a diagram of a preferred embodiment of a user interface menu 400 which includes menu items 402A-402F.
  • each menu item 402 corresponds to the option of forming a communications link between the local video teleconferencing system and any one of a plurality of remote video teleconferencing systems.
  • menu item 402A represents the option of forming a communications link with the video teleconferencing system associated with the individual Ann Bass.
  • menu item 402B corresponds to the option of forming a communications link between the local video teleconferencing system and the video teleconferencing system associated with individual Saul Bass.
  • the local video teleconferencing system initiates the formation of a communications link with the selected remote video teleconferencing system.
  • Slider 410 allows the user to scroll through menu 400.
  • each menu item 402 includes a corresponding graphics area 403 for displaying a graphic representative of the video teleconferencing system corresponding to the menu item.
  • the graphic areas 403 are occupied either by graphic icons 406A, 406B, and 406D; or by images 408C, 408E, and 408F.
  • a graphic icon 406 is used when a representative image 408 is not available. Once an image 408 becomes available, the graphic icon 406 is replaced by the image 408. For example, in menu item 402A, if an image representative of the Ann Bass video teleconferencing system were to become available, graphic icon 406A would be replaced by it.
  • the use of graphics 406 and 408 in menu 400 is beneficial because the graphics 406 and 408, particularly images 408, are a visual indication and reminder of the various remote video teleconferencing systems.
  • Images 408 representing the remote video teleconferencing systems may be generated in a number of ways.
  • image 408 is substantially similar to images which may be captured by the remote video teleconferencing system. These images may be either simulated or actually captured.
  • the remote video teleconferencing system includes a camera and image 408 is an image captured by that camera.
  • the remote video teleconferencing system is located in Neville Brody's office and includes a camera which has a view of his office.
  • Image 408C is an image of Neville Brody's office captured by that camera. The image may be selected by the user of the local video teleconferencing system when connected to the remote video teleconferencing system in Neville Brody's office.
  • the user of the local video teleconferencing system might move the camera in Neville Brody's office to a particular position, have the camera capture an image from that position, and then instruct the local video teleconferencing system to store and use that image as image 408C.
  • the image 408C may be selected by the user of Neville Brody's video teleconferencing system.
  • Neville Brody might move the camera in his office to a particular position, have the camera capture an image from that position, and then instruct his video teleconferencing system to store and provide that image as image 408C.
  • the image is received 304 by control unit 110 and displayed 306 as part of menu item 402C.
  • the graphics in graphics area 403 are received 304 as part of the caller i.d. information for the remote video teleconferencing system.
  • a central repository stores caller i.d. information for all video teleconferencing systems and provides this information as part of the process of establishing communications links between video teleconferencing systems.
  • the caller i.d. information is distributed among the video teleconferencing systems. For example, if the local video teleconferencing system were to connect to the Ann Bass video teleconferencing system, the Ann Bass video teleconferencing system may send its caller i.d. information to the local video teleconferencing system as part of the handshake process when first establishing the communications link.
  • the control unit 110 displays 306 the received graphic in graphics area 403 A.
  • the caller i.d. graphics can be formed in various ways.
  • Ann Bass could have her camera capture an image and store this image as her caller i.d.
  • Ann Bass could store a computer file with her caller i.d. graphic in her control unit 110.
  • the Ann Bass video teleconferencing system would then supply this graphic as part of the caller i.d. handshake.
  • caller i.d. information is meant to include any type of information pertaining to a video teleconferencing system and is not meant to be limited to the caller i.d. information provided in the telephone system (i.e., identity and phone number of caller).
  • the caller i.d. information for a video teleconferencing system may contain a graphic or an image representing the video teleconferencing system, such as an image captured by a camera connected to the video teleconferencing system or a company logo.
  • one or more of the menu items 402 is highlighted to emphasize that menu item.
  • the term "highlight” as used here means simply that the menu item is emphasized.
  • the method of emphasis may or may not be based on color highlighting.
  • the highlight may be achieved by placing a cursor or other graphic indicator in close proximity to the highlighted menu item, or by moving the highlighted menu item to a position of prominence such as the head of the menu.
  • the highlighted menu item might be emphasized via the use of animation or it might be rendered such that it appears to move above or below the plane of the screen.
  • the menu item could also be color highlighted.
  • the highlighted menu item corresponds to the remote video teleconferencing system with which the local video teleconferencing system last formed the communications link.
  • menu item 402E would be highlighted. This would facilitate a reconnection with the Ned Flanders video teleconferencing system since the user would not need to search for menu item 402E.
  • the highlighted menu item is the menu item which was last highlighted by the user. For example, if the user highlighted menu item 402F and then left menu 400, when he returned, menu 400 would "remember" the user's last choice and menu item 402F would still be highlighted.
  • FIG. 5 is a diagram of a preferred embodiment of user interface menu 500.
  • menu 500 does not occupy the entire display so as not to interfere with the rest of the video teleconference. Rather, it occupies a bottom portion of the display and is side scrolling via right and left arrows 510A-510B.
  • Menu 500 includes menu items 502, each of which corresponds to a different preset position for an image capture device (a video camera in this example) which can capture and provide images to the local video teleconferencing system.
  • the camera itself may be connected either to the local or to the remote video teleconferencing system. Hence, if the user were to activate menu item 502A, the camera would move to the preset position represented by that menu item.
  • each of the menu items 502 includes an image 504 which is substantially similar to the image which would be captured by the camera if it were positioned in the preset position corresponding to that menu item.
  • the images 504 preferably are actual images captured by the camera.
  • menu item 502A corresponds to the camera being zoomed out and looking straight ahead
  • image 504A would be an image from this view.
  • menu item 502B corresponds to the camera at medium zoom and looking down and to the right, then image 504B would be an image from this view.
  • each menu item 502 provides the user with images which presumably are similar to those which would be captured by the camera if it were returned to the preset position. Hence, the user can more easily determine which view corresponds to which menu item.
  • the images 504 can be manually generated.
  • the user would move the camera to a position which the user desired as a preset position.
  • the user would then command the control unit 110 to retain this position as a preset position.
  • the control unit 110 would then generate and display a corresponding menu item 502 and image 504.
  • FIG. 6 is a flow diagram illustrating an alternate method 600 for generating images 504.
  • the menu items 502 and corresponding images 504 are generated automatically in response to the camera remaining in a stationary position for longer than a predetermined length of time.
  • control unit 110 receives 602 an image captured by the camera in this position.
  • Control unit 110 displays 604, 606 a menu item corresponding to this position, including the image 504 received from the camera.
  • the predetermined length of time preferably is adjustable by the user.
  • Method 600 is advantageous because the user does not have to consciously create preset positions during a video teleconference. Rather, the video teleconferencing system generates the preset positions automatically and they are represented in menu 500 by actual captured images 504. Heuristically, if the camera has stayed in a certain position for a long period of time, then that position likely is a good preset position to retain.
  • a threshold approach preferably is used. In this approach, if the camera is moved only a few degrees from a previously retained preset position (i.e., the movement falls within a threshold), a new preset position is not be created. Rather, the nearest preset position is replaced by the new position. This updates the previous preset position and prevents the proliferation of nearly identical preset positions.
  • a preferred threshold allows approximately six inches of camera movement on a subject at twenty feet distance from the camera.
  • FIG. 7 is a diagram of the preferred embodiment of a user interface menu 700.
  • menu 700 occupies a bottom portion of the display and is side scrolling via right and left arrows 710A-710B.
  • video teleconferencing system 100 may receive images from any of a plurality of different image sources.
  • Menu 700 includes menu items 702, each of which corresponds to one of the image sources providing images to the local video teleconferencing system.
  • menu item 702A corresponds to the SmartTrak device providing images to the video teleconferencing system
  • menu item 702B corresponds to the PC (or applications running on a PC) providing images, and so forth.
  • each of these menu items includes a graphic 704 representative of the source.
  • menu item 702C includes a pictorial representation 704C of a document reader.
  • the graphics 704 preferably include images representing the various image sources.
  • the image might be an image of the corresponding source, such as a digital photograph of a document reader for menu item 702C.
  • the image might represent the images which would be provided by the various sources, such as a simulated document for menu item 702C.
  • the image is an actual image provided by the image source, such as an actual document image captured by the document reader for menu item 702C.
  • the sources are represented by graphic icons, such as 702A-702C, when no image is available. These icons are replaced as images become available.
  • control unit 110 may be implemented in forms other than software code running on a processor.
  • some or all of the functionality may be implemented in dedicated hardware. Therefore, the scope of the appended claims should not be limited to the description of the preferred embodiments contained herein.

Abstract

A video teleconferencing system (100) includes a display device (102), and a user interface menu (200) is suitable for display on the display device (102). The user interface menu includes a plurality of menu items (202A, 202N), and each item corresponds to one of a plurality of options for a user of the video teleconferencing system (100). At least one menu item (202B) includes a graphic which is representative of the option corresponding to that menu item.

Description

GRAPHICAL MENU ITEMS FOR A USER INTERFACE MENU OF A VIDEO
TELECONFERENCING SYSTEM
CROSS-REFERENCE TO RELATED APPLICATION
This application claims the benefit of U.S. Provisional Patent Application Serial No. 60/105,540, "User Interface for Video Teleconferencing", by Timothy J. Maroney, Ly-Huong Thi Pham, Mark Rolston, and Ruth Kaufman, filed October 24, 1998, which subject matter is incorporated herein by reference.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The invention relates generally to user interface menus, for example, user interface menus for operating video teleconferencing systems. More particularly, the invention relates to user interface menus with graphics for simplifying a user's operation of a video teleconferencing system.
2. Description of the Related Art
As the result of continuous advances in technology, video teleconferencing is becoming an increasingly popular means of communication. The development and standardization of advanced coding/decoding and compression decompression schemes has facilitated the communication of ever larger amounts of information over communications links of fixed size. Technological advances in the communication links themselves and increases in the sheer number of links have further increased the effective size of communications links which are available to carry video teleconferencing information.
Advances in the basic components used in video teleconferencing systems, such as computers, cameras, displays, and microphones, have resulted in better quality components available at lower prices.
These advances translate to more powerful video teleconferencing systems available at lower prices. Video and audio quality has improved, as has the capability to combine the basic video teleconferencing functionality with other functionalities, such as presentation software, desktop publishing applications, and networking. As a result, video teleconferencing systems have progressed from being expensive novelty systems which were infrequently used, to moderately priced systems which were more often used but still located in a dedicated facility and shared by many users, to relatively inexpensive systems which one day may be as ubiquitous as the telephone is today.
The typical video teleconferencing system, by its very nature, includes a large number of components and thus presents a large number of options to the user. For example, a system typically will include cameras and displays to support a bidirectional video link, and microphones and loudspeakers to support a bidirectional audio link. These components typically are manipulated by the user of the video teleconferencing system. For example, the user may adjust the position, zoom and picture quality of the various cameras; select between different image sources to provide images to the various displays, as well as adjusting the displays themselves; and also adjust volume and stereo effect for the microphones and loudspeakers. The user typically will also have additional options for setting up the video teleconferencing system, such as setting defaults for the system, maintaining an address book, and options for setting up actual video teleconferencing calls. The user typically manipulates the various options via a user interface.
However, until video teleconferencing systems become ubiquitous, an individual may use a video teleconferencing system only on an infrequent basis. For this reason, users of video teleconferencing systems may not be familiar with the options available to them and may not have the time to learn a complex user interface. Infrequent use also makes the user more likely to forget how to manipulate the user interface. This can make the use of video teleconferencing systems seem arcane or frustrating. In addition, once video teleconferencing systems become ubiquitous, the user interface should be simple enough for everyone to use, preferably without extensive training.
Thus, there is a need for a user interface for video teleconferencing systems which is easy and intuitive to use but still capable of handling the complexities of a video teleconferencing system. There is a further need for video teleconferencing systems which intelligently simplify the options available to the user, thus inherently reducing the complexity of the corresponding user interface.
SUMMARY OF THE INVENTION In accordance with the present invention, a video teleconferencing system includes a display device, and a user interface menu suitable for display on the display device. The user interface menu includes a plurality of menu items, and each menu item corresponds to one of a plurality of options for a user of the video teleconferencing system. At least one menu item includes a graphic which is representative of the option corresponding to that menu item. In another aspect of the invention, each of the options includes forming a communications link between the video teleconferencing system and any one of a plurality of other video teleconferencing systems. At least one menu item includes a graphic which is representative of the remote video teleconferencing system corresponding to that menu item. The graphic may be an image captured by the remote video teleconferencing system.
Alternately, the graphic may be provided as part of the caller i.d. information for the remote video teleconferencing system.
In another aspect of the invention, an image capture device, such as a camera, captures images and provides these images to the video teleconferencing system. The image capture device can be positioned in a plurality of positions. Each of the options includes positioning the image capture device in one of a plurality of preset positions. At least one menu item includes an image captured by the image capture device when positioned in the preset position corresponding to the menu item. In one alternative, a position is automatically added as a preset position, including displaying a menu item corresponding to that position, responsive to the image capture device remaining in that position for longer than a predetermined length of time.
In another aspect of the invention, any of a plurality of image sources is capable of providing images to the video teleconferencing system. Each of the options includes one of the image sources acting as a source of images for the video teleconferencing system. At least one menu item includes an image provided by the image source corresponding to that menu item.
The present invention is particularly advantageous because the use of graphics, including images, to represent various options results in a simpler, more intuitive user interface menu simply because graphics often are more intuitive than other representations, such as text. For example, in the case of preset positions for an image capture device, the preset positions could be represented by arbitrary labels such as preset position A, preset position B, etc., but this is non-intuitive and most users would have difficulty associating these labels with the actual preset positions and would also have difficulty later remembering which label corresponded to which preset position. In contrast, representing a preset position by an image captured by the image capture device while in the preset position in some sense allows the user to effectively preview the preset position, which is a more intuitive and useful representation. In another aspect of the invention, the video teleconferencing system includes a control unit for coordinating the actions of the various components, including for displaying the user interface menu on the display device, forming communications links with other video teleconferencing systems, and receiving graphics from various sources for display on the display device. In yet another aspect, a computer program product includes a computer readable storage medium for storing computer instructions for executing these actions.
BRIEF DESCRIPTION OF THE DRAWINGS The invention has other advantages and features which will be more readily apparent from the following detailed description of the invention and the appended claims, when taken in conjunction with the accompanying drawing, in which: FIG. 1 is a diagram of a video teleconferencing system 100 suitable for use with the present invention;
FIG. 2 is a diagram of one embodiment of a user interface menu 200 in accordance with the present invention;
FIG. 3 is a flow diagram illustrating a method 300 for generating user interface menu 200;
FIG. 4 is a diagram of a preferred embodiment of a user interface menu 400 for forming a communications link between video teleconferencing systems;
FIG. 5 is a diagram of a preferred embodiment of a user interface menu 500 for selecting a preset position for an image capture device; FIG. 6 is a flow diagram illustrating a method 600 for generating user interface menu
600;
FIG. 7 is a diagram of a preferred embodiment of a user interface menu 700 for selecting an image source for a video teleconferencing system.
Due to the requirement of rendering the FIGS, in black and white line art only (e.g., no gray scale), many of the graphics and images in the FIGS, may be depicted by black and white line art representations rather than the actual graphics and/or images. For example, photorealistic images which in true life may be color with shading will be represented in the FIGS, by black and white line art representations.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a diagram of a video teleconferencing system 100 suitable for use with the present invention. The video teleconferencing system 100 includes a control unit 110, display monitor 102, video camera 104, microphone 106, and loudspeaker 108. The control unit 110 is coupled to each of the other devices and controls the video teleconferencing system 100, including the various devices. Control unit 110 also includes electronic circuits to encode/decode and/or compress/decompress audio and image (including video) data, and to send and receive this data over communications links to other video teleconferencing systems (not shown). The user interacts with control unit 110 via a remote control, keyboard, joystick, touchpad, touch screen, graphics tablet, and/or any number of other types of input devices.
In a preferred embodiment, the control unit 110 includes a processor 120 and storage medium 122 containing software code to be executed on the processor. In a preferred embodiment, the processor 120 is an Intel Pentium microprocessor and the storage medium 122 is memory for the microprocessor. In alternate embodiments, the control unit 110 may be based on more of an embedded architecture, in which the storage medium 122 might be, for example, flash memory or programmable logic. The software code implements control of the video teleconferencing system 100, with the processor typically interfacing to the various other devices through auxiliary electronics and/or driver software in control unit 110. The processor and software also control the formation of communications links with other video teleconferencing systems, preferably using ISDN, Internet, standard telephone, or ATM protocols.
Video teleconferencing system 100 is exemplary only. Other video teleconferencing systems can contain combinations of devices other than the one shown in FIG. 1. For example, any number of display devices 102, cameras 104, microphones 106 and loudspeakers 108 may be used. Alternately, not all of the devices shown in FIG. 1 need be used, and/or devices other than those shown in FIG. 1 may be used. For example, devices other than video camera 104 may be used to capture images; examples of such image capture devices include electronic still cameras and document readers. Furthermore, image sources other image capture devices may also be used to provide images to video teleconferencing system 100. Examples would include VCRs, DVD players, and computer applications which can produce images such as PowerPoint, Illustrator, or QuickTime video. As one final example, the functionality of the devices described above may be apportioned or combined differently than in the above examples. For example, a sophisticated graphics tablet may have a display surface which receives graphics from control unit 110 and also a touch screen whereby the user can send commands to the control unit 110 by touching the various graphics displayed. This type of device functions as both a display device and an input device.
Video teleconferencing system 100 is typically used for video teleconferencing. System 100 achieves this by forming a communications link between itself and other video teleconferencing systems. The users of the various video teleconferencing systems 100 then communicate with each other using the various devices coupled to the video teleconferencing systems. For purposes of clarity, the term "local" video teleconferencing system will be used to refer to the video teleconferencing system 100 which provides the frame of reference for this description. In other words, the user interface menus described below will be used for interfacing to the "local" video teleconferencing system. The term "remote" video teleconferencing system, then, will be used to refer to the video teleconferencing systems with which the local video teleconferencing system is communicating. The terms "local" and "remote" are used solely to establish a frame of reference for purposes of clarity and are not meant to imply any physical proximity. For example, the "remote" video teleconferencing system need not be separated from the "local" video teleconferencing system by some minimum physical distance nor need it be situated in a remote physical location. The local and remote video teleconferencing systems will sometimes be referred to by the equivalent descriptors "here" and "there," respectively.
The typical video teleconferencing system, by its very nature, includes a large number of devices and thus presents a large number of options to the user. For example, the user may adjust the position, zoom and picture quality of the various cameras 104; select between different image sources to provide images to the various displays 102, as well as adjusting the displays themselves; and also adjust volume and stereo effect for the microphones 106 and loudspeakers 108. The user typically will also have additional options for setting up the video teleconferencing system, such as setting defaults for the system, maintaining an address book, and options for setting up communications links with other video teleconferencing systems. The user manipulates these various options by interacting with control unit 110 using a user interface and an input device. FIG. 2 is a diagram of one embodiment of a user interface in accordance with the present invention. In this embodiment, the user interface is a user interface menu 200 displayed on display device 102. The user interface menu 200 includes a number of menu items 202A-202N (collectively, menu items 202). Each menu item 202 corresponds to one of the options available to the user of the local video teleconferencing system. The user selects between the available options by activating the corresponding menu item 202, for example by clicking on it or by touching it (e.g., in the case of touch screens). At least one menu item 202B further includes a graphic 204B which represents the option corresponding to menu item 202B. The graphic, for example, could be an icon, a logo, an image, a photograph, a video, or any other type of graphic element. The term "graphic," however, is specifically intended to exclude elements which are solely textual. The use of graphics is beneficial because, in many instances, the visual identification of options is easier, quicker, and more intuitive, as will be illustrated by the examples below.
FIG. 3 is a flow diagram illustrating a method 300 for generating user interface menu 200. In method 300, control unit 110 displays 302 the menu items 202 on display device 102. Control unit 110 also receives 304 graphic 204B and displays 306 it as part of menu item 202A. Graphic 204B may be received from the same or different sources as the remainder of menu 200. For example, the various elements for menu items 202 and graphic 204B may be received by a processor separate from the one in control unit 110 and assembled by that processor into menu 200, which is then sent to control unit 110. Control unit 110 then displays the previously composed menu 200 on display 102. Alternately, control unit 110 may receive the various menu items 202 from one source and the graphic 204B from another, with control unit 110 assembling the various elements into menu 200 and displaying the resulting menu on display 102. FIG. 4 is a diagram of a preferred embodiment of a user interface menu 400 which includes menu items 402A-402F. In this embodiment, each menu item 402 corresponds to the option of forming a communications link between the local video teleconferencing system and any one of a plurality of remote video teleconferencing systems. For example, menu item 402A represents the option of forming a communications link with the video teleconferencing system associated with the individual Ann Bass. Similarly, menu item 402B corresponds to the option of forming a communications link between the local video teleconferencing system and the video teleconferencing system associated with individual Saul Bass. When the user activates one of the menu items 402, the local video teleconferencing system initiates the formation of a communications link with the selected remote video teleconferencing system. Slider 410 allows the user to scroll through menu 400.
In this particular embodiment, each menu item 402 includes a corresponding graphics area 403 for displaying a graphic representative of the video teleconferencing system corresponding to the menu item. Furthermore, the graphic areas 403 are occupied either by graphic icons 406A, 406B, and 406D; or by images 408C, 408E, and 408F. A graphic icon 406 is used when a representative image 408 is not available. Once an image 408 becomes available, the graphic icon 406 is replaced by the image 408. For example, in menu item 402A, if an image representative of the Ann Bass video teleconferencing system were to become available, graphic icon 406A would be replaced by it. The use of graphics 406 and 408 in menu 400 is beneficial because the graphics 406 and 408, particularly images 408, are a visual indication and reminder of the various remote video teleconferencing systems.
Images 408 representing the remote video teleconferencing systems may be generated in a number of ways. In one approach, image 408 is substantially similar to images which may be captured by the remote video teleconferencing system. These images may be either simulated or actually captured. In a preferred embodiment, the remote video teleconferencing system includes a camera and image 408 is an image captured by that camera. For example, in menu item 402C, the remote video teleconferencing system is located in Neville Brody's office and includes a camera which has a view of his office. Image 408C is an image of Neville Brody's office captured by that camera. The image may be selected by the user of the local video teleconferencing system when connected to the remote video teleconferencing system in Neville Brody's office. For example, when the local video teleconferencing system is connected to the remote video teleconferencing system in Neville Brody's office, the user of the local video teleconferencing system might move the camera in Neville Brody's office to a particular position, have the camera capture an image from that position, and then instruct the local video teleconferencing system to store and use that image as image 408C. Alternately, the image 408C may be selected by the user of Neville Brody's video teleconferencing system. For example, Neville Brody might move the camera in his office to a particular position, have the camera capture an image from that position, and then instruct his video teleconferencing system to store and provide that image as image 408C. In either event, the image is received 304 by control unit 110 and displayed 306 as part of menu item 402C. In an alternate approach, the graphics in graphics area 403 are received 304 as part of the caller i.d. information for the remote video teleconferencing system. In one approach, a central repository stores caller i.d. information for all video teleconferencing systems and provides this information as part of the process of establishing communications links between video teleconferencing systems. In an alternate approach, the caller i.d. information is distributed among the video teleconferencing systems. For example, if the local video teleconferencing system were to connect to the Ann Bass video teleconferencing system, the Ann Bass video teleconferencing system may send its caller i.d. information to the local video teleconferencing system as part of the handshake process when first establishing the communications link. In any event, the control unit 110 displays 306 the received graphic in graphics area 403 A.
The caller i.d. graphics can be formed in various ways. For example, Ann Bass could have her camera capture an image and store this image as her caller i.d. Alternately, Ann Bass could store a computer file with her caller i.d. graphic in her control unit 110. The Ann Bass video teleconferencing system would then supply this graphic as part of the caller i.d. handshake.
Throughout this description, the term "caller i.d. information" is meant to include any type of information pertaining to a video teleconferencing system and is not meant to be limited to the caller i.d. information provided in the telephone system (i.e., identity and phone number of caller). For example, the caller i.d. information for a video teleconferencing system may contain a graphic or an image representing the video teleconferencing system, such as an image captured by a camera connected to the video teleconferencing system or a company logo.
In an alternate embodiment, one or more of the menu items 402 is highlighted to emphasize that menu item. The term "highlight" as used here means simply that the menu item is emphasized. The method of emphasis may or may not be based on color highlighting. For example, the highlight may be achieved by placing a cursor or other graphic indicator in close proximity to the highlighted menu item, or by moving the highlighted menu item to a position of prominence such as the head of the menu. Alternately, the highlighted menu item might be emphasized via the use of animation or it might be rendered such that it appears to move above or below the plane of the screen. Of course, the menu item could also be color highlighted. In one embodiment, the highlighted menu item corresponds to the remote video teleconferencing system with which the local video teleconferencing system last formed the communications link. For example, if the local video teleconferencing system last formed a communications link with the Ned Flanders video teleconferencing system, then menu item 402E would be highlighted. This would facilitate a reconnection with the Ned Flanders video teleconferencing system since the user would not need to search for menu item 402E. In an alternative embodiment, the highlighted menu item is the menu item which was last highlighted by the user. For example, if the user highlighted menu item 402F and then left menu 400, when he returned, menu 400 would "remember" the user's last choice and menu item 402F would still be highlighted.
FIG. 5 is a diagram of a preferred embodiment of user interface menu 500. In this example, menu 500 does not occupy the entire display so as not to interfere with the rest of the video teleconference. Rather, it occupies a bottom portion of the display and is side scrolling via right and left arrows 510A-510B. Menu 500 includes menu items 502, each of which corresponds to a different preset position for an image capture device (a video camera in this example) which can capture and provide images to the local video teleconferencing system. The camera itself may be connected either to the local or to the remote video teleconferencing system. Hence, if the user were to activate menu item 502A, the camera would move to the preset position represented by that menu item. In this example, each of the menu items 502 includes an image 504 which is substantially similar to the image which would be captured by the camera if it were positioned in the preset position corresponding to that menu item. Furthermore, the images 504 preferably are actual images captured by the camera. Thus, for example, if menu item 502A corresponds to the camera being zoomed out and looking straight ahead, then image 504A would be an image from this view. Similarly, if menu item 502B corresponds to the camera at medium zoom and looking down and to the right, then image 504B would be an image from this view.
The use of representative images 504 is advantageous because it is a simple and intuitive representation of the different preset positions. For example, a commonly used alternative is to represent each preset position by a label, such as preset position A, preset position B, and so on. However, this is non-intuitive because the label does not provide any information about the actual preset position. As a result, users have difficulty remembering which label corresponds to which preset positions. In contrast, in the described approach, each menu item 502 provides the user with images which presumably are similar to those which would be captured by the camera if it were returned to the preset position. Hence, the user can more easily determine which view corresponds to which menu item. The images 504 can be manually generated. In this approach, the user would move the camera to a position which the user desired as a preset position. The user would then command the control unit 110 to retain this position as a preset position. The control unit 110 would then generate and display a corresponding menu item 502 and image 504.
FIG. 6 is a flow diagram illustrating an alternate method 600 for generating images 504. In this approach, the menu items 502 and corresponding images 504 are generated automatically in response to the camera remaining in a stationary position for longer than a predetermined length of time. When this happens, control unit 110 receives 602 an image captured by the camera in this position. Control unit 110 then displays 604, 606 a menu item corresponding to this position, including the image 504 received from the camera. The predetermined length of time preferably is adjustable by the user. Method 600 is advantageous because the user does not have to consciously create preset positions during a video teleconference. Rather, the video teleconferencing system generates the preset positions automatically and they are represented in menu 500 by actual captured images 504. Heuristically, if the camera has stayed in a certain position for a long period of time, then that position likely is a good preset position to retain.
In order to prevent new menu items from appearing every time the camera is adjusted even slightly, a threshold approach preferably is used. In this approach, if the camera is moved only a few degrees from a previously retained preset position (i.e., the movement falls within a threshold), a new preset position is not be created. Rather, the nearest preset position is replaced by the new position. This updates the previous preset position and prevents the proliferation of nearly identical preset positions. A preferred threshold allows approximately six inches of camera movement on a subject at twenty feet distance from the camera.
FIG. 7 is a diagram of the preferred embodiment of a user interface menu 700. Like the example of menu 500, menu 700 occupies a bottom portion of the display and is side scrolling via right and left arrows 710A-710B. In this embodiment, video teleconferencing system 100 may receive images from any of a plurality of different image sources. Menu 700 includes menu items 702, each of which corresponds to one of the image sources providing images to the local video teleconferencing system. For example, menu item 702A corresponds to the SmartTrak device providing images to the video teleconferencing system; menu item 702B corresponds to the PC (or applications running on a PC) providing images, and so forth. In a preferred embodiment, each of these menu items includes a graphic 704 representative of the source. For example, menu item 702C includes a pictorial representation 704C of a document reader. The graphics 704 preferably include images representing the various image sources. For example, the image might be an image of the corresponding source, such as a digital photograph of a document reader for menu item 702C. Alternately, the image might represent the images which would be provided by the various sources, such as a simulated document for menu item 702C. In a preferred embodiment, the image is an actual image provided by the image source, such as an actual document image captured by the document reader for menu item 702C. In another aspect, the sources are represented by graphic icons, such as 702A-702C, when no image is available. These icons are replaced as images become available. Although the invention has been described in considerable detail with reference to certain preferred embodiments thereof, other embodiments will be apparent. For example, graphic representations can be used advantageously for menus other than the ones described above. In addition, all of the menus described above are based on a rectilinear layout; other layouts will be apparent. As a final example, the functionality of the control unit 110 may be implemented in forms other than software code running on a processor. For example, some or all of the functionality may be implemented in dedicated hardware. Therefore, the scope of the appended claims should not be limited to the description of the preferred embodiments contained herein.

Claims

WHAT IS CLAIMED IS:
1. A user interface menu for a local video teleconferencing system including a display device, the user interface menu suitable for display on the display device, the user interface menu comprising: a plurality of menu items, wherein each menu item corresponds to one of a plurality of options for a user of the local video teleconferencing system, and at least one menu item comprises a graphic representative of the option corresponding to said menu item.
2. The user interface menu of claim 1 wherein a communications link may be formed between the local video teleconferencing system and any of a plurality of remote video teleconferencing systems, wherein: each of the plurality of options comprises forming a communications link between the local video teleconferencing system and one of the remote video teleconferencing systems; and at least one menu item comprises a graphic representative of the remote video teleconferencing system corresponding to said menu item.
3. The user interface menu of claim 2 wherein: the graphic includes an image representative of the remote video teleconferencing system.
4. The user interface menu of claim 3 wherein: the image is substantially similar to images capturable by the remote video teleconferencing system.
5. The user interface menu of claim 2 wherein: the graphic representative of the remote video teleconferencing system includes caller i.d. information for the remote video teleconferencing system.
6. The user interface menu of claim 2 wherein: the plurality of menu items includes a highlighted menu item; and the highlighted menu item corresponds to the remote video teleconferencing system with which the local video teleconferencing system last formed a communications link.
7. The user interface menu of claim 2 wherein: the plurality of menu items includes a highlighted menu item; and the highlighted menu item is the menu item which was last highlighted by the user of the local video teleconferencing system.
8. The user interface menu of claim 1 wherein an image capture device is capable of providing images captured by the image capture device to the local video teleconferencing system, wherein: each of the plurality of options comprises positioning the image capture device in a preset position; and at least one menu item comprises an image which is substantially similar to an image capturable by the image capture device positioned in the preset position corresponding to said menu item.
9. The user interface menu of claim 1 wherein a plurality of image sources is capable of providing images to the local video teleconferencing system, wherein: each of the plurality of options comprises one of the image sources providing images to the local video teleconferencing system; and at least one menu item comprises an image which is substantially similar to an image providable by the image source corresponding to said menu item.
10. The user interface menu of claim 1 wherein each menu item comprises a graphics area for displaying a graphic representative of the option corresponding to said menu item.
11. In a local video teleconferencing system including a display device, a method for presenting a plurality of options to a user comprising the steps of: displaying a plurality of menu items on the display device, wherein each menu item corresponds to one of a plurality of options for a user of the local video teleconferencing system; receiving a graphic representative of one of the options; and displaying the graphic as a part of the menu item corresponding to the option represented by the graphic.
12. The method of claim 11 wherein a communications link may be formed between the local video teleconferencing system and any of a plurality of remote video teleconferencing systems wherein: each of the plurality of options comprises forming a communications link between the local video teleconferencing system and one of the remote video teleconferencing systems; and the step of receiving a graphic comprises receiving a graphic representative of one of the remote video teleconferencing systems.
13. The method of claim 12 wherein: the step of receiving a graphic comprises receiving an image representative of the remote video teleconferencing system.
14. The method of claim 13 wherein: the step of receiving a graphic comprises receiving an image captured by the remote video teleconferencing system.
15. The method of claim 12 wherein: the step of receiving a graphic comprises receiving caller i.d. information for the remote video teleconferencing system.
16. The method of claim 12 further comprising the step of: highlighting the menu item corresponding to the remote video teleconferencing system with which the local video teleconferencing system last formed a communications link.
17. The method of claim 12 further comprising the step of: highlighting the menu item which was last highlighted by the user of the local video teleconferencing system.
18. The method of claim 11 wherein an image capture device is capable of providing images captured by the image capture device to the local video teleconferencing system, wherein: each of the plurality of options comprises positioning the image capture device in a preset position; the step of receiving a graphic comprises receiving an image captured by the image capture device in one of the preset positions; and the step of displaying the graphic comprises displaying the image captured by the image capture device in the preset position as part of the menu item corresponding to said preset position.
19. The method of claim 18 further comprising the steps of: responsive to the image capture device remaining in a first position for longer than a predetermined length of time, receiving an image captured by the image capture device in said first position; displaying on the display device a menu item corresponding to said first position; and displaying the image captured by the image capture device as part of the menu item.
20. The method of claim 18 further comprising the steps of: responsive to the image capture device remaining in a first position for longer than a predetermined length of time and the first position being separated by at least a preselected threshold from the preset positions, receiving an image captured by the image capture device in said first position; displaying on the display device an additional menu item corresponding to said first position; and displaying the image captured by the image capture device as part of the additional menu item.
21. The method of claim 11 wherein a plurality of image sources is capable of providing images to the local video teleconferencing system wherein: each of the plurality of options comprises one of the image sources providing images to the local video teleconferencing system; the step of receiving a graphic comprises receiving an image from one of the image sources; and the step of displaying the graphic comprises displaying the image received from the image source as part of the menu item corresponding to said image source.
22. The method of claim 11 further comprising the steps of: displaying a graphic icon as part of each menu item when an image representative of the option corresponding to said menu item is not available for display; and replacing the graphic icon with an image representative of the option corresponding to said menu item when said image becomes available.
23. A computer program product, for a local video teleconferencing system including a display device, for presenting a plurality of options to a user of the local video teleconferencing system, the computer program product comprising: a computer readable storage medium comprising: code for displaying a plurality of menu items on the display device, wherein each menu item corresponds to one of a plurality of options for a user of the local video teleconferencing system; and code for displaying a graphic as part of at least one menu item, wherein said graphic is representative of the option corresponding to said menu item.
24. The computer program product of claim 23 wherein a communications link may be formed between the local video teleconferencing system and any of a plurality of remote video teleconferencing systems wherein: each of the plurality of options comprises forming a communications link between the local video teleconferencing system and one of the remote video teleconferencing systems; and the computer readable storage medium further comprises: code for receiving a graphic representative of one of the remote video teleconferencing systems; and code for displaying said graphic as part of the menu item corresponding to said remote video teleconferencing system.
25. The computer program product of claim 24 wherein the computer readable storage medium further comprises: code for receiving an image representative of the remote video teleconferencing system; and code for displaying said image as part of the menu item corresponding to said remote video teleconferencing system.
26. The computer program product of claim 25 wherein the computer readable storage medium further comprises: code for receiving an image captured by the remote video teleconferencing system; and code for displaying said image as part of the menu item corresponding to said remote video teleconferencing system.
27. The computer program product of claim 24 wherein the computer readable storage medium further comprises: code for receiving a graphic as part of caller i.d. information for the remote video teleconferencing system; and code for displaying said graphic as part of the menu item corresponding to said remote video teleconferencing system.
28. The computer program product of claim 24 wherein the computer readable storage medium further comprises: code for highlighting the menu item corresponding to the remote video teleconferencing system with which the local video teleconferencing system last formed a communications link.
29. The computer program product of claim 24 wherein the computer readable storage medium further comprises: code for highlighting the menu item which was last highlighted by the user of the local video teleconferencing system.
30. The computer program product of claim 23 wherein an image capture device is capable of providing images captured by the image capture device to the local video teleconferencing system, wherein: each of the plurality of options comprises positioning the image capture device in a preset position; and the computer readable storage medium further comprises: code for receiving an image captured by the image capture device in one of the 5 preset positions; and code for displaying the image captured by the image capture device in the preset position as part of the menu item corresponding to said preset position.
31. The computer program product of claim 30 wherein the computer readable storage o medium further compri ses : code, responsive to the image capture device remaining in a first position for longer than a predetermined length of time, for receiving an image captured by the image capture device positioned in the first position; code for displaying on the display device a menu item corresponding to said first 5 position; and code for displaying the image captured by the image capture device as part of the menu item.
32. The computer program product of claim 23 wherein a plurality of image sources is capable of providing images to the local video teleconferencing system wherein: 0 each of the plurality of options comprises one of the image sources providing images to the local video teleconferencing system; and the computer readable storage medium further comprises: code for receiving an image from one of the image sources; and code for displaying the image received from the image source as part of the 5 menu item corresponding to said image source.
33. The computer program product of claim 23 wherein the computer readable storage medium further comprises: code for displaying a graphic icon as part of each menu item when an image representative of the option corresponding to said menu item is not available for 0 display; and code for replacing the graphic icon with an image representative of the option corresponding to said menu item when said image becomes available.
34. A local video teleconferencing system comprising: a display device; and a control unit coupled to the display device for generating a plurality of menu items for display on the display device, wherein each menu item corresponds to one of a plurality of options for a user of the local video teleconferencing system and at least one menu item comprises a graphic representative of the option coπesponding to said menu item.
35. The local video teleconferencing system of claim 34 wherein: the control unit is further for forming a communications link between the local video teleconferencing system and any of a plurality of remote video teleconferencing systems; each of the plurality of options comprises forming a communications link between the local video teleconferencing system and one of the remote video teleconferencing systems; and at least one menu item comprises a graphic representative of the remote video teleconferencing system corresponding to said menu item.
36. The local video teleconferencing system of claim 35 wherein: the control unit is further for receiving an image captured by the remote video teleconferencing system and for displaying said image as part of the menu item corresponding to said remote video teleconferencing system.
37. The local video teleconferencing system of claim 34 wherein: the control unit is further for receiving images from an image capture device; each of the plurality of options comprises positioning the image capture device in one of a plurality of preset positions; and at least one menu item comprises an image captured by the image capture device in the preset position corresponding to said menu item.
38. The local video teleconferencing system of claim 37 wherein: the control unit is further for, responsive to the image capture device remaining in a first position for longer than a predetermined length of time, receiving an image captured by the image capture device positioned in the first position; displaying on the display device a menu item coπesponding to said first position; and displaying the image captured by the image capture device as part of the menu item.
39. The local video teleconferencing system of claim 34 wherein: the control unit is further for receiving images from any of a plurality of image sources; each of the plurality of options comprises one of the image sources providing images to the control unit; and at least one menu item comprises an image provided by the image source coπesponding to said menu item.
40. A local video teleconferencing system comprising: menu means for generating a plurality of menu items, wherein each menu item coπesponds to one of a plurality of options for a user of the local video teleconferencing system and at least one menu item comprises a graphic representative of the option coπesponding to said menu item; and display means coupled to the menu generation means for displaying the plurality of menu items.
41. The local video teleconferencing system of claim 40 further comprising: communications means coupled to the menu means for forming a communications link between the local video teleconferencing system and any of a plurality of remote video teleconferencing systems; and wherein each of the plurality of options comprises forming a communications link between the local video teleconferencing system and one of the remote video teleconferencing systems, and at least one menu item comprises a graphic representative of the remote video teleconferencing system corresponding to said menu item.
42. The local video teleconferencing system of claim 41 further comprising: image receiving means coupled to the menu means for receiving an image captured by the remote video teleconferencing system; and wherein the menu item coπesponding to said remote video teleconferencing system includes said image.
43. The local video teleconferencing system of claim 40 further comprising: image receiving means coupled to the menu means for receiving images from an image capture device; and wherein each of the plurality of options comprises positioning the image capture device in one of a plurality of preset positions, and at least one menu item comprises an image captured by the image capture device in the preset position coπesponding to said menu item.
44. The local video teleconferencing system of claim 43 wherein: the image receiving means is further for, responsive to the image capture device remaining in a first position for longer than a predetermined length of time, receiving an image captured by the image capture device positioned in the first position; and the menu means is further for generating a menu item coπesponding to said first position, wherein said menu item includes the image captured by the image capture device in said first position.
45. The local video teleconferencing system of claim 40 further comprising: image receiving means coupled to the menu means for receiving images from any of a plurality of image sources; and wherein each of the plurality of options comprises one of the image sources providing images to the control unit, and at least one menu item comprises an image provided by the image source coπesponding to said menu item.
PCT/US1999/024612 1998-10-24 1999-10-22 Graphical menu items for a user interface menu of a video teleconferencing system WO2000025516A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU12162/00A AU1216200A (en) 1998-10-24 1999-10-22 Graphical menu items for a user interface menu of a video teleconferencing system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US10554098P 1998-10-24 1998-10-24
US60/105,540 1998-10-24
US29561699A 1999-04-20 1999-04-20
US09/295,616 1999-04-20

Publications (1)

Publication Number Publication Date
WO2000025516A1 true WO2000025516A1 (en) 2000-05-04

Family

ID=26802688

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/024612 WO2000025516A1 (en) 1998-10-24 1999-10-22 Graphical menu items for a user interface menu of a video teleconferencing system

Country Status (2)

Country Link
AU (1) AU1216200A (en)
WO (1) WO2000025516A1 (en)

Cited By (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050204438A1 (en) * 2004-02-26 2005-09-15 Yulun Wang Graphical interface for a remote presence system
US8682486B2 (en) 2002-07-25 2014-03-25 Intouch Technologies, Inc. Medical tele-robotic system with a master remote station with an arbitrator
US8836751B2 (en) 2011-11-08 2014-09-16 Intouch Technologies, Inc. Tele-presence system with a user interface that displays different communication links
US8849679B2 (en) 2006-06-15 2014-09-30 Intouch Technologies, Inc. Remote controlled robot system that provides medical images
US8849680B2 (en) 2009-01-29 2014-09-30 Intouch Technologies, Inc. Documentation through a remote presence robot
US8897920B2 (en) 2009-04-17 2014-11-25 Intouch Technologies, Inc. Tele-presence robot system with software modularity, projector and laser pointer
US8902278B2 (en) 2012-04-11 2014-12-02 Intouch Technologies, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
US8965579B2 (en) 2011-01-28 2015-02-24 Intouch Technologies Interfacing with a mobile telepresence robot
US8983174B2 (en) 2004-07-13 2015-03-17 Intouch Technologies, Inc. Mobile robot with a head-based movement mapping scheme
US8996165B2 (en) 2008-10-21 2015-03-31 Intouch Technologies, Inc. Telepresence robot with a camera boom
US9089972B2 (en) 2010-03-04 2015-07-28 Intouch Technologies, Inc. Remote presence system including a cart that supports a robot face and an overhead camera
US9098611B2 (en) 2012-11-26 2015-08-04 Intouch Technologies, Inc. Enhanced video interaction for a user interface of a telepresence network
US9138891B2 (en) 2008-11-25 2015-09-22 Intouch Technologies, Inc. Server connectivity control for tele-presence robot
US9174342B2 (en) 2012-05-22 2015-11-03 Intouch Technologies, Inc. Social behavior rules for a medical telepresence robot
US9193065B2 (en) 2008-07-10 2015-11-24 Intouch Technologies, Inc. Docking system for a tele-presence robot
US9198728B2 (en) 2005-09-30 2015-12-01 Intouch Technologies, Inc. Multi-camera mobile teleconferencing platform
US9251313B2 (en) 2012-04-11 2016-02-02 Intouch Technologies, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
US9264664B2 (en) 2010-12-03 2016-02-16 Intouch Technologies, Inc. Systems and methods for dynamic bandwidth allocation
US9296107B2 (en) 2003-12-09 2016-03-29 Intouch Technologies, Inc. Protocol for a remotely controlled videoconferencing robot
US9323250B2 (en) 2011-01-28 2016-04-26 Intouch Technologies, Inc. Time-dependent navigation of telepresence robots
US9361021B2 (en) 2012-05-22 2016-06-07 Irobot Corporation Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US9381654B2 (en) 2008-11-25 2016-07-05 Intouch Technologies, Inc. Server connectivity control for tele-presence robot
US9429934B2 (en) 2008-09-18 2016-08-30 Intouch Technologies, Inc. Mobile videoconferencing robot system with network adaptive driving
US9602765B2 (en) 2009-08-26 2017-03-21 Intouch Technologies, Inc. Portable remote presence robot
US9616576B2 (en) 2008-04-17 2017-04-11 Intouch Technologies, Inc. Mobile tele-presence system with a microphone system
US9842192B2 (en) 2008-07-11 2017-12-12 Intouch Technologies, Inc. Tele-presence robot system with multi-cast features
US9974612B2 (en) 2011-05-19 2018-05-22 Intouch Technologies, Inc. Enhanced diagnostics for a telepresence robot
US10343283B2 (en) 2010-05-24 2019-07-09 Intouch Technologies, Inc. Telepresence robot system that can be accessed by a cellular phone
US10471588B2 (en) 2008-04-14 2019-11-12 Intouch Technologies, Inc. Robotic based health care system
US10682763B2 (en) 2007-05-09 2020-06-16 Intouch Technologies, Inc. Robot system that operates through a network firewall
US10769739B2 (en) 2011-04-25 2020-09-08 Intouch Technologies, Inc. Systems and methods for management of information among medical providers and facilities
US10808882B2 (en) 2010-05-26 2020-10-20 Intouch Technologies, Inc. Tele-robotic system with a robot face placed on a chair
US10875182B2 (en) 2008-03-20 2020-12-29 Teladoc Health, Inc. Remote presence system mounted to operating room hardware
US11154981B2 (en) 2010-02-04 2021-10-26 Teladoc Health, Inc. Robot user interface for telepresence robot system
US11389064B2 (en) 2018-04-27 2022-07-19 Teladoc Health, Inc. Telehealth cart that supports a removable tablet with seamless audio/video switching
US11399153B2 (en) 2009-08-26 2022-07-26 Teladoc Health, Inc. Portable telepresence apparatus
US11636944B2 (en) 2017-08-25 2023-04-25 Teladoc Health, Inc. Connectivity infrastructure for a telehealth platform
US11742094B2 (en) 2017-07-25 2023-08-29 Teladoc Health, Inc. Modular telehealth cart with thermal imaging and touch screen user interface
US11862302B2 (en) 2017-04-24 2024-01-02 Teladoc Health, Inc. Automated transcription and documentation of tele-health encounters

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821211A (en) * 1987-11-19 1989-04-11 International Business Machines Corp. Method of navigating among program menus using a graphical menu tree
US5758079A (en) * 1993-10-01 1998-05-26 Vicor, Inc. Call control in video conferencing allowing acceptance and identification of participants in a new incoming call during an active teleconference

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821211A (en) * 1987-11-19 1989-04-11 International Business Machines Corp. Method of navigating among program menus using a graphical menu tree
US5758079A (en) * 1993-10-01 1998-05-26 Vicor, Inc. Call control in video conferencing allowing acceptance and identification of participants in a new incoming call during an active teleconference

Cited By (83)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8682486B2 (en) 2002-07-25 2014-03-25 Intouch Technologies, Inc. Medical tele-robotic system with a master remote station with an arbitrator
US10315312B2 (en) 2002-07-25 2019-06-11 Intouch Technologies, Inc. Medical tele-robotic system with a master remote station with an arbitrator
US9849593B2 (en) 2002-07-25 2017-12-26 Intouch Technologies, Inc. Medical tele-robotic system with a master remote station with an arbitrator
US9956690B2 (en) 2003-12-09 2018-05-01 Intouch Technologies, Inc. Protocol for a remotely controlled videoconferencing robot
US10882190B2 (en) 2003-12-09 2021-01-05 Teladoc Health, Inc. Protocol for a remotely controlled videoconferencing robot
US9296107B2 (en) 2003-12-09 2016-03-29 Intouch Technologies, Inc. Protocol for a remotely controlled videoconferencing robot
US9375843B2 (en) 2003-12-09 2016-06-28 Intouch Technologies, Inc. Protocol for a remotely controlled videoconferencing robot
US20050204438A1 (en) * 2004-02-26 2005-09-15 Yulun Wang Graphical interface for a remote presence system
US10241507B2 (en) 2004-07-13 2019-03-26 Intouch Technologies, Inc. Mobile robot with a head-based movement mapping scheme
US8983174B2 (en) 2004-07-13 2015-03-17 Intouch Technologies, Inc. Mobile robot with a head-based movement mapping scheme
US9766624B2 (en) 2004-07-13 2017-09-19 Intouch Technologies, Inc. Mobile robot with a head-based movement mapping scheme
US9198728B2 (en) 2005-09-30 2015-12-01 Intouch Technologies, Inc. Multi-camera mobile teleconferencing platform
US10259119B2 (en) 2005-09-30 2019-04-16 Intouch Technologies, Inc. Multi-camera mobile teleconferencing platform
US8849679B2 (en) 2006-06-15 2014-09-30 Intouch Technologies, Inc. Remote controlled robot system that provides medical images
US10682763B2 (en) 2007-05-09 2020-06-16 Intouch Technologies, Inc. Robot system that operates through a network firewall
US10875182B2 (en) 2008-03-20 2020-12-29 Teladoc Health, Inc. Remote presence system mounted to operating room hardware
US11787060B2 (en) 2008-03-20 2023-10-17 Teladoc Health, Inc. Remote presence system mounted to operating room hardware
US11472021B2 (en) 2008-04-14 2022-10-18 Teladoc Health, Inc. Robotic based health care system
US10471588B2 (en) 2008-04-14 2019-11-12 Intouch Technologies, Inc. Robotic based health care system
US9616576B2 (en) 2008-04-17 2017-04-11 Intouch Technologies, Inc. Mobile tele-presence system with a microphone system
US9193065B2 (en) 2008-07-10 2015-11-24 Intouch Technologies, Inc. Docking system for a tele-presence robot
US10493631B2 (en) 2008-07-10 2019-12-03 Intouch Technologies, Inc. Docking system for a tele-presence robot
US9842192B2 (en) 2008-07-11 2017-12-12 Intouch Technologies, Inc. Tele-presence robot system with multi-cast features
US10878960B2 (en) 2008-07-11 2020-12-29 Teladoc Health, Inc. Tele-presence robot system with multi-cast features
US9429934B2 (en) 2008-09-18 2016-08-30 Intouch Technologies, Inc. Mobile videoconferencing robot system with network adaptive driving
US8996165B2 (en) 2008-10-21 2015-03-31 Intouch Technologies, Inc. Telepresence robot with a camera boom
US9138891B2 (en) 2008-11-25 2015-09-22 Intouch Technologies, Inc. Server connectivity control for tele-presence robot
US10059000B2 (en) 2008-11-25 2018-08-28 Intouch Technologies, Inc. Server connectivity control for a tele-presence robot
US10875183B2 (en) 2008-11-25 2020-12-29 Teladoc Health, Inc. Server connectivity control for tele-presence robot
US9381654B2 (en) 2008-11-25 2016-07-05 Intouch Technologies, Inc. Server connectivity control for tele-presence robot
US8849680B2 (en) 2009-01-29 2014-09-30 Intouch Technologies, Inc. Documentation through a remote presence robot
US8897920B2 (en) 2009-04-17 2014-11-25 Intouch Technologies, Inc. Tele-presence robot system with software modularity, projector and laser pointer
US10969766B2 (en) 2009-04-17 2021-04-06 Teladoc Health, Inc. Tele-presence robot system with software modularity, projector and laser pointer
US10911715B2 (en) 2009-08-26 2021-02-02 Teladoc Health, Inc. Portable remote presence robot
US10404939B2 (en) 2009-08-26 2019-09-03 Intouch Technologies, Inc. Portable remote presence robot
US11399153B2 (en) 2009-08-26 2022-07-26 Teladoc Health, Inc. Portable telepresence apparatus
US9602765B2 (en) 2009-08-26 2017-03-21 Intouch Technologies, Inc. Portable remote presence robot
US11154981B2 (en) 2010-02-04 2021-10-26 Teladoc Health, Inc. Robot user interface for telepresence robot system
US11798683B2 (en) 2010-03-04 2023-10-24 Teladoc Health, Inc. Remote presence system including a cart that supports a robot face and an overhead camera
US9089972B2 (en) 2010-03-04 2015-07-28 Intouch Technologies, Inc. Remote presence system including a cart that supports a robot face and an overhead camera
US10887545B2 (en) 2010-03-04 2021-01-05 Teladoc Health, Inc. Remote presence system including a cart that supports a robot face and an overhead camera
US11389962B2 (en) 2010-05-24 2022-07-19 Teladoc Health, Inc. Telepresence robot system that can be accessed by a cellular phone
US10343283B2 (en) 2010-05-24 2019-07-09 Intouch Technologies, Inc. Telepresence robot system that can be accessed by a cellular phone
US10808882B2 (en) 2010-05-26 2020-10-20 Intouch Technologies, Inc. Tele-robotic system with a robot face placed on a chair
US9264664B2 (en) 2010-12-03 2016-02-16 Intouch Technologies, Inc. Systems and methods for dynamic bandwidth allocation
US10218748B2 (en) 2010-12-03 2019-02-26 Intouch Technologies, Inc. Systems and methods for dynamic bandwidth allocation
US10399223B2 (en) 2011-01-28 2019-09-03 Intouch Technologies, Inc. Interfacing with a mobile telepresence robot
US9785149B2 (en) 2011-01-28 2017-10-10 Intouch Technologies, Inc. Time-dependent navigation of telepresence robots
US9323250B2 (en) 2011-01-28 2016-04-26 Intouch Technologies, Inc. Time-dependent navigation of telepresence robots
US10591921B2 (en) 2011-01-28 2020-03-17 Intouch Technologies, Inc. Time-dependent navigation of telepresence robots
US11468983B2 (en) 2011-01-28 2022-10-11 Teladoc Health, Inc. Time-dependent navigation of telepresence robots
US8965579B2 (en) 2011-01-28 2015-02-24 Intouch Technologies Interfacing with a mobile telepresence robot
US11289192B2 (en) 2011-01-28 2022-03-29 Intouch Technologies, Inc. Interfacing with a mobile telepresence robot
US9469030B2 (en) 2011-01-28 2016-10-18 Intouch Technologies Interfacing with a mobile telepresence robot
US10769739B2 (en) 2011-04-25 2020-09-08 Intouch Technologies, Inc. Systems and methods for management of information among medical providers and facilities
US9974612B2 (en) 2011-05-19 2018-05-22 Intouch Technologies, Inc. Enhanced diagnostics for a telepresence robot
US9715337B2 (en) 2011-11-08 2017-07-25 Intouch Technologies, Inc. Tele-presence system with a user interface that displays different communication links
US8836751B2 (en) 2011-11-08 2014-09-16 Intouch Technologies, Inc. Tele-presence system with a user interface that displays different communication links
US10331323B2 (en) 2011-11-08 2019-06-25 Intouch Technologies, Inc. Tele-presence system with a user interface that displays different communication links
US8902278B2 (en) 2012-04-11 2014-12-02 Intouch Technologies, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
US10762170B2 (en) 2012-04-11 2020-09-01 Intouch Technologies, Inc. Systems and methods for visualizing patient and telepresence device statistics in a healthcare network
US9251313B2 (en) 2012-04-11 2016-02-02 Intouch Technologies, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
US11205510B2 (en) 2012-04-11 2021-12-21 Teladoc Health, Inc. Systems and methods for visualizing and managing telepresence devices in healthcare networks
US10892052B2 (en) 2012-05-22 2021-01-12 Intouch Technologies, Inc. Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US11453126B2 (en) 2012-05-22 2022-09-27 Teladoc Health, Inc. Clinical workflows utilizing autonomous and semi-autonomous telemedicine devices
US9361021B2 (en) 2012-05-22 2016-06-07 Irobot Corporation Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US10061896B2 (en) 2012-05-22 2018-08-28 Intouch Technologies, Inc. Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US10328576B2 (en) 2012-05-22 2019-06-25 Intouch Technologies, Inc. Social behavior rules for a medical telepresence robot
US9174342B2 (en) 2012-05-22 2015-11-03 Intouch Technologies, Inc. Social behavior rules for a medical telepresence robot
US11628571B2 (en) 2012-05-22 2023-04-18 Teladoc Health, Inc. Social behavior rules for a medical telepresence robot
US10780582B2 (en) 2012-05-22 2020-09-22 Intouch Technologies, Inc. Social behavior rules for a medical telepresence robot
US10658083B2 (en) 2012-05-22 2020-05-19 Intouch Technologies, Inc. Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US11515049B2 (en) 2012-05-22 2022-11-29 Teladoc Health, Inc. Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US10603792B2 (en) 2012-05-22 2020-03-31 Intouch Technologies, Inc. Clinical workflows utilizing autonomous and semiautonomous telemedicine devices
US9776327B2 (en) 2012-05-22 2017-10-03 Intouch Technologies, Inc. Social behavior rules for a medical telepresence robot
US10924708B2 (en) 2012-11-26 2021-02-16 Teladoc Health, Inc. Enhanced video interaction for a user interface of a telepresence network
US10334205B2 (en) 2012-11-26 2019-06-25 Intouch Technologies, Inc. Enhanced video interaction for a user interface of a telepresence network
US9098611B2 (en) 2012-11-26 2015-08-04 Intouch Technologies, Inc. Enhanced video interaction for a user interface of a telepresence network
US11910128B2 (en) 2012-11-26 2024-02-20 Teladoc Health, Inc. Enhanced video interaction for a user interface of a telepresence network
US11862302B2 (en) 2017-04-24 2024-01-02 Teladoc Health, Inc. Automated transcription and documentation of tele-health encounters
US11742094B2 (en) 2017-07-25 2023-08-29 Teladoc Health, Inc. Modular telehealth cart with thermal imaging and touch screen user interface
US11636944B2 (en) 2017-08-25 2023-04-25 Teladoc Health, Inc. Connectivity infrastructure for a telehealth platform
US11389064B2 (en) 2018-04-27 2022-07-19 Teladoc Health, Inc. Telehealth cart that supports a removable tablet with seamless audio/video switching

Also Published As

Publication number Publication date
AU1216200A (en) 2000-05-15

Similar Documents

Publication Publication Date Title
WO2000025516A1 (en) Graphical menu items for a user interface menu of a video teleconferencing system
KR100777480B1 (en) Information processing apparatus and method, information processing system and medium
EP2372990B1 (en) Mobile terminal with ergonomic imaging functions
US8947543B2 (en) System and method of personalizing a user interface of a portable electronic device
US7194701B2 (en) Video thumbnail
US6788293B1 (en) Viewer with code sensor
KR101179890B1 (en) Method and apparatus for digital image displaying on a portable terminal
US20030210331A1 (en) System for and method of personalizing a user interface of a portable electronic device
WO2008001843A1 (en) Image data providing device, image display device, image display system, control method for image data providing device, control method for image display device, control program and recording medium
US9229615B2 (en) Method and apparatus for displaying additional information items
CN112073798B (en) Data transmission method and equipment
WO2006064358A1 (en) Method and apparatus for video editing on small screen with minimal input device
CN113645494B (en) Screen fusion method, display device, terminal device and server
US11917329B2 (en) Display device and video communication data processing method
CN112698905A (en) Screen protection display method, display device, terminal device and server
WO2008018503A1 (en) Image display device, image data providing device, image display system, image display system control method, control program, and recording medium
WO2008018506A1 (en) Image display device, image data providing device, image display system, image display system control method, control program, and recording medium
JPH09233384A (en) Image input device and image transmitter using it
JP2003316490A (en) Remote control system and method thereof
JP4533315B2 (en) Information processing apparatus, information display method, and program for setting background image
CN113747078A (en) Display device and focus control method
EP1959342A1 (en) Information processing device, method for control of information processing device, control program of information processing device, and recording medium having control program of information processing device recorded therein
CN112274910A (en) Virtual key configuration method, virtual key method and related device
JP3680886B2 (en) Remote control device
CN112905008B (en) Gesture adjustment image display method and display device

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref country code: AU

Ref document number: 2000 12162

Kind code of ref document: A

Format of ref document f/p: F

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase