WO2001059551A2 - User interface for interacting with plural real-time data sources - Google Patents

User interface for interacting with plural real-time data sources Download PDF

Info

Publication number
WO2001059551A2
WO2001059551A2 PCT/US2000/035374 US0035374W WO0159551A2 WO 2001059551 A2 WO2001059551 A2 WO 2001059551A2 US 0035374 W US0035374 W US 0035374W WO 0159551 A2 WO0159551 A2 WO 0159551A2
Authority
WO
WIPO (PCT)
Prior art keywords
user
icon
data
source
toolbar
Prior art date
Application number
PCT/US2000/035374
Other languages
French (fr)
Other versions
WO2001059551A3 (en
Inventor
Satoru Yukie
Gina C. Eubanks
Original Assignee
Sony Corporation Of America
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/542,154 external-priority patent/US20030174154A1/en
Application filed by Sony Corporation Of America filed Critical Sony Corporation Of America
Priority to AU2601001A priority Critical patent/AU2601001A/en
Publication of WO2001059551A2 publication Critical patent/WO2001059551A2/en
Publication of WO2001059551A3 publication Critical patent/WO2001059551A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/954Navigation, e.g. using categorised browsing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/04Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/30Profiles
    • H04L67/306User profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/55Push-based network services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438Window management, e.g. event handling following interaction with the user interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4753End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for user identification, e.g. by entering a PIN or password
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W80/00Wireless network protocols or protocol adaptations to wireless operation

Definitions

  • the present invention relates generally to monitoring multiple real-time data feeds from multiple customized sources using a remote terminal device.
  • PDAs personal digital assistants
  • PDA personal digital assistant
  • PCs personal computers
  • laptop computers The present invention consequently recognizes that PDAs and other consumer computers potentially can support a large number of applications.
  • the present invention further recognizes that many additional useful applications can be supported using the Internet. Specifically, owing to the world wide computer-to-computer communications provided by the Internet, the present invention recognizes that many useful applications can be provided that use data gathered by or generated by other computers. Also, such applications, as understood herein, are not necessarily limited to simply using data, but can include two-way communication between computers to permit a first computer, such as a PC or PDA, to control or monitor a second computer, such as a digital telephone or a digital video camera, based on data communicated from the second computer to the first computer.
  • a first computer such as a PC or PDA
  • a second computer such as a digital telephone or a digital video camera
  • a user interface is disclosed with accompanying general purpose computer that is programmed according to the inventive steps herein.
  • the invention can also be embodied as an article of manufacture - a machine component - that is used by a digital processing apparatus and which tangibly embodies a program of instructions that are executable by the digital processing apparatus to execute the present logic.
  • This invention is realized in a critical machine component that causes a digital processing apparatus to perform the inventive method steps herein.
  • the invention is a graphical user interface (GUI) for a user terminal including a monitor.
  • GUI graphical user interface
  • the GUI includes a personalized toolbar that can be presented on the monitor and that has one or more icons.
  • Each icon is associated with a respective network address of a respective source of digitized content in wireless communication with the terminal.
  • a user can configure an icon to cause data from the respective source to be presented on the monitor.
  • the toolbar is defined by a user. At least some icons include thumbnails of data from the respective sources.
  • the toolbar is stored on a server and is associated with a user ID, such that the toolbar is presented on any computer device logged onto using the user ID and communicating with the server.
  • a computer system in another aspect, includes at least one user terminal including at least one output device, and plural sources of digitized content in wireless communication with the user terminal.
  • Logic is executable by the terminal for displaying a toolbar on the output device.
  • the toolbar includes one or more icons, each being associated with a respective source and each being manipulable by a computer input device associated with the terminal to select the associated source for display.
  • each icon is associated with a content channel, and an icon is manipulable to cause data from the channel to be displayed.
  • the preferred logic can receive an alert from at least one source and generate an alert signal in response thereto, with the alert signal altering the respective icon.
  • an icon can be enlarged when a user manipulates the icon. Data from a channel is displayed in the associated icon. Thus, the icon essentially functions as a display window.
  • a computer-implemented method for monitoring real-time customized data and stored public content includes providing a terminal accessing at least one wireless network path of a computer network, and providing one or more sources of data on the network. The method also includes displaying at least one channel selector element having multiple selections corresponding to the multiple sources to permit the user to select a source for display of data therefrom from among the sources of data.
  • Figure 1 is a schematic diagram showing the system of the present invention
  • Figure 2 is a schematic diagram of a generic toolbar for use in selecting realtime data to be monitored;
  • Figure 3 is a flow chart showing the overall logic of the invention;
  • Figure 4 is a flow chart showing a more detailed logic flow
  • Figure 5 is a flow chart showing a specific logic flow when the real-time data includes, for example, video
  • Figure 6 is a flow chart showing further details of the user terminal logic
  • Figure 7 is a screen display of an implementation of the terminal toolbar and accompanying real-time data displays
  • Figure 8 is another screen display of an implementation of the terminal toolbar and accompanying real-time data displays.
  • Figure 9 is a flow chart showing terminal daemon logic. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • a system for selectively monitoring multiple real-time data feeds from one or more customized data sources 12, in addition to the publicly available sources mentioned further below.
  • customized data sources is meant sources that provide data as defined by the user or that are associated with the user, and not with the general public.
  • one source 12 might be a home security camera or a video camera located in the user's child's playroom or day care center as defined (set up) by the user, while another source 12 might be the user's home telephone, either wired or wireless or both.
  • Yet another source 12 might be a stock market feed with portions of its stock information compiled into customized user-defined portfolio.
  • Still another source 12 might be an intra-office or inter-office intercom associated with the user or with a small group of people to which the user belongs, or an in-home appliance with, e.g., a JAVA interface.
  • Another source 12 might be a customized database, such as, for example, an electronic journal of the user's personal finances, or a database containing customized public or third party content.
  • the content can be stored on a server, such as a user's home video device or other device.
  • IP Internet Protocol
  • the server 18 can include a communication server 20 for appropriate format conversion to and from IP packets, and a service management server 22, both of which function to undertake the server logic includes in the flow charts below. If desired, the below-described server functions can be distributed among the sources 12/terminal 26.
  • the communication interface 24 can be a standard modem, in which case the network path 28 between the server 18 and terminal device 26 is a standard copper wire or optical fiber Internet path.
  • the network path 28 is a wireless path such as the so-called iBurstTM or RicochetTM communication systems, and more preferably is a space division multiple access (SDMA) path as disclosed in, e.g., U.S. Patent Nos.
  • SDMA space division multiple access
  • SDMA is essentially a directional version of time division multiple access (TDMA) or code division multiple access (CDMA), which produces a very high rate of data transmission (i.e., in excess of one megabyte per second) as compared to other types of Internet communication protocols.
  • TDMA time division multiple access
  • CDMA code division multiple access
  • the network paths 30 between the sources 12 and Internet 16 can be conventional wired Internet paths but more preferably are SDMA wireless paths.
  • the terminal device 26 is a digital processing apparatus, such as a personal digital assistant made by Sony. Or, the terminal device 26 can be a personal computer made by International Business Machines Corporation (IBM) or Apple computer, or the terminal device 26 may be any computer, including a laptop computer, a palmtop computer, or any other appropriate digital appliance.
  • IBM International Business Machines Corporation
  • Apple computer or the terminal device 26 may be any computer, including a laptop computer, a palmtop computer, or any other appropriate digital appliance.
  • the terminal device 26 is electrically connected to one or more input devices 32, e.g., a mouse and/or a keyboard, which can be manipulated by a user of the system 10 as set forth further below to select customized data 14 from the sources 12 for display on, e.g., an output device such as a monitor 34.
  • input devices 32 e.g., a mouse and/or a keyboard
  • output device such as a monitor 34.
  • Other output devices such as other computers, computer networks, audio speakers, printers, and so on can be used.
  • the terminal device 26 includes a daemon module 36.
  • the flow charts herein illustrate the structure of the module 36 of the present invention as well as the logical structure of the server 18 and sources 12 as embodied in computer program software.
  • the flow charts illustrate the structures of logic elements, such as computer program code elements or electronic logic circuits, that function according to this invention.
  • the invention is practiced in its essential embodiment by a machine component that renders the logic elements in a form that instructs a digital processing apparatus (that is, a computer) to perform a sequence of function steps corresponding to those shown.
  • the present logic may be established as a computer program that is executed by a processor within, e.g., the terminal device 26 as a series of computer-executable instructions.
  • these instructions may reside, for example, in RAM of the appropriate computer, or the instructions may be stored on a DASD array, magnetic tape, electronic read-only memory, or other appropriate data storage device.
  • the computer-executable instructions may be lines of compiled C ++ compatible code.
  • the selector element 38 is a toolbar, although other graphical user interface (GUI) elements can be used, such as, for example, dropdown menus.
  • GUI graphical user interface
  • the selector element 38 includes plural source icons 40, with each icon 40 being associated with a respective one of the data sources 12 shown in Figure 1.
  • IP Internet protocol
  • the icon can be associated with a hyperlink that points to the Internet protocol (IP) address or other address of the associated source 12.
  • IP Internet protocol
  • An icon can be configured by the user to be static or it can display real-time data from its respective source. In the latter case, clicking on an icon can cause it to enlarge and/or to zoom in or expand the view.
  • the user establishes the data feeds he or she wants to monitor by appropriately defining the icons 40, in cooperation with the system server.
  • the toolbar 38 is conformable.
  • a user can specify the appearance, configuration, and content of the toolbar 38 depending on the available sources 12.
  • the toolbar 38 can be further customized in light of the particular capabilities of the terminal 26. For example, text only icons might be established for a terminal 26 (e.g., a wireless telephone) that has limited display capabilities.
  • the terminal 26 is an audio device, monitored data can be played and audible alerts generated when appropriate.
  • the selector element 38 is presented on the monitor 34 ( Figure 1) so that a user can click on one or more of the icons 40 to display on the monitor 34 the real-time data feed from the associated source 12.
  • clicking on an icon can cause an option of services, e.g., in the form of a popup menu, to be displayed.
  • These services can be tailored to the particular source.
  • the services can include, in the case of a home video camera, the ability to control the camera remotely.
  • a user selectively monitors one or more data feeds from one or more sources 12.
  • clicking on the appropriate icon 40 causes the data feed to be displayed.
  • the icon is a window displaying realtime data, the user can view the relatively small icon or click on it to cause it to enlarge as described above, and/or to cause a menu of services related to the source 12 to appear
  • selection of an icon is detected by the daemon module 36 at block 44, which communicates via the preferably wireless network path 28 with the server 18 to establish a preferably dedicated channel, referred to herein as a "tunnel channel", between the selected source(s) and the terminal device 26.
  • the selected data feeds are thereby communicated to the terminal device 26 for presentation thereof on the monitor 34, such that a user can monitor the feeds.
  • the user can monitor any alerts that might be generated by an unselected source 12, such as, for example, a stock price from a portfolio source, or a motion alarm from a security camera, or an incoming call alert from an in-home or cellular telephone.
  • the above-described service is billed for in accordance with accounting details set forth more fully below.
  • Figure 4 shows additional details of the present logic.
  • the customized data sources 12 are defined by the user. For instance, the user can set up and start an in-home video camera at block 48, or define a list of stocks for inclusion in a stock portfolio maintained by an online quote service at block 48.
  • the toolbar 38 is defined, based on the sources 12. More specifically, icons 40 (with underlying source 12 addresses) of the toolbar 38 are established along with identifying the sources 12.
  • the daemon module 36 is established.
  • a single daemon module 36 is provided for all the sources 12 as set forth further below, although each source 12 can have an associated module 36 at the terminal device 26.
  • the sources 12 are registered with the server 18.
  • the registration includes recording the source's Internet protocol (IP) address or other identifying address with the server 18.
  • IP Internet protocol
  • the sources 12 are perpetually available to generate data streams that are available to, but that are not necessarily sent to, the terminal device 26 via the Internet.
  • an in-home telephone might not continuously generate data and send it to the Internet unless the telephone receives an incoming call.
  • digitized voice data might not be sent to the Internet unless and until the user at the terminal device 26 responds to an alert to answer the call by clicking on the appropriate icon 40 of the toolbar 38.
  • a video camera or other appliance is available to generate data continuously but might not generate the data until requested or, if continuously generating the data, might not send the data to the Internet until a user clicks on the appropriate icon of the toolbar 38.
  • both the telephone source 12 and video camera source 12 are continuously available to generate data in that they are both on and either generating data or continuously monitoring for a signal to generate data.
  • the server 18 can be provided with real-time quotes for all publicly traded securities by a quote service, with the gathering of particular quotes into customized portfolios being accomplished at the server 18 for provision thereof to the user when the user clicks on the appropriate icon on the toolbar 38.
  • Billing for the above-described service can be accomplished at block 58.
  • the billing is accomplished by gathering accounting data either during the entire time a source 12 or sources 12 are available via the Internet, or as the user displays the data from one or more sources 12 at block 60. That is, a user can be billed essentially a fixed monthly rate, and/or a user can be billed as the user actually displays the data streams from the sources 12. Invoices are periodically sent to the user of the terminal device 26 based on the accounting data gathered at block 58. Billing can also be done on a per-piece basis in the case of the below-described public sources, i.e., each time a user downloads a song or video.
  • a user can be billed on a service basis (the number and/or type of channels and/or monitoring services embodied in the toolbar 38) and on a registration basis (e.g., the number and/or type of terminal devices registered with the server, such as for customized download).
  • a service basis the number and/or type of channels and/or monitoring services embodied in the toolbar 38
  • a registration basis e.g., the number and/or type of terminal devices registered with the server, such as for customized download.
  • the user can periodically control the sources 12 (as by, for instance, answering a telephone call alert from a telephone source 12, or by modifying a stock portfolio).
  • a source 12 for display such as by clicking on the appropriate icon 40
  • the data is displayed at block 64.
  • Figure 5 shows the details of one preferred but non-limiting implementation of the present logic for a single one of the sources 12, assuming that the source 12 is a source of digitized video data.
  • the daemon module 36 enters a loop.
  • the loop can cause the daemon module to periodically "sleep" (e.g., for one-half second), and then "wake up” to poll the icons 40 to determine whether any icon 40 has been selected by the user in the past second.
  • the daemon module thus can be a foreground or background process that continuously monitors for selection of a source 12 data stream to be displayed.
  • the daemon module 36 monitors the data feeds from the sources 12 when it "awakens", to update the icons 40 as appropriate.
  • block 68 represents the selection of an icon 40 associated with a source 12 that is a video camera.
  • the daemon transmits a feed request through the server 18 to the source 12 associated with the icon 40 that was clicked at block 68.
  • the source 12 acknowledges the request, and then a real-time video feed from the source 12 to the terminal 26 for display thereof is facilitated by several steps as follows.
  • the terminal 26 sends registration/authorization data tags to the server 18 for billing and security purposes.
  • the server 18 allocates buffer space as required to buffer the video feed, authenticates the user, and registers the user for billing purposes.
  • the server 18 can also allocate storage for the feed that can be later accessed if desired.
  • the server 18 preferably establishes a so-called "tunnel" channel, which is a private, secure, two-way dedicated channel between only the source 12 and terminal 26.
  • tunnel a so-called "tunnel” channel, which is a private, secure, two-way dedicated channel between only the source 12 and terminal 26.
  • the terminal 26 While the server 18 is undertaking the above-described functions, the terminal 26 creates video buffers as necessary and undertakes time synchronization with the server 18 in accordance with video transmission principles known in the art.
  • the terminal 26 When the terminal 26 is ready to receive data, it sends a "start" command at block 78 to the source 12, which creates the requested content, compresses it, and packetizes it in IP packet format at block 80.
  • the packets of data can include tags that, in addition to or in lieu of the terminal tags received at block 74, can be stripped or copied by the server 18 for billing purposes. Thus, billing can be undertaken on a per-transmitted packet basis (or based on multiple packets) if desired.
  • the source 12 undertakes time synchronization with the server 18, and a realtime video stream is transmitted via the wireless network paths and Internet described above at block 82. As it is transmitted, the packet tags can be extracted for billing purposes at block 84.
  • the terminal 26 monitors for an interrupt signal at block 86, and when one is generated, the terminal 26 sends the interrupt signal to the source 12 at block 88.
  • the request for video is then deactivated at block 90, at which time data from the source 12 is no longer presented to the user.
  • Figures 6 and 7 show details of the structure and logic of the toolbar 38 shown in Figure 2.
  • the user logs on using the appropriate user name and password to any suitable network device, such as the terminal device 26.
  • the server 18 correlates the user ID to the toolbar 38 defined at block 48 in Figure 4 and sends the toolbar 38 to the user at block 94.
  • the toolbar 38 is associated with a user, not necessarily with a particular network device, such that wherever the user logs on his or her own personalized toolbar is presented.
  • the toolbar 38 is always displayed, although if desired the user can minimize the toolbar 38 and drag and drop the toolbar 38 on the display.
  • the toolbar 38 can be resident on the terminal 26, with its configuration parameters being sent to the server for "portability" of the toolbar 38 to other devices that the user might log on to.
  • Figure 7 shows that the icons 40 can be thumbnails generated by the respective source 12 to which they pertain.
  • the left-most icon shown in Figure 7 is associated with an in-home video camera, and accordingly the icon is a thumbnail of an interior room.
  • an icon is shown that is associated with a day care video camera and that is a thumbnail of a day care center, while the next icon is associated with a customized stock portfolio and accordingly is a thumbnail of a personalized stock ticker.
  • Other icons shown in Figure 7 include a symbol of a telephone, associated with a network-attached telephone source 12, a check balance icon, associated with an online checkbook database, and a wireless telephone symbol, associated with an online wireless telephone.
  • the icons themselves can be thumbnail videos of the realtime feeds, in which case the associated video source 12 would be continuously generating the feed and sending it via the network paths described above to the terminal 26. Or, still images from a video stream can be used for an icon.
  • a source e.g., a networked telephone source 12
  • the terminal device 26 when an alert is received from a source, e.g., a networked telephone source 12, the terminal device 26 generates an alert signal.
  • the alert signal can, for example, cause the associated icon 40 to blink, or to become highlighted.
  • an audible or even tactile alert can be generated, if desired, to indicate to the user that the user might want to access the source generating the alert.
  • Figure 7 shows that the present display can present data from non-customized, i.e., publicly available, sources as well.
  • icons 95 representing, e.g., online music channels, online movies and television shows, online electronics vendors, and online games can be provided. Clicking on one of the icons 95 causes data from the associated public source to be displayed.
  • the user clicks on the appropriate icon 40 at block 96.
  • the clicked-on icon 40 can be enlarged, as shown at 40A in Figure 8, to show the details of the icon 40.
  • the exemplary icon 40 shown in Figure 8 is a personalized portfolio stock quote, and so quotes 40B can be seen on the enlarged icon 40A.
  • the enlarged icons 40A essentially are windows, and that when the user clicks on plural icons 40, plural enlarged icons 40A appear as windows on the display. It is to be further appreciated that in the case of a video source 12, clicking on the associated icon 40 causes an enlarged icon 40A to be displayed that is a video window.
  • the real-time feeds are presented, preferably in the windows established by the enlarged icons 40A.
  • Figure 9 shows further details of how the daemon module 36 presents realtime feed.
  • the selected input stream or streams are received.
  • the IP packets of the streams are sent to the software port corresponding to the associated icon 40. That is, when more than one stream is being received, the packets of the various streams are separated from those of other streams and sent to the respective ports associated with the selected sources 12.
  • the packets are processed in accordance with IP packet processing principles known in the art at block 108, and the processed data is then displayed at output state 110.

Abstract

A system and method for monitoring real-time data customized data feeds such as are generated by in-home security cameras, telephones, appliances, as well as customized stock portfolios and other user-specific data, using a wireless user terminal (26) such as a PDA. The data feeds are communicated to the Internet by wired or wireless paths, and a server (18) is connected to the Internet. A toolbar (38) of customized sources (12) is presented on the PDA, and a user can click on one of the toolbar icon (40) to cause the server (18) to establish a tunnel channel between the selected data source and the PDA, such that one or more of the selected real-time feeds from the respective data source (12) can be viewed or otherwise displayed on the PDA.

Description

USER INTERFACE FOR INTERACTING WITH PLURAL REAL-TIME DATA SOURCES
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates generally to monitoring multiple real-time data feeds from multiple customized sources using a remote terminal device.
2. Description of the Related Art
Personal computers and other personal computing devices such as personal digital assistants (PDAs) have become ubiquitous. Along with this, instant worldwide computer communication has become available via the Internet. This juxtaposition of technologies has spawned thousands of new computer-driven consumer devices that are convenient, useful, and indeed that quickly become indispensable.
One such consumer device is the personal digital assistant (PDA). Current PDAs enable users to carry a relatively large amount of data, such as checkbook data, telephone numbers, schedules, and the like in a small, user-friendly device. By manipulating the input device of a PDA a user can very quickly and conveniently access much information that the user might formerly have recorded in a number of different paper journals. In addition, PDAs provide much functionality usually associated with larger computers such as personal computers (PCs) and laptop computers. The present invention consequently recognizes that PDAs and other consumer computers potentially can support a large number of applications.
The present invention further recognizes that many additional useful applications can be supported using the Internet. Specifically, owing to the world wide computer-to-computer communications provided by the Internet, the present invention recognizes that many useful applications can be provided that use data gathered by or generated by other computers. Also, such applications, as understood herein, are not necessarily limited to simply using data, but can include two-way communication between computers to permit a first computer, such as a PC or PDA, to control or monitor a second computer, such as a digital telephone or a digital video camera, based on data communicated from the second computer to the first computer.
Unfortunately, in many cases network data transfer rates are relatively low. Most personal computers, for example, currently have Internet data transfer rates of less than 100 Kbps per second, making the communication of certain types of data, such as video, less than satisfactory over the Internet. Moreover, personal computers typically are connected to the Internet via telephone lines or fiber optic lines, meaning that the computers cannot be transported while connected to the Internet. Further, since the computers must be connected to hard-wired lines, cumbersome and costly line installation is required.
In the case of most wireless Internet network paths, the data rates are relatively slow, and moreover the network paths are not continuous. That is, to establish a wireless network path, a user has had to dial up the wireless network and establish a connection through a circuit switch. This renders impractical applications that require continuous, high data rate, wireless network paths. The present invention recognizes the above-noted problems and provides the solutions disclosed herein, as well as various applications that take advantage of these solutions. SUMMARY OF THE INVENTION
A user interface is disclosed with accompanying general purpose computer that is programmed according to the inventive steps herein. The invention can also be embodied as an article of manufacture - a machine component - that is used by a digital processing apparatus and which tangibly embodies a program of instructions that are executable by the digital processing apparatus to execute the present logic. This invention is realized in a critical machine component that causes a digital processing apparatus to perform the inventive method steps herein.
In one aspect the invention is a graphical user interface (GUI) for a user terminal including a monitor. The GUI includes a personalized toolbar that can be presented on the monitor and that has one or more icons. Each icon is associated with a respective network address of a respective source of digitized content in wireless communication with the terminal. A user can configure an icon to cause data from the respective source to be presented on the monitor.
In a preferred embodiment, the toolbar is defined by a user. At least some icons include thumbnails of data from the respective sources. Preferably, the toolbar is stored on a server and is associated with a user ID, such that the toolbar is presented on any computer device logged onto using the user ID and communicating with the server.
In another aspect, a computer system includes at least one user terminal including at least one output device, and plural sources of digitized content in wireless communication with the user terminal. Logic is executable by the terminal for displaying a toolbar on the output device. The toolbar includes one or more icons, each being associated with a respective source and each being manipulable by a computer input device associated with the terminal to select the associated source for display.
As envisioned by the preferred embodiment, each icon is associated with a content channel, and an icon is manipulable to cause data from the channel to be displayed. The preferred logic can receive an alert from at least one source and generate an alert signal in response thereto, with the alert signal altering the respective icon.
If desired, an icon can be enlarged when a user manipulates the icon. Data from a channel is displayed in the associated icon. Thus, the icon essentially functions as a display window.
In another aspect, a computer-implemented method for monitoring real-time customized data and stored public content includes providing a terminal accessing at least one wireless network path of a computer network, and providing one or more sources of data on the network. The method also includes displaying at least one channel selector element having multiple selections corresponding to the multiple sources to permit the user to select a source for display of data therefrom from among the sources of data.
The details of the present invention, both as to its structure and operation, can best be understood in reference to the accompanying drawings, in which like reference numerals refer to like parts, and in which:
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 is a schematic diagram showing the system of the present invention;
Figure 2 is a schematic diagram of a generic toolbar for use in selecting realtime data to be monitored; Figure 3 is a flow chart showing the overall logic of the invention;
Figure 4 is a flow chart showing a more detailed logic flow;
Figure 5 is a flow chart showing a specific logic flow when the real-time data includes, for example, video;
Figure 6 is a flow chart showing further details of the user terminal logic;
Figure 7 is a screen display of an implementation of the terminal toolbar and accompanying real-time data displays;
Figure 8 is another screen display of an implementation of the terminal toolbar and accompanying real-time data displays; and
Figure 9 is a flow chart showing terminal daemon logic. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Referring initially to Figure 1 , a system is shown, generally designated 10, for selectively monitoring multiple real-time data feeds from one or more customized data sources 12, in addition to the publicly available sources mentioned further below. By "customized data sources" is meant sources that provide data as defined by the user or that are associated with the user, and not with the general public. For instance, one source 12 might be a home security camera or a video camera located in the user's child's playroom or day care center as defined (set up) by the user, while another source 12 might be the user's home telephone, either wired or wireless or both. Yet another source 12 might be a stock market feed with portions of its stock information compiled into customized user-defined portfolio. Still another source 12 might be an intra-office or inter-office intercom associated with the user or with a small group of people to which the user belongs, or an in-home appliance with, e.g., a JAVA interface. Another source 12 might be a customized database, such as, for example, an electronic journal of the user's personal finances, or a database containing customized public or third party content. The content can be stored on a server, such as a user's home video device or other device.
In the architecture shown, customized data 14 from the data sources 12 in Internet Protocol (IP) packets is sent via a network, such as but not limited to the Internet 16, to a server, generally designated 18. The server 18 can include a communication server 20 for appropriate format conversion to and from IP packets, and a service management server 22, both of which function to undertake the server logic includes in the flow charts below. If desired, the below-described server functions can be distributed among the sources 12/terminal 26.
In turn, data is communicated from the server 18 to a communication interface 24 of a terminal device 26. In accordance with present principles, the communication interface 24 can be a standard modem, in which case the network path 28 between the server 18 and terminal device 26 is a standard copper wire or optical fiber Internet path. In a preferred embodiment, however, the network path 28 is a wireless path such as the so-called iBurst™ or Ricochet™ communication systems, and more preferably is a space division multiple access (SDMA) path as disclosed in, e.g., U.S. Patent Nos. 5,515,378, 5,592,490, 5,642,353, 5,828,658, and 5,909,471 to ArrayComm, incorporated herein by reference, in which case the communication interface 24 is an interface for undertaking appropriate conversion of PPP-formatted data from the server 18 to IP packet format (and to convert IP packet format data to PPP format for sending the data to the server 18). As set forth in the above- referenced patents, SDMA is essentially a directional version of time division multiple access (TDMA) or code division multiple access (CDMA), which produces a very high rate of data transmission (i.e., in excess of one megabyte per second) as compared to other types of Internet communication protocols. Likewise, the network paths 30 between the sources 12 and Internet 16 can be conventional wired Internet paths but more preferably are SDMA wireless paths.
The terminal device 26 is a digital processing apparatus, such as a personal digital assistant made by Sony. Or, the terminal device 26 can be a personal computer made by International Business Machines Corporation (IBM) or Apple computer, or the terminal device 26 may be any computer, including a laptop computer, a palmtop computer, or any other appropriate digital appliance.
As shown in Figure 1 , the terminal device 26 is electrically connected to one or more input devices 32, e.g., a mouse and/or a keyboard, which can be manipulated by a user of the system 10 as set forth further below to select customized data 14 from the sources 12 for display on, e.g., an output device such as a monitor 34. Other output devices such as other computers, computer networks, audio speakers, printers, and so on can be used.
As intended by the present invention, the terminal device 26 includes a daemon module 36. The flow charts herein illustrate the structure of the module 36 of the present invention as well as the logical structure of the server 18 and sources 12 as embodied in computer program software. Those skilled in the art will appreciate that the flow charts illustrate the structures of logic elements, such as computer program code elements or electronic logic circuits, that function according to this invention. Manifestly, the invention is practiced in its essential embodiment by a machine component that renders the logic elements in a form that instructs a digital processing apparatus (that is, a computer) to perform a sequence of function steps corresponding to those shown.
In other words, the present logic may be established as a computer program that is executed by a processor within, e.g., the terminal device 26 as a series of computer-executable instructions. In addition to residing on hard disk drives, these instructions may reside, for example, in RAM of the appropriate computer, or the instructions may be stored on a DASD array, magnetic tape, electronic read-only memory, or other appropriate data storage device. In an illustrative embodiment of the invention, the computer-executable instructions may be lines of compiled C++ compatible code.
Now referring to Figure 2, a generalized selector element 38 can be seen. In the preferred embodiment the selector element 38 is a toolbar, although other graphical user interface (GUI) elements can be used, such as, for example, dropdown menus. As shown, the selector element 38 includes plural source icons 40, with each icon 40 being associated with a respective one of the data sources 12 shown in Figure 1. In associating an icon 40 with a source 12, it is to be understood that the icon can be associated with a hyperlink that points to the Internet protocol (IP) address or other address of the associated source 12. Details of a particularly preferred selector element are set forth below in reference to Figure 8. An icon can be configured by the user to be static or it can display real-time data from its respective source. In the latter case, clicking on an icon can cause it to enlarge and/or to zoom in or expand the view.
In any case, the user establishes the data feeds he or she wants to monitor by appropriately defining the icons 40, in cooperation with the system server. Thus, the toolbar 38 is conformable. A user can specify the appearance, configuration, and content of the toolbar 38 depending on the available sources 12. The toolbar 38 can be further customized in light of the particular capabilities of the terminal 26. For example, text only icons might be established for a terminal 26 (e.g., a wireless telephone) that has limited display capabilities. Moreover, when the terminal 26 is an audio device, monitored data can be played and audible alerts generated when appropriate.
In any case, the selector element 38 is presented on the monitor 34 (Figure 1) so that a user can click on one or more of the icons 40 to display on the monitor 34 the real-time data feed from the associated source 12. In addition or as an alternative, clicking on an icon can cause an option of services, e.g., in the form of a popup menu, to be displayed. These services can be tailored to the particular source. For example, the services can include, in the case of a home video camera, the ability to control the camera remotely.
Referring now to Figure 3, the overall logic can be seen. Commencing at block 42, perpetual, i.e., continuously available, data feeds, also referred to as data streams, are available from the data sources 12. As mentioned above, these feeds can be provided via wireless network path portions through the Internet. When a user is not monitoring a source, the data need not be transmitted from the sources 12 to the Internet, although it could be. Indeed, "continuously available" does not necessarily mean that the sources 12 actually continuously generate data, but that a source is continuously available to generate and send data real-time (i.e., within a few seconds) of receiving a request for it. In any case, the sources 12 are continuously available to generate data, preferably digitized data in Internet Protocol (IP) packet format.
At block 44, a user selectively monitors one or more data feeds from one or more sources 12. When an icon is static, clicking on the appropriate icon 40 (Figure 2) causes the data feed to be displayed. When the icon is a window displaying realtime data, the user can view the relatively small icon or click on it to cause it to enlarge as described above, and/or to cause a menu of services related to the source 12 to appear
As discussed in greater detail below, selection of an icon is detected by the daemon module 36 at block 44, which communicates via the preferably wireless network path 28 with the server 18 to establish a preferably dedicated channel, referred to herein as a "tunnel channel", between the selected source(s) and the terminal device 26. The selected data feeds are thereby communicated to the terminal device 26 for presentation thereof on the monitor 34, such that a user can monitor the feeds. Also, the user can monitor any alerts that might be generated by an unselected source 12, such as, for example, a stock price from a portfolio source, or a motion alarm from a security camera, or an incoming call alert from an in-home or cellular telephone. At block 46, the above-described service is billed for in accordance with accounting details set forth more fully below.
Figure 4 shows additional details of the present logic. Commencing at block 48, the customized data sources 12 are defined by the user. For instance, the user can set up and start an in-home video camera at block 48, or define a list of stocks for inclusion in a stock portfolio maintained by an online quote service at block 48. Also, the toolbar 38 is defined, based on the sources 12. More specifically, icons 40 (with underlying source 12 addresses) of the toolbar 38 are established along with identifying the sources 12.
Moving to block 50, the daemon module 36 is established. In a preferred embodiment, a single daemon module 36 is provided for all the sources 12 as set forth further below, although each source 12 can have an associated module 36 at the terminal device 26.
Proceeding to block 52, the sources 12 are registered with the server 18. In the case of video cameras, telephones, and other Internet appliances, the registration includes recording the source's Internet protocol (IP) address or other identifying address with the server 18. The sources 12 are then activated at block 54.
Once activated, at block 56 the sources 12 are perpetually available to generate data streams that are available to, but that are not necessarily sent to, the terminal device 26 via the Internet. For instance, an in-home telephone might not continuously generate data and send it to the Internet unless the telephone receives an incoming call. Even if the telephone receives a call, digitized voice data might not be sent to the Internet unless and until the user at the terminal device 26 responds to an alert to answer the call by clicking on the appropriate icon 40 of the toolbar 38. Likewise, a video camera or other appliance is available to generate data continuously but might not generate the data until requested or, if continuously generating the data, might not send the data to the Internet until a user clicks on the appropriate icon of the toolbar 38. Regardless, both the telephone source 12 and video camera source 12 are continuously available to generate data in that they are both on and either generating data or continuously monitoring for a signal to generate data. In the case of a source 12 of quotes for a customized stock portfolio, the server 18 can be provided with real-time quotes for all publicly traded securities by a quote service, with the gathering of particular quotes into customized portfolios being accomplished at the server 18 for provision thereof to the user when the user clicks on the appropriate icon on the toolbar 38.
Billing for the above-described service can be accomplished at block 58. The billing is accomplished by gathering accounting data either during the entire time a source 12 or sources 12 are available via the Internet, or as the user displays the data from one or more sources 12 at block 60. That is, a user can be billed essentially a fixed monthly rate, and/or a user can be billed as the user actually displays the data streams from the sources 12. Invoices are periodically sent to the user of the terminal device 26 based on the accounting data gathered at block 58. Billing can also be done on a per-piece basis in the case of the below-described public sources, i.e., each time a user downloads a song or video. Also, a user can be billed on a service basis (the number and/or type of channels and/or monitoring services embodied in the toolbar 38) and on a registration basis (e.g., the number and/or type of terminal devices registered with the server, such as for customized download).
As shown at block 62, the user can periodically control the sources 12 (as by, for instance, answering a telephone call alert from a telephone source 12, or by modifying a stock portfolio). In any case, once a user selects a source 12 for display such as by clicking on the appropriate icon 40, the data is displayed at block 64. For instance, if the user clicks on an icon 40 representing a security video camera, the real-time video stream in IP packet format from the video camera source 12 is presented on the monitor 34 (Figure 1). Figure 5 shows the details of one preferred but non-limiting implementation of the present logic for a single one of the sources 12, assuming that the source 12 is a source of digitized video data. Commencing at block 66, the daemon module 36 enters a loop. The loop can cause the daemon module to periodically "sleep" (e.g., for one-half second), and then "wake up" to poll the icons 40 to determine whether any icon 40 has been selected by the user in the past second. The daemon module thus can be a foreground or background process that continuously monitors for selection of a source 12 data stream to be displayed. Moreover, the daemon module 36 monitors the data feeds from the sources 12 when it "awakens", to update the icons 40 as appropriate.
Assume that block 68 represents the selection of an icon 40 associated with a source 12 that is a video camera. Moving to block 70, the daemon transmits a feed request through the server 18 to the source 12 associated with the icon 40 that was clicked at block 68. At block 72, the source 12 acknowledges the request, and then a real-time video feed from the source 12 to the terminal 26 for display thereof is facilitated by several steps as follows. At block 74, the terminal 26 sends registration/authorization data tags to the server 18 for billing and security purposes. In response, at block 76 the server 18 allocates buffer space as required to buffer the video feed, authenticates the user, and registers the user for billing purposes. The server 18 can also allocate storage for the feed that can be later accessed if desired. Moreover, the server 18 preferably establishes a so-called "tunnel" channel, which is a private, secure, two-way dedicated channel between only the source 12 and terminal 26. When plural sources 12 are selected by the user, a single tunnel may be provided from the terminal 26 with plural threads, one for each source 12 feed.
While the server 18 is undertaking the above-described functions, the terminal 26 creates video buffers as necessary and undertakes time synchronization with the server 18 in accordance with video transmission principles known in the art. When the terminal 26 is ready to receive data, it sends a "start" command at block 78 to the source 12, which creates the requested content, compresses it, and packetizes it in IP packet format at block 80. The packets of data can include tags that, in addition to or in lieu of the terminal tags received at block 74, can be stripped or copied by the server 18 for billing purposes. Thus, billing can be undertaken on a per-transmitted packet basis (or based on multiple packets) if desired.
The source 12 undertakes time synchronization with the server 18, and a realtime video stream is transmitted via the wireless network paths and Internet described above at block 82. As it is transmitted, the packet tags can be extracted for billing purposes at block 84.
When the user no longer wishes to display the data from the source 12, the user can so indicate by, e.g., clicking once again on the icon 40 associated with the source 12 to essentially generate an interrupt signal. Accordingly, the terminal 26 monitors for an interrupt signal at block 86, and when one is generated, the terminal 26 sends the interrupt signal to the source 12 at block 88. The request for video is then deactivated at block 90, at which time data from the source 12 is no longer presented to the user.
Figures 6 and 7 show details of the structure and logic of the toolbar 38 shown in Figure 2. Commencing at block 92, the user logs on using the appropriate user name and password to any suitable network device, such as the terminal device 26. When the user logs on, the server 18 correlates the user ID to the toolbar 38 defined at block 48 in Figure 4 and sends the toolbar 38 to the user at block 94. Thus, the toolbar 38 is associated with a user, not necessarily with a particular network device, such that wherever the user logs on his or her own personalized toolbar is presented. The toolbar 38 is always displayed, although if desired the user can minimize the toolbar 38 and drag and drop the toolbar 38 on the display. The toolbar 38 can be resident on the terminal 26, with its configuration parameters being sent to the server for "portability" of the toolbar 38 to other devices that the user might log on to.
Figure 7 shows that the icons 40 can be thumbnails generated by the respective source 12 to which they pertain. For example, the left-most icon shown in Figure 7 is associated with an in-home video camera, and accordingly the icon is a thumbnail of an interior room. Likewise, an icon is shown that is associated with a day care video camera and that is a thumbnail of a day care center, while the next icon is associated with a customized stock portfolio and accordingly is a thumbnail of a personalized stock ticker. Other icons shown in Figure 7 include a symbol of a telephone, associated with a network-attached telephone source 12, a check balance icon, associated with an online checkbook database, and a wireless telephone symbol, associated with an online wireless telephone. If desired, for icons representing video feeds, the icons themselves can be thumbnail videos of the realtime feeds, in which case the associated video source 12 would be continuously generating the feed and sending it via the network paths described above to the terminal 26. Or, still images from a video stream can be used for an icon. In any case, when an alert is received from a source, e.g., a networked telephone source 12, the terminal device 26 generates an alert signal. The alert signal can, for example, cause the associated icon 40 to blink, or to become highlighted. In addition or as an alternative an audible or even tactile alert can be generated, if desired, to indicate to the user that the user might want to access the source generating the alert.
In addition to customized data sources, Figure 7 shows that the present display can present data from non-customized, i.e., publicly available, sources as well. Specifically, icons 95 representing, e.g., online music channels, online movies and television shows, online electronics vendors, and online games can be provided. Clicking on one of the icons 95 causes data from the associated public source to be displayed.
When the user wishes to display data or additional unshown data from a customized source 12, the user clicks on the appropriate icon 40 at block 96. At block 98 and now cross-referencing Figures 6 and 8, the clicked-on icon 40 can be enlarged, as shown at 40A in Figure 8, to show the details of the icon 40. The exemplary icon 40 shown in Figure 8 is a personalized portfolio stock quote, and so quotes 40B can be seen on the enlarged icon 40A. It will readily be appreciated that the enlarged icons 40A essentially are windows, and that when the user clicks on plural icons 40, plural enlarged icons 40A appear as windows on the display. It is to be further appreciated that in the case of a video source 12, clicking on the associated icon 40 causes an enlarged icon 40A to be displayed that is a video window. In any case, at block 100 the real-time feeds are presented, preferably in the windows established by the enlarged icons 40A. Figure 9 shows further details of how the daemon module 36 presents realtime feed. Commencing at block 104, the selected input stream or streams are received. At block 106 the IP packets of the streams are sent to the software port corresponding to the associated icon 40. That is, when more than one stream is being received, the packets of the various streams are separated from those of other streams and sent to the respective ports associated with the selected sources 12. The packets are processed in accordance with IP packet processing principles known in the art at block 108, and the processed data is then displayed at output state 110.
While the particular USER INTERFACE FOR INTERACTING WITH PLURAL REAL-TIME DATA SOURCES as herein shown and described in detail is fully capable of attaining the above-described objects of the invention, it is to be understood that it is the presently preferred embodiment of the present invention and is thus representative of the subject matter which is broadly contemplated by the present invention, that the scope of the present invention fully encompasses other embodiments which may become obvious to those skilled in the art, and that the scope of the present invention is accordingly to be limited by nothing other than the appended claims, in which reference to an element in the singular means "at least one". All structural and functional equivalents to the elements of the above-described preferred embodiment that are known or later come to be known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the present claims. Moreover, it is not necessary for a device or method to address each and every problem sought to be solved by the present invention, for it to be encompassed by the present claims. Furthermore, no element, component, or method step in the present disclosure is intended to be dedicated to the public regardless of whether the element, component, or method step is explicitly recited in the claims. No claim element herein is to be construed under the provisions of 35 U.S.C. §112, sixth paragraph, unless the element is expressly recited using the phrase "means for". WE CLAIM:

Claims

1. An improved graphical user interface (GUI) for a user terminal (26) including a monitor (34), the improvement characterized by: a personalized toolbar (38) presentable on the monitor (34) and having at least one icon (40), each icon (40) being associated with a respective network address of a respective source (12) of digitized content in wireless communication with the user terminal (26), whereby a user can configure an icon (40) to cause data from the respective source (12) to be presented on the monitor (34).
2. The GUI of Claim 1 , wherein the toolbar (38) is defined by a user.
3. The GUI of Claim 1 , wherein at least one icon (40) includes a thumbnail of data from the respective source (12).
4. The GUI of Claim 1 , wherein the toolbar (38) is stored on a server (18) and is associated with a user ID, such that the toolbar (38) is presented on any computer device logged onto using the user ID and communicating with the server (18).
5. An improved computer system having at least one user terminal (26) including at least one output device and one or more sources (12) of digitized content in wireless communication with the user terminal (26), the improvement characterized by: logic executable by the user terminal (26) for undertaking method acts comprising: displaying a toolbar (38) on the output device, the toolbar (38) including one or more icons (40), each being associated with a respective source (12) and each being configurable to present data from an associated source (12) for display.
6. The system of Claim 5, wherein at least one icon (40) is established by a thumbnail of data from the respective source (12).
7. The system of Claim 6, wherein each icon (40) is associated with a content channel, an icon (40) being manipulable to cause data from the channel to be displayed.
8. The system of Claim 7, wherein the method acts undertaken by the logic further comprise receiving an alert from at least one source (12) and generating an alert signal in response thereto, the alert signal altering the respective icon (40).
9. The system of Claim 7, wherein an icon (40) is enlarged when a user manipulates the icon (40).
10. The system of Claim 7, wherein data from a channel is displayed in the associated icon (40).
11. The system of Claim 6, wherein the toolbar (38) is associated with a particular user, the toolbar (38) being made available at the user terminal (26) in response to a user identification.
12. The computer system of Claim 7, wherein the sources (12) communicate with the user terminal (26) via a network path including the Internet.
13. The computer system of Claim 12, wherein at least a portion of the network path is a directional wireless path.
14. The computer system of Claim 7, wherein at least one source (12) is a customized data source.
15. The computer system of Claim 7, wherein at least one source (12) is a source of digitized public content.
16. The computer system of Claim 7, wherein the logic is embodied by a daemon (36) that loops in a monitoring state to determine at least one of: whether the user has manipulated an icon (40), and whether new data has been sent from a source.
PCT/US2000/035374 2000-02-08 2000-12-27 User interface for interacting with plural real-time data sources WO2001059551A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2601001A AU2601001A (en) 2000-02-08 2001-01-16 User interface for interacting with plural real-time data sources

Applications Claiming Priority (38)

Application Number Priority Date Filing Date Title
US18114700P 2000-02-08 2000-02-08
US18098800P 2000-02-08 2000-02-08
US18098400P 2000-02-08 2000-02-08
US18112800P 2000-02-08 2000-02-08
US18099000P 2000-02-08 2000-02-08
US18114800P 2000-02-08 2000-02-08
US18099200P 2000-02-08 2000-02-08
US18099100P 2000-02-08 2000-02-08
US18098700P 2000-02-08 2000-02-08
US18110500P 2000-02-08 2000-02-08
US18099300P 2000-02-08 2000-02-08
US18112700P 2000-02-08 2000-02-08
US18098500P 2000-02-08 2000-02-08
US18114400P 2000-02-08 2000-02-08
US18114500P 2000-02-08 2000-02-08
US18112900P 2000-02-08 2000-02-08
US60/180,985 2000-02-08
US60/180,984 2000-02-08
US60/181,147 2000-02-08
US60/181,127 2000-02-08
US60/181,128 2000-02-08
US60/180,993 2000-02-08
US60/180,990 2000-02-08
US60/180,987 2000-02-08
US60/181,105 2000-02-08
US60/181,145 2000-02-08
US60/181,148 2000-02-08
US60/180,988 2000-02-08
US60/180,992 2000-02-08
US60/181,129 2000-02-08
US60/180,991 2000-02-08
US60/181,144 2000-02-08
US19118400P 2000-03-22 2000-03-22
US60/191,184 2000-03-22
US19226400P 2000-03-27 2000-03-27
US60/192,264 2000-03-27
US09/542,154 US20030174154A1 (en) 2000-04-04 2000-04-04 User interface for interfacing with plural real-time data sources
US09/542,154 2000-04-04

Publications (2)

Publication Number Publication Date
WO2001059551A2 true WO2001059551A2 (en) 2001-08-16
WO2001059551A3 WO2001059551A3 (en) 2002-07-04

Family

ID=27586312

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/035374 WO2001059551A2 (en) 2000-02-08 2000-12-27 User interface for interacting with plural real-time data sources

Country Status (2)

Country Link
AU (1) AU2601001A (en)
WO (1) WO2001059551A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004090899A1 (en) * 2003-04-07 2004-10-21 Internet Pro Video Limited Electronic device with media manipulation capabilities
EP1503588A1 (en) * 2003-07-31 2005-02-02 Polycom, Inc. Graphical user interface for video feed in a videoconference terminal
WO2005041613A1 (en) * 2003-10-14 2005-05-06 The Boc Group Plc Apparatus for remote monitoring of equipment, with feed for feeding data
US20060259552A1 (en) * 2005-05-02 2006-11-16 Mock Wayne E Live video icons for signal selection in a videoconferencing system
WO2007098398A1 (en) * 2006-02-16 2007-08-30 Newsgator Technologies, Inc. System and method for synchronizing feed content
EP1962467A1 (en) * 2007-02-26 2008-08-27 Research In Motion Limited Method and system for correlation of mobile channel subscription with delivery context
EP2296359A1 (en) * 2008-06-30 2011-03-16 Olympus Corporation Wireless communication system comprising receiver and image transmitter and wireless communication method thereof
US8407320B2 (en) 2007-02-26 2013-03-26 Research In Motion Limited Method and system for correlation of mobile channel subscription with delivery context

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0798655A2 (en) * 1996-03-25 1997-10-01 Sun Microsystems, Inc. Internet-enabled graphical user interface with toolbar icons having built-in links to world-wide web documents and an integrated web browser
EP0878759A1 (en) * 1997-04-22 1998-11-18 International Business Machines Corporation Remote controlling method and apparatus
US5874965A (en) * 1995-10-11 1999-02-23 Sharp Kabushiki Kaisha Method for magnifying a plurality of display images to reveal more detailed information
WO1999018499A1 (en) * 1997-10-03 1999-04-15 Ericsson, Inc. Method of processing information using a personal communication assistant
EP0917052A1 (en) * 1997-11-17 1999-05-19 International Business Machines Corporation Method and apparatus for interacting with hardware devices remotely
US6141339A (en) * 1997-04-04 2000-10-31 Sprint Communications Company, L.P. Telecommunications system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5874965A (en) * 1995-10-11 1999-02-23 Sharp Kabushiki Kaisha Method for magnifying a plurality of display images to reveal more detailed information
EP0798655A2 (en) * 1996-03-25 1997-10-01 Sun Microsystems, Inc. Internet-enabled graphical user interface with toolbar icons having built-in links to world-wide web documents and an integrated web browser
US6141339A (en) * 1997-04-04 2000-10-31 Sprint Communications Company, L.P. Telecommunications system
EP0878759A1 (en) * 1997-04-22 1998-11-18 International Business Machines Corporation Remote controlling method and apparatus
WO1999018499A1 (en) * 1997-10-03 1999-04-15 Ericsson, Inc. Method of processing information using a personal communication assistant
EP0917052A1 (en) * 1997-11-17 1999-05-19 International Business Machines Corporation Method and apparatus for interacting with hardware devices remotely

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"DYNAMIC ICON CONTENT" RESEARCH DISCLOSURE, KENNETH MASON PUBLICATIONS, HAMPSHIRE, GB, no. 298, 1 February 1989 (1989-02-01), page 99 XP000293031 ISSN: 0374-4353 *
HOWARD M ET AL: "MANAGING DEVICES WITH THE WEB" BYTE, MCGRAW-HILL INC. ST PETERBOROUGH, US, vol. 22, no. 9, 1 September 1997 (1997-09-01), pages 45-46, XP000726362 ISSN: 0360-5280 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004090899A1 (en) * 2003-04-07 2004-10-21 Internet Pro Video Limited Electronic device with media manipulation capabilities
EP1503588A1 (en) * 2003-07-31 2005-02-02 Polycom, Inc. Graphical user interface for video feed in a videoconference terminal
US7133062B2 (en) 2003-07-31 2006-11-07 Polycom, Inc. Graphical user interface for video feed on videoconference terminal
WO2005041613A1 (en) * 2003-10-14 2005-05-06 The Boc Group Plc Apparatus for remote monitoring of equipment, with feed for feeding data
US20060259552A1 (en) * 2005-05-02 2006-11-16 Mock Wayne E Live video icons for signal selection in a videoconferencing system
WO2007098398A1 (en) * 2006-02-16 2007-08-30 Newsgator Technologies, Inc. System and method for synchronizing feed content
EP1962467A1 (en) * 2007-02-26 2008-08-27 Research In Motion Limited Method and system for correlation of mobile channel subscription with delivery context
AU2008200262B2 (en) * 2007-02-26 2010-05-13 Blackberry Limited Method and system for correlation of mobile channel subscription with delivery context
US8407320B2 (en) 2007-02-26 2013-03-26 Research In Motion Limited Method and system for correlation of mobile channel subscription with delivery context
EP2296359A1 (en) * 2008-06-30 2011-03-16 Olympus Corporation Wireless communication system comprising receiver and image transmitter and wireless communication method thereof
EP2296359A4 (en) * 2008-06-30 2011-12-07 Olympus Corp Wireless communication system comprising receiver and image transmitter and wireless communication method thereof
US9143639B2 (en) 2008-06-30 2015-09-22 Olympus Corporation Wireless communication system comprising receiver and image transmitter and wireless communication method thereof

Also Published As

Publication number Publication date
AU2601001A (en) 2001-08-20
WO2001059551A3 (en) 2002-07-04

Similar Documents

Publication Publication Date Title
US20030174154A1 (en) User interface for interfacing with plural real-time data sources
US11173517B2 (en) Display inserts, overlays, and graphical user interfaces for multimedia systems
US6978475B1 (en) Method and apparatus for internet TV
US6704031B1 (en) Toolbar tracking
US8397264B2 (en) Display inserts, overlays, and graphical user interfaces for multimedia systems
TW513637B (en) Method and system for sharing the browser
US6271752B1 (en) Intelligent multi-access system
US7143141B1 (en) System for providing internet-related services in response to a handheld device that is not required to be internet-enabled
US20070005607A1 (en) Interface control program, interface control method, interface control apparatus, plug-in program and information processing apparatus
JP2004516726A (en) Ergonomic system for device control by portable wireless terminal
US20100057588A1 (en) System and Method for Providing Publicly Vended Content Via A Wireless Network
WO2009046651A1 (en) Method and apparatus for syncretizing browser and instant communication system
US20020078445A1 (en) Internet appliance for interactive audio/video display using a remote control unit for user input
WO2001059551A2 (en) User interface for interacting with plural real-time data sources
US20030115330A1 (en) Recording medium, transmission medium, information processing apparatus/information processing method, information providing apparatus and information processing system
US6539423B1 (en) Methods and systems for generating interactive information formatted for a device
EP1503276B1 (en) Graphical user interface for system status alert on videoconference terminal
US20050125492A1 (en) Integrated network element management system and method
WO2001059572A2 (en) System and method for monitoring plural real-time customized data sources
CN114510205A (en) Display interaction method, display device, electronic device and storage medium
US20230057851A1 (en) Display inserts, overlays, and graphical user interfaces for multimedia systems
KR20000058315A (en) Integrated system for producing/transferring multimedia data and method thereof
WO2001059651A2 (en) System and method for providing publicly vended content via a wireless network

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP