US20010039544A1 - Method for interactively creating an information database including preferred information elements, such as preferred authority, world - Google Patents

Method for interactively creating an information database including preferred information elements, such as preferred authority, world Download PDF

Info

Publication number
US20010039544A1
US20010039544A1 US09/143,733 US14373398A US2001039544A1 US 20010039544 A1 US20010039544 A1 US 20010039544A1 US 14373398 A US14373398 A US 14373398A US 2001039544 A1 US2001039544 A1 US 2001039544A1
Authority
US
United States
Prior art keywords
information
frame
user
pages
authority
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/143,733
Other versions
US6334131B2 (en
Inventor
Soumen Chakrabarti
Byron Edward Dorn
David Andrew Gibson
Prabhakar Raghavan
Sridhar Rajagopalan
Shanmugasundaram Ravikumar
Andrew Tomkins
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Priority to US09/143,733 priority Critical patent/US6334131B2/en
Priority to US09/261,926 priority patent/US6356899B1/en
Priority to US09/811,108 priority patent/US6336112B2/en
Publication of US20010039544A1 publication Critical patent/US20010039544A1/en
Application granted granted Critical
Publication of US6334131B2 publication Critical patent/US6334131B2/en
Assigned to INTERNATIONAL BUSINESS MACHINES CORPORATION reassignment INTERNATIONAL BUSINESS MACHINES CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHAKRABARTI, SOUMEN, GIBSON, DAVID ANDREW, DOM, BYRON EDWARD, RAGHAVAN, PRABHAKAR, RAJAGOPALAN, SRIDHAR, RAVIKUMAR, SHANMUGASUNDARAM, TOMKINS, ANDREW
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/954Navigation, e.g. using categorised browsing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99932Access augmentation or optimizing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • Y10S707/99934Query formulation, input preparation, or translation
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching
    • Y10S707/99935Query augmenting and refining, e.g. inexact access
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99943Generating database or data structure, e.g. via user interface
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99944Object-oriented database structure
    • Y10S707/99945Object-oriented database structure processing

Definitions

  • This invention relates generally to a method for cataloging, filtering and ranking information; as for example, World Wide Web pages of the Internet; and more particularly, to method preferably implemented in computer software for interactively creating an information database including preferred information elements such as preferred-authority World Wide Web pages, the method including steps for enabling a user to interactively creating a frame-based, hierarchical organizational structure for the information elements, and steps for identifying and automatically filtering and ranking by relevance, information elements, such as World Wide Web pages for populating the structure, to form; for example, a searchable, World Wide Web page database; the method featuring steps for enabling a user to interactively define a frame-based, hierarchical information structure for cataloging information, identify a preliminary population of information elements for a particular hierarchical category arranged as a frame, based upon the respective frame attributes, and thereafter, expand the information population to include related information, and subsequently, automatically filter and rank the information based upon relevance, and then populate the hierarchical structure with the a definable portion of the filtered
  • search facilities such as Yahoo! and others, to assist Web users in finding the information; i.e., Web pages, they might be looking for.
  • search facilities such as Yahoo! typically only provide general organizations of Web subject matter and associated Web pages, those organizations being arranged as categories of Web subject matter that are based on the subjective points of view of the individuals who compile the information for the respective search facilities, or the points of view of the respective providers of the search facilities, or the points of view of the Web information providers, or some combination of all of these points of view.
  • search facilities such as Yahoo! typically only provide general organizations of Web subject matter and associated Web pages, those organizations being arranged as categories of Web subject matter that are based on the subjective points of view of the individuals who compile the information for the respective search facilities, or the points of view of the respective providers of the search facilities, or the points of view of the Web information providers, or some combination of all of these points of view.
  • Such Web subject matter organizations are susceptible to over inclusion and under inclusion of information which effects the accuracy and ease-of-use of the respective search facilities.
  • Such search facilities typically, are unable to group the information elements they return; i.e., pages, by their respective “authoritativeness”, that is, the degree to which others have referred to the respective elements; i.e., pages, as sources of information on the subject matter in question, termed in the art “authorities”, or the degree to which the respective elements; i.e. pages, point to sources of information, termed “hubs”, based upon the “hyperlinks”; i.e., “links”, between the respective hub and authority pages.
  • the method of the present invention includes steps for enabling a user to interactively create and or modify an information database featuring a hierarchical, frame-based, organizational structure of the user's selection for receiving information elements, such as World Wide Web pages, also of the user selection. Further, the method features steps for enabling the identification of information elements, such as Web pages, having preferred-authority as determined by improved, automated computation of the link structure between information elements.
  • page(s) and “Web site(s)” will be employed to include, and understood to embrace, respectively, the more general terms “information element(s)” and “information source(s)” unless otherwise expressly stated.
  • the method of the present invention is implemented in computer software suitable to be run on a conventional personal computer having a central processing unit, associated RAM, ROM and disk storage memory, and accompanying input-output devices, such as keyboard, pointing device, display monitor and printer.
  • the method includes program steps for facilitating generation of a display; at; for example, the computer monitor, the display featuring an interface for enabling a user to interactively compose and or modify an adjustable, frame-based, hierarchical organizational structure representing an arrangement of topics of the user's design.
  • the user formulates the frame-based organization structure to receive information elements, such as World Wide Web pages, which the users may subsequently select to populate the various frames of the organizational structure based on the respective frame attributes; i.e., descriptive features.
  • the interface includes one or more screens respectively having multiple partitions for presenting: a graphical representation of the frame-based, hierarchical information structure of the users creation; the Web pages contained in the category frames of the structure, and the components employed in selecting the Web pages for populating the frames. More particularly, the interface features graphical presentation of the frame-based hierarchical information structure, together with associated tools for freely navigating and modifying the structure; as for example, by adding, deleting or moving frames within the structure to represent the tastes and preferences of the user.
  • the interface includes partitions for displaying the Web pages associated with a user-selected frame of the organizational structure, together with tools for manipulating and managing the pages included at the frame. And, still further in preferred form, the interface includes partitions and associated tools for enabling the user to view respective Web page content, such as page links, associated with selected frames, and the frame attributes used as query terms for initiating automated generation of preferred-authority, Web pages for populating the frames of the organizational structure.
  • the method includes steps for constructing a root set of information Web pages likely to be relevant to a topic selected by the user.
  • the root set it is developed by first generating an initial set of Web pages with the use of a conventional query derived from the attributes of the category frame for the database hierarchical organizational structure the user is interested in populating, the query so derived, thereafter, being applied in conventional fashion against the World Wide Web.
  • the method includes steps for, subsequently, expanding the initial set of Web pages returned responsive to the query, to include pages elements directly linked to the Web pages of the initial set, thus, forming the root set.
  • the method includes steps for associating a hub-weight parameter and authority-weight parameter for each Web page, and iteratively calculating the authoritativeness of the respective pages of the root set based on the resulting, respective, hub-weight and authority-weight values for each page.
  • the method additionally features steps for improving computational accuracy of the authoritativeness for the Web pages.
  • the method features steps executed during the computation of authoritativeness for filtering spurious computational factors such as “self-promotion”, “related-page promotion.”, “hub redundancy”, and “false authority.”
  • the method includes steps for filtering “self-promotion” from the computation, the steps including the discarding of links between pages, from the same Web Site.
  • the method includes steps for filtering “related-page promotion” from the computation, which steps include “re-packing” the Web pages, for any Web site, having multiple pages showing non-zero authority, during which re-packing, all authorities other that the largest authority is set to zero.
  • the method in preferred form also includes steps for filtering “hub redundancy”, the steps including identifying the highest weight; i.e., “best,” hub during computation, zeroing the authority values of all pages pointed to by that hub, re-compute hub values, and, subsequently, recalculate authoritativeness.
  • the method in preferred form includes steps for filtering “false authority”, the steps including: allowing each link in a Web page to have its own hub value; incrementing the authority value of the destination page with the hub value of the link when authority values are calculated; and re-computing the hub values of the original hub page with the authority value of the destination page, and accordingly, by a spreading function, the hub values of neighboring links.
  • this makes the final hub value of the page, therefore, the integral of the hub values of its links.
  • the method in accordance with the invention includes steps for ranking the pages of the root set based on authoritativeness following computation of page hub and authority weights, and to thereafter, truncated the root set to a number of highest ranking pages prescribed by the user.
  • FIG. 1 is a diagram illustrating an Internet, environment including a number of World Wide Web site and associated servers having page information suitable for being maintained in a frame-based, hierarchical database created or maintained in accordance with the method of the present invention
  • FIG. 2 is a diagram illustrating a hierarchical organization of information suitable for being maintained in a frame-based, hierarchical database created or maintained in accordance with the method of the present invention
  • FIG. 3 is a diagram illustrating a hierarchical organization of information suitable for being maintained in a frame-based, hierarchical database in which a new information category frame has been suggested for addition in accordance with the method of the present invention
  • FIG. 4 is a diagram illustrating a hierarchical organization of information suitable for being maintained in a frame-based, hierarchical database in which a new information frame has been added and populated with Web pages in accordance with the method of the present invention
  • FIG. 5 is a schematic illustration of the display interface presented to a user for enabling creation or modification of a database hierarchical organizational structure in accordance with the method of the present invention
  • FIG. 6 is a schematic illustration of the display interface presented to a user for disclosing the page population of an information frame of a database hierarchical organizational structure in accordance with the method of the present invention
  • FIG. 7 is a schematic illustration of the display interface presented to a user for disclosing the content of a page included as a member of the page population for the information frame of a database hierarchical organizational structure in accordance with the method of the present invention
  • FIG. 8 is a diagram illustrating a root set of pages expanded from an initial set of pages returned in response to a query based upon the attributes of a frame proposed to be added to a database hierarchical organizational structure in accordance with the method of the present invention
  • FIG. 9 is a flow diagram illustrating the general steps of the method in accordance with the present invention.
  • FIG. 10 is a flow diagram illustrating the more specific steps associated with the “Develop Classification Frame Hierarchy” general step of the method in accordance with the present invention illustrated in FIG. 9;
  • FIG. 11 is a flow diagram illustrating the more specific steps associated with the “Prompt User To Modify Frame Structure” step of FIG. 10, FIG. 10 itself illustrating the “Develop Classification Frame Hierarchy” general step in accordance with the invention illustrated in FIG. 9;
  • FIG. 12 is a flow diagram illustrating the more specific steps associated with the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated FIG. 9;
  • FIG. 13 is a flow diagram illustrating the more specific steps associated with the “Do Key Word Search To Identifying Initial Set Of Information Elements” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9;
  • FIG. 14 is a flow diagram illustrating the more specific steps associated with the “Expand Initial Set To Root Set” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9.
  • FIG. 15 is a flow diagram illustrating the more specific steps associated with the “Ranking Information Elements Of Root Set” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9;
  • FIG. 16 is a flow diagram illustrating the more specific steps associated with the “Generate Weights For Information Elements” of FIG. 15, FIG. 15 itself illustrating the “Rank Information Elements Of Root Set of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9.
  • FIG. 17 is a flow diagram illustrating the more specific steps associated with the “Determine Information Element Authority And Hub Scores” of FIG. 15, FIG. 15 itself illustrating the “Rank Information Elements Of Root Set of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9; and
  • FIG. 18 is a flow diagram illustrating the more specific steps associated with the “Truncate Ranked Information Elements” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9.
  • Such search facilities are unable to group the pages they return, by their respective “authoritativeness”, that is, the degree to which others have referred to the pages, as sources of information on the subject matter in question, termed in the art “authorities”, or the degree to which the respective elements; i.e. pages, point to sources of information, termed “hubs”, based upon the “hyperlinks”; i.e., “links”, between the respective hub and authority pages.
  • hub page resides in the links that it processes, and not, typically, the content of the page. Accordingly, where all the links of a hub page can be found in “better” hub pages; i.e., hub pages having a greater number of relevant links, inclusion of the first hub page gives rise to “hub redundancy” which unnecessarily burdens computation.
  • the method of the present invention overcomes problems found in prior approaches to organization and retrieval a information; as for example, pages of the World Wide Web, by providing a method for cataloging, filtering and ranking information, and, particularly, Web pages. More specifically, the method is preferably implemented in computer software suitable for being run on a conventional personal computer and includes steps for enabling a user to interactively create and or modify an information database featuring a hierarchical, frame-based, organizational structure of the user's selection for receiving information elements, such as World Wide Web pages, also of the user selection. Further, the method features steps for enabling the identification of information elements, such as Web pages, having preferred-authority as determined by improved, automated computation of the link structure between information elements.
  • the invention has application to use by individuals for creating personalized, preferred-authority; e.g., high-authority, information databases, which may be developed from information sources such as the World Wide Web, in which the user can tailor the information organization to his tastes
  • the invention also has application to broad, business applications, not only for commercially cataloging information sources such as the World Wide Web, and providing facilities for distilling information retrieved to the higher levels of authority, but also, to such applications as building preferred-authority databases for use in law, medicine, engineering and other fields.
  • method 2 is seen to broadly include step 4 for enabling a user to develop a personalized, frame-based, hierarchical information classification structure for the database. Further, following developments of the frame-based, hierarchical, information classification structure at step 4 , method 2 is seen to include steps 6 for enabling the user to select the information frame from the classification hierarchy he wishes to populate with information elements; e.g., Web pages.
  • step 4 for enabling a user to develop a personalized, frame-based, hierarchical information classification structure for the database.
  • steps 6 for enabling the user to select the information frame from the classification hierarchy he wishes to populate with information elements; e.g., Web pages.
  • method 2 includes step 8 for enabling the automated retrieval of information elements; e.g. Web pages, from the information source; e.g., the Web, for populating the selected frame. Thereafter, method 2 includes step 10 for prompting the user to indicate whether there are any other frames in the information classification hierarchy the user would like to populate with information. If the user indicates, there are additional frames of the classification hierarchy to be populated, method 2 returns at branch 12 to select frame step 6 , where the user is again permitted to designate a frame to be populated, followed by subsequent transition to step 8 for enabling automated retrieval of information for the newly selected frame.
  • information elements e.g. Web pages
  • step 10 for prompting the user to indicate whether there are any other frames in the information classification hierarchy the user would like to populate with information. If the user indicates, there are additional frames of the classification hierarchy to be populated, method 2 returns at branch 12 to select frame step 6 , where the user is again permitted to designate a frame to be populated, followed by subsequent transition to step 8 for enabling automated retrieval
  • method 2 advances over program-flow branch 14 to steps 16 , where the user is prompted to indicate whether there are any modifications of the information classification frame hierarchy which the user would like to undertake.
  • steps 16 where the user is prompted to indicate whether there are any modifications of the information classification frame hierarchy which the user would like to undertake.
  • method 2 would advance over program-flow branch 18 back to classification developments step 4 , at which the user would be enabled to enter desired modifications to the information classification organizational structure.
  • the World Wide Web of the Internet represents a valuable and important information resource, including literally hundreds of millions of documents accessed by tens of millions of users daily.
  • the Web 22 includes millions of Web sites, several of which, again for simplicity, are schematically represented as Web site servers 24 to 32 , it being understood that a single server might host one or more sites.
  • each Web site 24 to 32 includes numerous information pages arranged in Web applications; e.g., Web sites, Web site databases, etc., 34 to 66 .
  • a user at his personal computer 68 equipped with a suitable Web browser and communications software, can access Web 22 over his ordinary phone line 70 , the public switching network 72 and through an Internet service provider 74 , which itself may be in connected to public switching network 72 by an ordinary line 76 and to Web 22 by a high-speed data line 78 . And, with this setup and some computer protocol magic, the user can access the literally hundreds on millions of documents available on Web 22 represented by applications 34 to 66 in FIG. 1.
  • method 2 provides solutions to those problems in the form of steps for enabling the user to interactively create an information database having a organizational structure which the user can interactively personalize to his tastes for holding the information he retrieves, and steps for enabling automated retrieval of reduced size; i.e., distilled, preferred-authority collections of Web pages responsive to his queries.
  • method 2 broadly includes step 4 for enabling the user to develop a frame-based, hierarchical information classification structure for his personalized database.
  • step 4 of method 2 includes a serious of more detailed steps for carrying out that procedure.
  • classification developments step 4 is seen to include step 80 which would follow activation of the software in which method 2 is implemented and embodied, at users personal computer 68 , step 80 prompting the user to identify; i.e., provide the file name and path, for the hierarchical database frame structure method 2 should initially access.
  • step 82 which, responsive to the user's designation, advances either over program-flow branch 84 to retrieve, at step 86 , any preexisting structure which the user has identified, or over program-flow branch 88 in the case where the user has indicated he is going to develop a new structure.
  • step 88 which prompts the user to provide the name for the new classification structure.
  • step 92 where the user is prompted to provide an initial structure element; e.g., a classification frame, for the new structure.
  • hierarchically organized data and, particularly frame-based, hierarchical organized data featuring representations of information categories as a hierarchy of frames having frame attributes and attribute values, that characterize and distinguish the respective frames and their associations to each other provides a representation that enable users to more readily understand and appreciate the information elements and their relationships.
  • hierarchical organization of information enables a much speedier search when information is sought to be retrieve.
  • identification of its category affiliation not only designates the features to be looked for, but also, immediately excludes features, and other aspects of the organizational structure not to be looked for, thus more immediately directing the search to the relevant section of the organization.
  • method 2 in preferred form, supports frame-based, hierarchical organizational structures for the information the user seeks to catalog.
  • FIG. 2 illustrates such an organizational structure.
  • a frame-based, hierarchical organization structure 100 which was previously created, is seen to include a plurality of frames arrayed in hierarchical relation for representing a general classification of information.
  • the respective frames feature attributes and attribute values for identifying the nature of each frame and its relationships to the other frames.
  • attributes appearing at a particular frame level in the hierarchy apply to all depending frames of lower hierarchical level.
  • frames may be given different attributes and or different attribute values to, thereby, identify different subcategory types within the category level.
  • structure 100 features four levels organization, 102 to 104 , the highest and most general 102 , including four frames, specifically frames 108 concerning “Business”, 110 concerning “Entertainment”, 112 concerning “Science”, and 114 concerning “News.” Beneath frame 108 to 114 is a second categorization level 104 which further defines first level 102 .
  • structure 100 is seen to feature frames 116 “Companies” and 118 “Finance”, both of which depend from frame 102 .
  • structure 100 is further seen to include a third category level 106 which yet additionally defines second level 104 and first level 102 .
  • third level 106 for frame 108 of level 102 is seen to include frames 120 , “Computers”, 122 “Products & Services”, 124 , “Savings & Securities” and 128 , “Job,” frames 120 and 122 depending from frame 116 “Companies” and frames 124 and 128 from frame 118 “Finance.”
  • frame 122 “Products & Services”, as a “child” of frame 116 “Companies” and “grandchild” or frame 108 “Business”, in view of the above discussion concerning attribute inheritance, carry the attribute limitations of its progenitors.
  • frame 102 would be considered to include product and service information of business companies only.
  • method 2 over is that difficulty by providing steps to easily and quickly obtain information for re-populating modify frames, and additionally and independently by providing steps for supporting a display interface that enables the user to readily add, delete, or move frames within a hierarchical information organizational structure.
  • method 2 of the present invention features steps for presenting a display at the monitor of user's computer 24 for enabling the user to interactively and easily modify structure 100 .
  • users monitor 132 is seen to have a display 136 at which interface 138 in accordance with method 2 is illustrated.
  • method 2 includes program steps for providing interface 138 with one or more screens having multiple partitions.
  • interface 138 in preferred form is seen includes a first screen 140 having a partition 142 for displaying the hierarchical, information organizational structure 100 .
  • interface screen 140 is seem to include a second partition 144 , including graphically presented tools for modifying structure 100 .
  • tool partition 138 for screen 140 is seen to include a tool 146 for selecting frames of structure 100 . Additionally, tool partition 138 is also seen to include tools 148 and 150 for respectively adding and deleting frames from structure 100 .
  • method 2 includes program steps for enabling a user and to also freely move frames within structure 100 using selection tool 146 in conventional “drag-and-drop” fashion. Still further, tool partition 138 is seen to include a “zoom” tool 151 for enabling the user to zoom in and zoom out organizational structure 100 to see, respectively, fewer or more frames;.
  • interface screen 140 is also seen to have a partition 152 including a section 154 for identifying the filename 156 associated with organizational structure 100 . Further, partition 152 is also seen to include a section 158 including “drop-down” menus in conventional “Windows” fashion for enabling management of interface 138 , the including “File” 160 , “Edit” 162 , “View” 164 and “Help” 166 . Still further, screen partition 152 is also seen to include a section 168 including interface mode buttons for enabling movement between interface mode screen.
  • section 168 of partition 152 is seen to include a mode button 170 “Structure” for viewing organizational structure 100 at screen partition 142 , a mode button 172 viewing the information element; e.g. Web page content of any frame selected with selection tool 146 as will be more fully described below.
  • section 168 of screen partition 152 is also seem to include a mode button 174 for viewing the contact of the respective information elements; e.g. Web page is populating a particular frame of structure of 100 as also will be described more fully below.
  • screen interface 138 in preferred form is also seen to include a second screen 176 having multiple partitions.
  • screen 176 a seem to include a partition 178 for displaying the information elements; e.g. Web pages, which populate a particular frame of organizational structure 100 .
  • method 2 includes steps for presenting the pages of a frame identified as authorities in, column 180 , and pages identifying as hubs at column 182 .
  • partition 178 is also saying to include presentation of the attributes for the frame of structure 100 being presented at partition 178 at region 184 , and the title for the respective frame at region 186 .
  • interface screen 176 includes a partition 188 for displaying frame structure 100 .
  • structure 100 at partition 188 may be readily scrolled in typical Windows Explorer fashion.
  • control of the frame content at partition 178 may be readily effected by selecting frames of structure 100 in conventional fashion; as for example, with a mouse pointer.
  • frames of structure 100 may again be freely managed; for example, added, deleted and moved at partition 188 .
  • Screen 176 in accord with method 2 is also seen to include a partition 190 for enabling editing of the frame page content. More specifically, any partition 190 is seen to include information entry boxes, 194 , 196 for respectively entering modifications to the frame attributes which control the initial query for returning information elements; e.g., page is for populating the selected frame in accordance with method 2 as will be described more fully below. Particularly, entry box 192 enables user specification of a frame attributes to be included in the initial query, while entry box 194 enables the user to expressly exclude attributes not desired because of known lack a relevance to the subject frame. Additionally, partition 190 is seen to include a scroll box 198 including a predetermined lists of frame features known to produce pages of authority for listed features. In accordance with method 2 , where the usury is uncertain what attributes to include for frame, he can make reference to feature pallet 198 .
  • screen 176 is also seen to include a partition 200 identical to partition 152 of screen 140 including respectively, designation of the display structure filename, menus, and mode buttons.
  • interface 138 in preferred form is seen to include a third screen 202 again having multiple partitions.
  • a partition 204 is provided for displaying the content of a document included in the lists of authority and Hub pages for a selected frame presented at partition 178 of interface screen 176 .
  • presentation of the content and links for an authority or hub page selected from respective lists 180 and 182 enables the user to quickly and easily monitor the effectiveness of the query and search process, and iteratively adjust the pages returned to populate the selected frame of structure 100 .
  • screen 202 also includes an editing partition 206 comparable to partition 190 of screen 176 , and a structure display partition 208 comparable to partition 188 of screen 176 . Still further, screen 202 is again seen to include a partition 210 comparable to partitions 200 of screen 176 and partition 152 of screen 140 which present the filename for structure 100 , drop-down menus and mode buttons.
  • method 2 includes step 220 for enabling the user to modify structure 100 .
  • method 2 includes step 222 for prompting the user to select a frame to modify.
  • step 222 would be interactively conducted with the user at method interface 138 .
  • method 2 includes program steps for successively presenting to the user interface screens at which the user can make judgments as to whether changes in structure 100 are required.
  • interface 138 provides displays; e.g., screens 140 , 176 and 202 for enabling the user and to make judgments as to whether frame modification would be desirable.
  • the user can make a judgment as to whether frame structure 100 is too general or not based upon a review of the authorities and hubs presented at interface screen 176 and their content at screen 202 ; for example, as the frame existed prior to being worked or during the course a subsequent population steps.
  • displays e.g., screens 140 , 176 and 202 for enabling the user and to make judgments as to whether frame modification would be desirable.
  • the user can make a judgment as to whether frame structure 100 is too general or not based upon a review of the authorities and hubs presented at interface screen 176 and their content at screen 202 ; for example, as the frame existed prior to being worked or during the course a subsequent population steps.
  • method 2 would proceed over branch 226 to step 228 where the user to could code split the selected frame and add at step 230 child frames having more specific frame attributes to specify at step 223 .
  • addition of a frame could be readily effected and interface 138 as described above.
  • method 2 would loop back over method branch 233 to modification prompt step 222 where the user could again assess whether further modifications when necessary. For example, if after specifying addition of a frame at step 230 , the user determines the frame specified at step 232 is too specific, the user would advance method 2 over branch 234 to step 236 , where the user could then advance method 2 over branch 238 to step 240 where the user could readily delete a frame at interface 138 as above described and respecify a parent frame at step 242 . And, again, method 2 would loop back to step 222 at method 2 branch 244 .
  • step 222 the user could again determine the if any further modifications of structure 100 were called for. For example, if the user neither found the selected frame too general nor too specific, method 2 would advance over branch 246 to step 248 where the user to determine if the selected frame is misplaced and is required to be moved. If the user determines that the selected frame should be moved, method 2 would advance over branch 250 to steps 252 , 254 and 256 where the associated sub frames could be removed and replaced in structure 100 as required at steps to 252 , and 254 respectively, and the selected frame re-specified for its new location. Thereafter, method 2 would loop back over branch 258 to step 222 to enable the user to again assess whether any further modifications to structure 100 were called for. In if the user found that no further modifications to the structure were called for, method 2 would exit the structure modification sequence at branch 260 .
  • step 6 the user could select the frame he would like to populate with information pages.
  • step 8 population of the selected frame is undertaken.
  • method 2 of the present invention seeks to determine what a first information elements, e.g., page, i says about a second information element; e.g., page j. To investigate this, method 2 defines a numeral affinity from i to j denoted a ij . At a high level, method 2 consists of three steps:
  • n
  • and a be a non-negative real-valued affinity of the ordered pair of entities of entities (i, j), so a ij need not equal a ji .
  • each a ij is a carefully chosen function of the terms and where applicable links in the entities, this choice is data source and application dependent.
  • A [a ij ].
  • [0102] is performed to arrive at hub and authority scores converging to the principal eigenvectors, those associated with the largest eigenvalue of A T A and AA T , respective. Then the entities with the largest entities in the principal eigenvector of A T A (resp. AA T ) as the top authorities (resp. hub) are outputted.
  • the procedure begins by constructing a root set of pages that are likely to be relevant to the topic. This construction is arbitrary, but could be performed by creating an initial set of pages by quering acardino search engine using the topics as query, and then expanding this set to the full root set by including all pages that point to or are pointed to by a page in the initial set.
  • the procedure the assoicates with each page p a hub weight h(p) and an authority weight a(p), all initialized to 1. Then the weights are updated as follows:
  • the authority value of the destination is used to increment the hub value of the sauce like and according to a spreading function, the hub values of neighboring links.
  • the hub values of neighboring links can be identified.
  • the final hub value of a page is the integral all the hub values of its links.

Abstract

A method for cataloging, filtering and ranking information; as for example, World Wide Web pages of the Internet. The method is preferably implemented in computer software and features steps for enabling a user to interactively create an information database including preferred information elements such as preferred-authority World Wide Web pages. The method including steps for enabling a user to interactively creating a frame-based, hierarchical organizational structure for the information elements, and steps for identifying and automatically filtering and ranking by relevance, information elements, such as World Wide Web pages for populating the structure, to form; for example, a searchable, World Wide Web page database. Additionally, the method featuring steps for enabling a user to interactively define a frame-based, hierarchical information structure for cataloging information, identify a preliminary population of information elements for a particular hierarchical category arranged as a frame, based upon the respective frame attributes, and thereafter, expand the information population to include related information, and subsequently, automatically filter and rank the information based upon relevance, and then populate the hierarchical structure with the a definable portion of the filtered, upper-ranked information elements.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of Use [0001]
  • This invention relates generally to a method for cataloging, filtering and ranking information; as for example, World Wide Web pages of the Internet; and more particularly, to method preferably implemented in computer software for interactively creating an information database including preferred information elements such as preferred-authority World Wide Web pages, the method including steps for enabling a user to interactively creating a frame-based, hierarchical organizational structure for the information elements, and steps for identifying and automatically filtering and ranking by relevance, information elements, such as World Wide Web pages for populating the structure, to form; for example, a searchable, World Wide Web page database; the method featuring steps for enabling a user to interactively define a frame-based, hierarchical information structure for cataloging information, identify a preliminary population of information elements for a particular hierarchical category arranged as a frame, based upon the respective frame attributes, and thereafter, expand the information population to include related information, and subsequently, automatically filter and rank the information based upon relevance, and then populate the hierarchical structure with the a definable portion of the filtered, upper-ranked information elements; in the case of World Wide Web pages, the method features steps for enabling a user's to interactively establish a hierarchical database structure having frames defined as categories of information of user interest, searching for and collecting a preliminary population of web pages of interest based upon the respective frame attributes of the hierarchy, subsequently expanding the population based upon links either actual or virtual associated with the pages, followed by filtering and ranking the pages based upon the relevance of the pages derived from the authority of the links, and thereafter, limiting the population to desired number of upper-ranked pages. [0002]
  • 2. Related Art [0003]
  • The computer revolution has precipitated an information explosion, the fall out from which has settled on every aspect of human endeavor. Indeed, information and its availability has changing forever the way we do business, conduct personal affairs and manage our lives. Not since Gutenberg's printing press has such a dramatic proliferation of information and knowledge been experienced. [0004]
  • The consequence of this has been that now, all cognitive process call for the application of information to be effective. Gone are the days of naive decision making, where, because of the unavailability or difficulty in obtaining information decisions were based on instinct, raw opinion or impulse. In fact, not only has unstudied decision making fallen from fashion, but, indeed, if one is found engaging in it, either on the job or at home, he is, at best, likely to be branded unconscientious or, at worst, dumb. [0005]
  • But, beyond labels which others may apply, the more important consideration is that application of information to decision making, typically, produces better results. If your buying a big item like a new car, you want information on what features makers include in the models they offer, and what prices they're asking. After spending $20,000 to $40,000 on a new family sedan, nobody want to hear they could have gotten then same thing from another maker for $4,000 or $5,000 less. Or, that what he did buy, is more likely to be found in the dealers repair garage, rather than his own. [0006]
  • And, one can experience comparable annoyance over even small items. For example, there is no better way to ruin a Friday evening than going to a movie and finding you've arrived 15 minutes after its started; or getting there on time, only to find what you're looking at, either puts you to sleep or, worse, offends you. Plainly, its better to know what is playing, where its playing and what others have had to say about it. [0007]
  • Still further, the importance of informed decision making has yet greater importance where matters of health and finance are involved. When one's health is in question; for example, one wants to find the most knowledgeable medical assistance available, or in matters financial, when IBM stock is likely to next split. [0008]
  • As a yet further problem, and potentially an even more perplexing one, not only has the computer revolution created a greater need for information, but, it has created an abundance, indeed, and over abundance of information to meet that need. In fact, the computer revolution has spawned so much information, that it is now to the point where the amount of information available on most subjects is typically so large as to create the new and associated problems of going through that wealth of information and selecting from it the specific pieces of information most relevant to the question at hand. [0009]
  • For example, in the case of the Internet's World Wide Web, if one were looking for information concerning something as straightforward as the restoration of an old car, there would likely be hundreds, if not thousands, of potential Web sites having as many if not more pages of information related to the subject. Accordingly, one faced with the problem of developing information on the subject of automobile restoration, would potentially be required to locate and go through literally hundreds of Web pages in an attempt to find those few most suited to his needs. [0010]
  • In the past, the World Wide Web's approach to this problem has been to provide so-called search facilities such as Yahoo! and others, to assist Web users in finding the information; i.e., Web pages, they might be looking for. However, search facilities such as Yahoo! typically only provide general organizations of Web subject matter and associated Web pages, those organizations being arranged as categories of Web subject matter that are based on the subjective points of view of the individuals who compile the information for the respective search facilities, or the points of view of the respective providers of the search facilities, or the points of view of the Web information providers, or some combination of all of these points of view. As a result, such Web subject matter organizations are susceptible to over inclusion and under inclusion of information which effects the accuracy and ease-of-use of the respective search facilities. [0011]
  • Still further, such search facilities, typically, are unable to group the information elements they return; i.e., pages, by their respective “authoritativeness”, that is, the degree to which others have referred to the respective elements; i.e., pages, as sources of information on the subject matter in question, termed in the art “authorities”, or the degree to which the respective elements; i.e. pages, point to sources of information, termed “hubs”, based upon the “hyperlinks”; i.e., “links”, between the respective hub and authority pages. [0012]
  • While some workers in the field of information retrieval have noted the importance of “links” between hub and authority information elements such as Web pages, and computation of their respective authoritativeness weights, none have proposed systems or methods for enabling a user to interactively create an information databases of preferred-authority data elements such as Web pages, or, procedures for removing spurious factors that arise during computation of the authoritativeness weights for the respective pages. [0013]
  • With regard to the accuracy of authoritativeness computation, workers in the field have found that the computational accuracy is adversely affected by such factors as “self-promotion”, “related-page promotion.”, “hub redundancy”, and “false authority.” Particularly, it has been found that during authoritativeness computations pages with links to other pages of the same Web site can improperly confer authority upon themselves, thus giving rise to false promotion; i.e., “self-promotion,” and adversely affecting authoritativeness computation accuracy. Further, it has been found that in addition to “self-promotion”, related pages from the same Web site, as for example, a home page and several sub-pages of the home page can improperly accumulate authority weights, giving rise to false promotion in the form of “related-page promotion”, which again adversely affecting authoritativeness computation accuracy. Still further, workers have found that the value of a hub page resides in the links that it processes, and not, typically, the content of the page. Accordingly, where all the links of a hub page can be found in “better” hub pages; i.e., hub pages having a greater number of relevant links, inclusion of the first hub page gives rise to “hub redundancy” which unnecessarily burdens computation. And, still further, it has been found that certain pages pertaining to a number of unrelated topics; e.g., pages of resource compilations, typically refer to; i.e., are linked to, a number of other pages, and accordingly appear as if they are “good hubs” even though many of the associated links point to pages of unrelated subject matter, which in turn causes the relevant links from the same page to become “falls authorities”, which, once again, adversely affecting accuracy of authoritativeness computation. [0014]
  • For example, J. Kleinberg in his U.S. patent application entitled: “Method and System for Identifying Authoritative Information Resources in an Environment with Content-based Links Between Information Resources”, Ser. No. 08/813,749, filed Mar. 7, 1997 and assigned to the assignee of the current application, describes a method for automatically identifying the most authoritative Web pages from a large set of hyperlinked Web pages. More specifically, Kleinberg explains his method applies to the case where; for example, one has a page whose content is of interest, and desires to find other pages which are authoritative with respect to the content of the page of interest. However, while Kleinberg notes his method includes: steps for conducting a search based upon a query composed from the content of the page of interest; steps for, thereafter, expanding the group of pages initially retrieved with pages that are linked to the pages initially retrieved; and finally, steps for iteratively computing the authoritativeness of the pages retrieved based upon the “weights” for the respective page link structures his method fails to consider the interactive creation by a user of a database structure for the information, or optimization of the authoritativeness computation by removal spurious of factors which adversely effect accuracy. [0015]
  • Likewise, S. Chakrabarti et al. in their U.S. patent application entitled, “Method and System for Filtering of Information Entities”, Ser. No. 08/947,221 filed Oct. 8, 1997, also assigned to the assignee of the current application, describes a method for determining the “affinity” of information elements, the method including steps for first obtaining an initial set of information elements, thereafter, steps for expanding the initial set with “related” information elements, and subsequently, iteratively computing the relative affinity for the respective information elements. However, as in the case of Kleinberg, Chakrabarti et. al. fails to consider or describe facilities for enabling a user to interactive create a database structure for the information, or optimization of the “affinity” computation by removing spurious factors which adversely effect accuracy. [0016]
  • SUMMARY OF THE INVENTION
  • Accordingly, it is an object of the present invention to provide a method for cataloging and ranking information. [0017]
  • Additionally, it is an object of the present invention to provide a method for interactively creating and or modifying an information database including preferred information elements such as preferred-authority, World Wide Web pages. [0018]
  • Further, it is an object of the present invention to provide a method for improving the determination of authoritativeness amongst related information elements such as hyperlinked, World Wide Web pages. [0019]
  • Yet further, it is an object of the present invention to provide a method for improving the determination of authoritativeness amongst related information elements such as Web pages by the filtering spurious factors which adversely effect accuracy. [0020]
  • Still further, it is an object of the present invention to provide a method for enabling a user to interactively develop a personalized database structure for information organized in accordance with the user preferences, which may be subsequently populated with preferred-authority information elements such as hyperlinked, World Wide Web pages collected by the user. [0021]
  • Yet additionally, it is also an object of the present invention to provide a method for enabling a user to interactively develop a database of preferred-authority information elements, which database may be subsequently searched conveniently and efficiently to identify information elements such as World Wide Web pages of preferred-authority. [0022]
  • Briefly, to achieve the above and other objects and advantages, the method of the present invention includes steps for enabling a user to interactively create and or modify an information database featuring a hierarchical, frame-based, organizational structure of the user's selection for receiving information elements, such as World Wide Web pages, also of the user selection. Further, the method features steps for enabling the identification of information elements, such as Web pages, having preferred-authority as determined by improved, automated computation of the link structure between information elements. [0023]
  • In the interests of simplicity, and to assist understanding, in the following discussion and throughout the specification, usage of the more specific terms “page(s)” and “Web site(s)” will be employed to include, and understood to embrace, respectively, the more general terms “information element(s)” and “information source(s)” unless otherwise expressly stated. [0024]
  • With the above thought in mind, it is to be noted that in preferred form, the method of the present invention is implemented in computer software suitable to be run on a conventional personal computer having a central processing unit, associated RAM, ROM and disk storage memory, and accompanying input-output devices, such as keyboard, pointing device, display monitor and printer. In preferred form the method includes program steps for facilitating generation of a display; at; for example, the computer monitor, the display featuring an interface for enabling a user to interactively compose and or modify an adjustable, frame-based, hierarchical organizational structure representing an arrangement of topics of the user's design. In accordance with the invention, the user formulates the frame-based organization structure to receive information elements, such as World Wide Web pages, which the users may subsequently select to populate the various frames of the organizational structure based on the respective frame attributes; i.e., descriptive features. In preferred form, the interface includes one or more screens respectively having multiple partitions for presenting: a graphical representation of the frame-based, hierarchical information structure of the users creation; the Web pages contained in the category frames of the structure, and the components employed in selecting the Web pages for populating the frames. More particularly, the interface features graphical presentation of the frame-based hierarchical information structure, together with associated tools for freely navigating and modifying the structure; as for example, by adding, deleting or moving frames within the structure to represent the tastes and preferences of the user. Additionally, the interface includes partitions for displaying the Web pages associated with a user-selected frame of the organizational structure, together with tools for manipulating and managing the pages included at the frame. And, still further in preferred form, the interface includes partitions and associated tools for enabling the user to view respective Web page content, such as page links, associated with selected frames, and the frame attributes used as query terms for initiating automated generation of preferred-authority, Web pages for populating the frames of the organizational structure. [0025]
  • Further, in preferred form, computation of Web page authoritativeness is undertaken, by defining Web page and associated link structure as including hub pages, and authority pages, wherein a hub page, “points to”; i.e., links to, one or more authorities pages, and an authority page, is “pointed to”; i.e. linked to, by one or more hub pages. Further, the method includes steps for constructing a root set of information Web pages likely to be relevant to a topic selected by the user. The root set it is developed by first generating an initial set of Web pages with the use of a conventional query derived from the attributes of the category frame for the database hierarchical organizational structure the user is interested in populating, the query so derived, thereafter, being applied in conventional fashion against the World Wide Web. Further, the method includes steps for, subsequently, expanding the initial set of Web pages returned responsive to the query, to include pages elements directly linked to the Web pages of the initial set, thus, forming the root set. [0026]
  • Following creation of the root set, the method includes steps for associating a hub-weight parameter and authority-weight parameter for each Web page, and iteratively calculating the authoritativeness of the respective pages of the root set based on the resulting, respective, hub-weight and authority-weight values for each page. [0027]
  • In accordance with the invention, the method additionally features steps for improving computational accuracy of the authoritativeness for the Web pages. Specifically, the method features steps executed during the computation of authoritativeness for filtering spurious computational factors such as “self-promotion”, “related-page promotion.”, “hub redundancy”, and “false authority.” In preferred form, the method includes steps for filtering “self-promotion” from the computation, the steps including the discarding of links between pages, from the same Web Site. Further the method includes steps for filtering “related-page promotion” from the computation, which steps include “re-packing” the Web pages, for any Web site, having multiple pages showing non-zero authority, during which re-packing, all authorities other that the largest authority is set to zero. [0028]
  • Still further, the method in preferred form also includes steps for filtering “hub redundancy”, the steps including identifying the highest weight; i.e., “best,” hub during computation, zeroing the authority values of all pages pointed to by that hub, re-compute hub values, and, subsequently, recalculate authoritativeness. And, yet additionally the method in preferred form includes steps for filtering “false authority”, the steps including: allowing each link in a Web page to have its own hub value; incrementing the authority value of the destination page with the hub value of the link when authority values are calculated; and re-computing the hub values of the original hub page with the authority value of the destination page, and accordingly, by a spreading function, the hub values of neighboring links. As will be appreciated, this makes the final hub value of the page, therefore, the integral of the hub values of its links. [0029]
  • Still further, in preferred form, the method in accordance with the invention includes steps for ranking the pages of the root set based on authoritativeness following computation of page hub and authority weights, and to thereafter, truncated the root set to a number of highest ranking pages prescribed by the user. [0030]
  • DESCRIPTION OF THE DRAWINGS
  • The above and further objects, features and advantages of the invention will become apparent from the following more detailed description when read with reference to the accompanying drawings in which: [0031]
  • FIG. 1 is a diagram illustrating an Internet, environment including a number of World Wide Web site and associated servers having page information suitable for being maintained in a frame-based, hierarchical database created or maintained in accordance with the method of the present invention; [0032]
  • FIG. 2 is a diagram illustrating a hierarchical organization of information suitable for being maintained in a frame-based, hierarchical database created or maintained in accordance with the method of the present invention; [0033]
  • FIG. 3 is a diagram illustrating a hierarchical organization of information suitable for being maintained in a frame-based, hierarchical database in which a new information category frame has been suggested for addition in accordance with the method of the present invention; [0034]
  • FIG. 4 is a diagram illustrating a hierarchical organization of information suitable for being maintained in a frame-based, hierarchical database in which a new information frame has been added and populated with Web pages in accordance with the method of the present invention; [0035]
  • FIG. 5 is a schematic illustration of the display interface presented to a user for enabling creation or modification of a database hierarchical organizational structure in accordance with the method of the present invention; [0036]
  • FIG. 6 is a schematic illustration of the display interface presented to a user for disclosing the page population of an information frame of a database hierarchical organizational structure in accordance with the method of the present invention; [0037]
  • FIG. 7 is a schematic illustration of the display interface presented to a user for disclosing the content of a page included as a member of the page population for the information frame of a database hierarchical organizational structure in accordance with the method of the present invention; [0038]
  • FIG. 8 is a diagram illustrating a root set of pages expanded from an initial set of pages returned in response to a query based upon the attributes of a frame proposed to be added to a database hierarchical organizational structure in accordance with the method of the present invention; [0039]
  • FIG. 9 is a flow diagram illustrating the general steps of the method in accordance with the present invention; [0040]
  • FIG. 10 is a flow diagram illustrating the more specific steps associated with the “Develop Classification Frame Hierarchy” general step of the method in accordance with the present invention illustrated in FIG. 9; [0041]
  • FIG. 11 is a flow diagram illustrating the more specific steps associated with the “Prompt User To Modify Frame Structure” step of FIG. 10, FIG. 10 itself illustrating the “Develop Classification Frame Hierarchy” general step in accordance with the invention illustrated in FIG. 9; [0042]
  • FIG. 12 is a flow diagram illustrating the more specific steps associated with the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated FIG. 9; [0043]
  • FIG. 13 is a flow diagram illustrating the more specific steps associated with the “Do Key Word Search To Identifying Initial Set Of Information Elements” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9; [0044]
  • FIG. 14 is a flow diagram illustrating the more specific steps associated with the “Expand Initial Set To Root Set” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9. [0045]
  • FIG. 15 is a flow diagram illustrating the more specific steps associated with the “Ranking Information Elements Of Root Set” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9; [0046]
  • FIG. 16 is a flow diagram illustrating the more specific steps associated with the “Generate Weights For Information Elements” of FIG. 15, FIG. 15 itself illustrating the “Rank Information Elements Of Root Set of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9. [0047]
  • FIG. 17 is a flow diagram illustrating the more specific steps associated with the “Determine Information Element Authority And Hub Scores” of FIG. 15, FIG. 15 itself illustrating the “Rank Information Elements Of Root Set of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9; and [0048]
  • FIG. 18 is a flow diagram illustrating the more specific steps associated with the “Truncate Ranked Information Elements” step of FIG. 12, FIG. 12 itself illustrating the “Populate Selected Frame With Information Elements” general step of the method in accordance with the present invention illustrated in FIG. 9.[0049]
  • DETAILED DESCRIPTION OF OF THE PREFERRED EMBODIMENT
  • As noted, the computer revolution has precipitated an information explosion, the fall out from which has settled on every aspect of human endeavor. The consequence of this explosion has been that now, substantially all cognitive process that we undertake call for some application of information to be effective. Nonetheless, despite this new need, it has become clear that the application of information to decision making has, typically, produced better and more satisfying results in substantially all aspects of our lives. From how we earning our salaries, to the how we spend them on the things we need and enjoy, information and the application of it has provided advantage. [0050]
  • However, while this explosive growth of information and need for its application has produced benefit, they have provided yet further demands on us for their management. As also noted, a yet additional and potentially even more perplexing problem that the need to apply information to our decision making is the problem of how we locate and retrieve the information we are now required to have. The computer revolution has created an abundance, indeed, and over abundance of information to meet our every desire. In fact, the computer revolution has spawned so much information, that it is now to the point where the amount of information available on most subjects is typically so large as to create the problems of going through that wealth of information and selecting from it the specific pieces of information most relevant to the question at hand. [0051]
  • For example, one of the most potent information resources ever to be devised has been the Internet's World Wide Web. From its original emergence and recognition as a “treasure chest” of information, literally hundreds of millions of documents of varying quality had been made available online to millions of users in decentralized fashion. However, in its early days, and reflecting the distributed nature of the Web, the only facilities for finding and cataloging pages were “browsing”; i.e., moving from Web site to Web site, and storing the addresses of those found to have interesting information in unordered lists referred to as “bookmarks” which would enable later return without need to recall a specific Web address. As the Web develop, however, in response to the need for centralized page location resources, a number of independent search facilities appeared. These search facilities represent the primary approach to information discovery on the Web today. Good ones are capable of servicing in excess of 20 million queries today with subset and average response times. [0052]
  • However, the scope of the Web's content and its diverse body of users means that the same search facilities must service information requests ranging from specific, well-crafted queries for particular pieces of information to general, broad-topic queries for pages about an entire field or concept. While responses for specific queries tend to be acceptable, the responses for general or broad-topic queries is not good. Studies show that users typically consider pages returned from traditional search resources on broad-topic searchers to range from fair to bad in quality and relevance. Most typically, traditional search resources are unable to identifying the most authoritative pages which would be responsive to such an inquiry. [0053]
  • If one were looking broadly for information concerning restoration of an old car, there would likely be hundreds, if not thousands, of potential Web sites having as many if not more pages of information related to the subject. Accordingly, one faced with the problem of developing information on the subject of automobile restoration, would potentially be required to locate and go through literally hundreds of Web pages in an attempt to find those few most suited to his needs. [0054]
  • However, traditional search facilities such as Yahoo! typically only provide general organizations of Web subject matter and associated Web pages, those organizations being arranged as categories of Web subject matter that are based on the subjective points of view of the individuals who compile the information for the respective search facilities, or the points of view of the respective providers of the search facilities, or the points of view of the Web information providers, or some combination of all of these points of view. As a result, such Web subject matter organizations are susceptible to over inclusion and under inclusion of information which effects the accuracy and ease-of-use of the respective search facilities. [0055]
  • Still further, such search facilities, as noted are unable to group the pages they return, by their respective “authoritativeness”, that is, the degree to which others have referred to the pages, as sources of information on the subject matter in question, termed in the art “authorities”, or the degree to which the respective elements; i.e. pages, point to sources of information, termed “hubs”, based upon the “hyperlinks”; i.e., “links”, between the respective hub and authority pages. [0056]
  • While as also pointed out, workers in the field of information retrieval, for example, those noted above, have pointed out the importance of “links” between hub and authority pages, and computation of their respective authoritativeness weights, none have proposed systems or methods for enabling a user to interactively create an information databases of preferred-authority data elements such as Web pages, or, procedures for removing spurious factors that arise during computation that adversely determination of authoritativeness weights for the respective pages. [0057]
  • With regard to the accuracy of authoritativeness computation, it has been found that computational accuracy is adversely affected by such factors as “self-promotion”, “related-page promotion.”, “hub redundancy”, and “false authority.” Particularly, it has been found that during authoritativeness computations pages with links to other pages of the same Web site can improperly confer authority upon themselves, thus giving rise to false promotion; i.e., “self-promotion,” and adversely affecting authoritativeness computation accuracy. Further, it has been found that in addition to “self-promotion”, related pages from the same Web site, as for example, a home page and several sub-pages of the home page can improperly accumulate authority weights, giving rise to false promotion in the form of “related-page promotion”, which again adversely affecting authoritativeness computation accuracy. Still further, workers have found that the value of a hub page resides in the links that it processes, and not, typically, the content of the page. Accordingly, where all the links of a hub page can be found in “better” hub pages; i.e., hub pages having a greater number of relevant links, inclusion of the first hub page gives rise to “hub redundancy” which unnecessarily burdens computation. And, still further, it has been found that certain pages pertaining to a number of unrelated topics; e.g., pages of resource compilations, typically refer to; i.e., are linked to, a number of other pages, and accordingly appear as if they are “good hubs” even though many of the associated links point to pages of unrelated subject matter, which in turn causes the relevant links from the same page to become “falls authorities”, which, once again, adversely affecting accuracy of authoritativeness computation. [0058]
  • The method of the present invention, on the other hand, overcomes problems found in prior approaches to organization and retrieval a information; as for example, pages of the World Wide Web, by providing a method for cataloging, filtering and ranking information, and, particularly, Web pages. More specifically, the method is preferably implemented in computer software suitable for being run on a conventional personal computer and includes steps for enabling a user to interactively create and or modify an information database featuring a hierarchical, frame-based, organizational structure of the user's selection for receiving information elements, such as World Wide Web pages, also of the user selection. Further, the method features steps for enabling the identification of information elements, such as Web pages, having preferred-authority as determined by improved, automated computation of the link structure between information elements. [0059]
  • As will be appreciated by those skilled in the art, while the invention has application to use by individuals for creating personalized, preferred-authority; e.g., high-authority, information databases, which may be developed from information sources such as the World Wide Web, in which the user can tailor the information organization to his tastes, the invention also has application to broad, business applications, not only for commercially cataloging information sources such as the World Wide Web, and providing facilities for distilling information retrieved to the higher levels of authority, but also, to such applications as building preferred-authority databases for use in law, medicine, engineering and other fields. [0060]
  • The method in accordance with the present invention is shown in its general aspect at FIG. 9. As shown there, [0061] method 2 is seen to broadly include step 4 for enabling a user to develop a personalized, frame-based, hierarchical information classification structure for the database. Further, following developments of the frame-based, hierarchical, information classification structure at step 4, method 2 is seen to include steps 6 for enabling the user to select the information frame from the classification hierarchy he wishes to populate with information elements; e.g., Web pages.
  • Following user selection of the hierarchical classification frame to be populated, at [0062] step 6, method 2 includes step 8 for enabling the automated retrieval of information elements; e.g. Web pages, from the information source; e.g., the Web, for populating the selected frame. Thereafter, method 2 includes step 10 for prompting the user to indicate whether there are any other frames in the information classification hierarchy the user would like to populate with information. If the user indicates, there are additional frames of the classification hierarchy to be populated, method 2 returns at branch 12 to select frame step 6, where the user is again permitted to designate a frame to be populated, followed by subsequent transition to step 8 for enabling automated retrieval of information for the newly selected frame.
  • As will be appreciated, the noted sequence of frame selection at [0063] step 6, automated population of the frame at step 8, and query at step 10 as to whether any frames remain to be populated with information, would continue until the user has designate all the frames he wishes to populate.
  • Once all the frames the user wishes to populate had been exhausted, [0064] method 2 advances over program-flow branch 14 to steps 16, where the user is prompted to indicate whether there are any modifications of the information classification frame hierarchy which the user would like to undertake. In the case where the user would like to make changes to the classification structure; as for example, the addition, deletion or movement of any frames, method 2 would advance over program-flow branch 18 back to classification developments step 4, at which the user would be enabled to enter desired modifications to the information classification organizational structure.
  • Thereafter, and to be appreciated by those skilled in the art, following entry of all in a desired modifications to the information classification structure, [0065] method 2 program flow would again advance through method steps six 8 and 12 to enable population of modifications to the information classification frame structure as described above.
  • Finally, following information population of any modifications to the classification frame structure, the user, at [0066] step 16, would again be prompted to indicate whether any further changes to the classification structure were desired. If the user work and then indicate that no further modifications to the information classification structure were desired, method 2 would advance over program-flow branch 20 to finish.
  • As the be appreciated, and as noted above, the method of the present invention has application to a broad range of information sources. However, for the sake of clarity and simplicity, and with no sense of limitation, the following more detailed description of [0067] method 2 will be undertaken with reference to the World Wide Web and the information pages available there.
  • As noted, the World Wide Web of the Internet, referred to here for simplicity as the “Web”, represents a valuable and important information resource, including literally hundreds of millions of documents accessed by tens of millions of users daily. With reference to FIG. 1, as is well known, the [0068] Web 22 includes millions of Web sites, several of which, again for simplicity, are schematically represented as Web site servers 24 to 32, it being understood that a single server might host one or more sites. Additionally, and as shown, each Web site 24 to 32 includes numerous information pages arranged in Web applications; e.g., Web sites, Web site databases, etc., 34 to 66. Further, and as is also well known, a user, at his personal computer 68 equipped with a suitable Web browser and communications software, can access Web 22 over his ordinary phone line 70, the public switching network 72 and through an Internet service provider 74, which itself may be in connected to public switching network 72 by an ordinary line 76 and to Web 22 by a high-speed data line 78. And, with this setup and some computer protocol magic, the user can access the literally hundreds on millions of documents available on Web 22 represented by applications 34 to 66 in FIG. 1.
  • As pointed out, however, this great mass of information represents difficulties for the user in the form of retrieval and organization problems. And, as also pointed out, [0069] method 2 of the present invention provides the user with a means for dealing with those problems.
  • Particularly, and as noted in connection with the above description of the broad aspects of the invention, [0070] method 2 provides solutions to those problems in the form of steps for enabling the user to interactively create an information database having a organizational structure which the user can interactively personalize to his tastes for holding the information he retrieves, and steps for enabling automated retrieval of reduced size; i.e., distilled, preferred-authority collections of Web pages responsive to his queries.
  • As described in connection with FIG. 9, [0071] method 2 broadly includes step 4 for enabling the user to develop a frame-based, hierarchical information classification structure for his personalized database. As shown in FIG. 10, step 4 of method 2 includes a serious of more detailed steps for carrying out that procedure. Specifically, classification developments step 4 is seen to include step 80 which would follow activation of the software in which method 2 is implemented and embodied, at users personal computer 68, step 80 prompting the user to identify; i.e., provide the file name and path, for the hierarchical database frame structure method 2 should initially access.
  • As will be appreciated, in the case where the user has previously developed a database structure, he could call it at this point, and continue with its use and evolution. In the alternative, where the user wishes to develop a new structure, but, one having some similarity to the preexisting structure, he could designate the preexisting structure and employ it as a basis for the new structure and database. In this case, however, the user would be required to rename the initially-used, preexisting structure if he intended to retain it, otherwise, in conventional fashion, the preexisting structure, as modified would be saved under the original structure filename, thus corrupting the original structure. [0072]
  • In the case, where no preexisting structure is available, the user could simple start from, scratch; i.e., from nothing, indicate a new name for the structure to be created, and proceed. [0073]
  • Accordingly, and with reference to FIG. 10, following [0074] prompt step 80, method 2 is seen to include step 82 which, responsive to the user's designation, advances either over program-flow branch 84 to retrieve, at step 86, any preexisting structure which the user has identified, or over program-flow branch 88 in the case where the user has indicated he is going to develop a new structure. Where the user has indicated he is going to develop a new frame structure, method 2 advances over branch 88 to step 90 which prompts the user to provide the name for the new classification structure. Following step 90, and the user's submission of an identification for the new structure, method 2 advances to step 92 where the user is prompted to provide an initial structure element; e.g., a classification frame, for the new structure. Subsequently, method 2 program-flow advances from either step 86, for retrieval of a designated preexisting frame structure, or from step 92 for initiation of a new frame structure, to converge at step 94, where method 2 displays the frame structure to begin processing with.
  • With regard to the information structure, experience has shown, hierarchically organized data and, particularly frame-based, hierarchical organized data featuring representations of information categories as a hierarchy of frames having frame attributes and attribute values, that characterize and distinguish the respective frames and their associations to each other provides a representation that enable users to more readily understand and appreciate the information elements and their relationships. Still further, it has also been found that the hierarchical organization of information enables a much speedier search when information is sought to be retrieve. Particularly, when a particular element of information is sought, identification of its category affiliation not only designates the features to be looked for, but also, immediately excludes features, and other aspects of the organizational structure not to be looked for, thus more immediately directing the search to the relevant section of the organization. [0075]
  • Accordingly, [0076] method 2 in preferred form, supports frame-based, hierarchical organizational structures for the information the user seeks to catalog. FIG. 2 illustrates such an organizational structure.
  • As shown in FIG. 2, a frame-based, [0077] hierarchical organization structure 100 which was previously created, is seen to include a plurality of frames arrayed in hierarchical relation for representing a general classification of information. As is well understood in the art, the respective frames feature attributes and attribute values for identifying the nature of each frame and its relationships to the other frames. Particularly, in accordance with association rules commonly applied to hierarchical organizations, attributes appearing at a particular frame level in the hierarchy, apply to all depending frames of lower hierarchical level. Further, within a level, frames may be given different attributes and or different attribute values to, thereby, identify different subcategory types within the category level.
  • The nature of frame relationships may be readily understood with reference to [0078] structure 100. As seen in FIG. 2, structure 100 features four levels organization, 102 to 104, the highest and most general 102, including four frames, specifically frames 108 concerning “Business”, 110 concerning “Entertainment”, 112 concerning “Science”, and 114 concerning “News.” Beneath frame 108 to 114 is a second categorization level 104 which further defines first level 102. Particularly, and for ease of explanation, with reference to frame 108 “Business”, only, structure 100 is seen to feature frames 116 “Companies” and 118 “Finance”, both of which depend from frame 102. And, beneath frames 116, 118, structure 100 is further seen to include a third category level 106 which yet additionally defines second level 104 and first level 102. Particularly, third level 106 for frame 108 of level 102 is seen to include frames 120, “Computers”, 122 “Products & Services”, 124, “Savings & Securities” and 128, “Job,” frames 120 and 122 depending from frame 116 “Companies” and frames 124 and 128 from frame 118 “Finance.”
  • Accordingly, based on the frame structure and associated frame attributes and attribute values just described, it would follow that [0079] frame 122 “Products & Services”, as a “child” of frame 116 “Companies” and “grandchild” or frame 108 “Business”, in view of the above discussion concerning attribute inheritance, carry the attribute limitations of its progenitors. Specifically, frame 102 would be considered to include product and service information of business companies only.
  • In the case where a user intending to employ [0080] structure 100 for organizing his information found such limitations inappropriate or undesirable, in accordance with the present invention, he could readily undertake interactive modification of structure 100.
  • While at first blush, this may seem straight forward, those skilled in the database will appreciate that in the past, is was not readily possible to modify database structure, as to do so would typically require reloading of the database data. As is apparent, for the above discussion of hierarchical frame attribute inheritance rules, if a frame in a hierarchy is changed, the limitations associated with related frames of the hierarchical structure; e.g. parent, child, related frames, must also change, thus potentially causing data previously held at a frame prior to a frame structure change, to no longer be appropriate for the same frame after a modification of the structure. [0081]
  • In accordance with the invention, however, [0082] method 2 over, is that difficulty by providing steps to easily and quickly obtain information for re-populating modify frames, and additionally and independently by providing steps for supporting a display interface that enables the user to readily add, delete, or move frames within a hierarchical information organizational structure.
  • To facilitate this, [0083] method 2 of the present invention features steps for presenting a display at the monitor of user's computer 24 for enabling the user to interactively and easily modify structure 100. With refer to FIG. 5, users monitor 132 is seen to have a display 136 at which interface 138 in accordance with method 2 is illustrated. In accordance with the invention, method 2 includes program steps for providing interface 138 with one or more screens having multiple partitions. As shown in FIG. 5, interface 138 in preferred form is seen includes a first screen 140 having a partition 142 for displaying the hierarchical, information organizational structure 100. Additionally, interface screen 140 is seem to include a second partition 144, including graphically presented tools for modifying structure 100. Specifically, tool partition 138 for screen 140 is seen to include a tool 146 for selecting frames of structure 100. Additionally, tool partition 138 is also seen to include tools 148 and 150 for respectively adding and deleting frames from structure 100. In accordance with the invention method 2, includes program steps for enabling a user and to also freely move frames within structure 100 using selection tool 146 in conventional “drag-and-drop” fashion. Still further, tool partition 138 is seen to include a “zoom” tool 151 for enabling the user to zoom in and zoom out organizational structure 100 to see, respectively, fewer or more frames;.
  • Yet additionally, [0084] interface screen 140 is also seen to have a partition 152 including a section 154 for identifying the filename 156 associated with organizational structure 100. Further, partition 152 is also seen to include a section 158 including “drop-down” menus in conventional “Windows” fashion for enabling management of interface 138, the including “File” 160, “Edit” 162, “View” 164 and “Help” 166. Still further, screen partition 152 is also seen to include a section 168 including interface mode buttons for enabling movement between interface mode screen. More specifically, section 168 of partition 152 is seen to include a mode button 170 “Structure” for viewing organizational structure 100 at screen partition 142, a mode button 172 viewing the information element; e.g. Web page content of any frame selected with selection tool 146 as will be more fully described below. Finally, section 168 of screen partition 152 is also seem to include a mode button 174 for viewing the contact of the respective information elements; e.g. Web page is populating a particular frame of structure of 100 as also will be described more fully below.
  • Continuing with reference to FIG. 6, [0085] screen interface 138 in preferred form is also seen to include a second screen 176 having multiple partitions. Specifically, screen 176 a seem to include a partition 178 for displaying the information elements; e.g. Web pages, which populate a particular frame of organizational structure 100. In accordance with the invention, method 2 includes steps for presenting the pages of a frame identified as authorities in, column 180, and pages identifying as hubs at column 182. Further, partition 178 is also saying to include presentation of the attributes for the frame of structure 100 being presented at partition 178 at region 184, and the title for the respective frame at region 186.
  • As also seen in FIG. 6, [0086] interface screen 176 includes a partition 188 for displaying frame structure 100. In accordance with method 2, structure 100 at partition 188 may be readily scrolled in typical Windows Explorer fashion. Still further, control of the frame content at partition 178 may be readily effected by selecting frames of structure 100 in conventional fashion; as for example, with a mouse pointer. Also in preferred form, frames of structure 100 may again be freely managed; for example, added, deleted and moved at partition 188.
  • [0087] Screen 176 in accord with method 2 is also seen to include a partition 190 for enabling editing of the frame page content. More specifically, any partition 190 is seen to include information entry boxes, 194,196 for respectively entering modifications to the frame attributes which control the initial query for returning information elements; e.g., page is for populating the selected frame in accordance with method 2 as will be described more fully below. Particularly, entry box 192 enables user specification of a frame attributes to be included in the initial query, while entry box 194 enables the user to expressly exclude attributes not desired because of known lack a relevance to the subject frame. Additionally, partition 190 is seen to include a scroll box 198 including a predetermined lists of frame features known to produce pages of authority for listed features. In accordance with method 2, where the usury is uncertain what attributes to include for frame, he can make reference to feature pallet 198.
  • Finally, [0088] screen 176 is also seen to include a partition 200 identical to partition 152 of screen 140 including respectively, designation of the display structure filename, menus, and mode buttons.
  • Continuing with reference to FIG. 7, [0089] interface 138 in preferred form is seen to include a third screen 202 again having multiple partitions. In the case of interface screen 202, a partition 204 is provided for displaying the content of a document included in the lists of authority and Hub pages for a selected frame presented at partition 178 of interface screen 176. As the be appreciated, presentation of the content and links for an authority or hub page selected from respective lists 180 and 182 enables the user to quickly and easily monitor the effectiveness of the query and search process, and iteratively adjust the pages returned to populate the selected frame of structure 100.
  • To further assists in that process, in [0090] preferred form screen 202 also includes an editing partition 206 comparable to partition 190 of screen 176, and a structure display partition 208 comparable to partition 188 of screen 176. Still further, screen 202 is again seen to include a partition 210 comparable to partitions 200 of screen 176 and partition 152 of screen 140 which present the filename for structure 100, drop-down menus and mode buttons.
  • Continuing with reference to FIG. 10, following display of the information structure; [0091] e.g. structure 100, method 2 includes step 220 for enabling the user to modify structure 100. As better seen in FIG. 11, method 2 includes step 222 for prompting the user to select a frame to modify. As a be appreciated, step 222 would be interactively conducted with the user at method interface 138. Specifically, method 2 includes program steps for successively presenting to the user interface screens at which the user can make judgments as to whether changes in structure 100 are required.
  • For example, once the user has selected a frame of [0092] structure 100 to modify at step 220, in accordance with the method, interface 138 provides displays; e.g., screens 140,176 and 202 for enabling the user and to make judgments as to whether frame modification would be desirable. Particularly, at step 224 following step 220 in FIG. 11, the user can make a judgment as to whether frame structure 100 is too general or not based upon a review of the authorities and hubs presented at interface screen 176 and their content at screen 202; for example, as the frame existed prior to being worked or during the course a subsequent population steps. As seen in FIG. 11 if the user finds a selected frame to be too general, method 2 would proceed over branch 226 to step 228 where the user to could code split the selected frame and add at step 230 child frames having more specific frame attributes to specify at step 223. As would be appreciated, addition of a frame could be readily effected and interface 138 as described above.
  • Thereafter, [0093] method 2 would loop back over method branch 233 to modification prompt step 222 where the user could again assess whether further modifications when necessary. For example, if after specifying addition of a frame at step 230, the user determines the frame specified at step 232 is too specific, the user would advance method 2 over branch 234 to step 236, where the user could then advance method 2 over branch 238 to step 240 where the user could readily delete a frame at interface 138 as above described and respecify a parent frame at step 242. And, again, method 2 would loop back to step 222 at method 2 branch 244.
  • Following return to step [0094] 222, the user could again determine the if any further modifications of structure 100 were called for. For example, if the user neither found the selected frame too general nor too specific, method 2 would advance over branch 246 to step 248 where the user to determine if the selected frame is misplaced and is required to be moved. If the user determines that the selected frame should be moved, method 2 would advance over branch 250 to steps 252,254 and 256 where the associated sub frames could be removed and replaced in structure 100 as required at steps to 252, and 254 respectively, and the selected frame re-specified for its new location. Thereafter, method 2 would loop back over branch 258 to step 222 to enable the user to again assess whether any further modifications to structure 100 were called for. In if the user found that no further modifications to the structure were called for, method 2 would exit the structure modification sequence at branch 260.
  • The with reference to FIG. 9, following completion of [0095] structure development step 4, as noted, method 2 would advance to step 6 where the user could select the frame he would like to populate with information pages. Following designation by the user of the frame he would like to populate, method to advances to step 8 where population of the selected frame is undertaken.
  • Before describing program flow for frame population with information elements; e.g. Web pages, a review of the information elements search process would be appropriate. [0096]
  • While methods previously known for computing authoritativeness exploit the annotative power latent in hyperlinks, [0097] method 2 of the present invention seeks to determine what a first information elements, e.g., page, i says about a second information element; e.g., page j. To investigate this, method 2 defines a numeral affinity from i to j denoted aij. At a high level, method 2 consists of three steps:
  • 1. Acquisition of a route set As of entities to be analyzed. In many applications of [0098] method 2 this process consists of obtaining an initial set via a cap Boolean keyword search and then expanding its too include neighbors one link distance away;
  • 2. Approximate calculation of one or more of the eigenvectors of one or both of two possible similarity matrices as noted below; [0099]
  • 3. Analysis of the computed eigenvectors(s) to rank and/or partition this set of entities. [0100]
  • If n=|S| and a be a non-negative real-valued affinity of the ordered pair of entities of entities (i, j), so a[0101] ij need not equal aji. Typically, each aij is a carefully chosen function of the terms and where applicable links in the entities, this choice is data source and application dependent. Let A=[aij]. In accordance with method 2, the iteration
  • h←Aa, A←ATh
  • is performed to arrive at hub and authority scores converging to the principal eigenvectors, those associated with the largest eigenvalue of A[0102] TA and AAT, respective. Then the entities with the largest entities in the principal eigenvector of ATA (resp. AAT) as the top authorities (resp. hub) are outputted.
  • In accordance with [0103] method 2, the procedure begins by constructing a root set of pages that are likely to be relevant to the topic. This construction is arbitrary, but could be performed by creating an initial set of pages by quering a traditino search engine using the topics as query, and then expanding this set to the full root set by including all pages that point to or are pointed to by a page in the initial set. The procedure the assoicates with each page p a hub weight h(p) and an authority weight a(p), all initialized to 1. Then the weights are updated as follows:
  • a(p):=Σh(q), h(p):=Σa(q).
  • In accordance with [0104] method 2 the basic procedure is modify in several ways in order to remove spurious effects that adversely affect the noted computation.
  • Particularly to avoid self-promotion of Web sites that confer her authority upon themselves, we discard links to pages on the same site. We defined to pages to be on the same Web site using the following test: class A and B IP addresses must match to most significant octets; class C addresses must match three most significant octets, and class D addresses must match all four octets. [0105]
  • Regarding redundant hubs, the value of a hub page is by definition in its links rather than its contents. If all the destination is accessible from a particular hub are also accessible from better hubs, we do not need to output this hub. More generally, we seek to return a set of hub pages that together contained as many unique, high-quality links as possible. We therefore apply a well-known greedy tasks as follows: once the iteration step has converged the return the best hub, zero the authority values of all pages pointed to by the hub, recompute hub values, and iterate. [0106]
  • With respect t related page factors, it has been found that this by the self-promotion removal procedures is possible for instance for an organization home page, and several children of that page to accumulate authority. However in the final output the method seeks to provide the user as much authoritative substance as possible in a small number of pages. To achieve this, entry each step of iteration the method re-packs the authority of any site as follows: if multiple documents within a logical sit as defined above have non-zero authority, the authority of all but the page with the largest authority are set to zero. [0107]
  • Finally, with regard to false authority, it has been found that many resource compilations such as bookmark files contain pages pertaining to a number of disjoint topics. This causes such compilations to become good hubs, which in turn cause irrelevant links from the same page to become good authorities. To address this [0108] problem method 2 notes that pointers to pages on the same topic tend to be clustered together in resource compilations. Method 2 therefore allows each link in a Web page to have its own hub value so the hub value of the page become his a function of the particular link rather than a constant. When computing authority values, the authority of the destination is incremented by the hub value of the link. When computing hub values, the authority value of the destination is used to increment the hub value of the sauce like and according to a spreading function, the hub values of neighboring links. Thus useful regions of a large hub page can be identified. The final hub value of a page is the integral all the hub values of its links.
  • Convergence of the filtering computation depends on phraising the iterate in steps as a matrix multiplication. [0109] Method 2 described above still fit the framework. Particularly, the self-promotion and rebounded hub procedures are arranged as pre-and post processing steps and the false authority procedure is arranged as a linear transformation that may be expressed as a matrix multiplication.
  • While this invention has been described in its preferred form, it will be appreciated that changes may be made in the form, procedure and sequences of its various steps and elements without departing from its spirit or scope. [0110]

Claims (1)

What we claim is:
1. A method for cataloging, filtering and ranking information comprising the steps of:
a. enabling a user to interactively define a frame-based, hierarchical information structure for cataloging information;
b. identify a preliminary population of information elements for a particular hierarchical category arranged as a frame, based upon the respective frame attributes;
c. expand the information population to include related information;
d. automatically filter and rank the information based upon relevance;
e. thereafter populate the hierarchical structure with the a definable portion of the filtered, upper-ranked information elements.
US09/143,733 1998-08-29 1998-08-29 Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures Expired - Lifetime US6334131B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US09/143,733 US6334131B2 (en) 1998-08-29 1998-08-29 Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures
US09/261,926 US6356899B1 (en) 1998-08-29 1999-03-03 Method for interactively creating an information database including preferred information elements, such as preferred-authority, world wide web pages
US09/811,108 US6336112B2 (en) 1998-08-29 2001-03-16 Method for interactively creating an information database including preferred information elements, such as, preferred-authority, world wide web pages

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/143,733 US6334131B2 (en) 1998-08-29 1998-08-29 Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US09/261,926 Continuation-In-Part US6356899B1 (en) 1998-08-29 1999-03-03 Method for interactively creating an information database including preferred information elements, such as preferred-authority, world wide web pages
US09/811,108 Continuation US6336112B2 (en) 1998-08-29 2001-03-16 Method for interactively creating an information database including preferred information elements, such as, preferred-authority, world wide web pages

Publications (2)

Publication Number Publication Date
US20010039544A1 true US20010039544A1 (en) 2001-11-08
US6334131B2 US6334131B2 (en) 2001-12-25

Family

ID=22505356

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/143,733 Expired - Lifetime US6334131B2 (en) 1998-08-29 1998-08-29 Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures
US09/811,108 Expired - Lifetime US6336112B2 (en) 1998-08-29 2001-03-16 Method for interactively creating an information database including preferred information elements, such as, preferred-authority, world wide web pages

Family Applications After (1)

Application Number Title Priority Date Filing Date
US09/811,108 Expired - Lifetime US6336112B2 (en) 1998-08-29 2001-03-16 Method for interactively creating an information database including preferred information elements, such as, preferred-authority, world wide web pages

Country Status (1)

Country Link
US (2) US6334131B2 (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020129117A1 (en) * 1999-12-21 2002-09-12 Yoshikazu Shiba Information providing system and method
US20030018666A1 (en) * 2001-07-17 2003-01-23 International Business Machines Corporation Interoperable retrieval and deposit using annotated schema to interface between industrial document specification languages
EP1324220A1 (en) * 2001-12-24 2003-07-02 Abb Research Ltd. Process and system for generating and improving a collection of information objects
US20040139079A1 (en) * 2002-12-30 2004-07-15 Evren Eryurek Integrated navigational tree importation and generation in a process plant
US7308451B1 (en) * 2001-09-04 2007-12-11 Stratify, Inc. Method and system for guided cluster based processing on prototypes
US20080195605A1 (en) * 2007-02-09 2008-08-14 Icliquein Technology, Inc. Service directory and management system
US20080294620A1 (en) * 2007-05-23 2008-11-27 Microsoft Corporation User-defined relevance ranking for search
US7469246B1 (en) 2001-05-18 2008-12-23 Stratify, Inc. Method and system for classifying or clustering one item into multiple categories
US7725424B1 (en) 1999-03-31 2010-05-25 Verizon Laboratories Inc. Use of generalized term frequency scores in information retrieval systems
USRE42167E1 (en) * 1999-05-20 2011-02-22 Evresearch Ltd. Information management, retrieval and display systems and associated methods
US7945600B1 (en) 2001-05-18 2011-05-17 Stratify, Inc. Techniques for organizing data to support efficient review and analysis
US7974714B2 (en) 1999-10-05 2011-07-05 Steven Mark Hoffberg Intelligent electronic appliance system and method
US8015173B2 (en) 2000-05-08 2011-09-06 Google Inc. Techniques for web site integration
US8046313B2 (en) 1991-12-23 2011-10-25 Hoffberg Steven M Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US20120089633A1 (en) * 2010-09-10 2012-04-12 Ab Initio Technology Llc Managing data selection based on attributes
US8244795B2 (en) 1999-07-30 2012-08-14 Verizon Laboratories Inc. Page aggregation for web sites
US8275661B1 (en) 1999-03-31 2012-09-25 Verizon Corporate Services Group Inc. Targeted banner advertisements
WO2012178092A1 (en) * 2011-06-23 2012-12-27 Fullcontact Inc Information cataloging
US8572069B2 (en) 1999-03-31 2013-10-29 Apple Inc. Semi-automatic index term augmentation in document retrieval
US20160140207A1 (en) * 2014-11-14 2016-05-19 Symantec Corporation Systems and methods for aggregating information-asset classifications
USRE46310E1 (en) 1991-12-23 2017-02-14 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US10025804B2 (en) 2014-05-04 2018-07-17 Veritas Technologies Llc Systems and methods for aggregating information-asset metadata from multiple disparate data-management systems
US10361802B1 (en) 1999-02-01 2019-07-23 Blanding Hovenweep, Llc Adaptive pattern recognition based control system and method
US10445371B2 (en) 2011-06-23 2019-10-15 FullContact, Inc. Relationship graph
USRE47908E1 (en) 1991-12-23 2020-03-17 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US10635645B1 (en) 2014-05-04 2020-04-28 Veritas Technologies Llc Systems and methods for maintaining aggregate tables in databases
US10685328B2 (en) 2015-03-03 2020-06-16 Adp, Llc Dynamic nodes for managing organization structure
USRE48056E1 (en) 1991-12-23 2020-06-16 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system

Families Citing this family (164)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6640224B1 (en) * 1997-12-15 2003-10-28 International Business Machines Corporation System and method for dynamic index-probe optimizations for high-dimensional similarity search
US6677776B2 (en) * 1998-05-11 2004-01-13 Micron Technology, Inc. Method and system having switching network for testing semiconductor components on a substrate
US6522875B1 (en) 1998-11-17 2003-02-18 Eric Morgan Dowling Geographical web browser, methods, apparatus and systems
JP3760057B2 (en) * 1998-11-19 2006-03-29 株式会社日立製作所 Document search method and document search service for multiple document databases
JP4095739B2 (en) * 1999-04-16 2008-06-04 インターナショナル・ビジネス・マシーンズ・コーポレーション Website browsing method, website browsing system, computer, and storage medium
US6961897B1 (en) * 1999-06-14 2005-11-01 Lockheed Martin Corporation System and method for interactive electronic media extraction for web page generation
US6505168B1 (en) * 1999-08-16 2003-01-07 First Usa Bank, Na System and method for gathering and standardizing customer purchase information for target marketing
JP3698242B2 (en) * 1999-08-20 2005-09-21 日本電気株式会社 Information set importance determination system and method, and recording medium recording information set importance determination program
US7072863B1 (en) 1999-09-08 2006-07-04 C4Cast.Com, Inc. Forecasting using interpolation modeling
US6963867B2 (en) * 1999-12-08 2005-11-08 A9.Com, Inc. Search query processing to provide category-ranked presentation of search results
US8271316B2 (en) 1999-12-17 2012-09-18 Buzzmetrics Ltd Consumer to business data capturing system
US6691163B1 (en) * 1999-12-23 2004-02-10 Alexa Internet Use of web usage trail data to identify related links
WO2001063486A2 (en) * 2000-02-24 2001-08-30 Findbase, L.L.C. Method and system for extracting, analyzing, storing, comparing and reporting on data stored in web and/or other network repositories and apparatus to detect, prevent and obfuscate information removal from information servers
US7340464B2 (en) * 2000-03-10 2008-03-04 General Electric Company Method for automated web site maintenance via searching
US7257766B1 (en) * 2000-06-29 2007-08-14 Egocentricity Ltd. Site finding
US6601075B1 (en) * 2000-07-27 2003-07-29 International Business Machines Corporation System and method of ranking and retrieving documents based on authority scores of schemas and documents
US6556991B1 (en) * 2000-09-01 2003-04-29 E-Centives, Inc. Item name normalization
US7590558B2 (en) * 2000-09-26 2009-09-15 I2 Technologies Us, Inc. System and method for facilitating electronic commerce transactions
US6708161B2 (en) 2000-09-26 2004-03-16 I2 Technologies Us, Inc. System and method for selective database indexing
US20020111870A1 (en) 2000-09-26 2002-08-15 I2 Technologies, Inc. System and method for identifying a product
US7299255B2 (en) * 2000-09-26 2007-11-20 I2 Technologies Us, Inc. System and method for migrating data in an electronic commerce system
US7197470B1 (en) * 2000-10-11 2007-03-27 Buzzmetrics, Ltd. System and method for collection analysis of electronic discussion methods
US7185065B1 (en) 2000-10-11 2007-02-27 Buzzmetrics Ltd System and method for scoring electronic messages
US7831467B1 (en) 2000-10-17 2010-11-09 Jpmorgan Chase Bank, N.A. Method and system for retaining customer loyalty
US7035932B1 (en) 2000-10-27 2006-04-25 Eric Morgan Dowling Federated multiprotocol communication
US6901429B2 (en) 2000-10-27 2005-05-31 Eric Morgan Dowling Negotiated wireless peripheral security systems
US6965914B2 (en) 2000-10-27 2005-11-15 Eric Morgan Dowling Negotiated wireless peripheral systems
US6877033B1 (en) * 2000-11-06 2005-04-05 National Semiconductor Corporation Network-based integrated device identification and ordering system
DE10062351A1 (en) * 2000-12-14 2002-06-27 Siemens Ag Management of information using the World Wide Web or other network, especially for business relevant information and management information, with more intuitive and faster navigation to locate required information
US7356530B2 (en) * 2001-01-10 2008-04-08 Looksmart, Ltd. Systems and methods of retrieving relevant information
US7165088B2 (en) * 2001-01-24 2007-01-16 Microsoft Corporation System and method for incremental and reversible data migration and feature deployment
US7213069B2 (en) * 2001-02-28 2007-05-01 Microsoft Corporation Category name service able to override the category name based on requestor privilege information
US7080328B1 (en) * 2001-03-28 2006-07-18 Ebay, Inc. Graphical user interface for filtering a population of items
US6978266B2 (en) * 2001-05-07 2005-12-20 Microsoft Corporation Determining a rating for a collection of documents
US6826576B2 (en) * 2001-05-07 2004-11-30 Microsoft Corporation Very-large-scale automatic categorizer for web content
US7349868B2 (en) 2001-05-15 2008-03-25 I2 Technologies Us, Inc. Pre-qualifying sellers during the matching phase of an electronic commerce transaction
US7213019B1 (en) * 2001-05-15 2007-05-01 After College, Inc. Career management tools and network
US6983276B2 (en) * 2001-05-15 2006-01-03 I2 Technologies Us, Inc. Facilitating electronic commerce transactions using buyer profiles
US7475030B1 (en) 2001-05-16 2009-01-06 I2 Technologies Us, Inc. Facilitating electronic commerce transactions using a shared product data repository
US7263515B1 (en) * 2001-06-18 2007-08-28 I2 Technologies Us, Inc. Content enhancement in an electronic marketplace
US7110525B1 (en) 2001-06-25 2006-09-19 Toby Heller Agent training sensitive call routing system
US7330829B1 (en) * 2001-06-26 2008-02-12 I2 Technologies Us, Inc. Providing market feedback associated with electronic commerce transactions to sellers
US8086643B1 (en) 2001-06-28 2011-12-27 Jda Software Group, Inc. Translation between product classification schemas
US7809672B1 (en) 2001-06-28 2010-10-05 I2 Technologies Us, Inc. Association of data with a product classification schema
US7162453B1 (en) 2001-06-29 2007-01-09 I2 Technologies Us, Inc. Protecting content from unauthorized reproduction
US7346560B1 (en) 2001-06-29 2008-03-18 I2 Technologies Us, Inc. Protecting content from unauthorized reproduction
US8028001B2 (en) 2001-10-30 2011-09-27 Goldman Sachs & Co. Systems and methods for facilitating access to documents via a set of content selection tags
US7191185B2 (en) * 2001-10-30 2007-03-13 Goldman Sachs & Co. Systems and methods for facilitating access to documents via an entitlement rule
US6970870B2 (en) * 2001-10-30 2005-11-29 Goldman, Sachs & Co. Systems and methods for facilitating access to documents via associated tags
US6973624B2 (en) * 2002-02-26 2005-12-06 Microsoft Corporation Page function architectural framework
US7404004B2 (en) * 2002-02-26 2008-07-22 Microsoft Corporation Page function architectural framework
US7372952B1 (en) 2002-03-07 2008-05-13 Wai Wu Telephony control system with intelligent call routing
US7673234B2 (en) * 2002-03-11 2010-03-02 The Boeing Company Knowledge management using text classification
US7412424B1 (en) 2002-03-19 2008-08-12 I2 Technologies Us, Inc. Third party certification of content in electronic commerce transactions
US20030225763A1 (en) * 2002-04-15 2003-12-04 Microsoft Corporation Self-improving system and method for classifying pages on the world wide web
US7191210B2 (en) * 2002-05-01 2007-03-13 James Grossman Computer implemented system and method for registering websites and for displaying registration indicia in a search results list
DE10319277A1 (en) 2002-05-02 2003-11-13 I2 Technologies Inc Sales offer display system for e-commerce, has inter-linked markers in offer variable windows, that move relatively to indicate specific offer price in different offer windows
US7188117B2 (en) * 2002-05-17 2007-03-06 Xerox Corporation Systems and methods for authoritativeness grading, estimation and sorting of documents in large heterogeneous document collections
US20030221166A1 (en) * 2002-05-17 2003-11-27 Xerox Corporation Systems and methods for authoritativeness grading, estimation and sorting of documents in large heterogeneous document collections
US7167871B2 (en) * 2002-05-17 2007-01-23 Xerox Corporation Systems and methods for authoritativeness grading, estimation and sorting of documents in large heterogeneous document collections
US7039631B1 (en) 2002-05-24 2006-05-02 Microsoft Corporation System and method for providing search results with configurable scoring formula
US7024404B1 (en) * 2002-05-28 2006-04-04 The State University Rutgers Retrieval and display of data objects using a cross-group ranking metric
US7246128B2 (en) * 2002-06-12 2007-07-17 Jordahl Jena J Data storage, retrieval, manipulation and display tools enabling multiple hierarchical points of view
US7359904B2 (en) * 2002-06-14 2008-04-15 Integrated Knowledge Solutions, Inc. Method to efficiently process and present possible arrangements of a set of contiguous peer-to-peer links
US7266553B1 (en) * 2002-07-01 2007-09-04 Microsoft Corporation Content data indexing
US7152059B2 (en) 2002-08-30 2006-12-19 Emergency24, Inc. System and method for predicting additional search results of a computerized database search user based on an initial search query
US7249312B2 (en) * 2002-09-11 2007-07-24 Intelligent Results Attribute scoring for unstructured content
US20040194017A1 (en) * 2003-01-06 2004-09-30 Jasmin Cosic Interactive video interface
US9818136B1 (en) 2003-02-05 2017-11-14 Steven M. Hoffberg System and method for determining contingent relevance
US7676034B1 (en) 2003-03-07 2010-03-09 Wai Wu Method and system for matching entities in an auction
US20040237037A1 (en) * 2003-03-21 2004-11-25 Xerox Corporation Determination of member pages for a hyperlinked document with recursive page-level link analysis
US20050188300A1 (en) * 2003-03-21 2005-08-25 Xerox Corporation Determination of member pages for a hyperlinked document with link and document analysis
GB0309174D0 (en) * 2003-04-23 2003-05-28 Stevenson David W System and method for navigating a web site
US8175908B1 (en) 2003-09-04 2012-05-08 Jpmorgan Chase Bank, N.A. Systems and methods for constructing and utilizing a merchant database derived from customer purchase transactions data
JP2005092889A (en) * 2003-09-18 2005-04-07 Fujitsu Ltd Information block extraction apparatus and method for web page
US7822771B1 (en) * 2003-09-23 2010-10-26 Teradata Us, Inc. Search query generation
US7281005B2 (en) * 2003-10-20 2007-10-09 Telenor Asa Backward and forward non-normalized link weight analysis method, system, and computer program product
AU2003279999A1 (en) * 2003-10-21 2005-06-08 Nielsen Media Research, Inc. Methods and apparatus for fusing databases
US8719276B1 (en) * 2003-11-13 2014-05-06 Google Inc. Ranking nodes in a linked database based on node independence
US7444403B1 (en) 2003-11-25 2008-10-28 Microsoft Corporation Detecting sexually predatory content in an electronic communication
US20050138049A1 (en) * 2003-12-22 2005-06-23 Greg Linden Method for personalized news
US7499913B2 (en) * 2004-01-26 2009-03-03 International Business Machines Corporation Method for handling anchor text
US8296304B2 (en) * 2004-01-26 2012-10-23 International Business Machines Corporation Method, system, and program for handling redirects in a search engine
US20050177599A1 (en) * 2004-02-09 2005-08-11 Microsoft Corporation System and method for complying with anti-spam rules, laws, and regulations
US7725414B2 (en) 2004-03-16 2010-05-25 Buzzmetrics, Ltd An Israel Corporation Method for developing a classifier for classifying communications
US7376912B2 (en) 2004-03-25 2008-05-20 Morgan Stanley Interactive user interface for displaying supply chain information
US7363279B2 (en) * 2004-04-29 2008-04-22 Microsoft Corporation Method and system for calculating importance of a block within a display page
US7428530B2 (en) * 2004-07-01 2008-09-23 Microsoft Corporation Dispersing search engine results by using page category information
US7363296B1 (en) 2004-07-01 2008-04-22 Microsoft Corporation Generating a subindex with relevant attributes to improve querying
US7461064B2 (en) 2004-09-24 2008-12-02 International Buiness Machines Corporation Method for searching documents for ranges of numeric values
US7680648B2 (en) * 2004-09-30 2010-03-16 Google Inc. Methods and systems for improving text segmentation
US8051096B1 (en) 2004-09-30 2011-11-01 Google Inc. Methods and systems for augmenting a token lexicon
US7996208B2 (en) * 2004-09-30 2011-08-09 Google Inc. Methods and systems for selecting a language for text segmentation
US7523085B2 (en) 2004-09-30 2009-04-21 Buzzmetrics, Ltd An Israel Corporation Topical sentiments in electronically stored communications
US7409362B2 (en) 2004-12-23 2008-08-05 Diamond Review, Inc. Vendor-driven, social-network enabled review system and method with flexible syndication
US7657458B2 (en) * 2004-12-23 2010-02-02 Diamond Review, Inc. Vendor-driven, social-network enabled review collection system and method
US20060143066A1 (en) * 2004-12-23 2006-06-29 Hermann Calabria Vendor-driven, social-network enabled review syndication system
US7849090B2 (en) * 2005-03-30 2010-12-07 Primal Fusion Inc. System, method and computer program for faceted classification synthesis
US9104779B2 (en) 2005-03-30 2015-08-11 Primal Fusion Inc. Systems and methods for analyzing and synthesizing complex knowledge representations
US7596574B2 (en) * 2005-03-30 2009-09-29 Primal Fusion, Inc. Complex-adaptive system for providing a facted classification
US7606781B2 (en) * 2005-03-30 2009-10-20 Primal Fusion Inc. System, method and computer program for facet analysis
US9177248B2 (en) 2005-03-30 2015-11-03 Primal Fusion Inc. Knowledge representation systems and methods incorporating customization
US8849860B2 (en) 2005-03-30 2014-09-30 Primal Fusion Inc. Systems and methods for applying statistical inference techniques to knowledge representations
US9378203B2 (en) 2008-05-01 2016-06-28 Primal Fusion Inc. Methods and apparatus for providing information of interest to one or more users
US10002325B2 (en) 2005-03-30 2018-06-19 Primal Fusion Inc. Knowledge representation systems and methods incorporating inference rules
US7844565B2 (en) 2005-03-30 2010-11-30 Primal Fusion Inc. System, method and computer program for using a multi-tiered knowledge representation model
US7765207B2 (en) * 2005-04-29 2010-07-27 Microsoft Corporation Fast rich application view initiation
US9158855B2 (en) 2005-06-16 2015-10-13 Buzzmetrics, Ltd Extracting structured data from weblogs
US8417693B2 (en) * 2005-07-14 2013-04-09 International Business Machines Corporation Enforcing native access control to indexed documents
US9715542B2 (en) 2005-08-03 2017-07-25 Search Engine Technologies, Llc Systems for and methods of finding relevant documents by analyzing tags
US20070033224A1 (en) * 2005-08-04 2007-02-08 Allen Richard B Method and system for automatic construction and management of sets of hierarchical interest points
US20070100779A1 (en) 2005-08-05 2007-05-03 Ori Levy Method and system for extracting web data
US7565358B2 (en) * 2005-08-08 2009-07-21 Google Inc. Agent rank
US7725407B2 (en) * 2005-08-11 2010-05-25 International Business Machines Corporation Method of measuring a large population of web pages for compliance to content standards that require human judgement to evaluate
US7747937B2 (en) * 2005-08-16 2010-06-29 Rojer Alan S Web bookmark manager
US20070074111A1 (en) * 2005-09-23 2007-03-29 Rocket Software, Inc. Method and system for selectively viewing the content of websites
US7620607B1 (en) * 2005-09-26 2009-11-17 Quintura Inc. System and method for using a bidirectional neural network to identify sentences for use as document annotations
US8874477B2 (en) 2005-10-04 2014-10-28 Steven Mark Hoffberg Multifactorial optimization system and method
US7590940B2 (en) 2005-10-11 2009-09-15 Morgan Stanley Interactive user interface for displaying correlation
GB0524017D0 (en) * 2005-11-24 2006-01-04 Ibm Generation of a categorisation scheme
US7640234B2 (en) * 2006-02-09 2009-12-29 Ebay Inc. Methods and systems to communicate information
US7725417B2 (en) * 2006-02-09 2010-05-25 Ebay Inc. Method and system to analyze rules based on popular query coverage
US9443333B2 (en) 2006-02-09 2016-09-13 Ebay Inc. Methods and systems to communicate information
US7739225B2 (en) 2006-02-09 2010-06-15 Ebay Inc. Method and system to analyze aspect rules based on domain coverage of an aspect-value pair
US7849047B2 (en) 2006-02-09 2010-12-07 Ebay Inc. Method and system to analyze domain rules based on domain coverage of the domain rules
US7444343B2 (en) * 2006-03-31 2008-10-28 Microsoft Corporation Hybrid location and keyword index
US8300798B1 (en) 2006-04-03 2012-10-30 Wai Wu Intelligent communication routing system and method
US7603350B1 (en) 2006-05-09 2009-10-13 Google Inc. Search result ranking based on trust
CN105608110A (en) * 2006-05-19 2016-05-25 约恩·吕森根 Source search engine
US10339475B1 (en) * 2006-06-20 2019-07-02 International Business Machines Corporation Loosely coupled applications lifecycle methodology
US7650431B2 (en) * 2006-08-28 2010-01-19 Microsoft Corporation Serving locally relevant advertisements
US7660783B2 (en) 2006-09-27 2010-02-09 Buzzmetrics, Inc. System and method of ad-hoc analysis of data
US7529743B1 (en) * 2007-02-26 2009-05-05 Quintura, Inc. GUI for subject matter navigation using maps and search terms
US7610185B1 (en) * 2007-02-26 2009-10-27 Quintura, Inc. GUI for subject matter navigation using maps and search terms
US20090089381A1 (en) * 2007-09-28 2009-04-02 Microsoft Corporation Pending and exclusive electronic mail inbox
US20090119276A1 (en) * 2007-11-01 2009-05-07 Antoine Sorel Neron Method and Internet-based Search Engine System for Storing, Sorting, and Displaying Search Results
US7970727B2 (en) * 2007-11-16 2011-06-28 Microsoft Corporation Method for modeling data structures by creating digraphs through contexual distances
US8347326B2 (en) 2007-12-18 2013-01-01 The Nielsen Company (US) Identifying key media events and modeling causal relationships between key events and reported feelings
US20090187829A1 (en) * 2008-01-21 2009-07-23 International Business Machines Corporation Aggregation and visualization of reused shared lists
US9361365B2 (en) 2008-05-01 2016-06-07 Primal Fusion Inc. Methods and apparatus for searching of content using semantic synthesis
US8676732B2 (en) 2008-05-01 2014-03-18 Primal Fusion Inc. Methods and apparatus for providing information of interest to one or more users
WO2009132442A1 (en) 2008-05-01 2009-11-05 Sweeney Peter Method, system, and computer program for user-driven dynamic generation of semantic networks and media synthesis
CA2734756C (en) 2008-08-29 2018-08-21 Primal Fusion Inc. Systems and methods for semantic concept definition and semantic concept relationship synthesis utilizing existing domain definitions
US20100287174A1 (en) * 2009-05-11 2010-11-11 Yahoo! Inc. Identifying a level of desirability of hyperlinked information or other user selectable information
US8423554B2 (en) * 2009-07-07 2013-04-16 Sosvia, Inc. Content category scoring for nodes in a linked database
US20110047265A1 (en) * 2009-08-23 2011-02-24 Parental Options Computer Implemented Method for Identifying Risk Levels for Minors
US9292855B2 (en) 2009-09-08 2016-03-22 Primal Fusion Inc. Synthesizing messaging using context provided by consumers
US9262520B2 (en) 2009-11-10 2016-02-16 Primal Fusion Inc. System, method and computer program for creating and manipulating data structures using an interactive graphical interface
US8606792B1 (en) 2010-02-08 2013-12-10 Google Inc. Scoring authors of posts
US8874727B2 (en) 2010-05-31 2014-10-28 The Nielsen Company (Us), Llc Methods, apparatus, and articles of manufacture to rank users in an online social network
US9235806B2 (en) 2010-06-22 2016-01-12 Primal Fusion Inc. Methods and devices for customizing knowledge representation systems
US10474647B2 (en) 2010-06-22 2019-11-12 Primal Fusion Inc. Methods and devices for customizing knowledge representation systems
CN102469111B (en) * 2010-10-29 2016-03-30 国际商业机器公司 Analyzing website access method and system
US11294977B2 (en) 2011-06-20 2022-04-05 Primal Fusion Inc. Techniques for presenting content to a user based on the user's preferences
US8612850B2 (en) * 2011-01-13 2013-12-17 Mediatek Inc. Information browsing method for partitioning contents of page and assigning identifiers to data partitions and related machine-readable medium thereof
US8463765B2 (en) * 2011-04-29 2013-06-11 Zachary C. LESAVICH Method and system for creating vertical search engines with cloud computing networks
US9098575B2 (en) 2011-06-20 2015-08-04 Primal Fusion Inc. Preference-guided semantic processing
US20130135313A1 (en) * 2011-11-30 2013-05-30 Cbs Interactive, Inc. Systems and methods of displaying and navigating content
CN107004201A (en) * 2014-07-09 2017-08-01 曼扎技术私人有限公司 System and method for providing the social media platform with loyalty systems
US11580186B2 (en) * 2016-06-14 2023-02-14 Google Llc Reducing latency of digital content delivery over a network
US11586596B2 (en) 2018-10-05 2023-02-21 Tata Consultancy Services Limited Methods and systems for hierarchical dynamic cataloging
CN111460307B (en) * 2020-04-03 2020-11-06 渭南双盈未来科技有限公司 Mobile terminal accurate searching method and device
JP2022115316A (en) * 2021-01-28 2022-08-09 株式会社日立製作所 Log search support device and log search support method
CN113361525A (en) * 2021-06-30 2021-09-07 深圳市斯博科技有限公司 Page generation method and device based on OCR, computer equipment and storage medium

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4945475A (en) 1986-10-30 1990-07-31 Apple Computer, Inc. Hierarchical file system to provide cataloging and retrieval of data
US4996642A (en) 1987-10-01 1991-02-26 Neonics, Inc. System and method for recommending items
US4870579A (en) 1987-10-01 1989-09-26 Neonics, Inc. System and method of predicting subjective reactions
WO1989009963A1 (en) 1988-04-15 1989-10-19 Digital Equipment Corporation System for managing hierarchical information in a digital data processing system
JPH03129472A (en) * 1989-07-31 1991-06-03 Ricoh Co Ltd Processing method for document retrieving device
US5583763A (en) 1993-09-09 1996-12-10 Mni Interactive Method and apparatus for recommending selections based on preferences in a multi-user system
US5619709A (en) * 1993-09-20 1997-04-08 Hnc, Inc. System and method of context vector generation and retrieval
US5991751A (en) * 1997-06-02 1999-11-23 Smartpatents, Inc. System, method, and computer program product for patent-centric and group-oriented data processing
US6029195A (en) * 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US5615341A (en) 1995-05-08 1997-03-25 International Business Machines Corporation System and method for mining generalized association rules in databases
US5845270A (en) 1996-01-02 1998-12-01 Datafusion, Inc. Multidimensional input-output modeling for organizing information
US5937163A (en) * 1996-03-26 1999-08-10 Industrial Technology Research Institute Method and system at a host node for hierarchically organizing the links visited by a world wide web browser executing at the host node
US5875446A (en) * 1997-02-24 1999-02-23 International Business Machines Corporation System and method for hierarchically grouping and ranking a set of objects in a query context based on one or more relationships
US6112202A (en) * 1997-03-07 2000-08-29 International Business Machines Corporation Method and system for identifying authoritative information resources in an environment with content-based links between information resources
US5940821A (en) * 1997-05-21 1999-08-17 Oracle Corporation Information presentation in a knowledge base search and retrieval system
US5987454A (en) * 1997-06-09 1999-11-16 Hobbs; Allen Method and apparatus for selectively augmenting retrieved text, numbers, maps, charts, still pictures and/or graphics, moving pictures and/or graphics and audio information from a network resource
US6134541A (en) * 1997-10-31 2000-10-17 International Business Machines Corporation Searching multidimensional indexes using associated clustering and dimension reduction information
JPH11161063A (en) * 1997-11-28 1999-06-18 Nec Niigata Ltd Image forming device and method therefor
US6112203A (en) * 1998-04-09 2000-08-29 Altavista Company Method for ranking documents in a hyperlinked environment using connectivity and selective content analysis

Cited By (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8046313B2 (en) 1991-12-23 2011-10-25 Hoffberg Steven M Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE49387E1 (en) 1991-12-23 2023-01-24 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE48056E1 (en) 1991-12-23 2020-06-16 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE47908E1 (en) 1991-12-23 2020-03-17 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
USRE46310E1 (en) 1991-12-23 2017-02-14 Blanding Hovenweep, Llc Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US10361802B1 (en) 1999-02-01 2019-07-23 Blanding Hovenweep, Llc Adaptive pattern recognition based control system and method
US9275130B2 (en) 1999-03-31 2016-03-01 Apple Inc. Semi-automatic index term augmentation in document retrieval
US8572069B2 (en) 1999-03-31 2013-10-29 Apple Inc. Semi-automatic index term augmentation in document retrieval
US8275661B1 (en) 1999-03-31 2012-09-25 Verizon Corporate Services Group Inc. Targeted banner advertisements
US7725424B1 (en) 1999-03-31 2010-05-25 Verizon Laboratories Inc. Use of generalized term frequency scores in information retrieval systems
US8095533B1 (en) 1999-03-31 2012-01-10 Apple Inc. Automatic index term augmentation in document retrieval
USRE42167E1 (en) * 1999-05-20 2011-02-22 Evresearch Ltd. Information management, retrieval and display systems and associated methods
US8244795B2 (en) 1999-07-30 2012-08-14 Verizon Laboratories Inc. Page aggregation for web sites
US7974714B2 (en) 1999-10-05 2011-07-05 Steven Mark Hoffberg Intelligent electronic appliance system and method
US20020129117A1 (en) * 1999-12-21 2002-09-12 Yoshikazu Shiba Information providing system and method
US8015173B2 (en) 2000-05-08 2011-09-06 Google Inc. Techniques for web site integration
US8862565B1 (en) 2000-05-08 2014-10-14 Google Inc. Techniques for web site integration
US8756212B2 (en) 2000-05-08 2014-06-17 Google Inc. Techniques for web site integration
US7945600B1 (en) 2001-05-18 2011-05-17 Stratify, Inc. Techniques for organizing data to support efficient review and analysis
US7469246B1 (en) 2001-05-18 2008-12-23 Stratify, Inc. Method and system for classifying or clustering one item into multiple categories
US7305614B2 (en) * 2001-07-17 2007-12-04 International Business Machines Corporation Interoperable retrieval and deposit using annotated schema to interface between industrial document specification languages
US20030018666A1 (en) * 2001-07-17 2003-01-23 International Business Machines Corporation Interoperable retrieval and deposit using annotated schema to interface between industrial document specification languages
US7308451B1 (en) * 2001-09-04 2007-12-11 Stratify, Inc. Method and system for guided cluster based processing on prototypes
US7877388B1 (en) * 2001-09-04 2011-01-25 Stratify, Inc. Method and system for guided cluster based processing on prototypes
EP1324220A1 (en) * 2001-12-24 2003-07-02 Abb Research Ltd. Process and system for generating and improving a collection of information objects
US8935298B2 (en) * 2002-12-30 2015-01-13 Fisher-Rosemount Systems, Inc. Integrated navigational tree importation and generation in a process plant
US20040139079A1 (en) * 2002-12-30 2004-07-15 Evren Eryurek Integrated navigational tree importation and generation in a process plant
US20110238652A1 (en) * 2007-02-09 2011-09-29 Icliquein Technology, Inc. Service directory and management system
US20080195605A1 (en) * 2007-02-09 2008-08-14 Icliquein Technology, Inc. Service directory and management system
US7853603B2 (en) 2007-05-23 2010-12-14 Microsoft Corporation User-defined relevance ranking for search
US20080294620A1 (en) * 2007-05-23 2008-11-27 Microsoft Corporation User-defined relevance ranking for search
AU2011298983B2 (en) * 2010-09-10 2016-03-10 Ab Initio Technology Llc Managing data selection based on attributes
US9323824B2 (en) * 2010-09-10 2016-04-26 Ab Initio Technology Llc Managing data selection based on attributes
CN103098053A (en) * 2010-09-10 2013-05-08 起元技术有限责任公司 Managing data selection based on attributes
KR101826099B1 (en) 2010-09-10 2018-03-22 아브 이니티오 테크놀로지 엘엘시 Managing data selection based on attributes
US20120089633A1 (en) * 2010-09-10 2012-04-12 Ab Initio Technology Llc Managing data selection based on attributes
US10445371B2 (en) 2011-06-23 2019-10-15 FullContact, Inc. Relationship graph
US9684696B2 (en) 2011-06-23 2017-06-20 Fullcontact Inc. Information cataloging
US11216508B2 (en) 2011-06-23 2022-01-04 FullContact, Inc. Entity resolution
WO2012178092A1 (en) * 2011-06-23 2012-12-27 Fullcontact Inc Information cataloging
US10078668B1 (en) 2014-05-04 2018-09-18 Veritas Technologies Llc Systems and methods for utilizing information-asset metadata aggregated from multiple disparate data-management systems
US10073864B1 (en) 2014-05-04 2018-09-11 Veritas Technologies Llc Systems and methods for automated aggregation of information-source metadata
US10025804B2 (en) 2014-05-04 2018-07-17 Veritas Technologies Llc Systems and methods for aggregating information-asset metadata from multiple disparate data-management systems
US10817510B1 (en) 2014-05-04 2020-10-27 Veritas Technologies Llc Systems and methods for navigating through a hierarchy of nodes stored in a database
US10635645B1 (en) 2014-05-04 2020-04-28 Veritas Technologies Llc Systems and methods for maintaining aggregate tables in databases
US10095768B2 (en) * 2014-11-14 2018-10-09 Veritas Technologies Llc Systems and methods for aggregating information-asset classifications
US20160140207A1 (en) * 2014-11-14 2016-05-19 Symantec Corporation Systems and methods for aggregating information-asset classifications
US10685328B2 (en) 2015-03-03 2020-06-16 Adp, Llc Dynamic nodes for managing organization structure

Also Published As

Publication number Publication date
US6334131B2 (en) 2001-12-25
US20010016846A1 (en) 2001-08-23
US6336112B2 (en) 2002-01-01

Similar Documents

Publication Publication Date Title
US20010039544A1 (en) Method for interactively creating an information database including preferred information elements, such as preferred authority, world
US6356899B1 (en) Method for interactively creating an information database including preferred information elements, such as preferred-authority, world wide web pages
US7769741B2 (en) Portable browsing interface for information retrieval
EP1618496B1 (en) A system and method for generating refinement categories for a set of search results
US7881981B2 (en) Methods and computer readable media for determining a macro-context based on a micro-context of a user search
Kobayashi et al. Information retrieval on the web
US6185553B1 (en) System and method for implementing cooperative text searching
US5875446A (en) System and method for hierarchically grouping and ranking a set of objects in a query context based on one or more relationships
US6493702B1 (en) System and method for searching and recommending documents in a collection using share bookmarks
US5960422A (en) System and method for optimized source selection in an information retrieval system
US7185001B1 (en) Systems and methods for document searching and organizing
US20020073079A1 (en) Method and apparatus for searching a database and providing relevance feedback
US20060122979A1 (en) Search processing with automatic categorization of queries
WO2003052625A1 (en) A system and method for searching data sources
US20040015485A1 (en) Method and apparatus for improved internet searching
US7013300B1 (en) Locating, filtering, matching macro-context from indexed database for searching context where micro-context relevant to textual input by user
JP2000508450A (en) How to organize information retrieved from the Internet using knowledge-based representations
JP2000207422A (en) Retrieval and ranking system and method for document using concept thesaurus
EP1808786A1 (en) User context based search engine
KR20020017863A (en) Method for searching keyword by using connection statistics materials in internet user
WO1999064945A9 (en) Computer systems and computer-implemented processes for knowledge management using relevancy to search for, acquire and organize information for multiple users
Wu et al. Information Exploration on the World Wide Web
WO2002089005A2 (en) Data retrieval method and system

Legal Events

Date Code Title Description
STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHAKRABARTI, SOUMEN;DOM, BYRON EDWARD;GIBSON, DAVID ANDREW;AND OTHERS;SIGNING DATES FROM 19990407 TO 19990409;REEL/FRAME:026137/0508

FPAY Fee payment

Year of fee payment: 12