CA1324675C - System and method of predicting subjective reactions - Google Patents
System and method of predicting subjective reactionsInfo
- Publication number
- CA1324675C CA1324675C CA000609923A CA609923A CA1324675C CA 1324675 C CA1324675 C CA 1324675C CA 000609923 A CA000609923 A CA 000609923A CA 609923 A CA609923 A CA 609923A CA 1324675 C CA1324675 C CA 1324675C
- Authority
- CA
- Canada
- Prior art keywords
- user
- sampled
- users
- selected user
- item
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0202—Market predictions or forecasting for commercial activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/335—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
Abstract
Applicant: John B. Hey For: System and Method of Predicting Subjective Reactions ABSTRACT OF THE DISCLOSURE
A system and method of predicting, for a user selected from a group of users, the reactions of the selected user to items sampled by one or more users in the group but not sampled by the selected user. The predictions are based on other items previously sampled by that user. A scalar rating is defined for each item sampled by the selected user to represent the reaction of the selected user to that item. The selected user is successively paired with other users in the group who have defined scalar ratings for at least some of the items sampled by the selected user to determine the overall difference in ratings for items sampled by both members of each successive pair. One or more of the other users are designated as predicting users and a weighting value is assigned to each of the predicting users based on the overall difference in ratings between that predicting user and the selected user. The weighting values are applied for each item unsampled by the selected user to proportionally alter the difference between a rating previously predicted for each identified item and any actual ratings of that item by the predicting users to adjust the reaction predictions for the selected user.
A system and method of predicting, for a user selected from a group of users, the reactions of the selected user to items sampled by one or more users in the group but not sampled by the selected user. The predictions are based on other items previously sampled by that user. A scalar rating is defined for each item sampled by the selected user to represent the reaction of the selected user to that item. The selected user is successively paired with other users in the group who have defined scalar ratings for at least some of the items sampled by the selected user to determine the overall difference in ratings for items sampled by both members of each successive pair. One or more of the other users are designated as predicting users and a weighting value is assigned to each of the predicting users based on the overall difference in ratings between that predicting user and the selected user. The weighting values are applied for each item unsampled by the selected user to proportionally alter the difference between a rating previously predicted for each identified item and any actual ratings of that item by the predicting users to adjust the reaction predictions for the selected user.
Description
~32467~J
Applicants John B. ~ey Fors System ~nd Method of Predictlng SubjectlYe ~eactlons ~=
Th~ invention relate~ to a system and method of predicting reactions to itemfi not yet ~ampled by a user, and more particularly to 6uch a system and method which adjust the reaction prediction for each unsampled item for that user based on the similarity in reaction of other user6 relative to that user.
BACRGROI~ND OP INVENTIOl~
There are a number of situations in which it is helpful to predict the reactions of people to items they have not yet had the opportunity to sample. It is particularly useful to make recommendations for items to which people have wholly subjective reactions and which require a substantial investment of time or money to review, such ac movies, books, mu~ic, and games.
Difficulty arises because the actual reaction of a person to such an item can only be determined after money and time are invested in sampling the item.
The desirability of making recommendations for cubjectively appreciated item~ is evidenced by the prevalence of movie critics, book reviewers, and other critics who attempt to appraise such items. ~owever, the uniqueness of each item ~32~
hinde~6 objective compari~on of the items relative to the re~ponse they will eliclt from each lndivldual. Short ~ynopses or reviews are of limited value bec~use the actual 6atisfactlon of an indlvldual depend6 upon hl6 reactlon to the entire rendition of the item. For example, book6 or mov~es with very similar plots can differ widely in style, pace, mood, and other characteristic6. Moreover, knowledge beforehand of the plot or content can lessen enjoyment of the item.
It is common to 6tudy the advice of profes~ional critics, but it is difficult at best to find a critic whose taste matches the taste of a particular individual. U~ing a combination of critics provides more information, but correctly combining and interpreting multiple opinions to extract useful advice i~ quite difficult. Even if a satisfactory combination is achieved, the opinion~ of profes6ional critics frequently change over time as the critics lose their enthusiasm or become overly sophisticated.
Public opinion poll~ attempt to discern the average or majority opinion on particular topics, particularly for current events, but by their nature the polls are not tailored to the subjectlve opinions of any one person. Poll~ draw from a large amount of data but are not capable of responding to the subjective nature of a particular individual.
All of the above techniques requlre research by an individual, and the research is time consuming and often applied to out-of-date material. An individual is provided little help ~ 32~7~
in making an opt~mal choice from a l~rge ~et of largely unknown item6.
~UMMARY OF INVENTION
It is therefore an object of this invent~on to provide a system and method which automatically and accurately pred~ct the subjective reaction of a person to ~tems not yet ~ampled by that person.
It i~ a further object of this invention to provide such a system and method which draw upon the experience of a group of people and selectively weight the reactions of the group to make accurate predictions for any person within the group.
It is a further object of this invention to provide such a system and ~ethod which can repeatedly update the predictions for each person as the experience of the group increases.
Yet another obiect of this invention is to provide a system and method which can evaluate a large number of items and accurately supply an individual with a list of recommendations tailored for that individual.
It i8 i further object of this invention to provide such a system and method which can identify items already sampled and prevent accidental repetition of sampled items.
A still further object of thi6 invention is to provide such a system and method which require little time or effort on the part of each person in a group to obtain accurate recommendations.
~32~rl -' Another object of thi~ invention ifi to p~ovide such a sy~tem ~nd method whlch readily a6 imilate a new person or ltem and rapidly attain a u eful level of predlct~billty for each.
Thi8 ~nvention regult6 from the realization that truly effective prediction of subject1ve reactions, of one or more person~ selected from a group of persons, to unsampled items 6uch as movies, books or mu~ic; can be ach~eved by defining a scalar rating to represent the reaction of the selected person to each sampled item, successively pairing each selected person with other persons in the group to determine the difference in ratings for items sampled by both members of the pair, designating one or more of the other persons as predicting persons, assigning a weighting value to each of the predicting persons, and applying the weighting values to update the ratings previously predicted for each item unsampled by the selected person.
This invention features a method of predicting, for a user selected from a group of users, the reactions of the selected user to items sampled by one oe ~ore user~ in the group but not sampled by that user. The predictions are based on other items previously sampled by that user. A scalar rating is defined for each item sampled by the ~elected user to represent the reaction of the selected user to that ite~. The selected user is successively paired with other users in the group who have defined scalar ratings for at least some of the items sampled by the selected user to determine the overall difference in ratings 132~6 ~
for ~tems ~mpled by both me~bers of each succe86i~e pair. One or more of the other user~ are deslgnated a8 pred~cting user6 and a weighting value i~ assigned to each of the predictlng users based on the over~ll difference in rat~ngs between th~t predicting user and the selected user. Items un6ampled by the ~elected user are identif~ed and the weighting values are applied to proportionally alter the difference between a rating previou~ly predicted for each identified item and any actual ratings of that item by the predicting users to adjust the reaction pred~ctions for the selected user.
In one embodiment, successively pairing includes generating for each pair an agreement scalar representing the overall rating difference between the members of that pair, and the weighting value is obtained for each of the predicting users by converting the agreement scalar into the weighting value.
Pairing further includes successively matching, for each pair, items sampled by both members and, for each matched item, subtractinq the ratings of one member from the ratings of the other to obtain the difference in ratings. The difference in ratings for each ~atched item is converted to a closeness value and ~ummed with other closeness value~ for that pair. The sum of the closeness values is weighted by the number of items sampled by both members to generate the agreement scalar.
In another embodiment, designating and converting includes defining a greater weighting value for predicting users havinq a larger agreement scalar and defining a lesser weighting value ~324~
for predlctlng u~er6 having ~ smaller agree~ent Bcalar. The design~ting ~nd converting may ~nclude ranking the predlct$ng u6ers by sscending order of agreement scalar and defining 6uccessively larger weighting values for the ascending agreement scalar~. Identifying and applying includes combining tbe weight$ng value for each predictln~ user wlth the difference between ratings by that predicting user and by the selected user for each ~dentified item, and summing the combination with the previously predicted rating. The pairing may include successively pairing the selected users with each other user in the group or with a subset of other users in the group~ The re~ainder of the users in the group may be successively selected to adjust the reaction predictions for each user in the group.
This invention also features a method of selectively recommending, or disrecommendinq, for each user successively selected from a group of users, items not sampled by the selected u&er. The method includes defining a scalar rating for each sampled item, successively pairing the selected user with other users in the group, generating for each pair an agreement scalar, designating at least one of the other users as recommending users, converting the agreement scalar for each of the recommending use~C into a reco~mendation-fraction, identifying items unsampled by the selected user, and applying the recommendation-fractions to proportionally decrease the difference between a rating previously establi~hed for each identified item and the ratings of that item by the recommending i32~6~
user6 to ad~u6t the recommendations or th~ selected user. The method further includes ~uccesslvely 6electing the remainder of the u~er6 in the group to adju6t the recommendat~ons for e~ch user in the group and presenting, for each user, a plurallty of items based on the recommendation6 for that user.
Thi~ invention further features a sy6te~ for predicting the reaction to items, including means for defining a ~calar rating, means for succe~sively pairing the selected user with other users in the group to determine the difference in ratings, means for de ignating at least one of the other users as a predicting user, and means for assigning a weighting value to each of the predicting usets based on the difference in ratings between that predicting user and the selected user. The system further includes means for applying the weighting Yalues to items unsampled by the selected ucer to proportionally alter the difference between a rating previously predicted for each identified item and any actual rating of that item by the predicting user6 to adjust the reaction predictions for the selected user.
~OSURE OF PREFERRED EM80D.I~.E;NT
Other objects, features and advantages ~ill occur from the following description o a preferred embodi~ent and the accompanying drawings, in which:
Fig. 1 i6 a schematic block diagram of a system according to thi6 invention~
~ 3 2 ~ ~ 7 ~
Fig. 2 i~ a flow chart of the use of the ~yste~ of ~ig. 1 by a u~er~
Fig. 3 i6 a flow chart of the oper~tion of the ~ystem of Fig. 1 for each u6er ~elected to be updated~
Fig. ~ i8 ~ nore det~led flow chart of the p~iring of user6 to determine the difference in rating~ and to generate an agreement scalar; and Fig. S is ~ flow chart of the conver~ion of the agreement scalar to a recommendation-fraction and subsequent adjustment of the previously established rating of the selected person.
This invention may be accomplished by a ~ystem which predicts the reaction of a person selected from a group of persons to items not sampled by the selected person. Th e selected person designates, for each item sampled by the selected person, 2 scalar rating representing the reaction of the selected person to that item. The system ~uccessively pairs the selected person with other persons in the group who have defined scalar ratings for at least some of the items also sampled by the selected person to determine the difference in rating6 for items sampled by both members of each successive pair. The 6ystem further designates one or more of the other persons as a predicting person and assigns a weighting value to each of the predicting per~ons based on the difference in ratings between that predicting person and the selected person.
The weight;ng value i8 applied to items unsampled by the 324~7~rj ~elected person to proport~on~lly alter the difference between the ratlng prevlou ly pcedicted for the ~elected per~on for each unsampled item and the r~tlngs of that item by the predlctlng persons to ~d~ust the overall reaction predictions for the selected person.
Sy~tem 10 according to this invention, Pig. 1, lncludes keyboard 12 through which users of ~ystem 10 enter scalar rating~ for items they have sampled. The ratings are ~tored in memory 14 and are selectively retrieved by pairinq module 16 which, for each per~on for which a prediction is desired, pairs that person with a number of other persons who have previously entered scalar ratings.
A value for each pair representing the difference in ratings for items sampled by both ~ember~ of each successive pair is provided to weighting module I8. For persons designated as predicting person~ for the selected person, as described in more detail below, a weighting value i~ assigned based on the difference in rating~ between that predicting person and the selected person. The weighting values are provided to prediction adju~tment module 20 which applies the weighting values to items unsampled by the selected person to proportionally alter the difference between a rating previously predicted for the selected person for each unsampled item and the ratings of that item by the predicting persons. The rating previously predicted for each un~ampled item represents the predicted reaction of the selected person to the up-to-now -- 132~7r;
un~ampled ~tem. After ~djustment, the ratings are provided to ~emory 1~ ~hich, when re~ue~ted by ~ user, supplles to display 22 a list of u~ually the most highly recommended items for that user. Altern~t$vely, another list ba~ed on the recommendationg i8 provided 6uch a~ a list of tho most highly disrecommended items.
The interface between the user and ~ystem 10 i6 illustrated in Fig. 2. The user enter6 a pa~sword, step 30, and then decides to rate an item, such as a movie, step 32. To rate an item, the name of the item, such as the title of a movie, is entered into the system, ~tep 34. If the item has been previously sampled, step 36, his previous actual rating of it is displayed, step 38. Regardless of whether the item has been actually rated, the user is allo~ed to adju~t the rating, steps 40 and ~2. Increasing the number of items actually sampled and rated increases the accuracy of reaction predictions made for other items a~ explained in greater detail below.
Tn one construction, the scalar ratings are integers ranging from O to 12, with 0~ representing a reaction of ~pooc~, '3~ representing the reaction of 'fair~, ~6~
corresponding to a reaction of ~good~, ~9~ representing the reaction of ~very good~, and ~12~ corresponding to a reaction of ~excellent~. Establishing a greater number of ratings than the above-listed five verbal descriptions provides more accurate rating of the reactions of the user.
- ~2~7~
After the r~ting i6 entered, or ~f adjustment ~8 decllned, the operatlon return6 to tep 32. If rating of an ltem i6 not selected, the u6er elects to view the mo6t current list of recommendation6, ~teps 44, ~6, or ex~t~ the sy~tem, step ~8.
The operation of sy~tem 10, Flg. 1, i~ summarized ln Fig.
3. Each user enters A Bcalar rating for each item sampled by that user, step S0. Each user i~ succe~sively paired, step S2, with a number of other userfi to determine the difference in rating~ for items sampled by both users. For each pair of users, an aqreement scalar i8 generated, step 54, to represent the overall rating difference between that pair of users. For each selected user, one or more of the other users are designated as recommending users, ~tep 56, who contribute to ratings used to make recommendations for items to be sampled.
The agreement scalar for each recommending user is then converted into a recommendation-fraction, step 58, which i~ then applied to reduce the difference between the rating previously estimated for each unsampled item and the actual ratings of that item by the recommending users, ~tep 60. The recon,mendation-fraction is typically a fraction ranqing from zero to one.
The pairing of users to determine the difference in ratings and to generate an agreement scalar is shown in more detail in Fig. ~. For each pair of users, the item is set to first item, step 70, and loop 72 is entered until each of all 1 3 2 4L ~ ~ ~r pos6~ble item h~s been examined. The lte~ ls rec~lled, step 7~, and the ~tem~ for both members of the p~ir are Datched to ee lf that ~tem wa~ sampled by both me~bers, ~tep 76. A numb~r of rating6 for movles are provided ~6 an e~ample in Table Is ~LE Is RA~I~Ç~
Movie ~itle Smit~ Jones Wesso~
Star War~ 8 11 10 ~he Untouchables 10 9 4 Beverly ~ills Cops - 10 10 Fletch 10 - g Caddyshack 7 - 11 qhe rating difference is determined, step 78, and a closeness value is obtained for that difference, step 80. In one construction, the closeness value is obtained from a look-up table such as Table II:
132~7v WLE I I: I~Ti NG ~0 C~LOSE~ SS-VAhyE
jf~4 C~oliene6B V~l o 10 Step 80 provides a weighting step in which large difference~ in ratings are penalized and similarities are rewarded. In other constructions, the unaltered differences themselves are used.
In yet other embodiment~, ratios or item-specific probabilities of the differences may be compared, or agreement by types or categories of items may be utilized.
In this embodiment, the clo~ene6s-value i8 added to ~
running total, step 82, and the count of ite~ sampled by both members is incremented, step 8~. After the last item has been processed, step 86, an aqreemert ~calar is generated, step 88, 132467r for that palr of user6. ~he agreement scalar may be gener~ted by the use of the followlng equations AS - (CV~) ~2n-1)/n2 ~1) where AS i8 the agreement scalar, CVT i6 the closeness-value total, and n i6 the count o items sampled by both users. By the example provided in Tablç~ I and II, Smith and Jone~ have sampled two items in common having a difference in ratings of 3 and 1, respectively, which are assigned closeness values of 4 and 9, respectively. By application of equation (1), the agreement scalar for Smith and Jones is 9.75. Similarly, the closeness-value for the pair of Smith and Wesson is 17 and the agreement scalar is 7.44. The difference in reaction of Smith and Wesson to ~The Untoucbables~ and ~Caddyshack~ led to the smaller agreement scalar between those users. It is evident that the greater the number of items that the users have sampled, the more accurate the agree~ent scalar will be for each of the users with which the selected user i8 paired.
The conversion of the agreement scalar to a weighting value, referred to as a recommendation-fraction, and ad~ustment of the previously establi~hed ratings i6 shown in Fig. 5. One or more recommending users are designated, step 90, from the group of users. ~f the number of users is small, the entire group may be used. Otherwise, a subset of the group, e.g.
sixteen users may be used. Succe~sive ones of the users are 1 32~ ~7~i de6ign~ted as ~elected use~ wh~le the remainder of the ~ub~et are deslqnated as recommending user6.
The recommend~ng u6ers are ranked by order of ~greement scalar, 6tep 92. ~ach recommending user i6 then utilized to adjust the previou61y e tabll~hed predicted ratings for tbe selected user, loop ~ A recommendation-fractlon i8 defined for the agreement Ecalar of the first recommending user, step 94. It i8 desirable to rank the recommending person6 by ascending order of agreement scalar and in that order as6igning to the ranked predicting person~ progres6ively larger weighting values. In one embodiment, for the fourth highest agreement 6calar a recommendation-fraction of 1/16 is defined, for the third highest a recommendation fraction of 1/8 is defined, for the second highest a recommendation-fraction of 1/4 i defined, and for the highest a recommendation-fraction of 1/2 is defined.
All other agreement scalars are assigned a value of zero or their recon,mendation-fraction. The lists of items for the recommending user and the selected user are matched to identify, step 96, items 6a~pled by the recommending user but not by the selected user. Each identifying item is analy2ed in loop 98 in which the difference between ratings is determined, the recommendation-fraction and the difference are combined, and the rating is adjusted by the combination, steps 100, 102, 104, respectively. When the recommendation-fraction has been combined with the difference for each item including the last 1 3 2 4 ~ 7 ) ldentified item, 6tep 106, the next recommending u~er 18 selected, ~tep 108.
In one embodiment, a difference between the ratinqs 18 determined by subtracting the prevlou~ly estlmated rat1ng of the selected user from the actual eating of the recommending user.
The difference i8 then multiplled by the recommendation-fraction to obtain an adjustment, and the adjustment $6 added to the previou61y e6timated rating. When the recommending user6 are ranked in order of lowest to highest agreement scalar, the relative adjustment accorded by the recommending user with the highest scalar i~ enhanced. That is, his weighting effect is not diluted by later adjustments from less appropriate recommending users.
While the terms ~person~ and ~user~ as used above refer to a human being, the terms are used in their broadest sense to refer to any entity which exhibits a subjective but not random reaction to an item. The above-de6cribed sy~tem and method of operation according to the present invention similarly apply to more than movieæ, record albums, computer games, ol other consumer items. For example, reaction6 can be predicted for travel destination~, hotels, restaurants, or career6. Further, predlctions among categories can be accomplished, e.g., recommending books based on the ratings of movies. The system and method according to this invention are particularly useful for items which have significance in and of themselves to people, that is, predicting the reactions of people to the items ., 1324~7r~
benefits the people in optimally d~rectlng their lnve~ment of time and money ln choosing and 6ampling itecs.
Although sp4eific feature6 of the lnvention ale 6hown ln some drawing6 and not other~, thls i6 for convenience only a~
each feature ~ay be combined with any or all of the other feature6 in accoraance with the invention.
Other embodi~ent6 will occur to tho6e skilled in the art and are with$n the following claim6:
What i6 claimed i6:
Applicants John B. ~ey Fors System ~nd Method of Predictlng SubjectlYe ~eactlons ~=
Th~ invention relate~ to a system and method of predicting reactions to itemfi not yet ~ampled by a user, and more particularly to 6uch a system and method which adjust the reaction prediction for each unsampled item for that user based on the similarity in reaction of other user6 relative to that user.
BACRGROI~ND OP INVENTIOl~
There are a number of situations in which it is helpful to predict the reactions of people to items they have not yet had the opportunity to sample. It is particularly useful to make recommendations for items to which people have wholly subjective reactions and which require a substantial investment of time or money to review, such ac movies, books, mu~ic, and games.
Difficulty arises because the actual reaction of a person to such an item can only be determined after money and time are invested in sampling the item.
The desirability of making recommendations for cubjectively appreciated item~ is evidenced by the prevalence of movie critics, book reviewers, and other critics who attempt to appraise such items. ~owever, the uniqueness of each item ~32~
hinde~6 objective compari~on of the items relative to the re~ponse they will eliclt from each lndivldual. Short ~ynopses or reviews are of limited value bec~use the actual 6atisfactlon of an indlvldual depend6 upon hl6 reactlon to the entire rendition of the item. For example, book6 or mov~es with very similar plots can differ widely in style, pace, mood, and other characteristic6. Moreover, knowledge beforehand of the plot or content can lessen enjoyment of the item.
It is common to 6tudy the advice of profes~ional critics, but it is difficult at best to find a critic whose taste matches the taste of a particular individual. U~ing a combination of critics provides more information, but correctly combining and interpreting multiple opinions to extract useful advice i~ quite difficult. Even if a satisfactory combination is achieved, the opinion~ of profes6ional critics frequently change over time as the critics lose their enthusiasm or become overly sophisticated.
Public opinion poll~ attempt to discern the average or majority opinion on particular topics, particularly for current events, but by their nature the polls are not tailored to the subjectlve opinions of any one person. Poll~ draw from a large amount of data but are not capable of responding to the subjective nature of a particular individual.
All of the above techniques requlre research by an individual, and the research is time consuming and often applied to out-of-date material. An individual is provided little help ~ 32~7~
in making an opt~mal choice from a l~rge ~et of largely unknown item6.
~UMMARY OF INVENTION
It is therefore an object of this invent~on to provide a system and method which automatically and accurately pred~ct the subjective reaction of a person to ~tems not yet ~ampled by that person.
It i~ a further object of this invention to provide such a system and method which draw upon the experience of a group of people and selectively weight the reactions of the group to make accurate predictions for any person within the group.
It is a further object of this invention to provide such a system and ~ethod which can repeatedly update the predictions for each person as the experience of the group increases.
Yet another obiect of this invention is to provide a system and method which can evaluate a large number of items and accurately supply an individual with a list of recommendations tailored for that individual.
It i8 i further object of this invention to provide such a system and method which can identify items already sampled and prevent accidental repetition of sampled items.
A still further object of thi6 invention is to provide such a system and method which require little time or effort on the part of each person in a group to obtain accurate recommendations.
~32~rl -' Another object of thi~ invention ifi to p~ovide such a sy~tem ~nd method whlch readily a6 imilate a new person or ltem and rapidly attain a u eful level of predlct~billty for each.
Thi8 ~nvention regult6 from the realization that truly effective prediction of subject1ve reactions, of one or more person~ selected from a group of persons, to unsampled items 6uch as movies, books or mu~ic; can be ach~eved by defining a scalar rating to represent the reaction of the selected person to each sampled item, successively pairing each selected person with other persons in the group to determine the difference in ratings for items sampled by both members of the pair, designating one or more of the other persons as predicting persons, assigning a weighting value to each of the predicting persons, and applying the weighting values to update the ratings previously predicted for each item unsampled by the selected person.
This invention features a method of predicting, for a user selected from a group of users, the reactions of the selected user to items sampled by one oe ~ore user~ in the group but not sampled by that user. The predictions are based on other items previously sampled by that user. A scalar rating is defined for each item sampled by the ~elected user to represent the reaction of the selected user to that ite~. The selected user is successively paired with other users in the group who have defined scalar ratings for at least some of the items sampled by the selected user to determine the overall difference in ratings 132~6 ~
for ~tems ~mpled by both me~bers of each succe86i~e pair. One or more of the other user~ are deslgnated a8 pred~cting user6 and a weighting value i~ assigned to each of the predictlng users based on the over~ll difference in rat~ngs between th~t predicting user and the selected user. Items un6ampled by the ~elected user are identif~ed and the weighting values are applied to proportionally alter the difference between a rating previou~ly predicted for each identified item and any actual ratings of that item by the predicting users to adjust the reaction pred~ctions for the selected user.
In one embodiment, successively pairing includes generating for each pair an agreement scalar representing the overall rating difference between the members of that pair, and the weighting value is obtained for each of the predicting users by converting the agreement scalar into the weighting value.
Pairing further includes successively matching, for each pair, items sampled by both members and, for each matched item, subtractinq the ratings of one member from the ratings of the other to obtain the difference in ratings. The difference in ratings for each ~atched item is converted to a closeness value and ~ummed with other closeness value~ for that pair. The sum of the closeness values is weighted by the number of items sampled by both members to generate the agreement scalar.
In another embodiment, designating and converting includes defining a greater weighting value for predicting users havinq a larger agreement scalar and defining a lesser weighting value ~324~
for predlctlng u~er6 having ~ smaller agree~ent Bcalar. The design~ting ~nd converting may ~nclude ranking the predlct$ng u6ers by sscending order of agreement scalar and defining 6uccessively larger weighting values for the ascending agreement scalar~. Identifying and applying includes combining tbe weight$ng value for each predictln~ user wlth the difference between ratings by that predicting user and by the selected user for each ~dentified item, and summing the combination with the previously predicted rating. The pairing may include successively pairing the selected users with each other user in the group or with a subset of other users in the group~ The re~ainder of the users in the group may be successively selected to adjust the reaction predictions for each user in the group.
This invention also features a method of selectively recommending, or disrecommendinq, for each user successively selected from a group of users, items not sampled by the selected u&er. The method includes defining a scalar rating for each sampled item, successively pairing the selected user with other users in the group, generating for each pair an agreement scalar, designating at least one of the other users as recommending users, converting the agreement scalar for each of the recommending use~C into a reco~mendation-fraction, identifying items unsampled by the selected user, and applying the recommendation-fractions to proportionally decrease the difference between a rating previously establi~hed for each identified item and the ratings of that item by the recommending i32~6~
user6 to ad~u6t the recommendations or th~ selected user. The method further includes ~uccesslvely 6electing the remainder of the u~er6 in the group to adju6t the recommendat~ons for e~ch user in the group and presenting, for each user, a plurallty of items based on the recommendation6 for that user.
Thi~ invention further features a sy6te~ for predicting the reaction to items, including means for defining a ~calar rating, means for succe~sively pairing the selected user with other users in the group to determine the difference in ratings, means for de ignating at least one of the other users as a predicting user, and means for assigning a weighting value to each of the predicting usets based on the difference in ratings between that predicting user and the selected user. The system further includes means for applying the weighting Yalues to items unsampled by the selected ucer to proportionally alter the difference between a rating previously predicted for each identified item and any actual rating of that item by the predicting user6 to adjust the reaction predictions for the selected user.
~OSURE OF PREFERRED EM80D.I~.E;NT
Other objects, features and advantages ~ill occur from the following description o a preferred embodi~ent and the accompanying drawings, in which:
Fig. 1 i6 a schematic block diagram of a system according to thi6 invention~
~ 3 2 ~ ~ 7 ~
Fig. 2 i~ a flow chart of the use of the ~yste~ of ~ig. 1 by a u~er~
Fig. 3 i6 a flow chart of the oper~tion of the ~ystem of Fig. 1 for each u6er ~elected to be updated~
Fig. ~ i8 ~ nore det~led flow chart of the p~iring of user6 to determine the difference in rating~ and to generate an agreement scalar; and Fig. S is ~ flow chart of the conver~ion of the agreement scalar to a recommendation-fraction and subsequent adjustment of the previously established rating of the selected person.
This invention may be accomplished by a ~ystem which predicts the reaction of a person selected from a group of persons to items not sampled by the selected person. Th e selected person designates, for each item sampled by the selected person, 2 scalar rating representing the reaction of the selected person to that item. The system ~uccessively pairs the selected person with other persons in the group who have defined scalar ratings for at least some of the items also sampled by the selected person to determine the difference in rating6 for items sampled by both members of each successive pair. The 6ystem further designates one or more of the other persons as a predicting person and assigns a weighting value to each of the predicting per~ons based on the difference in ratings between that predicting person and the selected person.
The weight;ng value i8 applied to items unsampled by the 324~7~rj ~elected person to proport~on~lly alter the difference between the ratlng prevlou ly pcedicted for the ~elected per~on for each unsampled item and the r~tlngs of that item by the predlctlng persons to ~d~ust the overall reaction predictions for the selected person.
Sy~tem 10 according to this invention, Pig. 1, lncludes keyboard 12 through which users of ~ystem 10 enter scalar rating~ for items they have sampled. The ratings are ~tored in memory 14 and are selectively retrieved by pairinq module 16 which, for each per~on for which a prediction is desired, pairs that person with a number of other persons who have previously entered scalar ratings.
A value for each pair representing the difference in ratings for items sampled by both ~ember~ of each successive pair is provided to weighting module I8. For persons designated as predicting person~ for the selected person, as described in more detail below, a weighting value i~ assigned based on the difference in rating~ between that predicting person and the selected person. The weighting values are provided to prediction adju~tment module 20 which applies the weighting values to items unsampled by the selected person to proportionally alter the difference between a rating previously predicted for the selected person for each unsampled item and the ratings of that item by the predicting persons. The rating previously predicted for each un~ampled item represents the predicted reaction of the selected person to the up-to-now -- 132~7r;
un~ampled ~tem. After ~djustment, the ratings are provided to ~emory 1~ ~hich, when re~ue~ted by ~ user, supplles to display 22 a list of u~ually the most highly recommended items for that user. Altern~t$vely, another list ba~ed on the recommendationg i8 provided 6uch a~ a list of tho most highly disrecommended items.
The interface between the user and ~ystem 10 i6 illustrated in Fig. 2. The user enter6 a pa~sword, step 30, and then decides to rate an item, such as a movie, step 32. To rate an item, the name of the item, such as the title of a movie, is entered into the system, ~tep 34. If the item has been previously sampled, step 36, his previous actual rating of it is displayed, step 38. Regardless of whether the item has been actually rated, the user is allo~ed to adju~t the rating, steps 40 and ~2. Increasing the number of items actually sampled and rated increases the accuracy of reaction predictions made for other items a~ explained in greater detail below.
Tn one construction, the scalar ratings are integers ranging from O to 12, with 0~ representing a reaction of ~pooc~, '3~ representing the reaction of 'fair~, ~6~
corresponding to a reaction of ~good~, ~9~ representing the reaction of ~very good~, and ~12~ corresponding to a reaction of ~excellent~. Establishing a greater number of ratings than the above-listed five verbal descriptions provides more accurate rating of the reactions of the user.
- ~2~7~
After the r~ting i6 entered, or ~f adjustment ~8 decllned, the operatlon return6 to tep 32. If rating of an ltem i6 not selected, the u6er elects to view the mo6t current list of recommendation6, ~teps 44, ~6, or ex~t~ the sy~tem, step ~8.
The operation of sy~tem 10, Flg. 1, i~ summarized ln Fig.
3. Each user enters A Bcalar rating for each item sampled by that user, step S0. Each user i~ succe~sively paired, step S2, with a number of other userfi to determine the difference in rating~ for items sampled by both users. For each pair of users, an aqreement scalar i8 generated, step 54, to represent the overall rating difference between that pair of users. For each selected user, one or more of the other users are designated as recommending users, ~tep 56, who contribute to ratings used to make recommendations for items to be sampled.
The agreement scalar for each recommending user is then converted into a recommendation-fraction, step 58, which i~ then applied to reduce the difference between the rating previously estimated for each unsampled item and the actual ratings of that item by the recommending users, ~tep 60. The recon,mendation-fraction is typically a fraction ranqing from zero to one.
The pairing of users to determine the difference in ratings and to generate an agreement scalar is shown in more detail in Fig. ~. For each pair of users, the item is set to first item, step 70, and loop 72 is entered until each of all 1 3 2 4L ~ ~ ~r pos6~ble item h~s been examined. The lte~ ls rec~lled, step 7~, and the ~tem~ for both members of the p~ir are Datched to ee lf that ~tem wa~ sampled by both me~bers, ~tep 76. A numb~r of rating6 for movles are provided ~6 an e~ample in Table Is ~LE Is RA~I~Ç~
Movie ~itle Smit~ Jones Wesso~
Star War~ 8 11 10 ~he Untouchables 10 9 4 Beverly ~ills Cops - 10 10 Fletch 10 - g Caddyshack 7 - 11 qhe rating difference is determined, step 78, and a closeness value is obtained for that difference, step 80. In one construction, the closeness value is obtained from a look-up table such as Table II:
132~7v WLE I I: I~Ti NG ~0 C~LOSE~ SS-VAhyE
jf~4 C~oliene6B V~l o 10 Step 80 provides a weighting step in which large difference~ in ratings are penalized and similarities are rewarded. In other constructions, the unaltered differences themselves are used.
In yet other embodiment~, ratios or item-specific probabilities of the differences may be compared, or agreement by types or categories of items may be utilized.
In this embodiment, the clo~ene6s-value i8 added to ~
running total, step 82, and the count of ite~ sampled by both members is incremented, step 8~. After the last item has been processed, step 86, an aqreemert ~calar is generated, step 88, 132467r for that palr of user6. ~he agreement scalar may be gener~ted by the use of the followlng equations AS - (CV~) ~2n-1)/n2 ~1) where AS i8 the agreement scalar, CVT i6 the closeness-value total, and n i6 the count o items sampled by both users. By the example provided in Tablç~ I and II, Smith and Jone~ have sampled two items in common having a difference in ratings of 3 and 1, respectively, which are assigned closeness values of 4 and 9, respectively. By application of equation (1), the agreement scalar for Smith and Jones is 9.75. Similarly, the closeness-value for the pair of Smith and Wesson is 17 and the agreement scalar is 7.44. The difference in reaction of Smith and Wesson to ~The Untoucbables~ and ~Caddyshack~ led to the smaller agreement scalar between those users. It is evident that the greater the number of items that the users have sampled, the more accurate the agree~ent scalar will be for each of the users with which the selected user i8 paired.
The conversion of the agreement scalar to a weighting value, referred to as a recommendation-fraction, and ad~ustment of the previously establi~hed ratings i6 shown in Fig. 5. One or more recommending users are designated, step 90, from the group of users. ~f the number of users is small, the entire group may be used. Otherwise, a subset of the group, e.g.
sixteen users may be used. Succe~sive ones of the users are 1 32~ ~7~i de6ign~ted as ~elected use~ wh~le the remainder of the ~ub~et are deslqnated as recommending user6.
The recommend~ng u6ers are ranked by order of ~greement scalar, 6tep 92. ~ach recommending user i6 then utilized to adjust the previou61y e tabll~hed predicted ratings for tbe selected user, loop ~ A recommendation-fractlon i8 defined for the agreement Ecalar of the first recommending user, step 94. It i8 desirable to rank the recommending person6 by ascending order of agreement scalar and in that order as6igning to the ranked predicting person~ progres6ively larger weighting values. In one embodiment, for the fourth highest agreement 6calar a recommendation-fraction of 1/16 is defined, for the third highest a recommendation fraction of 1/8 is defined, for the second highest a recommendation-fraction of 1/4 i defined, and for the highest a recommendation-fraction of 1/2 is defined.
All other agreement scalars are assigned a value of zero or their recon,mendation-fraction. The lists of items for the recommending user and the selected user are matched to identify, step 96, items 6a~pled by the recommending user but not by the selected user. Each identifying item is analy2ed in loop 98 in which the difference between ratings is determined, the recommendation-fraction and the difference are combined, and the rating is adjusted by the combination, steps 100, 102, 104, respectively. When the recommendation-fraction has been combined with the difference for each item including the last 1 3 2 4 ~ 7 ) ldentified item, 6tep 106, the next recommending u~er 18 selected, ~tep 108.
In one embodiment, a difference between the ratinqs 18 determined by subtracting the prevlou~ly estlmated rat1ng of the selected user from the actual eating of the recommending user.
The difference i8 then multiplled by the recommendation-fraction to obtain an adjustment, and the adjustment $6 added to the previou61y e6timated rating. When the recommending user6 are ranked in order of lowest to highest agreement scalar, the relative adjustment accorded by the recommending user with the highest scalar i~ enhanced. That is, his weighting effect is not diluted by later adjustments from less appropriate recommending users.
While the terms ~person~ and ~user~ as used above refer to a human being, the terms are used in their broadest sense to refer to any entity which exhibits a subjective but not random reaction to an item. The above-de6cribed sy~tem and method of operation according to the present invention similarly apply to more than movieæ, record albums, computer games, ol other consumer items. For example, reaction6 can be predicted for travel destination~, hotels, restaurants, or career6. Further, predlctions among categories can be accomplished, e.g., recommending books based on the ratings of movies. The system and method according to this invention are particularly useful for items which have significance in and of themselves to people, that is, predicting the reactions of people to the items ., 1324~7r~
benefits the people in optimally d~rectlng their lnve~ment of time and money ln choosing and 6ampling itecs.
Although sp4eific feature6 of the lnvention ale 6hown ln some drawing6 and not other~, thls i6 for convenience only a~
each feature ~ay be combined with any or all of the other feature6 in accoraance with the invention.
Other embodi~ent6 will occur to tho6e skilled in the art and are with$n the following claim6:
What i6 claimed i6:
Claims (25)
1. A method of automatically predicting, for a user selec-ted from a group of users, the reactions of the selected user to items sampled by one or more users in the group but not sampled by the selected user, the reaction predictions being based on other items previously sampled by that user, comprising:
defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item;
successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to determine the difference in ratings for items sampled by both members of each successive pair;
designating at least one of the other users as a predicting user and assigning a weighting value to each of the predicting users based on the difference in ratings between that predicting user and the selected user; and applying the weighting values to items not yet sampled by the selected user to proportionally alter the difference between a rating previously predicted for each item not yet sampled by the selected user and the ratings of that item by the predicting users to adjust the reaction predictions for the selected user to more closely predict the actual reaction of the user to that item.
defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item;
successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to determine the difference in ratings for items sampled by both members of each successive pair;
designating at least one of the other users as a predicting user and assigning a weighting value to each of the predicting users based on the difference in ratings between that predicting user and the selected user; and applying the weighting values to items not yet sampled by the selected user to proportionally alter the difference between a rating previously predicted for each item not yet sampled by the selected user and the ratings of that item by the predicting users to adjust the reaction predictions for the selected user to more closely predict the actual reaction of the user to that item.
2. A method of using a computing device to automatically predict, for a user selected from a group of users, the reactions of the selected user to items sampled by one or more users in the group but not sampled by the selected user, the reaction predic-tions being based on other items previously sampled by that user, comprising:
defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item, the step of defining including entering, into an input device of the computing device, information representing the reaction of the selected user to items sampled by that user;
successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to determine the difference in ratings for items sampled by both members of each successive pair;
designating at least one of the other users as a predicting user and assigning a weighting value to each of the predicting users based on the difference in ratings between that predicting user and the selected user; and applying the weighting values to items not yet sampled by the selected user to proportionally alter the difference between a rating previously predicted for each item not yet sampled by the selected user and the ratings of that item by the predicting users to adjust the reaction predictions for the selected user to more closely predict the actual reaction of the user to that item.
defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item, the step of defining including entering, into an input device of the computing device, information representing the reaction of the selected user to items sampled by that user;
successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to determine the difference in ratings for items sampled by both members of each successive pair;
designating at least one of the other users as a predicting user and assigning a weighting value to each of the predicting users based on the difference in ratings between that predicting user and the selected user; and applying the weighting values to items not yet sampled by the selected user to proportionally alter the difference between a rating previously predicted for each item not yet sampled by the selected user and the ratings of that item by the predicting users to adjust the reaction predictions for the selected user to more closely predict the actual reaction of the user to that item.
3. The method of claim 2 in which pairing includes successively matching, for each pair, items sampled by both mem-bers and, for each matched item, comparing the ratings of one member from the rating of the other member to obtain the differ-ence in ratings.
4. The method of claim 3 in which pairing further includes converting, for each pair, the difference in ratings for each matched item to a closeness value, and combining the closeness values for the members of that pair.
5. The method of claim 4 in which pairing further includes weighting, for each pair, the combined closeness values by the number of items sampled by both members to generate the agreement scalar.
6. The method of claim 2 in which designating and convert-ing included defining a greater weighting value for predicting users having a larger agreement scalar and defining a lesser weighting value for predicting users having a smaller agreement scalar.
7. The method of claim 2 in which designating and convert-ing includes ranking the predicting users by ascending order of agreement scalar and in that order assigning to the ranked predicting users progressively larger weighting values.
8. The method of claim 2 in which applying includes combin-ing the weighting value for each predicting user with the differ-ence between the actual rating by that predicting user and the previous predicted rating by the selected user for each unsampled item, and summing the combination with the previously predicted rating.
9. The method of claim 2 in which pairing includes successively pairing the selected user with each other user in the group.
10. The method of claim 2 in which pairing includes defining a subset of other users in the group to be successively paired with the selected user.
11. The method of claim 2 further including successively selecting the remainder of the users in the group to adjust the reaction predictions for each user in the group.
12. A method of selectively recommending, for each user succesively selected from a group of users, items sampled by one or more users in the group but not yet sampled by the selected user, the recommendations being based on other items previously sampled by that user and being represented by a scalar rating for each item, the method comprising:
defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item;
successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to determine the difference in ratings for items sampled by both members of each successive pair;
generating for each pair an agreement scalar representing the overall rating agreement between the members of that pair;
designating at least one of the other users as recommending users;
converting, for each of the recommending users, the associa-ted agreement scalar into a recommendation-fraction;
identifying items not yet sampled by the selected user;
establishing an initial scalar rating for each identified item for the selected user;
applying the recommendation-fractions to proportionally decrease the difference between one of the initial scalar rating for each identified item and a scalar rating previously establi-shed for each identified item for the selected user and the actual ratings of that item by the recommending users to adjust the recommendations for the selected user;
successively selecting the remainder of the users in the group to adjust the recommendations for each user in the group by the above-recited steps; and presenting, for each user, a plurality of items based on the recommendations for that user.
defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item;
successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to determine the difference in ratings for items sampled by both members of each successive pair;
generating for each pair an agreement scalar representing the overall rating agreement between the members of that pair;
designating at least one of the other users as recommending users;
converting, for each of the recommending users, the associa-ted agreement scalar into a recommendation-fraction;
identifying items not yet sampled by the selected user;
establishing an initial scalar rating for each identified item for the selected user;
applying the recommendation-fractions to proportionally decrease the difference between one of the initial scalar rating for each identified item and a scalar rating previously establi-shed for each identified item for the selected user and the actual ratings of that item by the recommending users to adjust the recommendations for the selected user;
successively selecting the remainder of the users in the group to adjust the recommendations for each user in the group by the above-recited steps; and presenting, for each user, a plurality of items based on the recommendations for that user.
13. The method of claim 12 in which pairing includes successively matching, for each pair, items sampled by both members and, for each matched item, comparing the rating of one member with the rating of the other member to obtain the difference in ratings.
14. The method of claim 13 in which pairing further includes converting, for each pair, the difference in ratings for each matched item to a closeness value, and combining the closeness values for the members of that pair.
15. The method of claim 14 in which pairing further includes weighting, for each pair, the combined closeness values by the number of items sampled by both members to generate the agreement scalar.
16. The method of claim 15 in which designating and convert-ing includes sorting the recommending users by ascending order of agreement scalar and in that order assigning to the ranked predicting users progressively larger weighting values.
17. The method of claim 16 in which applying includes combining the weighting fraction for each recommending user with the difference between the actual rating by that recommending user and the previous predicted rating by the selected user for each identified item, and summing the combination with the previously established rating.
18. The method of claim 17 further including initially set-ting the established rating for each unsampled item for each selected user to a low rating value.
19. A system for predicting, for a user selected from a group of users, the reactions of the selected user to items sampled by one or more users in the group but not sampled by the selected user, the predictions being based on other items previously sampled by that user, comprising:
means for defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item, said means for defining including input means for entering information representing the reaction of the selected user to items sampled by that user;
means for successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to deter-mine the difference in ratings for items sampled by both members of each successive pair;
means for designating at least one of the other users as a predicting user and assigning a weighting value to each of the predicting users based on the overall difference in ratings between that predicting user and the selected user; and means for applying the weighting values to items not yet sampled by the selected user to proportionally alter the differ-ence between a rating previously predicted for each item not yet sampled by the selected user and the ratings of that item by the predicting users to adjust the reaction predictions for the selec-ted user to more closely predict the actual reaction of the user to that item.
means for defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item, said means for defining including input means for entering information representing the reaction of the selected user to items sampled by that user;
means for successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to deter-mine the difference in ratings for items sampled by both members of each successive pair;
means for designating at least one of the other users as a predicting user and assigning a weighting value to each of the predicting users based on the overall difference in ratings between that predicting user and the selected user; and means for applying the weighting values to items not yet sampled by the selected user to proportionally alter the differ-ence between a rating previously predicted for each item not yet sampled by the selected user and the ratings of that item by the predicting users to adjust the reaction predictions for the selec-ted user to more closely predict the actual reaction of the user to that item.
20. A computing device for predicting, for a user selected from a group of users, the reactions of the selected user to items sampled by one or more users in the group but not sampled by that user, the prediction being based on other items previously sampled by that user, comprising:
means for defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item, said means for defining including input means for entering information representing the reaction of the selected user to items sampled by that user;
means for successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to deter-mine the difference in rating for items sampled by both members of each successive pair, said means for pairing including means for generating for each pair an agreement scalar representing the overall rating difference between the members of that pair;
means for designating at least one of the other users as a predicting user and for converting, for each of the predicting users, the agreement scalar into a weighing fraction;
means for establishing an initial scalar rating for each identified item for the selected user; and means for identifying items not yet sampled by the selected user and applying the weighting values to items not yet sampled by the selected user to proportionally alter the difference between one of the initial scalar rating for each identified item and a rating previously predicted for each identified item and the ratings of that item by the predicting users to adjust the reac-tion predictions for the selected user to more closely predict the actual reaction of the user to that item.
means for defining, for each item sampled by the selected user, a scalar rating representing the reaction of the selected user to that item, said means for defining including input means for entering information representing the reaction of the selected user to items sampled by that user;
means for successively pairing the selected user with other users in the group for whom have been defined scalar ratings for at least some of the items sampled by the selected user to deter-mine the difference in rating for items sampled by both members of each successive pair, said means for pairing including means for generating for each pair an agreement scalar representing the overall rating difference between the members of that pair;
means for designating at least one of the other users as a predicting user and for converting, for each of the predicting users, the agreement scalar into a weighing fraction;
means for establishing an initial scalar rating for each identified item for the selected user; and means for identifying items not yet sampled by the selected user and applying the weighting values to items not yet sampled by the selected user to proportionally alter the difference between one of the initial scalar rating for each identified item and a rating previously predicted for each identified item and the ratings of that item by the predicting users to adjust the reac-tion predictions for the selected user to more closely predict the actual reaction of the user to that item.
21. A method of using a computing device to automatically update, for a user selected from a group of users, estimated scalar ratings for items sampled by one or more users in the group but not yet sampled by the selected user to more closely predict the reaction of the selected user to the not-yet-sampled items, the method comprising:
defining, for each item sampled by the selected user, an actual scalar rating representing the actual reaction of the selected user to that item, the step of defining including enter-ing, into an input device of the computing device, information representing the reaction of the selected user to items sampled by that user;
defining, for each item sampled by other users in the group, an actual scalar rating representing the actual reaction of each user to that item, including entering into the input device information representing the reaction of the other users to items sampled by each user;
successively pairing the selected user with other users in the group for whom have been defined actual scalar ratings for at least some of the items sampled by the selected user to determine the difference in actual ratings for items sampled by both members of each successive pair;
designating a plurality of the other users as updating users and assigning a weighting value to each of the updating users based on the difference in actual ratings between that updating user and the selected user;
establishing an initial estimated rating for items not yet sampled by the selected user; and applying the weighting values, for items not yet sampled by the selected user, to proportionally alter the difference between one of (a) the initial estimated rating for each item not yet sampled and (b) and estimated rating previously updated for each item not yet sampled by the selected user and the actual ratings of that item by the updating users to adjust the estimated ratings for the selected user to more closely predict the actual reaction of the user to that item.
defining, for each item sampled by the selected user, an actual scalar rating representing the actual reaction of the selected user to that item, the step of defining including enter-ing, into an input device of the computing device, information representing the reaction of the selected user to items sampled by that user;
defining, for each item sampled by other users in the group, an actual scalar rating representing the actual reaction of each user to that item, including entering into the input device information representing the reaction of the other users to items sampled by each user;
successively pairing the selected user with other users in the group for whom have been defined actual scalar ratings for at least some of the items sampled by the selected user to determine the difference in actual ratings for items sampled by both members of each successive pair;
designating a plurality of the other users as updating users and assigning a weighting value to each of the updating users based on the difference in actual ratings between that updating user and the selected user;
establishing an initial estimated rating for items not yet sampled by the selected user; and applying the weighting values, for items not yet sampled by the selected user, to proportionally alter the difference between one of (a) the initial estimated rating for each item not yet sampled and (b) and estimated rating previously updated for each item not yet sampled by the selected user and the actual ratings of that item by the updating users to adjust the estimated ratings for the selected user to more closely predict the actual reaction of the user to that item.
22. The method of claim 12 in which presenting includes providing a listing of a limited number of highly recommended items not yet sampled by the selected user.
23. The method of claim 12 in which establishing includes providing a low scalar rating value as the initial scalar rating.
24. The computing device of claim 20 in which said means for establishing establishes said initial scalar rating based on information entered through said input means.
25. The computing device of claim 20 in which said means for establishing includes memory for storing said initial scalar rating.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US07/103,848 US4870579A (en) | 1987-10-01 | 1987-10-01 | System and method of predicting subjective reactions |
CA000609923A CA1324675C (en) | 1987-10-01 | 1989-08-30 | System and method of predicting subjective reactions |
US07/411,857 US4996642A (en) | 1987-10-01 | 1989-09-25 | System and method for recommending items |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US07/103,848 US4870579A (en) | 1987-10-01 | 1987-10-01 | System and method of predicting subjective reactions |
CA000609923A CA1324675C (en) | 1987-10-01 | 1989-08-30 | System and method of predicting subjective reactions |
Publications (1)
Publication Number | Publication Date |
---|---|
CA1324675C true CA1324675C (en) | 1993-11-23 |
Family
ID=25672990
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA000609923A Expired - Lifetime CA1324675C (en) | 1987-10-01 | 1989-08-30 | System and method of predicting subjective reactions |
Country Status (2)
Country | Link |
---|---|
US (1) | US4870579A (en) |
CA (1) | CA1324675C (en) |
Families Citing this family (190)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4996642A (en) * | 1987-10-01 | 1991-02-26 | Neonics, Inc. | System and method for recommending items |
US8352400B2 (en) | 1991-12-23 | 2013-01-08 | Hoffberg Steven M | Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore |
US7242988B1 (en) * | 1991-12-23 | 2007-07-10 | Linda Irene Hoffberg | Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore |
USRE47908E1 (en) | 1991-12-23 | 2020-03-17 | Blanding Hovenweep, Llc | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
USRE48056E1 (en) | 1991-12-23 | 2020-06-16 | Blanding Hovenweep, Llc | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
USRE46310E1 (en) * | 1991-12-23 | 2017-02-14 | Blanding Hovenweep, Llc | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
CA2084443A1 (en) * | 1992-01-31 | 1993-08-01 | Leonard C. Swanson | Method of item selection for computerized adaptive tests |
GB9222884D0 (en) * | 1992-10-30 | 1992-12-16 | Massachusetts Inst Technology | System for administration of privatization in newly democratic nations |
US6323894B1 (en) | 1993-03-12 | 2001-11-27 | Telebuyer, Llc | Commercial product routing system with video vending capability |
US20030185356A1 (en) | 1993-03-12 | 2003-10-02 | Telebuyer, Llc | Commercial product telephonic routing system with mobile wireless and video vending capability |
US5495284A (en) | 1993-03-12 | 1996-02-27 | Katz; Ronald A. | Scheduling and processing system for telephone video communication |
US5583763A (en) * | 1993-09-09 | 1996-12-10 | Mni Interactive | Method and apparatus for recommending selections based on preferences in a multi-user system |
US5758257A (en) * | 1994-11-29 | 1998-05-26 | Herz; Frederick | System and method for scheduling broadcast of and access to video programs and other data using customer profiles |
US6460036B1 (en) | 1994-11-29 | 2002-10-01 | Pinpoint Incorporated | System and method for providing customized electronic newspapers and target advertisements |
US5749081A (en) * | 1995-04-06 | 1998-05-05 | Firefly Network, Inc. | System and method for recommending items to a user |
US6769128B1 (en) | 1995-06-07 | 2004-07-27 | United Video Properties, Inc. | Electronic television program guide schedule system and method with data feed access |
US6041311A (en) * | 1995-06-30 | 2000-03-21 | Microsoft Corporation | Method and apparatus for item recommendation using automated collaborative filtering |
US6092049A (en) * | 1995-06-30 | 2000-07-18 | Microsoft Corporation | Method and apparatus for efficiently recommending items using automated collaborative filtering and feature-guided automated collaborative filtering |
US6049777A (en) * | 1995-06-30 | 2000-04-11 | Microsoft Corporation | Computer-implemented collaborative filtering based method for recommending an item to a user |
WO1997006613A2 (en) * | 1995-08-09 | 1997-02-20 | British Telecommunications Public Limited Company | Programme selection means in a programme transmission and reception system |
AU1566597A (en) * | 1995-12-27 | 1997-08-11 | Gary B. Robinson | Automated collaborative filtering in world wide web advertising |
US5790426A (en) * | 1996-04-30 | 1998-08-04 | Athenium L.L.C. | Automated collaborative filtering system |
US6195657B1 (en) | 1996-09-26 | 2001-02-27 | Imana, Inc. | Software, method and apparatus for efficient categorization and recommendation of subjects according to multidimensional semantics |
US6108493A (en) * | 1996-10-08 | 2000-08-22 | Regents Of The University Of Minnesota | System, method, and article of manufacture for utilizing implicit ratings in collaborative filters |
US6016475A (en) * | 1996-10-08 | 2000-01-18 | The Regents Of The University Of Minnesota | System, method, and article of manufacture for generating implicit ratings based on receiver operating curves |
US5842199A (en) * | 1996-10-18 | 1998-11-24 | Regents Of The University Of Minnesota | System, method and article of manufacture for using receiver operating curves to evaluate predictive utility |
US5948061A (en) | 1996-10-29 | 1999-09-07 | Double Click, Inc. | Method of delivery, targeting, and measuring advertising over networks |
US6078740A (en) * | 1996-11-04 | 2000-06-20 | Digital Equipment Corporation | Item selection by prediction and refinement |
US6052122A (en) | 1997-06-13 | 2000-04-18 | Tele-Publishing, Inc. | Method and apparatus for matching registered profiles |
US6058367A (en) * | 1997-06-13 | 2000-05-02 | Tele-Publishing, Inc. | System for matching users based upon responses to sensory stimuli |
US7039599B2 (en) * | 1997-06-16 | 2006-05-02 | Doubleclick Inc. | Method and apparatus for automatic placement of advertising |
CN1941863B (en) | 1997-07-21 | 2011-06-29 | 骏升发展(美国)有限公司 | Method for displaying target advertisement to user in electronic program guide system |
US6782370B1 (en) * | 1997-09-04 | 2004-08-24 | Cendant Publishing, Inc. | System and method for providing recommendation of goods or services based on recorded purchasing history |
US6134532A (en) * | 1997-11-14 | 2000-10-17 | Aptex Software, Inc. | System and method for optimal adaptive matching of users to most relevant entity and information in real-time |
US6380950B1 (en) * | 1998-01-20 | 2002-04-30 | Globalstreams, Inc. | Low bandwidth television |
IL123129A (en) | 1998-01-30 | 2010-12-30 | Aviv Refuah | Www addressing |
IL125432A (en) * | 1998-01-30 | 2010-11-30 | Easynet Access Inc | Personalized internet interaction |
US20050203835A1 (en) * | 1998-01-30 | 2005-09-15 | Eli Nhaissi | Internet billing |
US7437313B1 (en) | 1998-03-11 | 2008-10-14 | West Direct, Llc | Methods, computer-readable media, and apparatus for offering users a plurality of scenarios under which to conduct at least one primary transaction |
US6055513A (en) | 1998-03-11 | 2000-04-25 | Telebuyer, Llc | Methods and apparatus for intelligent selection of goods and services in telephonic and electronic commerce |
US7386485B1 (en) | 2004-06-25 | 2008-06-10 | West Corporation | Method and system for providing offers in real time to prospective customers |
US8315909B1 (en) | 1998-03-11 | 2012-11-20 | West Corporation | Methods and apparatus for intelligent selection of goods and services in point-of-sale commerce |
US7364068B1 (en) | 1998-03-11 | 2008-04-29 | West Corporation | Methods and apparatus for intelligent selection of goods and services offered to conferees |
US6064980A (en) * | 1998-03-17 | 2000-05-16 | Amazon.Com, Inc. | System and methods for collaborative recommendations |
US6236980B1 (en) * | 1998-04-09 | 2001-05-22 | John P Reese | Magazine, online, and broadcast summary recommendation reporting system to aid in decision making |
US6275811B1 (en) | 1998-05-06 | 2001-08-14 | Michael R. Ginn | System and method for facilitating interactive electronic communication through acknowledgment of positive contributive |
JP3437445B2 (en) | 1998-05-22 | 2003-08-18 | 松下電器産業株式会社 | Receiving apparatus and method using linear signal prediction |
US6322368B1 (en) * | 1998-07-21 | 2001-11-27 | Cy Research, Inc. | Training and testing human judgment of advertising materials |
AU5234999A (en) * | 1998-08-03 | 2000-02-28 | Doubleclick Inc. | Network for distribution of re-targeted advertising |
US6898762B2 (en) | 1998-08-21 | 2005-05-24 | United Video Properties, Inc. | Client-server electronic program guide |
US6334131B2 (en) | 1998-08-29 | 2001-12-25 | International Business Machines Corporation | Method for cataloging, filtering, and relevance ranking frame-based hierarchical information structures |
US6356899B1 (en) | 1998-08-29 | 2002-03-12 | International Business Machines Corporation | Method for interactively creating an information database including preferred information elements, such as preferred-authority, world wide web pages |
US6266649B1 (en) * | 1998-09-18 | 2001-07-24 | Amazon.Com, Inc. | Collaborative recommendations using item-to-item similarity mappings |
US6317722B1 (en) | 1998-09-18 | 2001-11-13 | Amazon.Com, Inc. | Use of electronic shopping carts to generate personal recommendations |
US6487541B1 (en) * | 1999-01-22 | 2002-11-26 | International Business Machines Corporation | System and method for collaborative filtering with applications to e-commerce |
US7904187B2 (en) | 1999-02-01 | 2011-03-08 | Hoffberg Steven M | Internet appliance system and method |
US6249785B1 (en) | 1999-05-06 | 2001-06-19 | Mediachoice, Inc. | Method for predicting ratings |
KR100328670B1 (en) * | 1999-07-21 | 2002-03-20 | 정만원 | System For Recommending Items With Multiple Analyzing Components |
US6606624B1 (en) | 1999-08-13 | 2003-08-12 | The Regents Of The University Of California | Apparatus and method for recommending to an individual selective information contained within a computer network |
US7072863B1 (en) | 1999-09-08 | 2006-07-04 | C4Cast.Com, Inc. | Forecasting using interpolation modeling |
US7461058B1 (en) | 1999-09-24 | 2008-12-02 | Thalveg Data Flow Llc | Optimized rule based constraints for collaborative filtering systems |
US6681247B1 (en) | 1999-10-18 | 2004-01-20 | Hrl Laboratories, Llc | Collaborator discovery method and system |
US7630986B1 (en) | 1999-10-27 | 2009-12-08 | Pinpoint, Incorporated | Secure data interchange |
US6519648B1 (en) * | 2000-01-24 | 2003-02-11 | Friskit, Inc. | Streaming media search and continuous playback of multiple media resources located on a network |
US6389467B1 (en) | 2000-01-24 | 2002-05-14 | Friskit, Inc. | Streaming media search and continuous playback system of media resources located by multiple network addresses |
US7281034B1 (en) | 2000-01-24 | 2007-10-09 | Friskit, Inc. | System and method for media playback over a network using links that contain control signals and commands |
US6963848B1 (en) | 2000-03-02 | 2005-11-08 | Amazon.Com, Inc. | Methods and system of obtaining consumer reviews |
US7593863B1 (en) * | 2000-03-10 | 2009-09-22 | Smiths Detection Inc. | System for measuring and testing a product using artificial olfactometry and analytical data |
US6865546B1 (en) | 2000-04-19 | 2005-03-08 | Amazon.Com, Inc. | Methods and systems of assisting users in purchasing items |
US7010537B2 (en) * | 2000-04-27 | 2006-03-07 | Friskit, Inc. | Method and system for visual network searching |
US6892179B1 (en) * | 2000-06-02 | 2005-05-10 | Open Ratings Inc. | System and method for ascribing a reputation to an entity |
US6892178B1 (en) * | 2000-06-02 | 2005-05-10 | Open Ratings Inc. | Method and system for ascribing a reputation to an entity from the perspective of another entity |
US6895385B1 (en) * | 2000-06-02 | 2005-05-17 | Open Ratings | Method and system for ascribing a reputation to an entity as a rater of other entities |
US7526440B2 (en) * | 2000-06-12 | 2009-04-28 | Walker Digital, Llc | Method, computer product, and apparatus for facilitating the provision of opinions to a shopper from a panel of peers |
US7788123B1 (en) * | 2000-06-23 | 2010-08-31 | Ekhaus Michael A | Method and system for high performance model-based personalization |
US6895398B2 (en) | 2000-07-18 | 2005-05-17 | Inferscape, Inc. | Decision engine and method and applications thereof |
US6687696B2 (en) * | 2000-07-26 | 2004-02-03 | Recommind Inc. | System and method for personalized search, information filtering, and for generating recommendations utilizing statistical latent class models |
US6735568B1 (en) * | 2000-08-10 | 2004-05-11 | Eharmony.Com | Method and system for identifying people who are likely to have a successful relationship |
US6615208B1 (en) | 2000-09-01 | 2003-09-02 | Telcordia Technologies, Inc. | Automatic recommendation of products using latent semantic indexing of content |
WO2002021395A2 (en) * | 2000-09-06 | 2002-03-14 | Open Ratings, Inc. | Agents, system and method for dynamic pricing in a reputation-brokered, agent-mediated marketplace |
US7650304B1 (en) | 2000-09-08 | 2010-01-19 | Capital One Financial Corporation | Solicitation to web marketing loop process |
US7567916B1 (en) * | 2000-09-12 | 2009-07-28 | Capital One Financial Corporation | System and method for performing Web based in-view monitoring |
WO2002079901A2 (en) * | 2001-02-16 | 2002-10-10 | Bee-Bee, Inc. | Customer preference system |
US20020133404A1 (en) * | 2001-03-19 | 2002-09-19 | Pedersen Brad D. | Internet advertisements having personalized context |
US20020198882A1 (en) * | 2001-03-29 | 2002-12-26 | Linden Gregory D. | Content personalization based on actions performed during a current browsing session |
US7428496B1 (en) * | 2001-04-24 | 2008-09-23 | Amazon.Com, Inc. | Creating an incentive to author useful item reviews |
US7739162B1 (en) | 2001-05-04 | 2010-06-15 | West Corporation | System, method, and business method for setting micropayment transaction to a pre-paid instrument |
DE10154656A1 (en) | 2001-05-10 | 2002-11-21 | Ibm | Computer based method for suggesting articles to individual users grouped with other similar users for marketing and sales persons with user groups determined using dynamically calculated similarity factors |
US7295995B1 (en) * | 2001-10-30 | 2007-11-13 | A9.Com, Inc. | Computer processes and systems for adaptively controlling the display of items |
DE10247927A1 (en) * | 2001-10-31 | 2003-07-31 | Ibm | Improved procedure for evaluating units within a recommendation system based on additional knowledge of unit linking |
US7137070B2 (en) * | 2002-06-27 | 2006-11-14 | International Business Machines Corporation | Sampling responses to communication content for use in analyzing reaction responses to other communications |
US8495503B2 (en) * | 2002-06-27 | 2013-07-23 | International Business Machines Corporation | Indicating the context of a communication |
AU2003263928A1 (en) * | 2002-08-19 | 2004-03-03 | Choicestream | Statistical personalized recommendation system |
US7853684B2 (en) * | 2002-10-15 | 2010-12-14 | Sas Institute Inc. | System and method for processing web activity data |
US8306908B1 (en) | 2002-12-31 | 2012-11-06 | West Corporation | Methods and apparatus for intelligent selection of goods and services in telephonic and electronic commerce |
US8712857B1 (en) | 2003-03-31 | 2014-04-29 | Tuxis Technologies Llc | Methods and apparatus for intelligent selection of goods and services in mobile commerce |
US8140388B2 (en) * | 2003-06-05 | 2012-03-20 | Hayley Logistics Llc | Method for implementing online advertising |
US7885849B2 (en) | 2003-06-05 | 2011-02-08 | Hayley Logistics Llc | System and method for predicting demand for items |
US7685117B2 (en) * | 2003-06-05 | 2010-03-23 | Hayley Logistics Llc | Method for implementing search engine |
US7890363B2 (en) * | 2003-06-05 | 2011-02-15 | Hayley Logistics Llc | System and method of identifying trendsetters |
US8103540B2 (en) * | 2003-06-05 | 2012-01-24 | Hayley Logistics Llc | System and method for influencing recommender system |
US7689432B2 (en) * | 2003-06-06 | 2010-03-30 | Hayley Logistics Llc | System and method for influencing recommender system & advertising based on programmed policies |
US7836051B1 (en) | 2003-10-13 | 2010-11-16 | Amazon Technologies, Inc. | Predictive analysis of browse activity data of users of a database access system in which items are arranged in a hierarchy |
US7130777B2 (en) * | 2003-11-26 | 2006-10-31 | International Business Machines Corporation | Method to hierarchical pooling of opinions from multiple sources |
US7689452B2 (en) | 2004-05-17 | 2010-03-30 | Lam Chuck P | System and method for utilizing social networks for collaborative filtering |
US7178720B1 (en) | 2004-09-30 | 2007-02-20 | West Corporation | Methods, computer-readable media, and computer program product for intelligent selection of items encoded onto portable machine-playable entertainment media |
CA2582271A1 (en) * | 2004-09-30 | 2006-04-13 | Optionsxpress Holdings,Inc. | System and methods for prioritized management of financial instruments |
US7503477B2 (en) * | 2004-11-09 | 2009-03-17 | International Business Machines Corporation | Method for offering location-based targeted discounts without requirement for location sensing |
WO2006104534A2 (en) * | 2005-03-25 | 2006-10-05 | The Motley Fool, Inc. | Scoring items based on user sentiment and determining the proficiency of predictors |
US20060217994A1 (en) * | 2005-03-25 | 2006-09-28 | The Motley Fool, Inc. | Method and system for harnessing collective knowledge |
JP2008545200A (en) * | 2005-06-28 | 2008-12-11 | チョイスストリーム インコーポレイテッド | Method and apparatus for a statistical system for targeting advertisements |
US8285595B2 (en) * | 2006-03-29 | 2012-10-09 | Napo Enterprises, Llc | System and method for refining media recommendations |
US8903843B2 (en) * | 2006-06-21 | 2014-12-02 | Napo Enterprises, Llc | Historical media recommendation service |
US8805831B2 (en) * | 2006-07-11 | 2014-08-12 | Napo Enterprises, Llc | Scoring and replaying media items |
US9003056B2 (en) | 2006-07-11 | 2015-04-07 | Napo Enterprises, Llc | Maintaining a minimum level of real time media recommendations in the absence of online friends |
US8327266B2 (en) | 2006-07-11 | 2012-12-04 | Napo Enterprises, Llc | Graphical user interface system for allowing management of a media item playlist based on a preference scoring system |
US7970922B2 (en) * | 2006-07-11 | 2011-06-28 | Napo Enterprises, Llc | P2P real time media recommendations |
US7680959B2 (en) * | 2006-07-11 | 2010-03-16 | Napo Enterprises, Llc | P2P network for providing real time media recommendations |
US8059646B2 (en) | 2006-07-11 | 2011-11-15 | Napo Enterprises, Llc | System and method for identifying music content in a P2P real time recommendation network |
US8090606B2 (en) * | 2006-08-08 | 2012-01-03 | Napo Enterprises, Llc | Embedded media recommendations |
US8620699B2 (en) | 2006-08-08 | 2013-12-31 | Napo Enterprises, Llc | Heavy influencer media recommendations |
US8707160B2 (en) * | 2006-08-10 | 2014-04-22 | Yahoo! Inc. | System and method for inferring user interest based on analysis of user-generated metadata |
US20100004977A1 (en) * | 2006-09-05 | 2010-01-07 | Innerscope Research Llc | Method and System For Measuring User Experience For Interactive Activities |
US9514436B2 (en) | 2006-09-05 | 2016-12-06 | The Nielsen Company (Us), Llc | Method and system for predicting audience viewing behavior |
AU2007293092A1 (en) | 2006-09-05 | 2008-03-13 | Innerscope Research, Inc. | Method and system for determining audience response to a sensory stimulus |
US8874655B2 (en) * | 2006-12-13 | 2014-10-28 | Napo Enterprises, Llc | Matching participants in a P2P recommendation network loosely coupled to a subscription service |
US8175989B1 (en) | 2007-01-04 | 2012-05-08 | Choicestream, Inc. | Music recommendation system using a personalized choice set |
US20080194919A1 (en) * | 2007-02-08 | 2008-08-14 | Miranda Aref Farage | Method and apparatus for prediction and management of subjects and patients |
US8473345B2 (en) | 2007-03-29 | 2013-06-25 | The Nielsen Company (Us), Llc | Protocol generator and presenter device for analysis of marketing and entertainment effectiveness |
US9224427B2 (en) * | 2007-04-02 | 2015-12-29 | Napo Enterprises LLC | Rating media item recommendations using recommendation paths and/or media item usage |
US8112720B2 (en) | 2007-04-05 | 2012-02-07 | Napo Enterprises, Llc | System and method for automatically and graphically associating programmatically-generated media item recommendations related to a user's socially recommended media items |
US8392253B2 (en) | 2007-05-16 | 2013-03-05 | The Nielsen Company (Us), Llc | Neuro-physiology and neuro-behavioral based stimulus targeting system |
US8301623B2 (en) * | 2007-05-22 | 2012-10-30 | Amazon Technologies, Inc. | Probabilistic recommendation system |
US8839141B2 (en) | 2007-06-01 | 2014-09-16 | Napo Enterprises, Llc | Method and system for visually indicating a replay status of media items on a media device |
US9037632B2 (en) * | 2007-06-01 | 2015-05-19 | Napo Enterprises, Llc | System and method of generating a media item recommendation message with recommender presence information |
US8285776B2 (en) * | 2007-06-01 | 2012-10-09 | Napo Enterprises, Llc | System and method for processing a received media item recommendation message comprising recommender presence information |
US9164993B2 (en) * | 2007-06-01 | 2015-10-20 | Napo Enterprises, Llc | System and method for propagating a media item recommendation message comprising recommender presence information |
US20090049045A1 (en) | 2007-06-01 | 2009-02-19 | Concert Technology Corporation | Method and system for sorting media items in a playlist on a media device |
US8099315B2 (en) * | 2007-06-05 | 2012-01-17 | At&T Intellectual Property I, L.P. | Interest profiles for audio and/or video streams |
JP5542051B2 (en) | 2007-07-30 | 2014-07-09 | ニューロフォーカス・インコーポレーテッド | System, method, and apparatus for performing neural response stimulation and stimulation attribute resonance estimation |
US20090048992A1 (en) * | 2007-08-13 | 2009-02-19 | Concert Technology Corporation | System and method for reducing the repetitive reception of a media item recommendation |
US20090049030A1 (en) * | 2007-08-13 | 2009-02-19 | Concert Technology Corporation | System and method for reducing the multiple listing of a media item in a playlist |
US8386313B2 (en) | 2007-08-28 | 2013-02-26 | The Nielsen Company (Us), Llc | Stimulus placement system using subject neuro-response measurements |
US8392255B2 (en) | 2007-08-29 | 2013-03-05 | The Nielsen Company (Us), Llc | Content based selection and meta tagging of advertisement breaks |
US20090083129A1 (en) | 2007-09-20 | 2009-03-26 | Neurofocus, Inc. | Personalized content delivery using neuro-response priming data |
US8108255B1 (en) | 2007-09-27 | 2012-01-31 | Amazon Technologies, Inc. | Methods and systems for obtaining reviews for items lacking reviews |
US8001003B1 (en) | 2007-09-28 | 2011-08-16 | Amazon Technologies, Inc. | Methods and systems for searching for and identifying data repository deficits |
WO2009046224A1 (en) | 2007-10-02 | 2009-04-09 | Emsense Corporation | Providing remote access to media, and reaction and survey data from viewers of the media |
US20090094313A1 (en) * | 2007-10-03 | 2009-04-09 | Jay Feng | System, method, and computer program product for sending interactive requests for information |
WO2009059246A1 (en) | 2007-10-31 | 2009-05-07 | Emsense Corporation | Systems and methods providing en mass collection and centralized processing of physiological responses from viewers |
US7865522B2 (en) * | 2007-11-07 | 2011-01-04 | Napo Enterprises, Llc | System and method for hyping media recommendations in a media recommendation system |
US9060034B2 (en) * | 2007-11-09 | 2015-06-16 | Napo Enterprises, Llc | System and method of filtering recommenders in a media item recommendation system |
US9224150B2 (en) * | 2007-12-18 | 2015-12-29 | Napo Enterprises, Llc | Identifying highly valued recommendations of users in a media recommendation network |
US9734507B2 (en) * | 2007-12-20 | 2017-08-15 | Napo Enterprise, Llc | Method and system for simulating recommendations in a social network for an offline user |
US8396951B2 (en) | 2007-12-20 | 2013-03-12 | Napo Enterprises, Llc | Method and system for populating a content repository for an internet radio service based on a recommendation network |
US8117193B2 (en) | 2007-12-21 | 2012-02-14 | Lemi Technology, Llc | Tunersphere |
US8316015B2 (en) | 2007-12-21 | 2012-11-20 | Lemi Technology, Llc | Tunersphere |
US8060525B2 (en) | 2007-12-21 | 2011-11-15 | Napo Enterprises, Llc | Method and system for generating media recommendations in a distributed environment based on tagging play history information with location information |
US8725740B2 (en) | 2008-03-24 | 2014-05-13 | Napo Enterprises, Llc | Active playlist having dynamic media item groups |
US20090259621A1 (en) * | 2008-04-11 | 2009-10-15 | Concert Technology Corporation | Providing expected desirability information prior to sending a recommendation |
US8484311B2 (en) | 2008-04-17 | 2013-07-09 | Eloy Technology, Llc | Pruning an aggregate media collection |
US9501337B2 (en) | 2008-04-24 | 2016-11-22 | Adobe Systems Incorporated | Systems and methods for collecting and distributing a plurality of notifications |
US8484227B2 (en) | 2008-10-15 | 2013-07-09 | Eloy Technology, Llc | Caching and synching process for a media sharing system |
US8880599B2 (en) | 2008-10-15 | 2014-11-04 | Eloy Technology, Llc | Collection digest for a media sharing system |
US8589495B1 (en) | 2009-01-13 | 2013-11-19 | Adobe Systems Incorporated | Context-based notification delivery |
US8200602B2 (en) | 2009-02-02 | 2012-06-12 | Napo Enterprises, Llc | System and method for creating thematic listening experiences in a networked peer media recommendation environment |
US8577715B2 (en) * | 2009-02-27 | 2013-11-05 | Blackberry Limited | Pushed ringtones based on device-side content |
US20100250325A1 (en) | 2009-03-24 | 2010-09-30 | Neurofocus, Inc. | Neurological profiles for market matching and stimulus presentation |
US20110047213A1 (en) * | 2009-08-20 | 2011-02-24 | Alan David Manuel | Method and process for identifying trusted information of interest |
US10987015B2 (en) | 2009-08-24 | 2021-04-27 | Nielsen Consumer Llc | Dry electrodes for electroencephalography |
US20110066497A1 (en) * | 2009-09-14 | 2011-03-17 | Choicestream, Inc. | Personalized advertising and recommendation |
US9560984B2 (en) | 2009-10-29 | 2017-02-07 | The Nielsen Company (Us), Llc | Analysis of controlled and automatic attention for introduction of stimulus material |
US20110106750A1 (en) | 2009-10-29 | 2011-05-05 | Neurofocus, Inc. | Generating ratings predictions using neuro-response data |
WO2011133548A2 (en) | 2010-04-19 | 2011-10-27 | Innerscope Research, Inc. | Short imagery task (sit) research method |
WO2012173670A1 (en) * | 2011-06-13 | 2012-12-20 | United Video Properties, Inc. | Systems and methods for providing media recommendations |
US9015109B2 (en) | 2011-11-01 | 2015-04-21 | Lemi Technology, Llc | Systems, methods, and computer readable media for maintaining recommendations in a media recommendation system |
US9355366B1 (en) | 2011-12-19 | 2016-05-31 | Hello-Hello, Inc. | Automated systems for improving communication at the human-machine interface |
US9569986B2 (en) | 2012-02-27 | 2017-02-14 | The Nielsen Company (Us), Llc | System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications |
US9292858B2 (en) | 2012-02-27 | 2016-03-22 | The Nielsen Company (Us), Llc | Data collection system for aggregating biologically based measures in asynchronous geographically distributed public environments |
US9451303B2 (en) | 2012-02-27 | 2016-09-20 | The Nielsen Company (Us), Llc | Method and system for gathering and computing an audience's neurologically-based reactions in a distributed framework involving remote storage and computing |
US8769557B1 (en) | 2012-12-27 | 2014-07-01 | The Nielsen Company (Us), Llc | Methods and apparatus to determine engagement levels of audience members |
US9467718B1 (en) | 2015-05-06 | 2016-10-11 | Echostar Broadcasting Corporation | Apparatus, systems and methods for a content commentary community |
US9936250B2 (en) | 2015-05-19 | 2018-04-03 | The Nielsen Company (Us), Llc | Methods and apparatus to adjust content presented to an individual |
US10268689B2 (en) | 2016-01-28 | 2019-04-23 | DISH Technologies L.L.C. | Providing media content based on user state detection |
US10984036B2 (en) | 2016-05-03 | 2021-04-20 | DISH Technologies L.L.C. | Providing media content based on media element preferences |
US11196826B2 (en) | 2016-12-23 | 2021-12-07 | DISH Technologies L.L.C. | Communications channels in media systems |
US10390084B2 (en) | 2016-12-23 | 2019-08-20 | DISH Technologies L.L.C. | Communications channels in media systems |
US10764381B2 (en) | 2016-12-23 | 2020-09-01 | Echostar Technologies L.L.C. | Communications channels in media systems |
US11158204B2 (en) * | 2017-06-13 | 2021-10-26 | Cerego Japan Kabushiki Kaisha | System and method for customizing learning interactions based on a user model |
US11037550B2 (en) | 2018-11-30 | 2021-06-15 | Dish Network L.L.C. | Audio-based link generation |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2226078A5 (en) * | 1973-04-13 | 1974-11-08 | Sodema | |
US4041617A (en) * | 1976-07-26 | 1977-08-16 | James Fisher Hollander | Apparatus and method for indication and measurement of simulated emotional levels |
US4205464A (en) * | 1977-09-15 | 1980-06-03 | Baggott Patrick D | Apparatus and method for determining the extent of mutuality between partners |
US4348740A (en) * | 1978-04-04 | 1982-09-07 | White Edward A | Method and portable apparatus for comparison of stored sets of data |
FR2461302A1 (en) * | 1979-07-13 | 1981-01-30 | Lassays Yves | Calculating machine to analyse personality and predict future(s) - personal data is entered and predictions made by internal program using principles of 'numerology' |
US4646145A (en) * | 1980-04-07 | 1987-02-24 | R. D. Percy & Company | Television viewer reaction determining systems |
US4331973A (en) * | 1980-10-21 | 1982-05-25 | Iri, Inc. | Panelist response scanning system |
US4566030A (en) * | 1983-06-09 | 1986-01-21 | Ctba Associates | Television viewer data collection system |
US4658290A (en) * | 1983-12-08 | 1987-04-14 | Ctba Associates | Television and market research data collection system and method |
US4602279A (en) * | 1984-03-21 | 1986-07-22 | Actv, Inc. | Method for providing targeted profile interactive CATV displays |
US4630108A (en) * | 1984-03-26 | 1986-12-16 | A. C. Nielsen Company | Preprogrammed over-the-air marketing research system |
DE3529301A1 (en) * | 1984-08-28 | 1986-03-27 | Jost von Dr. Grüningen Fellenberg | Psychotechnical method and device for conducting the method |
JP2520588B2 (en) * | 1985-06-11 | 1996-07-31 | 橋本コーポレイション 株式会社 | Individual TV program guide creation device |
US4647964A (en) * | 1985-10-24 | 1987-03-03 | Weinblatt Lee S | Technique for testing television commercials |
US4682956A (en) * | 1985-11-27 | 1987-07-28 | Leonard Krane | Apparatus and method for learning about the relationships and personalities of a group of two or more persons |
US4781596A (en) * | 1986-06-16 | 1988-11-01 | Weinblatt Lee S | Survey technique for readership of publications |
-
1987
- 1987-10-01 US US07/103,848 patent/US4870579A/en not_active Expired - Lifetime
-
1989
- 1989-08-30 CA CA000609923A patent/CA1324675C/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
US4870579A (en) | 1989-09-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA1324675C (en) | System and method of predicting subjective reactions | |
US4996642A (en) | System and method for recommending items | |
US6195654B1 (en) | System and method for obtaining improved search results and for decreasing network loading | |
Aschenbrenner et al. | Stochastic choice heuristics | |
Wright et al. | State-of-mind effects on the accuracy with which utility functions predict marketplace choice | |
Lewis | Predicting hotel choice: The factors underlying perception | |
Stocking et al. | Methods of controlling the exposure of items in CAT | |
US20060015487A1 (en) | Method for determining compatibility | |
Beller et al. | Beauty and the labor market | |
Heckman et al. | The sensitivity of experimental impact estimates (evidence from the national JTPA study) | |
Fuld | A recipe for business intelligence success | |
Stanford | Predicting favorite TV program gratifications from general orientations | |
Cook et al. | R&D project selection in a multidimensional environment: A practical approach | |
Shapira et al. | Experimentation with an information filtering system that combines cognitive and sociological filtering integrated with user stereotypes | |
US20050125283A1 (en) | Methods for enhancing career analysis | |
Margolis et al. | Educational track, networks and labor market outcomes | |
Dustmann et al. | Inequality and immigration | |
Wehrung et al. | Adjusting risky situations: A theoretical framework and empirical test | |
Pham et al. | Labor markets during war time: Evidence from online job advertisements | |
Orvis et al. | Prospective outcome assessment for alternative recruit selection policies | |
US20020160338A1 (en) | Compatibility calculator and matchmaking by horoscope | |
Islam et al. | Men’s approval of family planning in Bangladesh | |
McManus et al. | Admission for medicine in the United Kingdom: a structural model of background factors | |
CN113986989A (en) | Form item recommendation method and device, computer equipment and storage medium | |
CN111708821A (en) | Method and device for determining personnel intimacy and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MKEX | Expiry |
Effective date: 20101123 |