CA2307264A1 - An interactive framework for understanding user's perception of multimedia data - Google Patents
An interactive framework for understanding user's perception of multimedia data Download PDFInfo
- Publication number
- CA2307264A1 CA2307264A1 CA002307264A CA2307264A CA2307264A1 CA 2307264 A1 CA2307264 A1 CA 2307264A1 CA 002307264 A CA002307264 A CA 002307264A CA 2307264 A CA2307264 A CA 2307264A CA 2307264 A1 CA2307264 A1 CA 2307264A1
- Authority
- CA
- Canada
- Prior art keywords
- intra
- user
- perception
- query
- relevance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99933—Query processing, i.e. searching
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99933—Query processing, i.e. searching
- Y10S707/99935—Query augmenting and refining, e.g. inexact access
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99941—Database schema or data structure
- Y10S707/99943—Generating database or data structure, e.g. via user interface
Abstract
A methodology of highly interactive intra-object relevance feedback is used to retrieve images from a database. The query is adjusted using the information fed-back by the user about the relevance of previously extracted part(s) from the object itself, such that the adjusted query is a better approximation to the user's perception. Since a single query image is utilized in the system according to the invention, high-performance learning techniques can be employed for this intra-object learning of user's perception. The refined query is subsequently used for intra-object relevance feedback where images are retrieved from the database based on parameters learnt by intra-image feedback mechanism, and the user provides feedback by ranking the retrieved objects in order of their relevance to him or her. In the system according to the invention, intra-object learning of user's perception is expedited by utilizing the learnt parameters in the intra-object relevance feedback.
Furthermore, the methodology of the invention allows for building refined queries based on part(s) of the query object rather than the entire object itself, thereby reducing the number of irrelevant objects, retrieved from the database.
Furthermore, the methodology of the invention allows for building refined queries based on part(s) of the query object rather than the entire object itself, thereby reducing the number of irrelevant objects, retrieved from the database.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/328,968 US6408293B1 (en) | 1999-06-09 | 1999-06-09 | Interactive framework for understanding user's perception of multimedia data |
US09/328,968 | 1999-06-09 |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2307264A1 true CA2307264A1 (en) | 2000-12-09 |
CA2307264C CA2307264C (en) | 2007-12-04 |
Family
ID=23283263
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002307264A Expired - Fee Related CA2307264C (en) | 1999-06-09 | 2000-05-01 | An interactive framework for understanding user's perception of multimedia data |
Country Status (4)
Country | Link |
---|---|
US (1) | US6408293B1 (en) |
JP (1) | JP2001043246A (en) |
CA (1) | CA2307264C (en) |
SG (1) | SG91283A1 (en) |
Families Citing this family (67)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100479613B1 (en) * | 1999-07-05 | 2005-03-30 | 엘지전자 주식회사 | Method of controlling image feature weight using auto relevance feedback in content based image retrieval |
US6859802B1 (en) | 1999-09-13 | 2005-02-22 | Microsoft Corporation | Image retrieval based on relevance feedback |
KR100346264B1 (en) * | 1999-12-02 | 2002-07-26 | 엘지전자주식회사 | Multimedia Feature Description System Using Weight And Reliability |
US20050162515A1 (en) * | 2000-10-24 | 2005-07-28 | Objectvideo, Inc. | Video surveillance system |
US8564661B2 (en) | 2000-10-24 | 2013-10-22 | Objectvideo, Inc. | Video analytic rule detection system and method |
US8711217B2 (en) | 2000-10-24 | 2014-04-29 | Objectvideo, Inc. | Video surveillance system employing video primitives |
US9892606B2 (en) | 2001-11-15 | 2018-02-13 | Avigilon Fortress Corporation | Video surveillance system employing video primitives |
US7099860B1 (en) * | 2000-10-30 | 2006-08-29 | Microsoft Corporation | Image retrieval systems and methods with semantic and feature based relevance feedback |
US6970860B1 (en) * | 2000-10-30 | 2005-11-29 | Microsoft Corporation | Semi-automatic annotation of multimedia objects |
TW501035B (en) * | 2001-03-20 | 2002-09-01 | Ulead Systems Inc | Interactive image searching method based on local object |
US6976016B2 (en) * | 2001-04-02 | 2005-12-13 | Vima Technologies, Inc. | Maximizing expected generalization for learning complex query concepts |
US7043058B2 (en) * | 2001-04-20 | 2006-05-09 | Avid Technology, Inc. | Correcting motion vector maps for image processing |
EP1398012A1 (en) * | 2002-08-30 | 2004-03-17 | Friedrich-Wilhelms-Universität Bonn Rheinische | Methods and apparatus for generating intersensory perceptions of associations |
US7298931B2 (en) * | 2002-10-14 | 2007-11-20 | Samsung Electronics Co., Ltd. | Image retrieval method and apparatus using iterative matching |
US20040177138A1 (en) * | 2003-03-05 | 2004-09-09 | Mathias Salle | Method and system for processing user feedback received from a user of a website |
US20040176998A1 (en) * | 2003-03-05 | 2004-09-09 | Evan Kirshenbaum | Method and system for selling an item over a computer network |
US20040176990A1 (en) * | 2003-03-05 | 2004-09-09 | Vacante Robert C. | Method and system enabling the trading of a futures contract for the purchase of goods or services |
US20040199584A1 (en) * | 2003-03-05 | 2004-10-07 | Evan Kirshenbaum | Method and system for customized configuration of an appearance of a website for a user |
US20040177092A1 (en) * | 2003-03-05 | 2004-09-09 | Mathias Salle | Apparatus and method for theorem certification without disclosing documents that lead to the theorem |
US8069075B2 (en) * | 2003-03-05 | 2011-11-29 | Hewlett-Packard Development Company, L.P. | Method and system for evaluating performance of a website using a customer segment agent to interact with the website according to a behavior model |
US20040176991A1 (en) * | 2003-03-05 | 2004-09-09 | Mckennan Carol | System, method and apparatus using biometrics to communicate dissatisfaction via stress level |
US7580033B2 (en) * | 2003-07-16 | 2009-08-25 | Honeywood Technologies, Llc | Spatial-based power savings |
US7602388B2 (en) * | 2003-07-16 | 2009-10-13 | Honeywood Technologies, Llc | Edge preservation for spatially varying power conservation |
US7714831B2 (en) * | 2003-07-16 | 2010-05-11 | Honeywood Technologies, Llc | Background plateau manipulation for display device power conservation |
US20060020906A1 (en) * | 2003-07-16 | 2006-01-26 | Plut William J | Graphics preservation for spatially varying display device power conversation |
US7583260B2 (en) * | 2003-07-16 | 2009-09-01 | Honeywood Technologies, Llc | Color preservation for spatially varying power conservation |
US7786988B2 (en) * | 2003-07-16 | 2010-08-31 | Honeywood Technologies, Llc | Window information preservation for spatially varying power conservation |
US7663597B2 (en) * | 2003-07-16 | 2010-02-16 | Honeywood Technologies, Llc | LCD plateau power conservation |
US7169920B2 (en) * | 2005-04-22 | 2007-01-30 | Xerox Corporation | Photoreceptors |
US7602408B2 (en) | 2005-05-04 | 2009-10-13 | Honeywood Technologies, Llc | Luminance suppression power conservation |
US7760210B2 (en) * | 2005-05-04 | 2010-07-20 | Honeywood Technologies, Llc | White-based power savings |
JP5009577B2 (en) | 2005-09-30 | 2012-08-22 | 富士フイルム株式会社 | Image search apparatus and method, and program |
US9767184B2 (en) * | 2006-03-14 | 2017-09-19 | Robert D. Fish | Methods and apparatus for facilitating context searching |
US8458606B2 (en) * | 2006-12-18 | 2013-06-04 | Microsoft Corporation | Displaying relatedness of media items |
KR100902010B1 (en) | 2007-06-18 | 2009-06-12 | 서강대학교산학협력단 | Effcient similarity search method for content based multimedia retrieval with relevance feedback |
US20090106233A1 (en) * | 2007-08-24 | 2009-04-23 | Veenstra John W | Query engine interpreter and prioritization engine |
US8190604B2 (en) * | 2008-04-03 | 2012-05-29 | Microsoft Corporation | User intention modeling for interactive image retrieval |
EP2350874A1 (en) * | 2008-09-24 | 2011-08-03 | France Telecom | Content classification utilizing a reduced description palette to simplify content analysis |
CN102265274B (en) * | 2008-12-22 | 2017-05-31 | 皇家飞利浦电子股份有限公司 | Relevance feedback on data object section |
TWI396105B (en) * | 2009-07-21 | 2013-05-11 | Univ Nat Taiwan | Digital data processing method for personalized information retrieval and computer readable storage medium and information retrieval system thereof |
US9087059B2 (en) * | 2009-08-07 | 2015-07-21 | Google Inc. | User interface for presenting search results for multiple regions of a visual query |
US8670597B2 (en) | 2009-08-07 | 2014-03-11 | Google Inc. | Facial recognition with social network aiding |
US9135277B2 (en) * | 2009-08-07 | 2015-09-15 | Google Inc. | Architecture for responding to a visual query |
US20110128288A1 (en) * | 2009-12-02 | 2011-06-02 | David Petrou | Region of Interest Selector for Visual Queries |
US8977639B2 (en) * | 2009-12-02 | 2015-03-10 | Google Inc. | Actionable search results for visual queries |
US9405772B2 (en) * | 2009-12-02 | 2016-08-02 | Google Inc. | Actionable search results for street view visual queries |
US8811742B2 (en) | 2009-12-02 | 2014-08-19 | Google Inc. | Identifying matching canonical documents consistent with visual query structural information |
US8805079B2 (en) | 2009-12-02 | 2014-08-12 | Google Inc. | Identifying matching canonical documents in response to a visual query and in accordance with geographic information |
US9176986B2 (en) | 2009-12-02 | 2015-11-03 | Google Inc. | Generating a combination of a visual query and matching canonical document |
US9183224B2 (en) * | 2009-12-02 | 2015-11-10 | Google Inc. | Identifying matching canonical documents in response to a visual query |
US9852156B2 (en) | 2009-12-03 | 2017-12-26 | Google Inc. | Hybrid use of location sensor data and visual query to return local listings for visual query |
CN102232220B (en) * | 2010-10-29 | 2014-04-30 | 华为技术有限公司 | Method and system for extracting and correlating video interested objects |
US9317533B2 (en) | 2010-11-02 | 2016-04-19 | Microsoft Technology Licensing, Inc. | Adaptive image retrieval database |
US8463045B2 (en) | 2010-11-10 | 2013-06-11 | Microsoft Corporation | Hierarchical sparse representation for image retrieval |
JP2012190349A (en) * | 2011-03-11 | 2012-10-04 | Omron Corp | Image processing device, image processing method, and control program |
US20140019431A1 (en) * | 2012-07-13 | 2014-01-16 | Deepmind Technologies Limited | Method and Apparatus for Conducting a Search |
US8577671B1 (en) | 2012-07-20 | 2013-11-05 | Veveo, Inc. | Method of and system for using conversation state information in a conversational interaction system |
US9465833B2 (en) | 2012-07-31 | 2016-10-11 | Veveo, Inc. | Disambiguating user intent in conversational interaction system for large corpus information retrieval |
US8935246B2 (en) | 2012-08-08 | 2015-01-13 | Google Inc. | Identifying textual terms in response to a visual query |
EP2994908B1 (en) | 2013-05-07 | 2019-08-28 | Veveo, Inc. | Incremental speech input interface with real time feedback |
US9946757B2 (en) | 2013-05-10 | 2018-04-17 | Veveo, Inc. | Method and system for capturing and exploiting user intent in a conversational interaction based information retrieval system |
KR102158691B1 (en) * | 2014-01-08 | 2020-09-22 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
US9852136B2 (en) | 2014-12-23 | 2017-12-26 | Rovi Guides, Inc. | Systems and methods for determining whether a negation statement applies to a current or past query |
WO2016109056A1 (en) * | 2014-12-31 | 2016-07-07 | Ebay, Inc. | Dynamic product placement based on perceived value |
US9854049B2 (en) | 2015-01-30 | 2017-12-26 | Rovi Guides, Inc. | Systems and methods for resolving ambiguous terms in social chatter based on a user profile |
US10482340B2 (en) * | 2016-12-06 | 2019-11-19 | Samsung Electronics Co., Ltd. | System and method for object recognition and ranging by deformation of projected shapes in a multimodal vision and sensing system for autonomous devices |
CN114040227A (en) * | 2021-10-22 | 2022-02-11 | 游密科技(深圳)有限公司 | Audio and video playing control method and device, electronic equipment and storage medium |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5802361A (en) * | 1994-09-30 | 1998-09-01 | Apple Computer, Inc. | Method and system for searching graphic images and videos |
DE69523063T2 (en) * | 1994-11-03 | 2002-06-20 | Amcor Packaging New Zealand Lt | Filling device for containers |
US6246804B1 (en) * | 1994-11-15 | 2001-06-12 | Canon Kabushiki Kaisha | Image retrieval method and apparatus using a compound image formed from a plurality of detected regions |
US5893095A (en) * | 1996-03-29 | 1999-04-06 | Virage, Inc. | Similarity engine for content-based retrieval of images |
US5913205A (en) * | 1996-03-29 | 1999-06-15 | Virage, Inc. | Query optimization for visual information retrieval system |
US5899999A (en) * | 1996-10-16 | 1999-05-04 | Microsoft Corporation | Iterative convolution filter particularly suited for use in an image classification and retrieval system |
-
1999
- 1999-06-09 US US09/328,968 patent/US6408293B1/en not_active Expired - Lifetime
-
2000
- 2000-05-01 CA CA002307264A patent/CA2307264C/en not_active Expired - Fee Related
- 2000-05-30 SG SG200002914A patent/SG91283A1/en unknown
- 2000-06-07 JP JP2000169919A patent/JP2001043246A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
SG91283A1 (en) | 2002-09-17 |
CA2307264C (en) | 2007-12-04 |
US6408293B1 (en) | 2002-06-18 |
JP2001043246A (en) | 2001-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2307264A1 (en) | An interactive framework for understanding user's perception of multimedia data | |
ATE368897T1 (en) | IMAGE RESEARCH SYSTEM AND METHOD WITH SEMANTIC AND PROPERTY BASED RELEVANCE FEEDBACK | |
JP3612125B2 (en) | Information filtering method and information filtering apparatus | |
WO2004019171A3 (en) | System and method for consulting an auction-based ranking of search results on a computer network | |
US8393002B1 (en) | Method and system for testing an entity | |
WO2003046761A3 (en) | System and method for retrieving information related to targeted subjects | |
WO1998012881A3 (en) | Method and system for network information access | |
WO2005024662A3 (en) | Method and apparatus for indexing and searching graphic elements | |
WO2004053654A3 (en) | Method of and system for controlling access to personal information records | |
WO2008012834A3 (en) | A method and a system for searching information using information device | |
WO2004104773A3 (en) | Method and system for playing video | |
WO2005055015A3 (en) | Click-through re-ranking of images and other data | |
EP1193588A3 (en) | Method and apparatus for protecting data retrieved from a database | |
GB2339954A (en) | An interactive education process | |
WO2003087982A3 (en) | Method and system for problem determination in distributed enterprise applications | |
WO2007047900A3 (en) | System and method for displaying data on a thin client | |
WO2004025408A3 (en) | On-line sales analysis system and method | |
WO2002067187A8 (en) | Method and system for physical motion analysis | |
CN103699588B (en) | A kind of information search method and system based on video display scene | |
EP1139235A3 (en) | Distributed data processing system and method of processing data in distributed data processing system | |
CN109376737A (en) | A kind of method and system for assisting user to solve problem concerning study | |
Cox et al. | Hidden annotation in content based image retrieval | |
US8595241B2 (en) | System and method for augmenting digital media with custom content | |
US7801356B2 (en) | Methods and apparatuses for generating compressed data representing a visual frame | |
WO2001071660A3 (en) | Improvements in or relating to processing data for interpretation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
MKLA | Lapsed |