WO2003050718A3 - System and method for retrieving information related to persons in video programs - Google Patents

System and method for retrieving information related to persons in video programs Download PDF

Info

Publication number
WO2003050718A3
WO2003050718A3 PCT/IB2002/005021 IB0205021W WO03050718A3 WO 2003050718 A3 WO2003050718 A3 WO 2003050718A3 IB 0205021 W IB0205021 W IB 0205021W WO 03050718 A3 WO03050718 A3 WO 03050718A3
Authority
WO
WIPO (PCT)
Prior art keywords
content data
information
query criteria
persons
information related
Prior art date
Application number
PCT/IB2002/005021
Other languages
French (fr)
Other versions
WO2003050718A2 (en
Inventor
Dongge Li
Nevenka Dimitrova
Lalitha Agnihotri
Original Assignee
Koninkl Philips Electronics Nv
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninkl Philips Electronics Nv filed Critical Koninkl Philips Electronics Nv
Priority to JP2003551704A priority Critical patent/JP2005512233A/en
Priority to KR10-2004-7009086A priority patent/KR20040066897A/en
Priority to AU2002347527A priority patent/AU2002347527A1/en
Priority to EP02783459A priority patent/EP1459209A2/en
Publication of WO2003050718A2 publication Critical patent/WO2003050718A2/en
Publication of WO2003050718A3 publication Critical patent/WO2003050718A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7834—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using audio features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/735—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
    • G06F16/784—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content the detected or recognised objects being people
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data

Abstract

An information tracking device receives content data, such as a video or television signal from one or more information sources and analyzes the content data according to a query criteria to extract relevant stories. The query criteria utilizes a variety of information, such as but not limited to a user request, a user profile, and a knowledge base of known relationships. Using the query criteria, the information tracking device calculates a probability of a person or event occurring in the content data and spots and extracts stories accordingly. The results are index, ordered, and then displayed on a display device.
PCT/IB2002/005021 2001-12-11 2002-11-20 System and method for retrieving information related to persons in video programs WO2003050718A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2003551704A JP2005512233A (en) 2001-12-11 2002-11-20 System and method for retrieving information about a person in a video program
KR10-2004-7009086A KR20040066897A (en) 2001-12-11 2002-11-20 System and method for retrieving information related to persons in video programs
AU2002347527A AU2002347527A1 (en) 2001-12-11 2002-11-20 System and method for retrieving information related to persons in video programs
EP02783459A EP1459209A2 (en) 2001-12-11 2002-11-20 System and method for retrieving information related to persons in video programs

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/014,234 2001-12-11
US10/014,234 US20030107592A1 (en) 2001-12-11 2001-12-11 System and method for retrieving information related to persons in video programs

Publications (2)

Publication Number Publication Date
WO2003050718A2 WO2003050718A2 (en) 2003-06-19
WO2003050718A3 true WO2003050718A3 (en) 2004-05-06

Family

ID=21764267

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2002/005021 WO2003050718A2 (en) 2001-12-11 2002-11-20 System and method for retrieving information related to persons in video programs

Country Status (7)

Country Link
US (1) US20030107592A1 (en)
EP (1) EP1459209A2 (en)
JP (1) JP2005512233A (en)
KR (1) KR20040066897A (en)
CN (1) CN1703694A (en)
AU (1) AU2002347527A1 (en)
WO (1) WO2003050718A2 (en)

Families Citing this family (70)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0230097D0 (en) * 2002-12-24 2003-01-29 Koninkl Philips Electronics Nv Method and system for augmenting an audio signal
KR101150748B1 (en) 2003-06-30 2012-06-08 아이피지 일렉트로닉스 503 리미티드 System and method for generating a multimedia summary of multimedia streams
US20050071888A1 (en) * 2003-09-30 2005-03-31 International Business Machines Corporation Method and apparatus for analyzing subtitles in a video
DE10353068A1 (en) * 2003-11-13 2005-06-23 Voice Trust Ag Method for authenticating a user based on his voice profile
ATE512411T1 (en) * 2003-12-05 2011-06-15 Koninkl Philips Electronics Nv SYSTEM AND METHOD FOR THE INTEGRATED ANALYSIS OF INTRINSIC AND EXTRINSIC AUDIOVISUAL DATA
JP2005242904A (en) * 2004-02-27 2005-09-08 Ricoh Co Ltd Document group analysis device, document group analysis method, document group analysis system, program and storage medium
JP4586446B2 (en) * 2004-07-21 2010-11-24 ソニー株式会社 Content recording / playback apparatus, content recording / playback method, and program thereof
US8694532B2 (en) * 2004-09-17 2014-04-08 First American Data Co., Llc Method and system for query transformation for managing information from multiple datasets
WO2006095292A1 (en) * 2005-03-10 2006-09-14 Koninklijke Philips Electronics N.V. Summarization of audio and/or visual data
WO2007004110A2 (en) * 2005-06-30 2007-01-11 Koninklijke Philips Electronics N.V. System and method for the alignment of intrinsic and extrinsic audio-visual information
US7689011B2 (en) 2006-09-26 2010-03-30 Hewlett-Packard Development Company, L.P. Extracting features from face regions and auxiliary identification regions of images for person recognition and other applications
CN100423004C (en) * 2006-10-10 2008-10-01 北京新岸线网络技术有限公司 Video search dispatching system based on content
CN100429659C (en) * 2006-10-10 2008-10-29 北京新岸线网络技术有限公司 Visual analysis amalgamating system based on content
US9311394B2 (en) * 2006-10-31 2016-04-12 Sony Corporation Speech recognition for internet video search and navigation
US7559017B2 (en) * 2006-12-22 2009-07-07 Google Inc. Annotation framework for video
CN101271454B (en) * 2007-03-23 2012-02-08 百视通网络电视技术发展有限责任公司 Multimedia content association search and association engine system for IPTV
KR100768127B1 (en) * 2007-04-10 2007-10-17 (주)올라웍스 Method for inferring personal relations by using readable data and method and system for tagging person identification information to digital data by using readable data
WO2009081307A1 (en) * 2007-12-21 2009-07-02 Koninklijke Philips Electronics N.V. Matched communicating devices
US8181197B2 (en) 2008-02-06 2012-05-15 Google Inc. System and method for voting on popular video intervals
US8112702B2 (en) * 2008-02-19 2012-02-07 Google Inc. Annotating video intervals
CN101588450B (en) 2008-05-19 2013-08-14 株式会社日立制作所 Recording and reproducing apparatus and method thereof
US8566353B2 (en) * 2008-06-03 2013-10-22 Google Inc. Web-based system for collaborative generation of interactive videos
CN101315631B (en) * 2008-06-25 2010-06-02 中国人民解放军国防科学技术大学 News video story unit correlation method
US8463053B1 (en) 2008-08-08 2013-06-11 The Research Foundation Of State University Of New York Enhanced max margin learning on multimodal data mining in a multimedia database
US8086692B2 (en) * 2008-08-27 2011-12-27 Satyam Computer Services Limited System and method for efficient delivery in a multi-source, multi destination network
CN101742111B (en) * 2008-11-14 2013-05-08 国际商业机器公司 Method and device for recording incident in virtual world
US8826117B1 (en) 2009-03-25 2014-09-02 Google Inc. Web-based system for video editing
US8132200B1 (en) 2009-03-30 2012-03-06 Google Inc. Intra-video ratings
TWI396184B (en) * 2009-09-17 2013-05-11 Tze Fen Li A method for speech recognition on all languages and for inputing words using speech recognition
US8572488B2 (en) * 2010-03-29 2013-10-29 Avid Technology, Inc. Spot dialog editor
US9311395B2 (en) * 2010-06-10 2016-04-12 Aol Inc. Systems and methods for manipulating electronic content based on speech recognition
US8971651B2 (en) 2010-11-08 2015-03-03 Sony Corporation Videolens media engine
US20120116764A1 (en) * 2010-11-09 2012-05-10 Tze Fen Li Speech recognition method on sentences in all languages
CN103797494A (en) * 2011-03-31 2014-05-14 维塔克公司 Devices, systems, methods, and media for detecting, indexing, and comparing video signals from a video display in a background scene using a camera-enabled device
US8938393B2 (en) * 2011-06-28 2015-01-20 Sony Corporation Extended videolens media engine for audio recognition
US9729942B2 (en) * 2011-11-28 2017-08-08 Discovery Communications, Llc Methods and apparatus for enhancing a digital content experience
CN103247063A (en) * 2012-02-13 2013-08-14 张棨翔 Technology system for embedding of film and image information
US9846696B2 (en) * 2012-02-29 2017-12-19 Telefonaktiebolaget Lm Ericsson (Publ) Apparatus and methods for indexing multimedia content
US9633015B2 (en) 2012-07-26 2017-04-25 Telefonaktiebolaget Lm Ericsson (Publ) Apparatus and methods for user generated content indexing
US10671926B2 (en) 2012-11-30 2020-06-02 Servicenow, Inc. Method and system for generating predictive models for scoring and prioritizing opportunities
US10706359B2 (en) 2012-11-30 2020-07-07 Servicenow, Inc. Method and system for generating predictive models for scoring and prioritizing leads
US9280739B2 (en) 2012-11-30 2016-03-08 Dxcontinuum Inc. Computer implemented system for automating the generation of a business decision analytic model
US20140181070A1 (en) * 2012-12-21 2014-06-26 Microsoft Corporation People searches using images
CN103902611A (en) * 2012-12-28 2014-07-02 鸿富锦精密工业（深圳）有限公司 Video content searching system and video content searching method
US20140270701A1 (en) * 2013-03-15 2014-09-18 First Principles, Inc. Method on indexing a recordable event from a video recording and searching a database of recordable events on a hard drive of a computer for a recordable event
US9123330B1 (en) * 2013-05-01 2015-09-01 Google Inc. Large-scale speaker identification
WO2014185834A1 (en) 2013-05-14 2014-11-20 Telefonaktiebolaget L M Ericsson (Publ) Search engine for textual content and non-textual content
WO2015001558A1 (en) * 2013-07-01 2015-01-08 Salespredict Sw Ltd. System and method for predicting sales
KR102107678B1 (en) * 2013-07-03 2020-05-28 삼성전자주식회사 Server for providing media information, apparatus, method and computer readable recording medium for searching media information related to media contents
WO2015030646A1 (en) 2013-08-29 2015-03-05 Telefonaktiebolaget L M Ericsson (Publ) Method, content owner device, computer program, and computer program product for distributing content items to authorized users
WO2015030645A1 (en) 2013-08-29 2015-03-05 Telefonaktiebolaget L M Ericsson (Publ) Methods, computer program, computer program product and indexing systems for indexing or updating index
CN104754373A (en) * 2013-12-27 2015-07-01 联想(北京)有限公司 Video acquisition method and electronic device
US20150319506A1 (en) * 2014-04-30 2015-11-05 Netflix, Inc. Displaying data associated with a program based on automatic recognition
US10140379B2 (en) 2014-10-27 2018-11-27 Chegg, Inc. Automated lecture deconstruction
CN104794179B (en) * 2015-04-07 2018-11-20 无锡天脉聚源传媒科技有限公司 A kind of the video fast indexing method and device of knowledge based tree
US10269387B2 (en) * 2015-09-30 2019-04-23 Apple Inc. Audio authoring and compositing
US10726594B2 (en) 2015-09-30 2020-07-28 Apple Inc. Grouping media content for automatically generating a media presentation
EP3998610A1 (en) 2015-09-30 2022-05-18 Apple Inc. Synchronizing audio and video components of an automatically generated audio/video presentation
US10733231B2 (en) * 2016-03-22 2020-08-04 Sensormatic Electronics, LLC Method and system for modeling image of interest to users
US9965680B2 (en) 2016-03-22 2018-05-08 Sensormatic Electronics, LLC Method and system for conveying data from monitored scene via surveillance cameras
CN105847964A (en) * 2016-03-28 2016-08-10 乐视控股（北京）有限公司 Movie and television program processing method and movie and television program processing system
US9668023B1 (en) * 2016-05-26 2017-05-30 Rovi Guides, Inc. Systems and methods for providing real-time presentation of timely social chatter of a person of interest depicted in media simultaneous with presentation of the media itself
US10019623B2 (en) 2016-05-26 2018-07-10 Rovi Guides, Inc. Systems and methods for providing timely and relevant social media updates from persons related to a person of interest in a video simultaneously with the video
US10353972B2 (en) 2016-05-26 2019-07-16 Rovi Guides, Inc. Systems and methods for providing timely and relevant social media updates for a person of interest in a media asset who is unknown simultaneously with the media asset
CN108763475B (en) * 2018-05-29 2021-01-15 维沃移动通信有限公司 Recording method, recording device and terminal equipment
CN108882033B (en) * 2018-07-19 2021-12-14 上海影谱科技有限公司 Character recognition method, device, equipment and medium based on video voice
US11195507B2 (en) * 2018-10-04 2021-12-07 Rovi Guides, Inc. Translating between spoken languages with emotion in audio and video media streams
CN109922376A (en) * 2019-03-07 2019-06-21 深圳创维－Rgb电子有限公司 One mode setting method, device, electronic equipment and storage medium
WO2021238733A1 (en) * 2020-05-25 2021-12-02 聚好看科技股份有限公司 Display device and image recognition result display method
CN113938712B (en) * 2021-10-13 2023-10-10 北京奇艺世纪科技有限公司 Video playing method and device and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5835667A (en) * 1994-10-14 1998-11-10 Carnegie Mellon University Method and apparatus for creating a searchable digital video library and a system and method of using such a library
WO2000039707A1 (en) * 1998-12-23 2000-07-06 Koninklijke Philips Electronics N.V. Personalized video classification and retrieval system

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9019538D0 (en) * 1990-09-07 1990-10-24 Philips Electronic Associated Tracking a moving object
US6400996B1 (en) * 1999-02-01 2002-06-04 Steven M. Hoffberg Adaptive pattern recognition based control system and method
US6029195A (en) * 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US5596705A (en) * 1995-03-20 1997-01-21 International Business Machines Corporation System and method for linking and presenting movies with their underlying source information
US6025837A (en) * 1996-03-29 2000-02-15 Micrsoft Corporation Electronic program guide with hyperlinks to target resources
US6172677B1 (en) * 1996-10-07 2001-01-09 Compaq Computer Corporation Integrated content guide for interactive selection of content and services on personal computer systems with multiple sources and multiple media presentation
US6125229A (en) * 1997-06-02 2000-09-26 Philips Electronics North America Corporation Visual indexing system
JPH11250071A (en) * 1998-02-26 1999-09-17 Minolta Co Ltd Image database constructing method, image database device and image information storage medium
EP0944018B1 (en) * 1998-03-19 2011-08-24 Panasonic Corporation Method and apparatus for recognizing image pattern, method and apparatus for judging identity of image patterns, recording medium for recording the pattern recognizing method and recording medium for recording the pattern identity judging method
GB2341231A (en) * 1998-09-05 2000-03-08 Sharp Kk Face detection in an image
EP1200902A2 (en) * 1999-07-16 2002-05-02 Agentarts, Inc. Methods and system for generating automated alternative content recommendations
US6594629B1 (en) * 1999-08-06 2003-07-15 International Business Machines Corporation Methods and apparatus for audio-visual speech detection and recognition
US20010049826A1 (en) * 2000-01-19 2001-12-06 Itzhak Wilf Method of searching video channels by content
CN100592788C (en) * 2000-04-14 2010-02-24 日本电信电话株式会社 Method, system, and apparatus for acquiring information concerning broadcast information
US20030061610A1 (en) * 2001-03-27 2003-03-27 Errico James H. Audiovisual management system
US6886015B2 (en) * 2001-07-03 2005-04-26 Eastman Kodak Company Method and system for building a family tree

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5835667A (en) * 1994-10-14 1998-11-10 Carnegie Mellon University Method and apparatus for creating a searchable digital video library and a system and method of using such a library
WO2000039707A1 (en) * 1998-12-23 2000-07-06 Koninklijke Philips Electronics N.V. Personalized video classification and retrieval system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DIMITROVA N ET AL: "ON SELECTIVE VIDEO CONTENT ANALYSIS AND FILTERING", PROCEEDINGS OF THE SPIE, SPIE, BELLINGHAM, VA, US, vol. 3972, 26 January 2000 (2000-01-26), pages 359 - 368, XP009002896, ISSN: 0277-786X *
GAUCH J M ET AL: "Real time video scene detection and classification", INFORMATION PROCESSING & MANAGEMENT, ELSEVIER, BARKING, GB, vol. 35, no. 3, May 1999 (1999-05-01), pages 381 - 400, XP004169416, ISSN: 0306-4573 *

Also Published As

Publication number Publication date
EP1459209A2 (en) 2004-09-22
AU2002347527A1 (en) 2003-06-23
WO2003050718A2 (en) 2003-06-19
KR20040066897A (en) 2004-07-27
CN1703694A (en) 2005-11-30
US20030107592A1 (en) 2003-06-12
JP2005512233A (en) 2005-04-28

Similar Documents

Publication Publication Date Title
WO2003050718A3 (en) System and method for retrieving information related to persons in video programs
WO2003046761A3 (en) System and method for retrieving information related to targeted subjects
EP1244025A4 (en) Image retrieval system and image retrieval method
WO2003017540A3 (en) System to provide access to information related to a broadcast signal
WO2004061587A3 (en) Method and system for direct purchase in response to a multi-media display
WO2005003888A3 (en) Function space reservation system
CA2307264A1 (en) An interactive framework for understanding user's perception of multimedia data
CA2170550A1 (en) Personalized Real Time Information Display
WO2004025408A3 (en) On-line sales analysis system and method
WO2004100162A3 (en) Methods and systems for video content browsing
AU2002337779A1 (en) Computing system and method to implicity commit unsaved data for a world wide web application
EP1363455A3 (en) Caption extraction device
WO2003036415A3 (en) System and method for interative advertising
WO2003052573A3 (en) System and method for providing access to epg features from within broadcast advertisements
AU2003285512A1 (en) Searching images
GB0327544D0 (en) Remote access system and method
WO2004072897A3 (en) Obtaining person-specific images in a public venue
WO2005079529A3 (en) Methods and systems for providing personalized frequently asked questions
EP0810534A3 (en) Document display system and electronic dictionary
WO2004104773A3 (en) Method and system for playing video
WO2005076772A3 (en) Systems and methods for context relevant information management and display
WO2018097379A1 (en) Method for inserting hash tag by image recognition, and software distribution server storing software for performing same method
WO2002041134A3 (en) A system and method for processing patient medical information acquired over a plurality of days
WO2001069443A3 (en) System, method and apparatus for utilizing transaction databases in a client - server environment
WO2002091739A3 (en) System and method for enhancing broadcast or recorded programs with information on the world wide web

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SC SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2002783459

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2003551704

Country of ref document: JP

Ref document number: 20028245628

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 1020047009086

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2002783459

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2002783459

Country of ref document: EP