WO2007004110A3 - System and method for the alignment of intrinsic and extrinsic audio-visual information - Google Patents

System and method for the alignment of intrinsic and extrinsic audio-visual information Download PDF

Info

Publication number
WO2007004110A3
WO2007004110A3 PCT/IB2006/052088 IB2006052088W WO2007004110A3 WO 2007004110 A3 WO2007004110 A3 WO 2007004110A3 IB 2006052088 W IB2006052088 W IB 2006052088W WO 2007004110 A3 WO2007004110 A3 WO 2007004110A3
Authority
WO
WIPO (PCT)
Prior art keywords
intrinsic
extrinsic
information
source
extrinsic information
Prior art date
Application number
PCT/IB2006/052088
Other languages
French (fr)
Other versions
WO2007004110A2 (en
Inventor
Lalitha Agnihotri
Mauro Barbieri
Nevenka Dimitrova
Original Assignee
Koninkl Philips Electronics Nv
Lalitha Agnihotri
Mauro Barbieri
Nevenka Dimitrova
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninkl Philips Electronics Nv, Lalitha Agnihotri, Mauro Barbieri, Nevenka Dimitrova filed Critical Koninkl Philips Electronics Nv
Publication of WO2007004110A2 publication Critical patent/WO2007004110A2/en
Publication of WO2007004110A3 publication Critical patent/WO2007004110A3/en

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/022—Electronic editing of analogue information signals, e.g. audio or video signals
    • G11B27/028—Electronic editing of analogue information signals, e.g. audio or video signals with computer assistance
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/327—Table of contents
    • G11B27/329—Table of contents on a disc [VTOC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/18—Arrangements for synchronising broadcast or distribution via plural systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/59—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/76—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet
    • H04H60/81—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself
    • H04H60/82—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself the transmission system being the Internet
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G10L2021/105—Synthesis of the lips movements from speech, e.g. for talking heads

Abstract

A system and method are provided for the alignment of intrinsic and extrinsic audio-visual information using classifications of the information and is particularly useful for aligning intrinsic and extrinsic information of different languages. The system comprises an intrinsic content analyser (2,3) that is communicatively connected to an audio-visual source (1), such as a film source that may be in a dubbed language. The film is searched for intrinsic data that is extracted and classified. Further, the system comprises an extrinsic content analyser (5,6) communicatively connected to an extrinsic information source (4), such as an original language film screenplay available through the Internet. The system searches the extrinsic information source, retrieves and then classifies the extrinsic information. The intrinsic and extrinsic information is aligned by correlating (7) the classifications to provide a multi-source data structure. The correlation is independent of the language of the intrinsic and the extrinsic information.
PCT/IB2006/052088 2005-06-30 2006-06-26 System and method for the alignment of intrinsic and extrinsic audio-visual information WO2007004110A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US69565405P 2005-06-30 2005-06-30
US60/695,654 2005-06-30

Publications (2)

Publication Number Publication Date
WO2007004110A2 WO2007004110A2 (en) 2007-01-11
WO2007004110A3 true WO2007004110A3 (en) 2007-03-22

Family

ID=37478631

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/052088 WO2007004110A2 (en) 2005-06-30 2006-06-26 System and method for the alignment of intrinsic and extrinsic audio-visual information

Country Status (1)

Country Link
WO (1) WO2007004110A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8935269B2 (en) 2006-12-04 2015-01-13 Samsung Electronics Co., Ltd. Method and apparatus for contextual search and query refinement on consumer electronics devices
US8938465B2 (en) 2008-09-10 2015-01-20 Samsung Electronics Co., Ltd. Method and system for utilizing packaged content sources to identify and provide information based on contextual information
US9286385B2 (en) 2007-04-25 2016-03-15 Samsung Electronics Co., Ltd. Method and system for providing access to information of potential interest to a user

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8195650B2 (en) 2007-02-28 2012-06-05 Samsung Electronics Co., Ltd. Method and system for providing information using a supplementary device
US8115869B2 (en) 2007-02-28 2012-02-14 Samsung Electronics Co., Ltd. Method and system for extracting relevant information from content metadata
US8209724B2 (en) 2007-04-25 2012-06-26 Samsung Electronics Co., Ltd. Method and system for providing access to information of potential interest to a user
US8732154B2 (en) 2007-02-28 2014-05-20 Samsung Electronics Co., Ltd. Method and system for providing sponsored information on electronic devices
US9100723B2 (en) 2006-03-07 2015-08-04 Samsung Electronics Co., Ltd. Method and system for managing information on a video recording
US8863221B2 (en) 2006-03-07 2014-10-14 Samsung Electronics Co., Ltd. Method and system for integrating content and services among multiple networks
US8510453B2 (en) * 2007-03-21 2013-08-13 Samsung Electronics Co., Ltd. Framework for correlating content on a local network with information on an external network
US8200688B2 (en) 2006-03-07 2012-06-12 Samsung Electronics Co., Ltd. Method and system for facilitating information searching on electronic devices
US8843467B2 (en) 2007-05-15 2014-09-23 Samsung Electronics Co., Ltd. Method and system for providing relevant information to a user of a device in a local network
US8176068B2 (en) 2007-10-31 2012-05-08 Samsung Electronics Co., Ltd. Method and system for suggesting search queries on electronic devices
US8789108B2 (en) 2007-11-20 2014-07-22 Samsung Electronics Co., Ltd. Personalized video system
US8332414B2 (en) 2008-07-01 2012-12-11 Samsung Electronics Co., Ltd. Method and system for prefetching internet content for video recorders
GB201101496D0 (en) * 2011-01-28 2011-03-16 Ocean Blue Software Television content adaptor
US9596386B2 (en) 2012-07-24 2017-03-14 Oladas, Inc. Media synchronization

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2117168A (en) * 1982-03-23 1983-10-05 Phillip Jeffrey Bloom Method and apparatus for use in processing signals
EP0540403A1 (en) * 1991-10-30 1993-05-05 Etablissement Public Télédiffusion de France Video analysis system for editing a broadcasted or recorded television program and its use for post-production techniques, particularly multilingual
EP0682344A2 (en) * 1994-05-12 1995-11-15 Elop Electro-Optics Industries Ltd., And Television Multilingue S.A. Movie processing system
GB2366110A (en) * 2000-06-23 2002-02-27 Ibm Synchronising audio and video.
US20020093591A1 (en) * 2000-12-12 2002-07-18 Nec Usa, Inc. Creating audio-centric, imagecentric, and integrated audio visual summaries
US20030107592A1 (en) * 2001-12-11 2003-06-12 Koninklijke Philips Electronics N.V. System and method for retrieving information related to persons in video programs
WO2004040576A1 (en) * 2002-11-01 2004-05-13 Synchro Arts Limited Methods and apparatus for use in sound replacement with automatic synchronization to images
US20050228663A1 (en) * 2004-03-31 2005-10-13 Robert Boman Media production system using time alignment to scripts

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2117168A (en) * 1982-03-23 1983-10-05 Phillip Jeffrey Bloom Method and apparatus for use in processing signals
EP0540403A1 (en) * 1991-10-30 1993-05-05 Etablissement Public Télédiffusion de France Video analysis system for editing a broadcasted or recorded television program and its use for post-production techniques, particularly multilingual
EP0682344A2 (en) * 1994-05-12 1995-11-15 Elop Electro-Optics Industries Ltd., And Television Multilingue S.A. Movie processing system
GB2366110A (en) * 2000-06-23 2002-02-27 Ibm Synchronising audio and video.
US20020093591A1 (en) * 2000-12-12 2002-07-18 Nec Usa, Inc. Creating audio-centric, imagecentric, and integrated audio visual summaries
US20030107592A1 (en) * 2001-12-11 2003-06-12 Koninklijke Philips Electronics N.V. System and method for retrieving information related to persons in video programs
WO2004040576A1 (en) * 2002-11-01 2004-05-13 Synchro Arts Limited Methods and apparatus for use in sound replacement with automatic synchronization to images
US20050228663A1 (en) * 2004-03-31 2005-10-13 Robert Boman Media production system using time alignment to scripts

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8935269B2 (en) 2006-12-04 2015-01-13 Samsung Electronics Co., Ltd. Method and apparatus for contextual search and query refinement on consumer electronics devices
US9286385B2 (en) 2007-04-25 2016-03-15 Samsung Electronics Co., Ltd. Method and system for providing access to information of potential interest to a user
US8938465B2 (en) 2008-09-10 2015-01-20 Samsung Electronics Co., Ltd. Method and system for utilizing packaged content sources to identify and provide information based on contextual information

Also Published As

Publication number Publication date
WO2007004110A2 (en) 2007-01-11

Similar Documents

Publication Publication Date Title
WO2007004110A3 (en) System and method for the alignment of intrinsic and extrinsic audio-visual information
CN101159834B (en) Method and system for detecting repeatable video and audio program fragment
WO2005055196A3 (en) System & method for integrative analysis of intrinsic and extrinsic audio-visual data
EP2506151A4 (en) Semantic syntax tree kernel-based processing system and method for automatically extracting semantic correlations between scientific and technological core entities
KR102069698B1 (en) Apparatus and Method Correcting Linguistic Analysis Result
CN100469109C (en) Automatic translation method for digital video captions
WO2007056535A3 (en) Method and apparatus for timed tagging of media content
WO2007146876A3 (en) Methods and apparatus to meter content exposure using closed caption information
US20130030810A1 (en) Frugal method and system for creating speech corpus
WO2009140272A3 (en) Search results with most clicked next objects
CA2656425C (en) Recognizing text in images
WO2009060760A1 (en) Electronic device for searching for index word in dictionary data, its controlling method, and program product
WO2007064640A3 (en) Detecting repeating content in broadcast media
WO2010068068A3 (en) Information search method and information provision method based on user's intention
CA2629999C (en) Information exploration systems and methods
CN1870728A (en) Method and system for automatic subtilting
WO2006057741A3 (en) Interactive system for collecting metadata
EP1881423A4 (en) Device for automatically creating information analysis report, program for automatically creating information analysis report, and method for automatically creating information analysis report
WO2007019691A3 (en) Automatic website generator
WO2006040727A3 (en) A system and a method of processing audio data to generate reverberation
AU2003303419A1 (en) Method and system to mark an audio signal with metadata
Trancoso et al. The LECTRA corpus œ classroom lecture transcriptions in European Portuguese
Aker et al. Projection of argumentative corpora from source to target languages
Nagao et al. Annotation-based multimedia summarization and translation
DE602004013799D1 (en) REAL-TIME MEDIA DICTIONARY

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06765869

Country of ref document: EP

Kind code of ref document: A2