EP1521464A2 - Method and apparatus for modulating a video signal with data - Google Patents
Method and apparatus for modulating a video signal with data Download PDFInfo
- Publication number
- EP1521464A2 EP1521464A2 EP04077707A EP04077707A EP1521464A2 EP 1521464 A2 EP1521464 A2 EP 1521464A2 EP 04077707 A EP04077707 A EP 04077707A EP 04077707 A EP04077707 A EP 04077707A EP 1521464 A2 EP1521464 A2 EP 1521464A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- video signal
- hand
- held device
- auxiliary data
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4784—Supplemental services, e.g. displaying phone caller identification, shopping application receiving rewards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/025—Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
- H04N7/081—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division the additional information signals being transmitted by means of a subcarrier
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17309—Transmission or handling of upstream communications
- H04N7/17318—Direct or substantially direct transmission and handling of requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Finance (AREA)
- Computer Networks & Wireless Communication (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- General Engineering & Computer Science (AREA)
- Economics (AREA)
- General Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- Software Systems (AREA)
- Marketing (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Game Theory and Decision Science (AREA)
- Theoretical Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Systems (AREA)
- Mobile Radio Communication Systems (AREA)
- Details Of Television Systems (AREA)
Abstract
Description
- The present invention relates to interactive hand-held devices, and more particularly to a method and apparatus for modulating video signals with auxiliary data for reception on and use by receivers such as hand-held devices, and providing promotional opportunities and other benefits to users of these receivers from the reception of the signals.
- Users of these hand-held devices and other receivers selectively receive auxiliary data for purposes including enjoyment, promotion, transfer of information, data collection, commercial verification, security, education, and transactions or verifications at points of sale, as well as other commercial, personal, entertainment, or amusement purposes collectively referred to herein as "promotional opportunities".
- U.S. Patent 4,807,031 to Broughton et al. ("Broughton") entitled "Interactive Video Method and Apparatus" relates generally to in-band video broadcasting of commands and other encoded information to interactive devices. The invention described therein relates generally to interactive educational and entertainment systems, and is described in one embodiment in the context of television program control of toys located where there is a television receiver, as within a residence.
- To encode control data capable of providing a benefit to a user, Broughton discloses a novel method of luminance or chrominance modulation of a video signal that creates a composite video signal (i.e., a modulated video signal), wherein the video signal is modulated with control data. The novel modulation method alternately raises and lowers the luminance/chrominance of adjacent horizontal scan lines to create a video subcarrier that contains the control data.
- In Broughton, the video signal is not being replaced with other data, nor is the data being added as a separate signal along with the video signal. Rather, the video signal itself is modulated to carry the control data. Therefore, the control data is a part of, or contained within, the video signal and yet is imperceptible to the human eye. The encoding method also includes preview and remove circuitry to ensure suitability or the presence of data encoding and removal of data encoding, respectively.
- The control data is transmitted either by television broadcast means, or by pre-recorded video players that are connected to a video display. The control data is then received by the video display where at least one video field of the video display is modulated by control data. The control data is then detected with either opto-electronic or radio frequency (RF) detection means that discriminate between the program material and the control data to detect the control data. The detected control data is further reproduced so that the control data can be used with an interactive device.
- The encoding method of Broughton may be used to record a "1" or a "0" on every field of a television video signal. Since under NTSC standard the video signal is broadcast at 30 frames a second, there are 60 fields per second resulting in a data rate of 60 bits per second. However, it is often difficult to achieve 60 bits per second of reliable continuous data using this method as will be explained in greater detail below.
- In addition to Broughton's data transmission rate being relatively slow, it may not be reliably used for transmitting long data strings to portable devices and other receivers for processing and reproduction. Accordingly, Broughton in one application is typically used by interactive devices to capture auxiliary data that triggers action on the device (i.e., the device acts in a triggered mode). Furthermore, the auxiliary data signals of Broughton are detected asynchronously, as the decoding process on the interactive devices and other receivers (e.g., decoder boxes) are not synchronized to the video signal received from the display device. Moreover, the beginning of a video field was undeterminable by the interactive device of Broughton.
- Broughton preferably operates by superimposing a 7875 Hz subcarrier on the video signal, which is at a rate of half the 15750 Hz horizontal retrace frequency. To modulate the video signal with a subcarrier signal, the intensity of one horizontal line is raised and the intensity of the next line in a field is lowered thereby resulting in the 7875 Hz subcarrier signal.
- An example of an implementation of Broughton is as follows: an encoder splits each field of a video signal into 8 equal slices, with each slice occupying approximately 2 milliseconds and encoded with the same data bit. The interactive device records and tracks every eighth bit, and thereafter compares the most recent 8 bits (i.e., 1 byte) it receives to the desired combination of 8 bits stored in a table on the interactive device. If there is a match between the two different sets of 8 bits, the interactive device then proceeds to match a second byte and then a third byte. Once all three bytes are matched, action is triggered on the interactive device, which may include a visual or audio notification of a promotional opportunity. Despite the success of Broughton, there is a need in the art for a new apparatus and method for modulating a video signal with data that is faster and more reliable.
- Improvements on the method of modulation described in Broughton are described in U.S. Patent 6,094,228 to Ciardullo et al. and U.S. Patent 6,229,572 to Ciardullo et al. (referred to collectively herein as "Ciardullo"). Both Ciardullo patents describe improved methods of modulation wherein the carrier signals relating to control data (i.e., auxiliary data) are inserted on the visual portion of a video signal by changing the luminance of paired lines in opposite directions. Instead of raising and lowering the intensity on an entire scan line of a video signal as in Broughton, Ciardullo uses pseudo noise sequences to raise and lower the intensity on portions on a series of first lines on every other video scan line in a field of a video signal, where the lines paired to the first lines are modulated with the inverse pseudo noise sequences. Ciardullo thereby allows larger amounts of auxiliary data to be modulated in video signals by use of the pseudo noise sequences. Broughton and Ciardullo, which are owned by the assignee of the present invention, are incorporated by reference herein.
- Prior efforts by the assignees of the present patent application include United States Utility Patent Application entitled "Interactive Optical Cards and Other Hand-Held Devices with Increased Connectivity", Serial No.: US 09/489,373, filed January 21, 2000 of Edward J. Koplar and Daniel A. Ciardullo ("Koplar I"), which is incorporated by reference herein. Koplar I relates to various methods and apparatuses for use with promotion opportunities, such as interactive advertising and gaming. Koplar I describes various methods for receiving and providing data and signals to hand-held devices, as well as apparatuses for use with promotional opportunities and methods of using the same.
- Another patent application by the assignees of the present invention is United States Utility Patent Application entitled "Universal Methods and Device for Hand-Held Promotional Opportunities", Serial No.: 09/829,223, filed 9 April 2001 of Edward J. Koplar, Daniel A. Ciardullo, James G. Withers and Christopher E. Chupp ("Koplar II"), which is incorporated by reference herein. Koplar II describes additional methods for receiving and providing data and signals to hand-held devices, as well as apparatuses for receiving promotional opportunities and methods of using the same.
- Yet another patent application by the assignees of the present invention is U.S. Patent Application entitled "RBDS Method and Device for Processing Promotional Opportunities", Serial No. 10/126770, filed on April 19, 2002, of James G. Withers and Alan G. Maltagliati (referred to hereinafter as "Withers"), which is incorporated by reference herein. Withers I describes further improvements to Koplar I and Koplar II including the transmission of auxiliary data to a hand-held device by use of the RBDS system.
- For purposes of the present invention, the term "hand-held device" means an interactive device of portable character, preferably of hand-held type that may be carried in the palm by a user, between fingers of the user, or is otherwise intended to be easily grasped and handled manually by the user. By way of example, hand-held devices includes smart cards, mobile phones, personal digital assistants (PDAs), gaming devices and other hand-held devices capable of receiving and processing auxiliary data.
- The present invention need not be implemented by manufacturing a customized hand-held device to incorporate functionality of the present invention. Hand-held devices may have a slot that typically allows the device to receive memory cards and sometimes may allow it to use specially designed interface cards to receive other types of information.
- A memory card, which may also be referred to as a flash memory card or a storage card, is a small storage medium that typically uses flash memory to store data such as text, pictures, audio, and video for use by small, portable electronic and computing devices. Memory cards on the market as of the date of the present invention include the SD™ (secure digital) card, the CompactFlash® card, the Memory Stick® card, the MultiMediaCard™ (MMC) and the SmartMedia® card. Memory cards are non-volatile solid-state devices that offer a combination of high storage capacity, fast data transfer, increased flexibility, excellent security and small size. Memory cards are typically accepted via a slot on portable devices.
- Although slots are primarily used to receive memory cards that only provide data storage, some of the slots' functionality are not so limited and are capable of interfacing with peripheral devices. An example of the foregoing is the SD slot, which was originally intended to provide portable devices with flash memory. However, the slot was written with an open standard so that computer software operating on a portable device may be written to control peripheral devices connected through use of the SD slot, and such hand-held devices with a slot and open protocol are referred to herein as "slotted hand-held devices". At the time of this invention, SD slots are available in cameras, cell phones, MP3 players and other portable devices.
- An interface device is a card capable of insertion into a card slot with a primary purpose of obtaining data or other input from sources not traditionally available to a slotted hand-held device and is referred to hereinafter as an "interface card". The biggest advantage of manufacturing and using an interface card (i.e., with a slotted hand-held device as opposed to a customized hand-held device) is that the interface card takes advantage of the resources (e.g., an LCD, Internet access, a keypad, etc.) on existing slotted hand-held devices, thereby reducing the manufacturing cost and increasing the functionality of existing such devices.
- An interface protocol such as SDIO (the SD input and output) protocol is a standard implemented on various slotted hand-held devices that allows storage media and peripheral devices to be operated through use of an appropriate slot (e.g., the SD slot). For example, a PDA with a SD slot and enabled with the SDIO protocol and related software that has a SD card outfitted with a camera-like device inserted into its SD slot may use a camera-like device to take photographs that are stored on the PDA or are automatically uploaded to a predetermined Internet location.
- Another device that may be configured to be a slotted hand-held device is the Nintendo® Gameboy® game unit. As of late 2002, there are approximately 25,000 Nintendo® Game Boy Advance® game units sold every day, and over 100,000,000 Gameboy game units currently in use worldwide. While Gameboy game units are not equipped with a slot such as a SD memory slot, a company operating under the name X-traFun has developed a Bluetooth™-ready Gameboy cartridge outfitted with a SD slot. The cartridge provides a network mechanism to communicate, and the slot enables the reception of storage and interface cards to provide functionality of the present invention.
- The term "computer" is also used herein in its broadest possible sense, and may include without limitation a laptop, compact or personal computer, mobile phone, gaming device, personal digital assistant (PDA), or other computer-like device, or other devices using one or more microprocessors or digital processors to achieve a computing or data processing or data manipulative process or comparable or similar functions.
- The present invention comprises a method and device for modulating a video signal with data. More specifically, the method involves a user directing a slotted hand-held device with an interface card at a display device that is presenting video signals modulated with auxiliary data from a broadcast source.
- The hand-held device has a microcontroller and associated circuitry that determines the timing of the video signals by use of a vertical retrace signal of the display device. The video signals are received on the interface card by use of an optical detector. The microcontroller of the interface card then determines whether auxiliary data is present in the video signals. The microcontroller next evaluates whether the received auxiliary data relates to data packets. If so, then the microcontroller assembles the data packets to provide the user with useful data and providing the user of the slotted hand-held device with promotional opportunities or other benefits from the reception of useful data.
- In the preferred embodiment of the present invention, various suitable hand-held devices may be used to provide the functionality of the present invention by use of an interface card attached to a slotted hand-held device and appropriate software running on the slotted hand-held device to interpret the received data. Preferably, the present invention uses a SD card and the SDIO protocol to interface with Nintendo's Gameboy, Compaq's iPAQ, and other slotted hand-held devices that include a SD slot.
- When auxiliary data is reproduced by use by the interface card or hand-held device, various signals, indications, display readouts, or other interactive events provide the user with promotional opportunities and other benefits according to content of the auxiliary data. The various interactive events described in Koplar I, Koplar II and Withers, incorporated by reference herein, are usable interchangeably by and in conjunction with the hand-held device and methods of use with the present invention. The interchangeability includes selective use of the features of the present invention, along with selective use of any of the various apparatuses and methods of Koplar I, Koplar II and Withers.
-
- Fig. 1 is a flow chart of the method of encoding of the present invention.
- Fig. 2 is a flow chart of the method of decoding of the present invention.
- Fig. 3 is a block diagram of the decoder of the present invention.
- Fig. 4 is a an alternate embodiment of the method of decoding of the present invention.
- Fig. 5 is a block diagram of the encoder of the present invention.
- Fig. 6 is a schematic circuit arrangement of one embodiment of the hand-held device of the present invention.
- Fig. 7 is a schematic circuit diagram of an analog pre-filter of the data decoder of the invention.
- Fig. 8 is a schematic circuit diagram of analog vertical synch and signal strength detection of the data decoder of the invention.
- Fig. 9 is a schematic circuit diagram of data signal detection circuitry of the data decoder of the invention.
- Fig. 10 is a schematic circuit diagram of a microcontroller of a first embodiment of the data decoder of the invention.
- Fig. 11 is a schematic circuit diagram of a microcontroller of a second embodiment of the data decoder of the invention.
- Fig. 12 is a flow chart of the method of decoding of the present invention.
- Fig. 13 is a graphic representation of the fields of the present invention.
- Fig. 14 is a graphic representation of a data packet used in the present invention.
-
- Corresponding characters indicate corresponding elements in the views of the drawings.
- The following method and apparatus for a modulating a video signal with data is an improvement upon the method and apparatus previously disclosed in Broughton. Broughton discloses a communication system that allows auxiliary data to be received from a display device, wherein the data is preferably read optically by a hand-held device through use of a photodetector.
- Referring to Fig. 1, a
video signal 18 is transmitted from asignal source 10 to anencoder 12.Video signal 18 is preferably an analog NTSC video signal, but may be other video signals or video signal formats compatible with the present invention. Signalsource 10 is typically a professional grade video tape player with a video tape containing a video program, but may also be other sources of video signals including a camcorder or a digital versatile disc (DVD) player with a DVD video containing a program.Encoder 12 is described in further detail in the description of Fig. 5 below. -
Operator 16 interacts withencoder 12 to control its operation. Preferably,operator 16 is a person that interacts withencoder 12 through the use of a computer or other electronic control device. However,operator 16 may consist entirely of a computer or other electronic control device that directs operation ofencoder 12 in an automated manner. - A
carrier signal 20 is selectively added tovideo signal 18 byoperator 16 atencoder 12 to modulateauxiliary data 21 withinvideo signal 18. The method of addingcarrier signal 20 is by selectively increasing and decreasing pixel intensity of paired scan lines as disclosed in Broughton. However, the present encoding method differs from Broughton in thatencoder 12 splits each field ofvideo signal 18 into multiple segments, such that each segment may be individually modulated withcarrier signal 20 and the complement of the data bit broadcast on the first field is modulated on the second field, as will be described in further detail below. It should be appreciated that the present method of selectively modulating can reverse the order of the fields (i.e., the first field and second field) as needed or desired in a particular embodiment. In the preferred embodiment, the present invention utilizes four equal segments per field. - Upon modulating
video signal 18,encoder 12 outputs a modulatedvideo signal 22 comprised ofvideo signal 18 and auxiliary data 21 (i.e., a composite video signal). Modulatedvideo signal 22 is then provided to abroadcast source 14 for distribution to end-users who will view the program.Broadcast source 14 is preferably a television broadcast station that broadcasts programs, but also may be other broadcast video sources and DVD media and other media sources including video tapes that will be provided to one or more end users. - Referring to Figs. 2 and 3, broadcast
source 14 provides modulatedvideo signal 22 to displaydevice 26.Display device 26 is representative of a television screen, video monitor or other video display, movie screen, computer monitor, video-converted display or video-like display, capable of receiving analog or digital video or video-representative signals from a suitable signal source, such as a television transmitter, a videotape, a streaming video server, a DVD, or the computerized display representation of such a source of image content. For present purposes, it will be assumed thatdisplay device 26 is a kinescope or other conventional type of television display or monitor (which may include multiple or single-beam types of projector displays). -
Display device 26 may schematically represent a video display for displayingvideo signals 18 but may also be any sort of electron gun, active, array or passive array display device capable of providing not only imaged information in a visible mode but also auxiliary information (e.g., data) in a substantially transparent mode.Display device 26 may be further characterized as a computer monitor or display, as well as a portion or computer window ofdisplay device 26.Display device 26 may also be a high definition or digital television, or other digital video presentation device.Display device 26 may vary in size, and may be small like a Sony® Watchman®, or large like a movie screen or a Sony Jumbotron®. Video signals 18 receivable frombroadcast source 14 bydisplay device 26 include those delivered by microwave relay, satellite retransmission or cable, streaming and other types of downloadable or viewable computer video presentations, and those generally made available by wired or wireless methods. - Modulated
video signal 22 is presented ondisplay device 26. Slotted hand-helddevice 29 optically receives modulatedvideo signal 22 by use of aphotodetector 62 on aninterface card 60. Slotted hand-helddevice 29 may be in the form of any type of hand manipulable device such as a smart card, cell phone, PDA, game unit or other palm like device that has a slot 66. Slotted hand-helddevice 29 may be held in the palm or between the fingers of a user in the general vicinity ofdisplay device 26, typically within the same room and, when necessary, oriented so thatphotodetector 62 may optically receive light from a visual representation of modulatedvideo signal 22 fromdisplay device 26. It should be appreciated thatphotodetector 62,interface card 60,data decoder 72 and slotted hand-helddevice 29 may alternatively be combined in a non-slotted hand-helddevice 28 such as used in Koplar I. - In the preferred embodiment of the present invention, a slotted hand-held
device 29 such as a PDA, game unit, or cellular telephone is outfitted with a slot 66 and contains software and/or other electronics to run aninterface protocol 68. The present invention may be used withvarious interface cards 60 and slots 66 provided thatdevice 29 uses aninterface protocol 68 that allows for expansive use of its protocol (i.e., an "open protocol") withcard 60 and slot 66. Preferably, slot 66 is a SD slot andinterface protocol 68 is the SDIO protocol. Aninterface card 60 also operatinginterface protocol 68 is inserted into slotted hand-helddevice 29, anddevice 29 runs software to interpret data received bycard 60 and passes it todevice 29 by use ofinterface protocol 68. - As further shown in Fig. 3 modulated
video signal 22, comprised ofvideo signal 20 andauxiliary data 21, is transmitted fromdisplay device 26 and detected byphotodetector 62 oninterface card 60. Thereafter, the received modulatedvideo signal 22 is decoded by adata decoder 72 located oninterface card 60. The decodedauxiliary data 21 is passed to slotted hand-helddevice 29 through use of aninterface protocol 68. Slotted hand-helddevice 29 utilizesauxiliary data 21 to provide the user with a benefit or promotional opportunities based on the receipt ofauxiliary data 21. The promotional opportunities may be redeemed or obtained using the optionalwireless Internet access 70, as described in Koplar I. - The slotted hand-held
device 29 preferably useswireless Internet access 70 to provide and/or redeem promotional opportunities over the Internet. The preferred protocol for wireless Internet access is the use of Bluetooth. Bluetooth provides a means for RF data to be passed in a specified form at a 2.4 GHz frequency between slotted hand-helddevice 29 and a transceiver that is connected to the Internet. It will be appreciated in the art of Internet networking that other means of providing wired and wireless Internet may be used with the present invention including Wifi 802.11. - As a further embodiment of the present invention,
interface card 60 may, in addition to or an alternative ofphotodetector 62, receive modulatedvideo signal 22 orauxiliary data 21 by other means including by use of a RF receiver such as when broadcastsource 14 is a decoder box that demodulates the modulated video signals and transmitsauxiliary data 21 by various methods known in the art of signal transmission including RF. - Also, when desirable, data storage (not shown) may be added to
interface card 60 to storeauxiliary data 21 or promotional opportunities for later recall. It should be appreciated that, depending on the application, it may be desirable to provide a large amount of space oninterface card 60 thereby allowing a significant amount of data to be stored and later retrieved. - In an alternate version of the optical detection of Fig. 2, Fig. 4 shows electrical detection of
auxiliary data 21.Broadcast source 14 provides modulatedvideo signal 22 to adecoder 13. As discussed in greater detail below,decoder 13 acts in a similar manner todata decoder 72 by determining whetherauxiliary data 21 is present in modulatedvideo signal 22 but also containstransmission device 24 and a video output to provide the modulatedvideo signal 22 to adisplay device 26.Auxiliary data 21 is provided to atransmission device 24, which transfers the information to a non-slotted hand-helddevice 28 without aphotodetector 62 but with anon-optical receiver 64 such as RF receivers, infrared and computer-like interconnections. Modulatedvideo signal 22 is passed unaltered throughdecoder 13 and out the video output and presented ondisplay device 26 so that a user may watch the video program. Upon receipt ofauxiliary data 21, non-slotted hand-helddevice 28 provides the user with a benefit or promotional opportunity. - In an alternate version of the foregoing,
non-optical receiver 64 may be implemented oninterface card 60 such that slotted hand-helddevice 29 replaces non-slotted hand-helddevice 28 and acts in a manner consistent with the foregoing description. -
Encoder 12 in Fig. 5 includes adigital video input 30 to receive avideo signal 18 fromsignal source 10 and to pass it to micro-controller 36. However,encoder 12 may receive ananalog video signal 18 viaanalog video input 32 and analog todigital converter 34. Analog todigital converter 34 digitizes theanalog video signal 18 according to known techniques such that it may be sent tomicro-controller 36. -
Micro-controller 36 is electronically connected to acarrier presence 38, which providesmicro-controller 36 with the timing of where, when and at whatintensity encoder 12 should insertcarrier signal 20 intovideo signal 18 at the direction ofoperator 16. Preferably, such instructions are received fromoperator 16 bycarrier presence 38 via a serial port. However it should appreciated in the art of electronics that other device interconnects ofencoder 12 are contemplated, including via universal serial bus (USB), "Firewire" protocol (IEEE 1394), and various wireless protocols. In an alternate embodiment,carrier presence 38 may be an operator interface so thatoperator 16 can directly interface withencoder 12. - Once
micro-controller 36 receivesvideo signal 18 and information fromcarrier presence 38, software 50 manages further operation ofencoder 12 and directsmicro-controller 36 to store the chrominance information ofvideo signal 18 instorage 40.Encoder electronics 42 at the direction of software 50 preferably uses the methods of Broughton and the present invention as will be described in further detail below to modulatecarrier signal 20 into the luminance ofvideo signal 18 thereby creating modulatedvideo signal 22. The resulting modulatedvideo signal 22 is then sent digitally fromencoder 12 bydigital video output 44, or in analog form by converting the resulting digital signal with digital toanalog converter 46 and outputting modulatedvideo signal 22 byanalog video output 48. -
Micro-controller 36 may consist of more than one processor to manage the various processing and input/output of the present invention, but preferably consists of a single processor. Moreover, the specific electronics and software used byencoder 12 may differ when its technology is included in a pre-existing device as opposed to a stand alone device.Encoder 12 may comprise varying degrees of hardware and software, as various components may interchangeably be used as either. - Fig. 6 shows an overview of the preferred embodiment of a
microcontroller 100 anddevice circuitry 102 ofdata decoder 32.Device circuitry 102 is comprised of ananalog pre-filter 104, a vertical detect/signal strength circuitry 106 and anauxiliary data detector 108, all of which are operatively associated with each other andmicrocontroller 100 as shown. - Referring to Fig. 7, the preferred embodiment of
analog pre-filter 104 that prepares the circuit for accurate digitization first comprises acurrent voltage converter 300.Current voltage converter 300 first comprises a photodetector D200, which optically reads avideo signal 18 fromdisplay device 26 and outputs a current tovoltage converter 300. Thereafter,current voltage converter 300 transforms the current detected by photodetector D200 into voltage. The circuitry ofvoltage converter 300 further comprises three resistors, R200, R201 and R202, three capacitors C200, C201 and C202, an operational amplifier U200 and voltages VA and VCC, all of which are operatively associated as shown. - An
automatic gain control 310 portion ofanalog prefilter 104 amplifiesvideo signal 18 by changing the resistance on the feedback circuit. The amount of gain provided to the circuit is controlled bymicrocontroller 100.Automatic gain control 310 is used withinterface card 60 as the distance and intensities received fromdisplay device 26 will vary. Accordingly, when the strength ofvideo signal 18 is low, it is desirable to add gain so that a better reading ofvideo signal 18 is possible. Therefore, the present invention measures the signal strength and decides whether to lower or increase the gain. The components ofautomatic gain control 310 include resistors R203, R208 and R209, capacitor C212, voltages VA and VCC an operational amplifier U400C and a digital potentiometer U204, all of which are operatively associated as shown. -
Video signal 18 passes fromautomatic gain control 310 to low pass filter - 80KHz cutoff 320. This circuit provides a low pass filter that removes the high frequency noise from the signal by eliminating all frequencies above a preset level (i.e., 80 kilohertz). The components of the low pass filter- 80KHz cutoff 320 include resistors R210, R204 and R205, capacitors C203, C204, and C206, voltages VA and VCC and operational amplifier U201, all of which are operatively associated as shown. -
Video signal 18 then passes from the low pass filter- 80KHz cutoff 320 to thehigh pass filter 7KHz cutoff 330.High pass filter 7KHz cutoff 330 cleans the signal below 7 KHZ by discarding the undesired signal. The components of the high pass filter - 7KHz cutoff 330 include resistors R206 and R207, capacitors C207, C208, C209, C210 and C211, voltages VA and VCC and operational amplifier U201, all of which are operatively associated as shown. Once the signal passes throughhigh pass filter 7KHz cutoff 330, the pre-filtering ofvideo signal 18 is complete. - Referring now to FIG. 8, the circuitry of vertical detect/
signal strength circuitry 106 in the preferred embodiment comprises asignal strength detector 340 and an analogvertical sync 350.Signal strength detector 340 first comprises a rectifier D300 that polarizesvideo signal 18. Thereafter,video signal 18 transitions through a buffer comprised of resistor R306 and R307, voltage VA, and operational amplifier U300B to invert the signal. The last portion of this circuit is an integrator, which measures the strength ofvideo signal 18 and is comprised of resistor R308, capacitor R305, voltage VA and operational amplifier U300C, all of which are operatively associated as shown. The output of the integrator is signal SSRES1 and is received bymicrocontroller 100 which then resets the signal strength integrator. - The signal for analog
vertical sync 350 is passed from low pass filter- 80KHz cutoff 320. Analogvertical sync 350 generates the desired vertical synchronization signal used to synchronize the reading of data bits fromauxiliary data 21. The first part of circuitry is a gaining amplifier that gains the signal and inverts it by use of resistor R300 and R301, capacitorC300, voltage VA and gate U300D. The second part of the circuitry provides a small filtering stage. Resistors R302 and R303 and capacitor C301 filter high spikes out of the signal. - Thereafter, the signal is processed by schmitt trigger inverters U302A and U302D, the double inversion acting as a buffer. Because of the nature of the schmitt trigger, voltage spikes are removed from the signal. Thereafter, the signal triggers a flip flop 74HC74. The output of the flip flop 74HC74 triggers a 555
timer 555, which is used to generate a constant timed pulse. During each pulse, regardless of how many triggers the 555timer 555 receives, it will not generate interloping pulses until it times out. Resistor R305 may be used to adjust the time constant, by which the pulse can become wider or narrower. Ifmicrocontroller 100 detects the pulse and then waits for another vertical retrace period (i.e., 16.67 milliseconds) and detects the pulse again, it knows that it has locked on the vertical synchronization signal. - Referring to FIG. 9, the pre-filter signal is passed to a
horizontal notch filter 360 that removesvideo signal 18 at the horizontal line scanning rate (i.e., 15570 KHz) from modulatedvideo signal 22 so that it does not interfere with the reading ofauxiliary data 21. Thereafter, low pass filter with cutoff at VEIL Freq. 370 is used for extra filtering to ensure that the signal higher than the 8 kilohertz is discarded. Then, the signal is passed to aband pass filter 380 which is another stage of filtering around 8 kilohertz. The signal then goes through asignal rectifier 390 that acts as an integrator that has a gain of one. Finally, the signal travels through a VEILsignal energy integrator 400 that measures the strength of the signal by measuring its voltage. The aforementioned circuits consists of a number of resistors R400-R413, capacitors C400-410, voltages VA and VCC, and operational amplifiers U400A, U400B, U400D, U401D, U401C, and U401B, all of which are operatively associated as shown. - As shown in FIG. 10,
microcontroller 100 and associated circuitry as would be used in a first version of the combination of slotted-hand device 29,data decoder 72 andinterface card 60 in a non-slotted hand-helddevice 28 withphotodetector 62 first comprises a power source consisting of four batteries BC500, BC501, BC502 and BC503. Each battery is 1.5 volts, and the power is provided to voltage regulator U501. Voltage regulator U501 providesmicrocontroller 100 with a steady 5 volts of power through D501. VCC and VA are also provided by voltage regulator U501, wherein by means of a voltage divider VA is 2½ volts and VCC is 5 volts. VCC is being fed through a diode D501 that provides battery voltage. - Diode D501 allows
microcontroller 100 to go into a sleep mode so as to reduce its need for voltage. Whenmicrocontroller 100 wants to sleep, it can shut of voltage regulator U501 and go into sleep mode. Dual analog switch MAX323 is used to reset both the signal strength integrator and the VEIL signal strength integrator via themicrocontroller 100. - Further components present in this embodiment are speaker SPK1, transistor Q504, visual display U503, switches S500, S501, S502, S503 and S504, and interface RS232, all of which are operatively associated as shown and the use of which are in accordance with the present invention as well as the hand-held devices described in Koplar I, Koplar II and Withers.
- In an alternate but preferred version of the present invention,
microcontroller 100 in Fig. 11 is shown as implemented oninterface card 60.Microcontroller 100 is shown in this preferred embodiment to be comprised of two separate microcontrollers U500 and U503, of which microcontroller U500 controls the operations ofmicrocontroller 100 as described in Fig. 10 above such as optical detection and determining whetherauxiliary data 21 is present invideo signal 18, and microcontroller U503 manages the interface with slot 66 (i.e., SDIO connector J501). SDIO connector J501 communicates withinterface card 60 as described below. Microcontroller U503 further controls the communication between the optical and SD portions of the circuitry. Preferably, microcontroller U503 runs at 8 MHz while microcontroller U500 runs at 4 MHz. - Port RS232 is a computer interface which may optionally be included in various embodiments such as to debug the system to ensure that the proper auxiliary data is being received and modulated on
interface card 60. Integrated circuit Max232 allowsinterface card 60 to communicate via a computer port RS232 so thatinterface card 60 may directly interact with a computer such as for debugging purposes. - In the preferred embodiment, a power source is not needed on
interface card 60 as power is provided through slot 66. However, a charge pump U504 changes the three volts received from slot 66 into five volts so as to properly powerinterface card 60. Other components as used in Fig. 10 as shown in Fig. 11. - The preferred embodiment of a method of modulating a
video signal 18 withauxiliary data 21 in FIG. 12. In afirst step 1000, a user orients or connects a receiver, such as slotted hand-helddevice 29, towards or in connection with adisplay device 26 for the purpose of capturing modulated video signals 28. Thereafter, in asecond step 1100, avideo signal 18 is captured fromdisplay device 26 by aphotodetector 30 ofinterface card 60. Amicrocontroller 100 anddevice circuitry 104 amplify, filter and shapevideo signal 18 received during athird step 1200. - Still referring to Fig. 12, during a
fourth step 1300microcontroller 100 determines whetherauxiliary data 21 is present in video signal 18 (i.e., whethervideo signal 18 is modulated video signal 22). If there is noauxiliary data 21 present invideo signal 18, the method returns tosecond step 1100 and again attempts to capture modulatedvideo signal 22. If infourth step 1300microcontroller 100 determines thatauxiliary data 21 is present, then the method proceeds to afifth step 1400 whereinmicrocontroller 100 determines whether a complete data packet 112 has been received byinterface card 60. Ifauxiliary data 21 is not in the form of data packet 112 or is otherwise unusable,auxiliary data 21 is discarded and the method returns tosecond step 1100. - If
auxiliary data 21 is in the form of data packet 112, during asixth step 1600microcontroller 100 determines the total number of packets 114 thatinterface card 60 expects to receive and the identification of a data packet number 116 of the just received data packet 112. If the total number of packets 114 to be received byinterface card 60 is 1, thenmicrocontroller 100 takes further action necessary to provide the user of slotted hand-helddevice 29 with a benefit as a result of receiving all of the desired auxiliary data 21 (e.g., promotional opportunities) as disclosed in aninth step 1800. If total number of packets 114 is greater than 1, thenmicrocontroller 100 proceeds to aneighth step 1700 wherebymicrocontroller 100 determines whether every data packet 112 corresponding to each data packet number 116 has been captured. - If in the
eighth step 1700 all data packets 112 have not been captured,interface card 60 returns to thesecond step 1100 so as to attempt to capture the missing data packets 112. If all data packets 112 have been captured, slotted hand-helddevice 29 proceeds to provide the promotional opportunities to the user according toninth step 1800. During theninth step 1800, a user of slotted hand-helddevice 29 receives promotional opportunities or other benefits that may include textual information, prizes, coupons, games, special access privileges, etc. Thereafter, the method of the present invention is terminated during afinal step 1900. - During the foregoing method, the fields of
video signal 20 are encoded differently than in Broughton. Broughton's method involves encoding each portion of afield 200 with an identical bit. As shown in FIG. 13, everyslice 200a-h offield 200 contains the bit "1". - With the present invention,
fields 210a and 210b of aframe 220 are encoded with complementary bits. Thus, a logic "1" is encoded in twofields 210a and 210b as "1 0", and a logic "0" is encoded in twofields 210a and 210b as "0 1". Wheninterface card 60 receives the bits, it performs a field comparison by subtracting the result of the intensity of twosuccessive fields 210a and 210b. This method produces a reliable data rate of 30 bits per second. - As shown in Fig. 13, the speed of the present invention is increased by splitting every field 210 into multiple segments with each portion having its own respective bit. Preferably, each field 210 is split into four equal portions such that each portions is at an equal offset from one another. Thus,
fields 210a and 210b splits appear in Fig. 13 with the 4 data bits decoded as "1 0 1 1". This method of splitting the fields produces a reliable rate of 120 bits per second data. - For the foregoing method to function, during the second step of Fig. 12,
microcontroller 100 needs to determine wherefields 210a and 210b begin during decoding so that it can properly obtain all of the bits. In a first embodiment,data decoder 32 obtains its proper timing by looking for and synchronizing to the vertical retrace period invideo signal 20. - Referring to Fig. 14,
microcontroller 100 first looks for a section of the picture presented ondisplay device 26 that is completely black (i.e., no video) and therefore may be a vertical retrace signal indicating that a vertical refresh of the picture has occurred. Thereafter,microcontroller 100 waits a sufficient time for another vertical refresh to occur (i.e., 16.67 milliseconds). Ifmicrocontroller 100 reads two successive regions that are completely black, and they are 16.67 milliseconds apart,microcontroller 100 acts under the belief that it has locked on the vertical retrace signal and continues to read and record data packets 112 at a preferred displacement of 2 milliseconds from the beginning of the vertical retrace signal. If during the foregoing synchronizationprocess data decoder 32 fails to detect a first and a second black region, it will continue attempting to synchronize by searching for black regions that are 16.67 milliseconds apart beyond where it previously looked. - Once the vertical retrace signal is synchronized, and
data decoder 32 successfully reads valid data,data decoder 32 is then in synchronization withvideo signal 18 and temporarily stops looking for the vertical retrace signal. Under the first preferred embodiment ofvideo signal 18 locking of the present invention,data decoder 32 locks on the vertical retrace signal for a few seconds and thereafter releases it and the synchronization process starts over again. Re-detection and re-synchronization of the present invention in this embodiment is preferred because timing ofmicrocontroller 100 is not entirely accurate, therefore causing the synchronization of the vertical retrace signal to drift after a few seconds and making it more difficult to detect validauxiliary data 21. - In a second but preferred embodiment, the beginning of
auxiliary data 21 is determined by looking for a sync.Data decoder 32 looks for a first data bit in data packet 112, such as A5, that acts as a marker or preamble.Data decoder 32 drifts very slowly acrossdisplay device 26 trying to capture the marker, then data decoder 32 acts as though it is at the start of data packet 112 and sequentially reads the various bits. The data bits are read sequentially and then shifted in a register to its left, so thatdata decoder 32 receives the A5 byte first. Once a valid data packet 112 is received, then data decoder 32 is perfectly synced and can continue to read successive data packets 112.Data decoder 32 is ensured of a valid data packet 112 by checking the CRCbyte of data packet 112. -
Auxiliary data 21 is read bymicrocontroller 32 in data packets 112 of preferably 8 bytes (i.e., 64 bits) in length. As shown in Fig. 14, the preferred embodiment of data packet 112 first comprises afirst byte 250 containing a preamble that identifies it as the start of data packet 112. Asecond byte 252 contains thedata packet number 26 relative to the total number of packets sent 25 (i.e., packet is 2 of 5). The following fivebytes final byte 264 contains a Cyclic Redundancy Check (CRC) to ensure that the received data bytes 250-262 were precisely matched with those transmitted from the signal source. - Data packets 112 of a message 118 are typically sent by
broadcast source 14 more than one time as will be appreciated in the art of computer networking. Message 118 in the preferred embodiment may contain up to 16 data packets 112. Data packets 112 may be received by slotted hand-helddevice 29 or other receiver in any order, and any data packets 112 that have previously been successfully captured by slotted hand-helddevice 29 will be ignored. Once all data packets 112 have been correctly received by slotted hand-helddevice 29, the entire message 118 is then declared to have been successfully decoded, and slotted hand-helddevice 29 takes appropriate action by providing the user with a benefit or one or more other promotional opportunities. - It should be understood from the foregoing that, while particular embodiments of the invention have been illustrated and described, various modifications can be made thereto without departing from the spirit and scope of the invention. Therefore, it is not intended that the invention be limited by the specification; instead, the scope of the present invention is intended to be limited only by the appended claims.
Claims (28)
a card microcontroller,
a receiver electronically coupled to the card microcontroller for receiving the modulated video signal from the broadcast source, and
circuitry electronically coupled to the card microcontroller and the receiver for demodulating the modulated video signal and reproducing the auxiliary data, and transferring the auxiliary data to the hand-held device via an interface protocol; and
a card microcontroller,
a receiver electronically coupled to the card microcontroller for receiving the modulated video signal from the broadcast source, and
circuitry electronically coupled to the card microcontroller and the receiver for transferring the modulated video signal to the hand-held device via an interface protocol; and
detecting a portion of the video signal without auxiliary data relating to the timing of the vertical retrace period,
awaiting a period of time equivalent to a vertical retrace period for a refresh of the video signal,
redetecting with the portion of the video signal without auxiliary data, and
determining the timing of the vertical retrace period by confirming redetection of the video signal without auxiliary data after a refresh of the display device.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/676,940 US7650624B2 (en) | 2002-10-01 | 2003-10-01 | Method and apparatus for modulating a video signal with data |
US676940 | 2003-10-01 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1521464A2 true EP1521464A2 (en) | 2005-04-06 |
EP1521464A3 EP1521464A3 (en) | 2005-04-20 |
Family
ID=34314043
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04077707A Withdrawn EP1521464A3 (en) | 2003-10-01 | 2004-10-01 | Method and apparatus for modulating a video signal with data |
Country Status (5)
Country | Link |
---|---|
US (3) | US7650624B2 (en) |
EP (1) | EP1521464A3 (en) |
JP (1) | JP2005167986A (en) |
KR (1) | KR20050032487A (en) |
CA (1) | CA2483492A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008025824A1 (en) * | 2006-08-31 | 2008-03-06 | Siemens Enterprise Communications Gmbh & Co. Kg | Method for secured transmission of digital information by means of optical information |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7650624B2 (en) | 2002-10-01 | 2010-01-19 | Koplar Interactive Systems International, L.L.C. | Method and apparatus for modulating a video signal with data |
US7197583B2 (en) * | 2003-01-21 | 2007-03-27 | Zentek Technology Japan, Inc. | SDIO controller |
US7330511B2 (en) * | 2003-08-18 | 2008-02-12 | Koplar Interactive Systems International, L.L.C. | Method and system for embedding device positional data in video signals |
US7116374B2 (en) * | 2003-08-26 | 2006-10-03 | Koplar Interactive Systems International, L.L.C. | Method and system for enhanced modulation of video signals |
JP2005117447A (en) * | 2003-10-09 | 2005-04-28 | Nec Corp | Animation recording device, animation recording method and animation recording program |
US7075583B2 (en) * | 2003-10-20 | 2006-07-11 | Koplar Interactive Systems International, L.L.C. | Methods for improved modulation of video signals |
JP4740857B2 (en) * | 2004-07-28 | 2011-08-03 | パナソニック株式会社 | Video display device and video display system |
US7826674B1 (en) | 2004-09-10 | 2010-11-02 | Koplar Interactive Systems International, L.L.C. | Content signal analysis |
US7920208B2 (en) * | 2005-08-11 | 2011-04-05 | Mario Maracic | Method, system, and apparatus for communication by means of transmitted signals over visual media |
US20070153025A1 (en) * | 2005-12-29 | 2007-07-05 | Mitchell Owen R | Method, apparatus, and system for encoding and decoding a signal on a viewable portion of a video |
US8363161B2 (en) * | 2006-05-26 | 2013-01-29 | Broadcom Corporation | Systems, methods, and apparatus for synchronization of audio and video signals |
KR100838575B1 (en) | 2007-01-15 | 2008-06-19 | 주식회사 대우일렉트로닉스 | Noise removal circuit for liquid crystal display television |
JPWO2009069692A1 (en) * | 2007-11-27 | 2011-04-14 | 日本電気株式会社 | Content distribution system, content distribution server, content distribution method, and content distribution program |
US8665374B2 (en) * | 2008-08-22 | 2014-03-04 | Disney Enterprises, Inc. | Interactive video insertions, and applications thereof |
US9015741B2 (en) | 2009-04-17 | 2015-04-21 | Gracenote, Inc. | Method and system for remotely controlling consumer electronic devices |
US8189340B2 (en) | 2009-06-24 | 2012-05-29 | Ivs, Inc. | Mobile digital video recorder |
US9277183B2 (en) * | 2009-10-13 | 2016-03-01 | Sony Corporation | System and method for distributing auxiliary data embedded in video data |
US8713604B2 (en) | 2010-06-23 | 2014-04-29 | Echostar Technologies L.L.C. | Systems and methods for processing supplemental information associated with media programming |
US9147222B2 (en) * | 2010-06-23 | 2015-09-29 | Digimarc Corporation | Detecting encoded signals under adverse lighting conditions using adaptive signal detection |
US20130009969A1 (en) * | 2011-07-05 | 2013-01-10 | Netanel Goldberg | Methods circuits & systems for wireless transmission of a video signal from a computing platform |
US8599311B2 (en) * | 2011-07-14 | 2013-12-03 | Amimon Ltd. | Methods circuits devices and systems for transmission and display of video |
US8949923B2 (en) * | 2012-02-21 | 2015-02-03 | Time Warner Cable Enterprises Llc | Remote media streaming |
CN103607559A (en) * | 2013-11-07 | 2014-02-26 | 成都斯科瑞特科技有限公司 | Communication method of video file, monitoring terminal, monitoring server and video monitoring system |
US20160065647A1 (en) * | 2014-08-26 | 2016-03-03 | Sandeep VENKATESH | System and method for enabling downloading of files |
JP6670996B2 (en) * | 2014-09-26 | 2020-03-25 | パナソニックIpマネジメント株式会社 | Display device and display method |
FR3053557B1 (en) * | 2016-07-01 | 2018-07-06 | Sagemcom Broadband Sas | METHOD FOR STORING A MULTIMEDIA CONTENT, ASSOCIATED READING METHOD AND METHOD FOR MANAGING A STORAGE SPACE CONTAINING SUCH CONTENT |
US11544748B2 (en) | 2017-10-26 | 2023-01-03 | Advocado, Inc | Online advertising and promotional coordination system |
US10945033B2 (en) * | 2018-03-14 | 2021-03-09 | Idomoo Ltd. | System and method to generate a customized, parameter-based video |
US10904637B2 (en) * | 2018-12-17 | 2021-01-26 | Qualcomm Incorporated | Embedded rendering engine for media data |
CN110428788A (en) * | 2019-07-24 | 2019-11-08 | 深圳市华星光电技术有限公司 | A kind of the common voltage compensation circuit and compensation system of display panel |
US11420118B2 (en) * | 2019-10-01 | 2022-08-23 | Sony Interactive Entertainment Inc. | Overlapping encode and transmit at the server |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3493674A (en) * | 1965-05-28 | 1970-02-03 | Rca Corp | Television message system for transmitting auxiliary information during the vertical blanking interval of each television field |
US3993861A (en) * | 1975-03-24 | 1976-11-23 | Sanders Associates, Inc. | Digital video modulation and demodulation system |
US4186413A (en) * | 1977-11-14 | 1980-01-29 | Sanders Associates, Inc. | Apparatus for receiving encoded messages on the screen of a television receiver and for redisplay thereof on the same receiver screen in a readable format |
WO1999041909A1 (en) * | 1998-02-10 | 1999-08-19 | Scm Microsystems Gmbh | Multimedia system, portable operating device and communication module for use in said system |
WO2001058151A2 (en) * | 2000-02-04 | 2001-08-09 | Intel Corporation | Displaying enhanced content information on a remote control unit |
WO2002098029A1 (en) * | 2001-05-25 | 2002-12-05 | Think Tank & Associates | Interactive system and method for collecting data and generating reports regarding viewer habits |
Family Cites Families (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5280734A (en) * | 1975-12-27 | 1977-07-06 | Sony Corp | Tv picture receiver |
US4688102A (en) * | 1982-11-11 | 1987-08-18 | Canon Kabushiki Kaisha | Color video signal mixing system |
US4642682A (en) * | 1984-04-27 | 1987-02-10 | Vta Technologies, Inc. | Phase responsive composite video signal control system |
US4691245A (en) * | 1984-12-03 | 1987-09-01 | Eastman Kodak Company | Method and apparatus for combining two color video signals |
US4654700A (en) * | 1985-04-01 | 1987-03-31 | Sanders Associates, Inc. | Optical decoder |
US5128752A (en) * | 1986-03-10 | 1992-07-07 | Kohorn H Von | System and method for generating and redeeming tokens |
US4807031A (en) * | 1987-10-20 | 1989-02-21 | Interactive Systems, Incorporated | Interactive video method and apparatus |
US5010499A (en) * | 1988-02-22 | 1991-04-23 | Yee Keen Y | Digital data capture for use with TV set or monitor |
DE3942570A1 (en) * | 1989-12-22 | 1991-07-04 | Inst Rundfunktechnik Gmbh | METHOD FOR TRANSMITTING DIGITAL INFORMATION, IN PARTICULAR SOUND INFORMATION, IN A TELEVISION CHANNEL |
US5561467A (en) * | 1990-03-26 | 1996-10-01 | Nippon Hoso Kyokai | Receiver and channel compatible encoding/decoding system for high definition video |
US5526034A (en) * | 1990-09-28 | 1996-06-11 | Ictv, Inc. | Interactive home information system with signal assignment |
US5387941A (en) * | 1991-06-14 | 1995-02-07 | Wavephore, Inc. | Data with video transmitter |
US5327237A (en) * | 1991-06-14 | 1994-07-05 | Wavephore, Inc. | Transmitting data with video |
US5831679A (en) * | 1991-06-14 | 1998-11-03 | Wavephore, Inc. | Network for retrieval and video transmission of information |
US5343239A (en) * | 1991-11-20 | 1994-08-30 | Zing Systems, L.P. | Transaction based interactive television system |
US5721788A (en) * | 1992-07-31 | 1998-02-24 | Corbis Corporation | Method and system for digital image signatures |
US5557334A (en) * | 1993-01-12 | 1996-09-17 | Visual Automation Systems, Inc. | Apparatus for tracking the flow of video signals by incorporating patterns of machine readable signals which will appear at predetermined locations of a television picture |
US5423555A (en) * | 1993-04-14 | 1995-06-13 | Kidrin; Thom | Interactive television and video game system |
US5461426A (en) * | 1993-08-20 | 1995-10-24 | Samsung Electronics Co., Ltd. | Apparatus for processing modified NTSC television signals, with digital signals buried therewithin |
US5768426A (en) * | 1993-11-18 | 1998-06-16 | Digimarc Corporation | Graphics processing system employing embedded code signals |
US5594493A (en) * | 1994-01-19 | 1997-01-14 | Nemirofsky; Frank R. | Television signal activated interactive smart card system |
WO1995029558A1 (en) * | 1994-04-20 | 1995-11-02 | Shoot The Moon Products, Inc. | Method and apparatus for nesting secondary signals within a television signal |
US5539471A (en) * | 1994-05-03 | 1996-07-23 | Microsoft Corporation | System and method for inserting and recovering an add-on data signal for transmission with a video signal |
US5621471A (en) * | 1994-05-03 | 1997-04-15 | Microsoft Corporation | System and method for inserting and recovering an add-on data signal for transmission with a video signal |
JP3089160B2 (en) * | 1994-05-20 | 2000-09-18 | シャープ株式会社 | Digital recording and playback device |
US5488423A (en) * | 1994-11-17 | 1996-01-30 | U.S. Narrow Networks, Inc. | Home communication method and apparatus |
US5555024A (en) * | 1994-12-23 | 1996-09-10 | Samsung Electronics Co., Ltd. | Transmitters for burying digital signals within the trace and retrace intervals of NTSC television signals |
US5510845A (en) * | 1994-12-23 | 1996-04-23 | Samsung Electronics Co., Ltd. | Receivers for digital signals buried within the trace and retrace intervals of NTSC television signals |
US5737417A (en) * | 1995-04-24 | 1998-04-07 | Technicolor Videocassette, Inc. | Videotape anti-copying encryption scheme |
US6072521A (en) * | 1995-06-15 | 2000-06-06 | Intel Corporation | Hand held apparatus for simulating two way connectivity for one way data streams |
CA2195037C (en) * | 1996-01-25 | 2001-03-20 | Theodore Ii Sizer | System and method for encoding digital information in a television signal |
US6240555B1 (en) * | 1996-03-29 | 2001-05-29 | Microsoft Corporation | Interactive entertainment system for presenting supplemental interactive content together with continuous video programs |
US6647548B1 (en) * | 1996-09-06 | 2003-11-11 | Nielsen Media Research, Inc. | Coded/non-coded program audience measurement system |
US6415439B1 (en) * | 1997-02-04 | 2002-07-02 | Microsoft Corporation | Protocol for a wireless control system |
US6211919B1 (en) * | 1997-03-28 | 2001-04-03 | Tektronix, Inc. | Transparent embedment of data in a video signal |
US6118490A (en) * | 1997-05-01 | 2000-09-12 | Interactive Learning Group, Inc. | Display based optical communication system |
US6094228A (en) * | 1997-10-28 | 2000-07-25 | Ciardullo; Daniel Andrew | Method for transmitting data on viewable portion of a video signal |
US6330034B1 (en) * | 1997-10-31 | 2001-12-11 | Texas Instruments Incorporated | Color phase-locked loop for video decoder |
US6091822A (en) * | 1998-01-08 | 2000-07-18 | Macrovision Corporation | Method and apparatus for recording scrambled video audio signals and playing back said video signal, descrambled, within a secure environment |
US6661905B1 (en) * | 1998-03-23 | 2003-12-09 | Koplar Interactive Systems International Llc | Method for transmitting data on a viewable portion of a video signal |
US6593972B1 (en) * | 1998-05-12 | 2003-07-15 | Clark E. Johnson, Jr. | Interactive display system |
US6256070B1 (en) * | 1998-08-03 | 2001-07-03 | Ati International Srl | Concurrent discrete time oscillators (DTO) for video and closed caption encoding |
US6215526B1 (en) * | 1998-11-06 | 2001-04-10 | Tivo, Inc. | Analog video tagging and encoding system |
US6351289B1 (en) * | 1998-11-24 | 2002-02-26 | Winbond Electronics Corp. | Method and apparatus that generates VBI data coding waveforms |
US6411800B1 (en) * | 1999-01-07 | 2002-06-25 | Surfernetwork.Com, Inc | Enhanced radio data system |
US6415438B1 (en) * | 1999-10-05 | 2002-07-02 | Webtv Networks, Inc. | Trigger having a time attribute |
US6704058B2 (en) * | 1999-12-30 | 2004-03-09 | Microsoft Corporation | System and method of adaptive timing estimation for horizontal overscan data |
US7213254B2 (en) * | 2000-04-07 | 2007-05-01 | Koplar Interactive Systems International Llc | Universal methods and device for hand-held promotional opportunities |
US6804377B2 (en) * | 2000-04-19 | 2004-10-12 | Digimarc Corporation | Detecting information hidden out-of-phase in color channels |
EP1285503A2 (en) * | 2000-05-31 | 2003-02-26 | Optinetix, Inc. | Systems and methods for distributing information through broadcast media |
US7057666B2 (en) * | 2000-10-24 | 2006-06-06 | Harris Corporation | System and method for encoding information into a video signal |
US7071994B2 (en) * | 2001-01-04 | 2006-07-04 | Telisar Corporation | System and method for nondisruptively embedding an OFDM modulated data signal into a composite video signal |
US20020183102A1 (en) * | 2001-04-21 | 2002-12-05 | Withers James G. | RBDS method and device for processing promotional opportunities |
US20030144035A1 (en) * | 2001-12-19 | 2003-07-31 | Lee Weinblatt | Electronically generating and displaying a reward coupon |
US7313375B2 (en) * | 2002-05-02 | 2007-12-25 | Lucent Technologies Inc. | Follow-me broadcast reception method and system |
US7650624B2 (en) | 2002-10-01 | 2010-01-19 | Koplar Interactive Systems International, L.L.C. | Method and apparatus for modulating a video signal with data |
US7167209B2 (en) * | 2003-02-07 | 2007-01-23 | Warner Bros. Entertainment, Inc. | Methods for encoding data in an analog video signal such that it survives resolution conversion |
US7069494B2 (en) * | 2003-04-17 | 2006-06-27 | International Business Machines Corporation | Application of special ECC matrix for solving stuck bit faults in an ECC protected mechanism |
US7116374B2 (en) * | 2003-08-26 | 2006-10-03 | Koplar Interactive Systems International, L.L.C. | Method and system for enhanced modulation of video signals |
US7075583B2 (en) * | 2003-10-20 | 2006-07-11 | Koplar Interactive Systems International, L.L.C. | Methods for improved modulation of video signals |
-
2003
- 2003-10-01 US US10/676,940 patent/US7650624B2/en active Active - Reinstated
-
2004
- 2004-10-01 KR KR1020040078258A patent/KR20050032487A/en not_active Application Discontinuation
- 2004-10-01 EP EP04077707A patent/EP1521464A3/en not_active Withdrawn
- 2004-10-01 JP JP2004290220A patent/JP2005167986A/en not_active Withdrawn
- 2004-10-01 CA CA002483492A patent/CA2483492A1/en not_active Abandoned
-
2009
- 2009-12-04 US US12/630,970 patent/US7900236B2/en not_active Expired - Lifetime
-
2010
- 2010-04-30 US US12/771,571 patent/US10511877B2/en not_active Expired - Fee Related
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3493674A (en) * | 1965-05-28 | 1970-02-03 | Rca Corp | Television message system for transmitting auxiliary information during the vertical blanking interval of each television field |
US3993861A (en) * | 1975-03-24 | 1976-11-23 | Sanders Associates, Inc. | Digital video modulation and demodulation system |
US4186413A (en) * | 1977-11-14 | 1980-01-29 | Sanders Associates, Inc. | Apparatus for receiving encoded messages on the screen of a television receiver and for redisplay thereof on the same receiver screen in a readable format |
WO1999041909A1 (en) * | 1998-02-10 | 1999-08-19 | Scm Microsystems Gmbh | Multimedia system, portable operating device and communication module for use in said system |
WO2001058151A2 (en) * | 2000-02-04 | 2001-08-09 | Intel Corporation | Displaying enhanced content information on a remote control unit |
WO2002098029A1 (en) * | 2001-05-25 | 2002-12-05 | Think Tank & Associates | Interactive system and method for collecting data and generating reports regarding viewer habits |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008025824A1 (en) * | 2006-08-31 | 2008-03-06 | Siemens Enterprise Communications Gmbh & Co. Kg | Method for secured transmission of digital information by means of optical information |
Also Published As
Publication number | Publication date |
---|---|
CA2483492A1 (en) | 2005-04-01 |
US7650624B2 (en) | 2010-01-19 |
JP2005167986A (en) | 2005-06-23 |
EP1521464A3 (en) | 2005-04-20 |
US10511877B2 (en) | 2019-12-17 |
US20100141837A1 (en) | 2010-06-10 |
KR20050032487A (en) | 2005-04-07 |
US20040117856A1 (en) | 2004-06-17 |
US7900236B2 (en) | 2011-03-01 |
US20100274643A1 (en) | 2010-10-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7900236B2 (en) | Method and apparatus for modulating a video signal with data | |
FI93916B (en) | Interactive video method and device | |
US9247197B2 (en) | Systems and methods for subscriber authentication | |
CN105430512A (en) | Method and device for displaying information on video image | |
EP0746941B1 (en) | Interactive television security through transaction time stamping | |
FR2505114A1 (en) | TELEVISION VIDEO DATA PROCESSING SYSTEM | |
JPH08237622A (en) | Communication system for digital information in video signal | |
US8233088B2 (en) | Methods and systems for improved modulation of video signals | |
US8018531B2 (en) | Method and system of detecting signal presence from a video signal presented on a digital display device | |
FR2540322A1 (en) | CONTROL PROGRAM SIGNAL DEMODULATION DEVICE | |
CN103197836B (en) | The exchange method of a kind of multimedia messages, Apparatus and system | |
EP1186169B1 (en) | Digital television receiver/decoder device with playback for interactive pre-recorded television programme | |
NL8500938A (en) | PLAYBACK FOR STILL IMAGES WITH SOUND. | |
JP2003519978A (en) | Method and apparatus for communicating status information using a vertical blanking interval | |
CN114078221A (en) | Video abstract generation method and device | |
EP1643766A1 (en) | Information recording device, information recording method, information transmission device, and information transmission method | |
CN113573100A (en) | Advertisement display method, equipment and system | |
US20070279524A1 (en) | Information Multiplexing Device And Method, And Computer Program | |
CN107635149A (en) | Method for processing video frequency and device | |
JPS62101188A (en) | System for receiving and reproducing transmission picture information on transmission line of tv receiver | |
WO2005004155A1 (en) | Information recording device and information recording method | |
WO2005043902A1 (en) | Methods for improved modulation of video signals | |
JPS5834689A (en) | Character multiplex broadcasting receiver |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: 7H 04N 5/445 B Ipc: 7H 04N 7/173 B Ipc: 7H 04N 7/08 A |
|
17P | Request for examination filed |
Effective date: 20050816 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20080503 |