US20090122184A1 - Providing identifiable video streams of different picture formats - Google Patents
Providing identifiable video streams of different picture formats Download PDFInfo
- Publication number
- US20090122184A1 US20090122184A1 US12/342,576 US34257608A US2009122184A1 US 20090122184 A1 US20090122184 A1 US 20090122184A1 US 34257608 A US34257608 A US 34257608A US 2009122184 A1 US2009122184 A1 US 2009122184A1
- Authority
- US
- United States
- Prior art keywords
- video
- picture
- video stream
- stream
- picture format
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
Definitions
- the present invention relates to digital television and, more specifically to receivers with different capabilities for receiving, processing and displaying the same emission of a compressed video signal, each receiver providing one in a plurality of picture formats according to its respective capability.
- HDTV digital television compressed video picture formats
- the picture formats currently used in HDTV are 1280 ⁇ 720 pixels progressive, 1920 ⁇ 1080 pixels interlaced, and 1920 ⁇ 1080 pixels progressive. These picture formats are more commonly referred to as 720P, 1080i and 1080P, respectively.
- the 1080i format which comprises of interlaced pictures, each picture or frame being two fields, shows 30 frames per second and it is deemed as the MPEG-2 video format requiring the most severe consumption of processing resources.
- the 1080P format shows 60 frames per second, each frame being a progressive picture, and results in a doubling of the most severe consumption of processing resources.
- a receiver capable of processing a maximum of 1080i-60 is also capable of processing a maximum 1080P-30.
- broadcasters intend to introduce 1080P-60 emissions and CE manufacturers intend to provide HDTVs and HDTV monitors capable of rendering 1080P-60, in the near future.
- 1080P-60 includes twice as much picture data as either 1080i-60 or 1080P-30. Dual carrying channels or programs as 1080P-60 and 1080i-60 would not be an acceptable solution because it triples the channel consumption of a single 1080i-60 transmission.
- FIG. 1 is a high-level block diagram depicting a non-limiting example of a subscriber television system.
- FIG. 2 is a block diagram of a DHCT in accordance with one embodiment of the present invention.
- FIG. 3 illustrates program specific information (PSI) of a program having elementary streams including encoded video streams which may be combined to form a single video stream encoded as 1080P-60.
- PSI program specific information
- FIG. 4A illustrates first and second video streams in display order.
- FIG. 4B illustrates pictures according to picture types in display order.
- FIG. 4C illustrates transmission order of the pictures in display order of FIG. 2B .
- picture is used throughout this specification as one from a sequence of pictures that constitutes video, or digital video, in one of any of a plurality of forms.
- a “frame” means a picture, either as a full progressive picture or in reference to a whole instance of a full frame comprising both fields of an interlaced picture.
- FIG. 1 is a block diagram depicting a non-limiting example of a subscriber television system (STS) 100 .
- the STS 100 includes a headend 110 and a DHCT 200 that are coupled via a network 130 .
- the DHCT 200 is typically situated at a user's residence or place of business and may be a stand-alone unit or integrated into another device such as, for example, the display device 140 or a personal computer (not shown).
- the DHCT 200 receives signals (video, audio and/or other data) including, for example, MPEG-2 streams, among others, from the headend 110 through the network 130 and provides any reverse information to the headend 110 through the network 130 .
- the network 130 may be any suitable means for communicating television services data including, for example, a cable television network or a satellite television network, among others.
- the headend 110 may include one or more server devices (not shown) for providing video, audio, and textual data to client devices such as DHCT 200 .
- Television services are provided via the display device 140 which is typically a television set.
- the display device 140 may also be any other device capable of displaying video images including, for example, a computer monitor.
- FIG. 2 is a block diagram illustrating selected components of a DHCT 200 in accordance with one embodiment of the present invention. It will be understood that the DHCT 200 shown in FIG. 2 is merely illustrative and should not be construed as implying any limitations upon the scope of the preferred embodiments of the invention. For example, in another embodiment, the DHCT 200 may have fewer, additional, and/or different components than illustrated in FIG. 2 .
- a DHCT 200 is typically situated at a user's residence or place of business and may be a stand alone unit or integrated into another device such as, for example, a television set or a personal computer.
- the DHCT 200 preferably includes a communications interface 242 for receiving signals (video, audio and/or other data) from the headend 110 through the network 130 ( FIG. 1 ) and for providing any reverse information to the headend 110 .
- the DHCT 200 is referred to as a receiver such as receiver 200 throughout this specification.
- the DHCT 200 further preferably includes at least one processor 244 for controlling operations of the DHCT 200 , an output system 248 for driving the television display 140 , and a tuner system 245 for tuning to a particular television channel or frequency and for sending and receiving various types of data to/from the headend 110 .
- the DHCT 200 may, in another embodiment, include multiple tuners for receiving downloaded (or transmitted) data.
- Tuner system 245 can select from a plurality of transmission signals provided by the subscriber television system 100 , including a 1080P-60 program.
- Tuner system 245 enables the DHCT 200 to tune to downstream media and data transmissions, thereby allowing a user to receive digital media content such as a 1080P-60 program via the subscriber television system.
- the tuner system 245 includes, in one implementation, an out-of-band tuner for bi-directional quadrature phase shift keying (QPSK) data communication and a quadrature amplitude modulation (QAM) tuner (in band) for receiving television signals.
- QPSK quadrature phase shift keying
- QAM quadrature amplitude modulation
- a user command interface 246 receives externally-generated user inputs or commands from an input device such as, for example, a remote control. User inputs could be alternatively received via communication port 274 .
- the DHCT 200 may include one or more wireless or wired interfaces, also called communication ports 274 , for receiving and/or transmitting data to other devices.
- the DHCT 200 may feature USB (Universal Serial Bus), Ethernet, IEEE-1394, serial, and/or parallel ports, etc.
- DHCT 200 may also include an analog video input port for receiving analog video signals.
- User input may be provided via an input device such as, for example, a hand-held remote control device or a keyboard.
- the DHCT 200 includes signal processing system 214 , which comprises a demodulating system 213 and a transport demultiplexing and parsing system 215 (herein demultiplexing system) for processing broadcast media content and/or data.
- signal processing system 214 comprises a demodulating system 213 and a transport demultiplexing and parsing system 215 (herein demultiplexing system) for processing broadcast media content and/or data.
- One or more of the components of the signal processing system 214 can be implemented with software, a combination of software and hardware, or preferably in hardware.
- Demodulating system 213 comprises functionality for demodulating analog or digital transmission signals. For instance, demodulating system 213 can demodulate a digital transmission signal in a carrier frequency that was modulated, among others, as a QAM-modulated signal.
- analog video decoder 216 converts the analog TV signal into a sequence of digitized pictures and their respective digitized audio.
- the analog TV decoder 216 and other analog video signal components may not exist in receivers or DHCTs that do not process analog video or TV channels.
- a compression engine in the headend processes a sequence of 1080P-60 pictures and associated digitized audio and converts them into compressed video and audio streams, respectively.
- the compressed video and audio streams are produced in accordance with the syntax and semantics of a designated audio and video coding method, such as, for example, MPEG-2, so that they can be interpreted by video decoder 223 and audio decoder 225 for decompression and reconstruction after transmission of the two video streams corresponding to the 1080P-60 compressed signal.
- Each compressed stream consists of a sequence of data packets containing a header and a payload.
- Each header contains a unique packet identification code, or packet identifier (PID) as is the casein MPEG-2 Transport specification, associated with the respective compressed stream.
- PID packet identification code
- the compression engine or a multiplexer at the headend multiplexes the first and second video streams into a transport stream, such as an MPEG-2 transport stream.
- Video decoder 223 may be capable of decoding a first compressed video stream encoded according to a first video specification and a second compressed video stream encoded according to a second video specification that is different than the first video specification.
- Video decoder 223 may comprise of two different video decoders, each respectively designated to decode a compressed video stream according to the respective video specification.
- Parsing capabilities 215 within signal processing 214 allow for interpretation of sequence and picture headers.
- the packetized compressed streams can be output by signal processing 214 and presented as input to media engine 222 for decompression by video decoder 223 and audio decoder 225 for subsequent output to the display device 140 ( FIG. 1 ).
- Demultiplexing system 215 can include MPEG-2 transport demultiplexing. When tuned to carrier frequencies carrying a digital transmission signal, demultiplexing system 215 enables the separation of packets of data, corresponding to the desired video streams, for further processing. Concurrently, demultiplexing system 215 precludes further processing of packets in the multiplexed transport stream that are irrelevant or not desired such as, for example in a 1080i-60 capable receiver, packets of data corresponding to the second video stream of the 1080P-60 program.
- the components of signal processing system 214 are preferably capable of QAM demodulation, forward error correction, demultiplexing MPEG-2 transport streams, and parsing packetized elementary streams and elementary streams.
- the signal processing system 214 further communicates with processor 244 via interrupt and messaging capabilities of DHCT 200 .
- the components of signal processing system 214 are further capable of performing PID filtering to reject packetized data associated with programs or services that are not requested by a user or unauthorized to DHCT 200 , such rejection being performed according to the PID value of the packetized streams.
- PID filtering is performed according to values for the filters under the control of processor 244 .
- PID filtering allows for one or more desired and authorized programs and/or services to penetrate into DHCT 200 for processing and presentation.
- PID filtering is further effected to allow one or more desired packetized streams corresponding to a program (e.g., a 1080P — 60 program) to penetrate DHCT 200 for processing, while simultaneously rejecting one or more different packetized stream also corresponding to the same program.
- Processor 244 determines values for one or more PIDS to allow to penetrate, or to reject, from received information such as tables carrying PID values as described later in this specification. In an alternate embodiment, undesirable video streams of a program are allowed to penetrate into DHCT 200 but disregarded by video decoder 223 .
- a compressed video stream corresponding to a tuned carrier frequency carrying a digital transmission signal can be output as a transport stream by signal processing 214 and presented as input for storage in storage device 273 via interface 275 .
- the packetized compressed streams can be also output by signal processing system 214 and presented as input to media engine 222 for decompression by the video decoder 223 and audio decoder 225 .
- signal processing system 214 may include other components not shown, including memory, decryptors, samplers, digitizers (e.g. analog-to-digital converters), and multiplexers, among others. Further, other embodiments will be understood, by those having ordinary skill in the art, to be within the scope of the preferred embodiments of the present invention. For example, analog signals (e.g., NTSC) may bypass one or more elements of the signal processing system 214 and may be forwarded directly to the output system 248 . Outputs presented at corresponding next-stage inputs for the aforementioned signal processing flow may be connected via accessible memory 252 in which an outputting device stores the output data and from which an inputting device retrieves it.
- analog signals e.g., NTSC
- Outputting and inputting devices may include analog video decoder 216 , media engine 222 , signal processing system 214 , and components or sub-components thereof. It will be understood by those having ordinary skill in the art that components of signal processing system 214 can be spatially located in different areas of the DHCT 200 .
- a first and second tuners and respective first and second demodulating systems 213 , demultiplexing systems 215 , and signal processing systems 214 may simultaneously receive and process the first and second video streams of a 1080P-60 program, respectively.
- a single demodulating system 213 , a single demultiplexing system 215 , and a single signal processing system 214 each with sufficient processing capabilities may be used to process the first and second video streams in a 1080P-60 capable receiver.
- the DHCT 200 may include at least one storage device 273 for storing video streams received by the DHCT 200 .
- a PVR application 277 in cooperation with the operating system 253 and the device driver 211 , effects, among other functions, read and/or write operations to the storage device 273 .
- the device driver 211 is a software module preferably resident in the operating system 253 .
- the device driver 211 under management of the operating system 253 , communicates with the storage device controller 279 to provide the operating instructions for the storage device 273 .
- Storage device 273 could be internal to DHCT 200 , coupled to a common bus 205 through a communication interface 275 .
- Received first and second video streams are deposited transferred to DRAM 252 , and then processed for playback according to mechanisms that would be understood by those having ordinary skill in the art.
- the video streams are retrieved and routed from the hard disk 201 to the digital video decoder 223 and digital audio decoder 225 simultaneously, and then further processed for subsequent presentation via the display device 140 .
- Compressed pictures in the second video stream may be compressed independent of reconstructed pictures in the first video stream.
- an aspect of the invention is that pictures in the second video stream, although compressed according to a second video specification that is different to the first video specification, can depend on decompressed and reconstructed pictures in the first video stream for their own decompression and reconstruction.
- dependent pictures are predicted pictures that reference at most one picture (from a set of at least one reconstructed picture) for each of its sub-blocks or macroblocks to effect its own reconstruction. That is, predicted pictures in the second video stream, can possibly depend one or more referenced pictures in the first video stream.
- Bi-predicted pictures can reference at most two pictures from a set of reconstructed pictures for reconstruction of each of its sub-blocks or macroblocks to effect their own reconstruction.
- pictures in the second video stream reference decompressed and reconstructed pictures (i.e., reference pictures) from the first video stream.
- pictures in the second video stream employ reference pictures from both the first and second video streams.
- a first type of picture in the second video stream references decompressed pictures from the second video stream and a second type of picture references decompressed pictures from the first video stream.
- the present invention includes several methods based on two separate video streams assigned to a program rather than a single stream with inherent built-in temporal scalability.
- Existing receivers capable of processing 1080i-60 video streams today would be deemed “legacy HD receivers” at the time that broadcasters start emissions of 1080P-60 programs. If a 1080P-60 program was transmitted without the advantage of this invention the “then” legacy HD receivers would not know how to process a 1080P-60 video stream, nor be capable of parsing the video stream to extract a 1080P-30 signal from the received 1080P-60.
- the legacy HD receivers were not designed to identify and discard pictures from a single 1080P-60 video stream.
- 1080P-60 in the standard bodies is specified for a 1080P-60 receiver without backward compatibility to 1080i-60 receivers.
- This invention enables 1080i-60 receivers to process the portion of the 1080P-60 program corresponding to a first video stream and reject a complementary second video stream based on PID filtering.
- a 1080i-60 receiver provides a portion of the 1080P-60 program that is equivalent to 1080P-30.
- the invention is equally applicable, for example, to 1080P-50, assigning two separate video streams to a program. Future 1080P50-capable receivers process the 1080P-50 video from the two separate video streams according to the invention, while legacy 1080i-50-capable receivers process a 1080P-25 portion of the 1080P-50 video program.
- 1080P-60 is used for simplicity to refer to a picture sequence with twice the picture rate of a progressive 1080P-30 picture sequence, or to a picture sequence with twice the amount of picture elements as an interlaced picture sequence displayed as fields rather than full frames.
- the invention is applicable to any pair of video formats with the same picture spatial resolution, in which a first video format has twice the “picture rate” of the second.
- the invention is also applicable to any pair of video formats with the same picture spatial resolution, in which a first video format has “progressive picture rate” and the second has an “interlaced” or field picture rate, the first video format resulting in twice the number of processed or displayed pixels per second.
- the invention is further applicable to any two video formats in which the first video format's picture rate is an integer number times that of the second video format or in which the number of pixels of a first video format divided by the number of pixels of a second video format is an integer number.
- the MPEG-2 Transport specification referred to in this invention is described in the two documents: ISO/IEC 13818-1:2000 (E), International Standard, Information technology—Generic coding of moving pictures and associated audio information: Systems, and ISO/IEC 13818-1/Amd. 3: 2003 Amendment 3: Transport of AVC video data over ITU-T Rec. H.222.0
- a multiplexed transport carries Program Specific Information (PSI) that includes the Program Association Table (PAT) and the Program Map Table (PMT). Information required to identify and extract a PMT from the multiplexed transport stream is transmitted in the PAT.
- PSI Program Specific Information
- PAT Program Association Table
- PMT Program Map Table
- Information required to identify and extract a PMT from the multiplexed transport stream is transmitted in the PAT.
- the PAT carries the program number and packet identifier (PID) corresponding to each of a plurality of programs, at least one such program's video being transmitted as encoded 1080P-60 video according to the invention.
- the PMT corresponding to a 1080P-60 program carries two video streams, each uniquely identified by a corresponding PID.
- the first video stream in the PMT has a unique corresponding PID 341 and the second video stream has its unique corresponding PID 342 , for example.
- the first and second video streams of the 1080P-60 program have corresponding stream type values.
- a stream type is typically a byte.
- the stream type value for the first and second video streams are video_type1 and video_type2, respectively.
- the stream type value, video_type1 equals video_type2, therefore, both video streams are encoded according to the syntax and semantics of the same video specification (e.g., both as MPEG-2 video or as MPEG-4 AVC).
- a receiver is then able to identify and differentiate between the first video stream and the second video stream by their PID values and the relationship of the two PID values. For example, the lower PID value of video_type1 would be associated with the first video stream.
- legacy HD receivers would not be able to incorporate such a processing step as a feature. However, there may be two types of legacy receivers.
- legacy receivers may be HD receivers that are capable of processing a first video stream encoded according to the MPEG-2 video specification described in ISO/IEC 13818-2:2000 (E), International Standard, Information technology—Generic coding of moving pictures and associated audio information: Video.
- the second video stream would likely be encoded with a video specification that provides superior compression performance, for example, MPEG-4 AVC as described by the three documents: ISO/IEC 14496-10 (ITU-T H.264), International Standard (2003), Advanced video coding for generic audiovisual services; ISO/IEC 14496-10/Cor. 1: 2004 Technical Corrigendum 1; and ISO/IEC 14496-10/Amd. 1,2004, Advanced Video Coding AMENDMENT 1: AVC fidelity range extensions.
- a second era may comprise legacy HD receivers that are capable of processing 1080i-60 video encoded according to the MPEG-4 AVC specification. Because the latter legacy receivers have yet to be deployed, these receivers could be designed to support identification of the first video stream in a multiple video stream program from the lowest PID value corresponding to video_type1 in the PMT. Alternatively, the first video entry in the PMT table, regardless of its PID value, would be considered the first video stream.
- the streams are encoded according to different video specifications and the values of video_type1 and video_type2 in the PMT differ.
- the first video stream would be encoded and identified as MPEG-2 video in the PMT by a video_type1 value that corresponds to MPEG-2 video.
- the second video stream would be encoded with MPEG-4 AVC and identified by a video_type2 value corresponding to MPEG-4 AVC.
- video_type2 corresponds to a stream type specifically designated to specify the complementary video stream (i.e, the second video stream of a 1080P-60 program). Both video streams could be encoded according to the syntax and semantics of the same video specification (e.g, with MPEG-4 AVC) or with different video specifications. Thus, while the values of video_type1 and video_type2 are different in the PMT table for a 1080P-60 program, both video streams composing the 1080P-60 program could adhere to the same video specification. Thus, video_type1's value identifies the video specification used to encode the first video stream, but video_type2's value identifies both:
- a first video_type2 value then corresponds to a stream type associated with the second stream of a 1080P-60 program that is encoded according to the MPEG-2 video specification.
- a second video_type2 value corresponds to a stream type associated with the second stream of a 1080P-60 program that is encoded according to the MPEG-4 AVC specification.
- other video_type2 values can correspond to respective stream types, each associated with the second stream of a 1080P-60 program and encoded according to a respective video coding specification.
- pictures in the second stream can still use reconstructed pictures from the first video stream as reference pictures.
- Encoded pictures in the first and second video streams are multiplexed in the transport multiplex according to a defined sequence that allows a single video decoder in a 1080P-60 receiver to receive and decode the pictures sequentially as if the pictures were transmitted in a single video stream. However, because they are two separate video streams, a 1080i-60 receiver can reject transport packets belonging to the second video stream and allow video packets corresponding to the first video stream to penetrate into its memory to process a portion equal to 1080P-30 video. Encoded pictures in the first video stream are transmitted in transmission order, adhering to the timing requirement and bit-buffer management policies required for a decoder to process the first video stream as a 1080P-30 encoded video signal.
- FIG. 4A depicts the first and second video streams in display order.
- P represents a picture and not a type of picture.
- Pi is the ith picture in display order.
- the blank squares represent gaps of when the picture being displayed is from the complementary video stream.
- the width of a blank square is one “picture display” time.
- Non-blank squares represent the time interval in which the corresponding picture is being displayed.
- a 1080P-30 picture corresponding to the first video stream is displayed and the width of two squares represents the picture display time.
- Video stream 1 is specified as 30 Hertz in alternating 60 Hertz intervals that correspond to even integers.
- Video stream 2 is specified as 30 Hertz in alternating 60 Hertz intervals that correspond to odd integers.
- FIG. 4B depicts pictures according to picture types in display order.
- Ni signifies the ith Picture in display order, where N is the type of picture designated by the letter I, P or B.
- all the pictures in video stream 2 are B pictures and the 1080P-60 receiver uses decoded pictures from video stream 1 as reference pictures to reconstruct the B pictures.
- FIG. 4C corresponds to the transmission order of the pictures in display order in FIG. 4B .
- Each picture is transmitted (and thus received by the receiver) at least one 60 Hz interval prior to its designated display time.
- I pictures are displayed six 60 Hz interval after being received and decoded. I pictures are thus transmitted at least seven 60 Hz intervals prior to its corresponding display time.
- the arrows from FIG. 4C to FIG. 4B reflect the relationship of the pictures' transmission order to their display order.
- Blank squares in FIG. 4C represent gaps when no picture data is transmitted for the respective video stream.
- the width of a blank square can be approximately one “picture display” time.
- Non-blank squares represent the time interval in which the corresponding picture is transmitted.
- One or more smaller transmission gaps of no data transmission may exist within the time interval in which a picture is transmitted.
- video stream 1 and video stream 2 are multiplexed at the emission point in a way to effect the transmission order reflected in FIG. 4C and transmission time relationship depicted in FIG. 4C .
- a sequence of video pictures is presented at an encoder for compression and production of a compressed 1080P-60 program. Every other picture is referred as an N picture and every subsequent picture as an N+1 picture.
- the sequence of all the N pictures is the first video stream of the 1080P-60 program and the sequence all the N+1 pictures is the second video stream.
- a video encoder produces the first video stream according to a first video specification (e.g., MPEG-2 video) and the second video stream according to a second video specification (e.g., MPEG-4 AVC).
- a first video specification e.g., MPEG-2 video
- a second video specification e.g., MPEG-4 AVC
- the second video specification is different than the first video specification.
- the first and second video specifications are the same (e.g., MPEG-4 AVC).
- the video encoder produces compressed pictures for the first video stream by depositing the compressed pictures into a first bit-buffer in memory, such memory being coupled to the encoder. Depositing of compressed pictures into the first bit-buffer is according to the buffer management policy (or policies) of the first video specification.
- the first bit-buffer is read for transmission by the video encoder in one embodiment.
- a multiplexer or transmitter reads the compressed pictures out of the first bit-buffer.
- the read potions of the first bit buffer are packetized and transmitted according to a transport stream specifications such as MPEG-2 transport.
- the video encoder, the multiplexer, or the transmitter, or the entity performing the first bit-buffer reading and packetization of the compressed pictures prepends a first PID to packets belonging to the first video stream.
- the packetized first video stream is then transmitted via a first transmission channel.
- the second video stream is produced by the video encoder and deposited into the first bit buffer.
- the second video stream is read from the first bit-buffer by the entity performing the packetization, and the entity prepends a second PID to packets belonging to the second video stream, and the transport packets are transmitted via a first transmission channel.
- the second video stream is produced by the video encoder and deposited into a second bit buffer.
- the entity performing the packetization reads the second video stream from the second bit buffer and prepends the second PID to packets belonging to the second video stream.
- the packetized second video stream is then transmitted via a first transmission channel.
- Both first and second video streams are packetized according to a transport stream specification, such as MPEG-2 Transport. Packets belonging to the second video stream are thus identifiable by a 1080P-60 capable receiver and become capable of being rejected by a receiver that is not capable of processing 1080P-60 programs.
- the bit buffer management policies of depositing compressed picture data into the first and/or second bit-buffers and reading (or drawing) compressed-picture data from the first and/or second bit-buffers are according to the first video specification. These operations may be further in accordance with bit-buffer management policies of the transport stream specification. Furthermore, the bit-buffer management policies implemented on the one or two bit-buffers may be according to the second video specification rather than the first video specification. In one embodiment, the first video stream's compressed data in the bit-buffer is managed according to both: the bit buffer management policies of the first video specification and the transport stream specification, while the second video stream's compressed data in the applicable bit-buffer is managed according to the bit buffer management policies of the second video specification as well as the transport stream specification.
- bit-buffer management policies described above are applicable at the emission or transmission point in the network, such as by the encoder and the entity producing the multiplexing and/or transmission. Bit-buffer management policies, consistent with the actual implementation at the emission or transmission point, are applicable at the receiver to process the one or more received video streams of a 1080P-60 program.
- the bit-buffer management policy implemented at the emission or transmission point may be provided to the receiver a priori for each program (e.g., with metadata) or according to an agreed one of the alternatives described above that is employed indefinitely.
- the video encoder constitutes two video encoders, a first video encoder producing the first video stream according to the first video specification, and a second video encoder producing the second video stream, which is interspersed for transmission in the transmission channel according to the pockets of “no data” transmission of video stream 1 (as shown in FIG. 4C ).
- the second video encoder further producing the second video stream according to the second video specification.
- the process of alternating transmission of compressed pictures corresponding to the first video stream and compressed pictures corresponding to the second video stream results in transmission of a first set of consecutive compressed pictures from different the first video stream when it is the turn to transmit the first video stream, or a second set of consecutive compressed pictures from different the second video stream when it is the turn to transmit the second video stream.
- two consecutive compressed pictures from the second video stream may be transmitted after each transmission of a single compressed picture of the first video stream.
- a 1080P-90 Hertz program can be facilitated to 1080P-90 receivers and a 1080P-30 portion of the 1080P-90 program to 1080P-30 receivers.
- the number of consecutive compressed pictures that is transmitted from the first video stream may be greater than one. For instance, if two consecutive compressed pictures from the first video stream are transmitted and three compressed pictures from the second video stream are transmitted after transmission the two from the first video stream, a number of receivers with different processing capabilities may be enabled. If two different PID values are employed, a 1080P-50 receiver will receive a 1080P-50 Program and a 1080P-20 receiver will receive a 1080P-20 corresponding portion. However, if five different PID values are used for the 1080P-50 program, five receivers, each with different processing capability will be capable of receiving a portion of the 1080P-50 program.
- Headend 110 may receive from an interface to a different environment, such as from a satellite or a storage device, an already compressed 1080P-60 program—a single video stream encoded according to a third video specification and according to a first stream specification.
- the first stream specification may be a type of transport stream specification suitable for transmission or a type of program stream specification suitable for storage.
- the third video specification may comprise of the first video specification, the second video specification, or both the first and second video specifications respectively applied, for example, to every other compressed picture.
- the already compressed 1080P-60 program is received at headend 110 encoded in such a way that it does not facilitate reception some of its portions by receivers with processing capability that are less than those of a 1080P-60 receiver. In other words, it is received without information to inherent signal its different portions to receivers with different processing capabilities.
- Another novel aspect of this invention is that at least one from one or more encoders, one or more multiplexers, or one or more processing entities at the point of transmission at headend 110 , effect packetization of the compressed pictures of the received 1080P-60 program with a plurality of different PIDS, then transmitting the 1080P-60 program as a plurality of identifiable video streams via the first transmission channel.
- headend 110 effects proper packetization and prepending of PID values to enable reception of at least a portion of the 1080P-program to receivers with different processing capabilities that are coupled to network 130 .
- the present invention includes methods and systems capable of transmitting compressed video signals according to one or more compression video formats, where compressed video signals correspond to television channels or television programs in any of a plurality of picture formats (i.e., picture spatial resolution and picture rate), including 1080i-60 and 1080P-60 formats.
- compressed video signals which correspond to television channels or television programs in any of a plurality of picture formats are received by a plurality of receivers, where each receiver may have a different maximum processing capability. Therefore, the present invention contemplates at least the following combinations for encoding, transmission and reception of video signals.
- the input such as 1080P-60 input in the first combination instance, refers to a compressed video stream that is received at receiver 200 from network 130 via communication interface 242 .
- the display such as the 1080P-60 Display in the first combination instance is a television, a display, or a monitor coupled to DHCT 200 via output system 248 .
- the DHCT 200 provides the compressed video stream corresponding to the “input” in “decoded and reconstructed” form (visible pictures) via output system 248 .
- the receiver such as 1080P-60 Receiver in the first combination instance, refers to a receiver, such as DHCT 200 , that has the processing capability specified in the trio.
- a 1080P-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface).
- the 1080P-60 compressed video signal is input by storing it in its memory and the receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the 1080P-60 video signal (or compressed video stream).
- a 1080P-60 capable display is driven by all the decoded 1080P-60 pictures.
- the 1080P-60 capable receiver receives a compressed 1080i-60 video stream via a network interface (or a communication interface).
- the 1080P-60 compressed video signal is input by storing it in its memory and the receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the compressed 1080i-60 video signal stored in memory.
- the 1080P-60 receiver then deinterlaces the decoded 1080i-60 signal with a de-interlacing algorithm based on information in two or more 1080i fields, including a current 1080i field.
- the deinterlacing algorithm makes decisions based on spatial picture information as well as temporal information.
- the deinterlacing algorithm can further base decisions on motion estimation or motion detection.
- a 1080P-60 capable display is driven by all the decoded 1080P-60 pictures.
- the 1080P-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface).
- the receiver When driving a non-1080P-60 display, the receiver outputs a portion of all the decoded 1080P-60 pictures or processes and scales the pictures of the decoded 1080P-60 signal for display.
- the 1080P-60 capable receiver could process a 1080P-60 compressed video signal in full (as explained above) and output (or display) a portion of each of the decoded 1080P-60 pictures.
- the portion may be a temporally-subsampled portion, a spatially-subsampled portion, or a portion resulting from a combination of a temporal-subsampling and spatially-subsampling.
- the 1080P60-capable receiver when driving a non-1080P-60 capable display, the 1080P60-capable receiver is informed by the user or through a discovery mechanism that the display is not 1080P-60. Consequently, the 1080P-60-capable receiver can behave as if it was a 1080P-30 receiver by not processing the second video stream.
- a 1080P-60 receiver When driving a non-1080P-60 display, a 1080P-60 receiver processes a 1080i-60 compressed video signal and outputs the decoded 1080i-60 pictures according to the picture format required to drive the non-1080 display, processing and scaling the pictures of the decoded 1080i-60 signal as required to drive the non-1080P-60 display.
- a 1080i-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface).
- the receiver inputs a first portion of the 1080P-60 compressed video signal by storing it in memory of receiver 200 and the receiver rejects a second and complementary portion of the 1080P compressed video signal by prohibiting it from penetrating any section, portion or buffer of its memory.
- the receiver 200 decodes with a video decoder (or decompression engine) all the pictures corresponding to the first portion of the 1080P-60 video signal; processing it as if it were a 1080i-60 compressed video signal.
- a 1080i-60 capable display is driven by the decoded first portion of the 1080P-60 pictures.
- a 1080i-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface).
- the receiver inputs a first portion of the 1080P-60 compressed video signal corresponding to a 1080i-60 compressed video signal by storing it in its memory and rejects a second and complementary portion of the 1080P compressed video signal by prohibiting it from penetrating any section, portion or buffer of its memory.
- the receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the first portion of the 1080P-60 video signal, processing it as if it were a 1080i-60 compressed video signal.
- the receiver deinterlaces a decoded 1080i-60 signal with a deinterlacing algorithm based on information in two or more 1080i fields, including a current 1080i field.
- the deinterlacing algorithm makes decisions based on spatial picture information as well as temporal information.
- the deinterlacing algorithm can further base decisions on motion estimation or motion detection.
- a 1080P-60 capable display is driven by all the decoded and deinterlaced 1080i-60 pictures as a 1080P-60 signal.
- a 1080i-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface).
- the receiver inputs a first portion of the 1080P-60 compressed video signal corresponding to a 1080i-60 compressed video signal by storing it in its memory and rejects a second and complementary portion of the 1080P-60 compressed video signal by prohibiting it from penetrating any section, portion or buffer of its memory.
- the receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the first portion of the 1080P-60 video signal, processing it as if it were a 1080i-60 compressed video signal.
- the display In order to drive a 1080P-60 capable display that is capable of receiving a 1080i-60 signal and internal deinterlacing, the display is driven by all the pictures of the decoded 1080i-60 compressed video signal as a 1080i-60 signal.
- the 1080P-60 display deinterlaces the received 1080i-60 signals according to its deinterlacing capabilities.
- the encoder produces a 1080P-60 encoded video stream according to a video specification (i.e., MPEG-2 video or MPEG-4 AVC), and assigns a first PID value to packets of every other encoded picture corresponding to the 1080P-60, and assigns a second PID value to every packet of the subsequent picture to the “every other” picture just mentioned, where the second PID value is different from the first PID value.
- a video specification i.e., MPEG-2 video or MPEG-4 AVC
- the encoder in one embodiment encodes all pictures according to a single video format, e.g., MPEG-4 AVC, and adheres to the buffer model of the video specification.
- the encoder in a second embodiment encodes the pictures that correspond to N according to a first video specification and in compliance with the video specification's buffering model, and according to a variable-bit rate model.
- the encoder further encodes the alternate pictures, every “N+1” picture, according to a second video specification, the second video specification being different from the first video specification.
- These alternate pictures are encoded according to the syntax of the second video specification, but managed and transferred into a transmission buffer according to the first video specification's buffering model.
- the encoder further employs in its “encoding loop” a model, or parts thereof, of a receiver's video decoder, including reference pictures, in it's memory.
- PID B contains only non-reference pictures that can optionally be included in the decoding of PID A. In this separation process, the original picture ordering must be maintained within the multiplex. For example, a picture in one PID must end before the next picture begins in the other PID.
- the frame rate value in PID A should be set at 30 frames per second; and the temporal references in PID A should be corrected for the separated pictures; and as a convenience, the temporal references in PID B should be set to match those in PID A, such that each picture pair shares a temporal reference number.
- the 1080P-60 capable decoder will be aware that the frame rate is actually 60 frames per second, and will support the pairs of duplicate temporal references.
- the decoder should expect two of every temporal reference number, adjacent in presentation order. Therefore, for example, it can use the temporal reference numbers to detect a missing picture. Picture re-ordering within the decoder may be based on the sequence of picture types received, as normal.
- PID B I1_B0_B2_B4_B6_B8_B10_B12_B1
- PID A I1_B0_P3_B2_P5_B4_P7_B6 —
- PID B _B0_B1_B2_B3_B4_B5_B6_B7
- PID B _B0_B2_B4_B6_B8_B10_B12_B14
- PID A I0_P1_P2_P3_P4_P5_P6_P7 —
- PID B _B0_B1_B2_B3_B4_B5_B6_B7
- PID B can be designated by a new stream_type.
- a common set of audio streams may serve each case: 1) using only PID A 2) using both PID A and PID B.
- the separation of every other frame occurred after encoding.
- separation occurs prior to encoding.
- supply every other frame of a 1080P-60 hz signal Encode this as 1080P-30 hz.
- 1080P-30 hz Simultaneously, supply another encoding process with the alternate frames, also at 1080P-30 hz.
- Presentation time stamps (PTSs) shall be generated for every picture, referencing a common clock. The result is two video streams, each being legitimate 1080P-30 hz.
- a 1080P-60 capable decoder may decode both simultaneously, as a dual-decode operation, to be recombined in the display process.
- the group of pictures (GOP) structures may be independent, and the buffering may be independent.
- the dual-decoder's display process will choose decoded pictures to put on display in order of PTS. If the picture for a particular time interval has not yet been decoded, possibly due to some data corruption or loss, then the previous picture will simply be repeated through that time interval. If any picture is decoded later than its PTS elapses, it is to be discarded.
- both PIDs may be completely independent, because they reference the same clock, there is no risk that a picture from one PID is sent later than the presentation time of a following picture from the other PID, as long as each PID's buffer is maintained compliantly within the multiplex.
- PID B in the PMT may be designated by a new stream_type, which may be allocated by MPEG, or which may be a user-private stream_type that indicates a privately managed stream.
- the new stream_type would not be recognized by legacy receivers, so the associated PID B would be ignored.
- the registration descriptor may be used in the ES_descriptor_loop of the PMT to register a unique and private attribute for association with PID B. Any combination of the above methods may be used, as deemed adequate and sensible.
- a common set of audio streams may serve each case: 1) using only PID A 2) using both PID A and PID B. The methods described above use a separate PID to carry additional information.
- a single video PID may be used to carry both the base information and the additional information, while still providing a way to optionally reject the additional information.
- a separate packetized elementary stream (PES) ID can be used such that a new PMT descriptor, which would be allocated by MPEG, may designate one PES ID for the base layer, and a different PES ID for the additional information, both carried by the same PID. In this way, existing PES IDs may be identified as base, and supplemental, without the need for new PES IDs to be allocated.
- the decoder that needs only the base layer may discard those PES packets whose ID does not match the ID designated as the base layer in the PMT.
- the decoder that can use both may simply not reject either. This approach is applicable to both schemes: post-encoding-separation and prior-encoding-separation.
Abstract
Description
- This application is a continuation of copending U.S. utility application entitled, “Higher Picture Rate HD Encoding and Transmission with Legacy HD Backward Compatibility,” having Ser. No. 11/132,060, filed May 18, 2005, which is entirely incorporated herein by reference.
- The present invention relates to digital television and, more specifically to receivers with different capabilities for receiving, processing and displaying the same emission of a compressed video signal, each receiver providing one in a plurality of picture formats according to its respective capability.
- There are many different digital television compressed video picture formats, some of which are HD. HDTV currently has the highest digital television spatial resolution available. The picture formats currently used in HDTV are 1280×720 pixels progressive, 1920×1080 pixels interlaced, and 1920×1080 pixels progressive. These picture formats are more commonly referred to as 720P, 1080i and 1080P, respectively. The 1080i format, which comprises of interlaced pictures, each picture or frame being two fields, shows 30 frames per second and it is deemed as the MPEG-2 video format requiring the most severe consumption of processing resources. The 1080P format shows 60 frames per second, each frame being a progressive picture, and results in a doubling of the most severe consumption of processing resources. A receiver capable of processing a maximum of 1080i-60 is also capable of processing a maximum 1080P-30. However, broadcasters intend to introduce 1080P-60 emissions and CE manufacturers intend to provide HDTVs and HDTV monitors capable of rendering 1080P-60, in the near future. 1080P-60 includes twice as much picture data as either 1080i-60 or 1080P-30. Dual carrying channels or programs as 1080P-60 and 1080i-60 would not be an acceptable solution because it triples the channel consumption of a single 1080i-60 transmission.
- Therefore, there is a need for encoding 1080P-60 video for transmission in a way that facilitates the superior picture quality benefits of a 1080P-60 signal to 1080P-60 capable receivers while simultaneously enabling legacy 1080i-60 capable receivers to fulfill the equivalent of a 1080P-30 signal from the transmitted 1080P-60 signal.
-
FIG. 1 is a high-level block diagram depicting a non-limiting example of a subscriber television system. -
FIG. 2 is a block diagram of a DHCT in accordance with one embodiment of the present invention. -
FIG. 3 illustrates program specific information (PSI) of a program having elementary streams including encoded video streams which may be combined to form a single video stream encoded as 1080P-60. -
FIG. 4A illustrates first and second video streams in display order. -
FIG. 4B illustrates pictures according to picture types in display order. -
FIG. 4C illustrates transmission order of the pictures in display order ofFIG. 2B . - The present invention will be described more fully hereinafter with reference to the accompanying drawings in which like numerals represent like elements throughout the several figures, and in which an exemplary embodiment of the invention is shown. This invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein; rather, the embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. The present invention is described more fully hereinbelow.
- It is noted that “picture” is used throughout this specification as one from a sequence of pictures that constitutes video, or digital video, in one of any of a plurality of forms. Furthermore, in this specification a “frame” means a picture, either as a full progressive picture or in reference to a whole instance of a full frame comprising both fields of an interlaced picture.
- Video Decoder in Receiver
-
FIG. 1 is a block diagram depicting a non-limiting example of a subscriber television system (STS) 100. In this example, the STS 100 includes aheadend 110 and a DHCT 200 that are coupled via anetwork 130. The DHCT 200 is typically situated at a user's residence or place of business and may be a stand-alone unit or integrated into another device such as, for example, thedisplay device 140 or a personal computer (not shown). The DHCT 200 receives signals (video, audio and/or other data) including, for example, MPEG-2 streams, among others, from theheadend 110 through thenetwork 130 and provides any reverse information to theheadend 110 through thenetwork 130. Thenetwork 130 may be any suitable means for communicating television services data including, for example, a cable television network or a satellite television network, among others. Theheadend 110 may include one or more server devices (not shown) for providing video, audio, and textual data to client devices such as DHCT 200. Television services are provided via thedisplay device 140 which is typically a television set. However, thedisplay device 140 may also be any other device capable of displaying video images including, for example, a computer monitor. -
FIG. 2 is a block diagram illustrating selected components of aDHCT 200 in accordance with one embodiment of the present invention. It will be understood that the DHCT 200 shown inFIG. 2 is merely illustrative and should not be construed as implying any limitations upon the scope of the preferred embodiments of the invention. For example, in another embodiment, the DHCT 200 may have fewer, additional, and/or different components than illustrated inFIG. 2 . A DHCT 200 is typically situated at a user's residence or place of business and may be a stand alone unit or integrated into another device such as, for example, a television set or a personal computer. The DHCT 200 preferably includes acommunications interface 242 for receiving signals (video, audio and/or other data) from theheadend 110 through the network 130 (FIG. 1 ) and for providing any reverse information to theheadend 110. - DHCT 200 is referred to as a receiver such as
receiver 200 throughout this specification. The DHCT 200 further preferably includes at least oneprocessor 244 for controlling operations of the DHCT 200, anoutput system 248 for driving thetelevision display 140, and atuner system 245 for tuning to a particular television channel or frequency and for sending and receiving various types of data to/from theheadend 110. The DHCT 200 may, in another embodiment, include multiple tuners for receiving downloaded (or transmitted) data.Tuner system 245 can select from a plurality of transmission signals provided by thesubscriber television system 100, including a 1080P-60 program.Tuner system 245 enables the DHCT 200 to tune to downstream media and data transmissions, thereby allowing a user to receive digital media content such as a 1080P-60 program via the subscriber television system. Thetuner system 245 includes, in one implementation, an out-of-band tuner for bi-directional quadrature phase shift keying (QPSK) data communication and a quadrature amplitude modulation (QAM) tuner (in band) for receiving television signals. Additionally, auser command interface 246 receives externally-generated user inputs or commands from an input device such as, for example, a remote control. User inputs could be alternatively received viacommunication port 274. - The DHCT 200 may include one or more wireless or wired interfaces, also called
communication ports 274, for receiving and/or transmitting data to other devices. For instance, the DHCT 200 may feature USB (Universal Serial Bus), Ethernet, IEEE-1394, serial, and/or parallel ports, etc. DHCT 200 may also include an analog video input port for receiving analog video signals. User input may be provided via an input device such as, for example, a hand-held remote control device or a keyboard. - The DHCT 200 includes
signal processing system 214, which comprises ademodulating system 213 and a transport demultiplexing and parsing system 215 (herein demultiplexing system) for processing broadcast media content and/or data. One or more of the components of thesignal processing system 214 can be implemented with software, a combination of software and hardware, or preferably in hardware.Demodulating system 213 comprises functionality for demodulating analog or digital transmission signals. For instance,demodulating system 213 can demodulate a digital transmission signal in a carrier frequency that was modulated, among others, as a QAM-modulated signal. When tuned to a carrier frequency corresponding to an analog TV signal,demultiplexing system 215 is bypassed and the demodulated analog TV signal that is output bydemodulating system 213 is instead routed toanalog video decoder 216.Analog video decoder 216 converts the analog TV signal into a sequence of digitized pictures and their respective digitized audio. Theanalog TV decoder 216 and other analog video signal components may not exist in receivers or DHCTs that do not process analog video or TV channels. - A compression engine in the headend processes a sequence of 1080P-60 pictures and associated digitized audio and converts them into compressed video and audio streams, respectively. The compressed video and audio streams are produced in accordance with the syntax and semantics of a designated audio and video coding method, such as, for example, MPEG-2, so that they can be interpreted by
video decoder 223 andaudio decoder 225 for decompression and reconstruction after transmission of the two video streams corresponding to the 1080P-60 compressed signal. Each compressed stream consists of a sequence of data packets containing a header and a payload. Each header contains a unique packet identification code, or packet identifier (PID) as is the casein MPEG-2 Transport specification, associated with the respective compressed stream. The compression engine or a multiplexer at the headend multiplexes the first and second video streams into a transport stream, such as an MPEG-2 transport stream. -
Video decoder 223 may be capable of decoding a first compressed video stream encoded according to a first video specification and a second compressed video stream encoded according to a second video specification that is different than the first video specification.Video decoder 223 may comprise of two different video decoders, each respectively designated to decode a compressed video stream according to the respective video specification. - Parsing
capabilities 215 withinsignal processing 214 allow for interpretation of sequence and picture headers. The packetized compressed streams can be output bysignal processing 214 and presented as input tomedia engine 222 for decompression byvideo decoder 223 andaudio decoder 225 for subsequent output to the display device 140 (FIG. 1 ). -
Demultiplexing system 215 can include MPEG-2 transport demultiplexing. When tuned to carrier frequencies carrying a digital transmission signal,demultiplexing system 215 enables the separation of packets of data, corresponding to the desired video streams, for further processing. Concurrently,demultiplexing system 215 precludes further processing of packets in the multiplexed transport stream that are irrelevant or not desired such as, for example in a 1080i-60 capable receiver, packets of data corresponding to the second video stream of the 1080P-60 program. - The components of
signal processing system 214 are preferably capable of QAM demodulation, forward error correction, demultiplexing MPEG-2 transport streams, and parsing packetized elementary streams and elementary streams. Thesignal processing system 214 further communicates withprocessor 244 via interrupt and messaging capabilities ofDHCT 200. - The components of
signal processing system 214 are further capable of performing PID filtering to reject packetized data associated with programs or services that are not requested by a user or unauthorized to DHCT 200, such rejection being performed according to the PID value of the packetized streams. PID filtering is performed according to values for the filters under the control ofprocessor 244. PID filtering allows for one or more desired and authorized programs and/or services to penetrate intoDHCT 200 for processing and presentation. PID filtering is further effected to allow one or more desired packetized streams corresponding to a program (e.g., a1080P —60 program) to penetrate DHCT 200 for processing, while simultaneously rejecting one or more different packetized stream also corresponding to the same program.Processor 244 determines values for one or more PIDS to allow to penetrate, or to reject, from received information such as tables carrying PID values as described later in this specification. In an alternate embodiment, undesirable video streams of a program are allowed to penetrate intoDHCT 200 but disregarded byvideo decoder 223. - A compressed video stream corresponding to a tuned carrier frequency carrying a digital transmission signal can be output as a transport stream by
signal processing 214 and presented as input for storage instorage device 273 viainterface 275. The packetized compressed streams can be also output bysignal processing system 214 and presented as input tomedia engine 222 for decompression by thevideo decoder 223 andaudio decoder 225. - One having ordinary skill in the art will appreciate that
signal processing system 214 may include other components not shown, including memory, decryptors, samplers, digitizers (e.g. analog-to-digital converters), and multiplexers, among others. Further, other embodiments will be understood, by those having ordinary skill in the art, to be within the scope of the preferred embodiments of the present invention. For example, analog signals (e.g., NTSC) may bypass one or more elements of thesignal processing system 214 and may be forwarded directly to theoutput system 248. Outputs presented at corresponding next-stage inputs for the aforementioned signal processing flow may be connected viaaccessible memory 252 in which an outputting device stores the output data and from which an inputting device retrieves it. Outputting and inputting devices may includeanalog video decoder 216,media engine 222,signal processing system 214, and components or sub-components thereof. It will be understood by those having ordinary skill in the art that components ofsignal processing system 214 can be spatially located in different areas of theDHCT 200. - In one embodiment of the invention, a first and second tuners and respective first and
second demodulating systems 213,demultiplexing systems 215, andsignal processing systems 214 may simultaneously receive and process the first and second video streams of a 1080P-60 program, respectively. Alternatively, asingle demodulating system 213, asingle demultiplexing system 215, and a singlesignal processing system 214, each with sufficient processing capabilities may be used to process the first and second video streams in a 1080P-60 capable receiver. - The
DHCT 200 may include at least onestorage device 273 for storing video streams received by theDHCT 200. APVR application 277, in cooperation with the operating system 253 and thedevice driver 211, effects, among other functions, read and/or write operations to thestorage device 273. Thedevice driver 211 is a software module preferably resident in the operating system 253. Thedevice driver 211, under management of the operating system 253, communicates with thestorage device controller 279 to provide the operating instructions for thestorage device 273.Storage device 273 could be internal to DHCT 200, coupled to acommon bus 205 through acommunication interface 275. - Received first and second video streams are deposited transferred to
DRAM 252, and then processed for playback according to mechanisms that would be understood by those having ordinary skill in the art. In some embodiments, the video streams are retrieved and routed from thehard disk 201 to thedigital video decoder 223 and digitalaudio decoder 225 simultaneously, and then further processed for subsequent presentation via thedisplay device 140. - Compressed pictures in the second video stream may be compressed independent of reconstructed pictures in the first video stream. On the other hand, an aspect of the invention is that pictures in the second video stream, although compressed according to a second video specification that is different to the first video specification, can depend on decompressed and reconstructed pictures in the first video stream for their own decompression and reconstruction.
- Examples of dependent pictures are predicted pictures that reference at most one picture (from a set of at least one reconstructed picture) for each of its sub-blocks or macroblocks to effect its own reconstruction. That is, predicted pictures in the second video stream, can possibly depend one or more referenced pictures in the first video stream.
- Bi-predicted pictures (B-pictures) can reference at most two pictures from a set of reconstructed pictures for reconstruction of each of its sub-blocks or macroblocks to effect their own reconstruction.
- In one embodiment, pictures in the second video stream reference decompressed and reconstructed pictures (i.e., reference pictures) from the first video stream. In another embodiment, pictures in the second video stream employ reference pictures from both the first and second video streams. In yet another embodiment, a first type of picture in the second video stream references decompressed pictures from the second video stream and a second type of picture references decompressed pictures from the first video stream.
- Enabling Receivers with Different Capabilities
- The present invention includes several methods based on two separate video streams assigned to a program rather than a single stream with inherent built-in temporal scalability. Existing receivers capable of processing 1080i-60 video streams today would be deemed “legacy HD receivers” at the time that broadcasters start emissions of 1080P-60 programs. If a 1080P-60 program was transmitted without the advantage of this invention the “then” legacy HD receivers would not know how to process a 1080P-60 video stream, nor be capable of parsing the video stream to extract a 1080P-30 signal from the received 1080P-60. The legacy HD receivers were not designed to identify and discard pictures from a single 1080P-60 video stream. Furthermore, 1080P-60 in the standard bodies is specified for a 1080P-60 receiver without backward compatibility to 1080i-60 receivers.
- This invention enables 1080i-60 receivers to process the portion of the 1080P-60 program corresponding to a first video stream and reject a complementary second video stream based on PID filtering. Thus, by processing the first video stream, a 1080i-60 receiver provides a portion of the 1080P-60 program that is equivalent to 1080P-30. The invention is equally applicable, for example, to 1080P-50, assigning two separate video streams to a program. Future 1080P50-capable receivers process the 1080P-50 video from the two separate video streams according to the invention, while legacy 1080i-50-capable receivers process a 1080P-25 portion of the 1080P-50 video program.
- Hereinafter, 1080P-60 is used for simplicity to refer to a picture sequence with twice the picture rate of a progressive 1080P-30 picture sequence, or to a picture sequence with twice the amount of picture elements as an interlaced picture sequence displayed as fields rather than full frames. However, it should be understood that the invention is applicable to any pair of video formats with the same picture spatial resolution, in which a first video format has twice the “picture rate” of the second. The invention is also applicable to any pair of video formats with the same picture spatial resolution, in which a first video format has “progressive picture rate” and the second has an “interlaced” or field picture rate, the first video format resulting in twice the number of processed or displayed pixels per second. The invention is further applicable to any two video formats in which the first video format's picture rate is an integer number times that of the second video format or in which the number of pixels of a first video format divided by the number of pixels of a second video format is an integer number.
- Stream Types and Unique PIDs
- The MPEG-2 Transport specification referred to in this invention is described in the two documents: ISO/IEC 13818-1:2000 (E), International Standard, Information technology—Generic coding of moving pictures and associated audio information: Systems, and ISO/IEC 13818-1/Amd. 3: 2003 Amendment 3: Transport of AVC video data over ITU-T Rec. H.222.0|ISO/IEC 13818-1 streams.
- In accordance with MPEG-2 Transport syntax, a multiplexed transport carries Program Specific Information (PSI) that includes the Program Association Table (PAT) and the Program Map Table (PMT). Information required to identify and extract a PMT from the multiplexed transport stream is transmitted in the PAT. The PAT carries the program number and packet identifier (PID) corresponding to each of a plurality of programs, at least one such program's video being transmitted as encoded 1080P-60 video according to the invention.
- As shown in the
FIG. 3 , the PMT corresponding to a 1080P-60 program carries two video streams, each uniquely identified by a corresponding PID. The first video stream in the PMT has a uniquecorresponding PID 341 and the second video stream has its uniquecorresponding PID 342, for example. Likewise, the first and second video streams of the 1080P-60 program have corresponding stream type values. A stream type is typically a byte. The stream type value for the first and second video streams are video_type1 and video_type2, respectively. - In one embodiment, the stream type value, video_type1 equals video_type2, therefore, both video streams are encoded according to the syntax and semantics of the same video specification (e.g., both as MPEG-2 video or as MPEG-4 AVC). A receiver is then able to identify and differentiate between the first video stream and the second video stream by their PID values and the relationship of the two PID values. For example, the lower PID value of video_type1 would be associated with the first video stream. However, legacy HD receivers would not be able to incorporate such a processing step as a feature. However, there may be two types of legacy receivers. During a first era, legacy receivers may be HD receivers that are capable of processing a first video stream encoded according to the MPEG-2 video specification described in ISO/IEC 13818-2:2000 (E), International Standard, Information technology—Generic coding of moving pictures and associated audio information: Video. The second video stream would likely be encoded with a video specification that provides superior compression performance, for example, MPEG-4 AVC as described by the three documents: ISO/IEC 14496-10 (ITU-T H.264), International Standard (2003), Advanced video coding for generic audiovisual services; ISO/IEC 14496-10/Cor. 1: 2004
Technical Corrigendum 1; and ISO/IEC 14496-10/Amd. 1,2004, Advanced Video Coding AMENDMENT 1: AVC fidelity range extensions. A second era, on the other hand, may comprise legacy HD receivers that are capable of processing 1080i-60 video encoded according to the MPEG-4 AVC specification. Because the latter legacy receivers have yet to be deployed, these receivers could be designed to support identification of the first video stream in a multiple video stream program from the lowest PID value corresponding to video_type1 in the PMT. Alternatively, the first video entry in the PMT table, regardless of its PID value, would be considered the first video stream. - In another alternate embodiment, the streams are encoded according to different video specifications and the values of video_type1 and video_type2 in the PMT differ. For example, the first video stream would be encoded and identified as MPEG-2 video in the PMT by a video_type1 value that corresponds to MPEG-2 video. The second video stream would be encoded with MPEG-4 AVC and identified by a video_type2 value corresponding to MPEG-4 AVC.
- In yet another alternate embodiment, video_type2 corresponds to a stream type specifically designated to specify the complementary video stream (i.e, the second video stream of a 1080P-60 program). Both video streams could be encoded according to the syntax and semantics of the same video specification (e.g, with MPEG-4 AVC) or with different video specifications. Thus, while the values of video_type1 and video_type2 are different in the PMT table for a 1080P-60 program, both video streams composing the 1080P-60 program could adhere to the same video specification. Thus, video_type1's value identifies the video specification used to encode the first video stream, but video_type2's value identifies both:
-
- (1) the video stream that corresponds to the second video stream of the 1080P-60 program, and
- (2) the video specification (or video coding format) used to encode the second video stream.
- A first video_type2 value then corresponds to a stream type associated with the second stream of a 1080P-60 program that is encoded according to the MPEG-2 video specification. A second video_type2 value corresponds to a stream type associated with the second stream of a 1080P-60 program that is encoded according to the MPEG-4 AVC specification. Likewise, other video_type2 values can correspond to respective stream types, each associated with the second stream of a 1080P-60 program and encoded according to a respective video coding specification.
- In yet another novel aspect of the invention, when video_type2 does not equal video_type1 and their values signify different video specifications, pictures in the second stream can still use reconstructed pictures from the first video stream as reference pictures.
- Encoded pictures in the first and second video streams are multiplexed in the transport multiplex according to a defined sequence that allows a single video decoder in a 1080P-60 receiver to receive and decode the pictures sequentially as if the pictures were transmitted in a single video stream. However, because they are two separate video streams, a 1080i-60 receiver can reject transport packets belonging to the second video stream and allow video packets corresponding to the first video stream to penetrate into its memory to process a portion equal to 1080P-30 video. Encoded pictures in the first video stream are transmitted in transmission order, adhering to the timing requirement and bit-buffer management policies required for a decoder to process the first video stream as a 1080P-30 encoded video signal.
- In one embodiment of the invention,
FIG. 4A depicts the first and second video streams in display order. P represents a picture and not a type of picture. Pi is the ith picture in display order. In a 1080P-60 receiver, the blank squares represent gaps of when the picture being displayed is from the complementary video stream. The width of a blank square is one “picture display” time. Non-blank squares represent the time interval in which the corresponding picture is being displayed. - Still referring to
FIG. 4A , in a 1080i-60 receiver, a 1080P-30 picture corresponding to the first video stream is displayed and the width of two squares represents the picture display time.Video stream 1 is specified as 30 Hertz in alternating 60 Hertz intervals that correspond to even integers.Video stream 2 is specified as 30 Hertz in alternating 60 Hertz intervals that correspond to odd integers. -
FIG. 4B depicts pictures according to picture types in display order. Ni signifies the ith Picture in display order, where N is the type of picture designated by the letter I, P or B. In one embodiment, all the pictures invideo stream 2 are B pictures and the 1080P-60 receiver uses decoded pictures fromvideo stream 1 as reference pictures to reconstruct the B pictures. -
FIG. 4C corresponds to the transmission order of the pictures in display order inFIG. 4B . Each picture is transmitted (and thus received by the receiver) at least one 60 Hz interval prior to its designated display time. I pictures are displayed six 60 Hz interval after being received and decoded. I pictures are thus transmitted at least seven 60 Hz intervals prior to its corresponding display time. The arrows fromFIG. 4C toFIG. 4B reflect the relationship of the pictures' transmission order to their display order. - Blank squares in
FIG. 4C represent gaps when no picture data is transmitted for the respective video stream. The width of a blank square can be approximately one “picture display” time. Non-blank squares represent the time interval in which the corresponding picture is transmitted. One or more smaller transmission gaps of no data transmission may exist within the time interval in which a picture is transmitted. In essence,video stream 1 andvideo stream 2 are multiplexed at the emission point in a way to effect the transmission order reflected inFIG. 4C and transmission time relationship depicted inFIG. 4C . - A sequence of video pictures is presented at an encoder for compression and production of a compressed 1080P-60 program. Every other picture is referred as an N picture and every subsequent picture as an N+1 picture. The sequence of all the N pictures is the first video stream of the 1080P-60 program and the sequence all the N+1 pictures is the second video stream.
- A video encoder produces the first video stream according to a first video specification (e.g., MPEG-2 video) and the second video stream according to a second video specification (e.g., MPEG-4 AVC). In one embodiment the second video specification is different than the first video specification. In an alternate embodiment, the first and second video specifications are the same (e.g., MPEG-4 AVC).
- The video encoder produces compressed pictures for the first video stream by depositing the compressed pictures into a first bit-buffer in memory, such memory being coupled to the encoder. Depositing of compressed pictures into the first bit-buffer is according to the buffer management policy (or policies) of the first video specification. The first bit-buffer is read for transmission by the video encoder in one embodiment. In an alternate embodiment, a multiplexer or transmitter reads the compressed pictures out of the first bit-buffer. The read potions of the first bit buffer are packetized and transmitted according to a transport stream specifications such as MPEG-2 transport.
- Furthermore, the video encoder, the multiplexer, or the transmitter, or the entity performing the first bit-buffer reading and packetization of the compressed pictures, prepends a first PID to packets belonging to the first video stream. The packetized first video stream is then transmitted via a first transmission channel.
- Similarly, the second video stream is produced by the video encoder and deposited into the first bit buffer. The second video stream is read from the first bit-buffer by the entity performing the packetization, and the entity prepends a second PID to packets belonging to the second video stream, and the transport packets are transmitted via a first transmission channel.
- In an alternate embodiment, the second video stream is produced by the video encoder and deposited into a second bit buffer. The entity performing the packetization reads the second video stream from the second bit buffer and prepends the second PID to packets belonging to the second video stream. The packetized second video stream is then transmitted via a first transmission channel.
- Both first and second video streams are packetized according to a transport stream specification, such as MPEG-2 Transport. Packets belonging to the second video stream are thus identifiable by a 1080P-60 capable receiver and become capable of being rejected by a receiver that is not capable of processing 1080P-60 programs.
- The bit buffer management policies of depositing compressed picture data into the first and/or second bit-buffers and reading (or drawing) compressed-picture data from the first and/or second bit-buffers, are according to the first video specification. These operations may be further in accordance with bit-buffer management policies of the transport stream specification. Furthermore, the bit-buffer management policies implemented on the one or two bit-buffers may be according to the second video specification rather than the first video specification. In one embodiment, the first video stream's compressed data in the bit-buffer is managed according to both: the bit buffer management policies of the first video specification and the transport stream specification, while the second video stream's compressed data in the applicable bit-buffer is managed according to the bit buffer management policies of the second video specification as well as the transport stream specification.
- The bit-buffer management policies described above are applicable at the emission or transmission point in the network, such as by the encoder and the entity producing the multiplexing and/or transmission. Bit-buffer management policies, consistent with the actual implementation at the emission or transmission point, are applicable at the receiver to process the one or more received video streams of a 1080P-60 program. The bit-buffer management policy implemented at the emission or transmission point may be provided to the receiver a priori for each program (e.g., with metadata) or according to an agreed one of the alternatives described above that is employed indefinitely.
- Enabling More than Two Receivers with Different Respective Processing Capabilities
- In an alternate embodiment, the video encoder constitutes two video encoders, a first video encoder producing the first video stream according to the first video specification, and a second video encoder producing the second video stream, which is interspersed for transmission in the transmission channel according to the pockets of “no data” transmission of video stream 1 (as shown in
FIG. 4C ). The second video encoder further producing the second video stream according to the second video specification. - In yet another embodiment, the process of alternating transmission of compressed pictures corresponding to the first video stream and compressed pictures corresponding to the second video stream, results in transmission of a first set of consecutive compressed pictures from different the first video stream when it is the turn to transmit the first video stream, or a second set of consecutive compressed pictures from different the second video stream when it is the turn to transmit the second video stream. For instance, instead of alternating between one compressed picture from the first video stream and one from the second video stream, two consecutive compressed pictures from the second video stream may be transmitted after each transmission of a single compressed picture of the first video stream. Thus, a 1080P-90 Hertz program can be facilitated to 1080P-90 receivers and a 1080P-30 portion of the 1080P-90 program to 1080P-30 receivers. Furthermore, by packetizing every second compressed picture in the second video stream with a third PID value that is different than the first and second PIDs, three corresponding versions of the compressed 1080P-90 program are facilitated respectively to a 1080P-30 receiver, a 1080P-60 receiver, and a 1080P-90 receiver, the latter being able to receive and fulfill the full benefits of the 1080P-90 program.
- In yet another embodiment, the number of consecutive compressed pictures that is transmitted from the first video stream may be greater than one. For instance, if two consecutive compressed pictures from the first video stream are transmitted and three compressed pictures from the second video stream are transmitted after transmission the two from the first video stream, a number of receivers with different processing capabilities may be enabled. If two different PID values are employed, a 1080P-50 receiver will receive a 1080P-50 Program and a 1080P-20 receiver will receive a 1080P-20 corresponding portion. However, if five different PID values are used for the 1080P-50 program, five receivers, each with different processing capability will be capable of receiving a portion of the 1080P-50 program.
-
Headend 110 may receive from an interface to a different environment, such as from a satellite or a storage device, an already compressed 1080P-60 program—a single video stream encoded according to a third video specification and according to a first stream specification. The first stream specification may be a type of transport stream specification suitable for transmission or a type of program stream specification suitable for storage. The third video specification may comprise of the first video specification, the second video specification, or both the first and second video specifications respectively applied, for example, to every other compressed picture. However, the already compressed 1080P-60 program is received atheadend 110 encoded in such a way that it does not facilitate reception some of its portions by receivers with processing capability that are less than those of a 1080P-60 receiver. In other words, it is received without information to inherent signal its different portions to receivers with different processing capabilities. - Another novel aspect of this invention is that at least one from one or more encoders, one or more multiplexers, or one or more processing entities at the point of transmission at
headend 110, effect packetization of the compressed pictures of the received 1080P-60 program with a plurality of different PIDS, then transmitting the 1080P-60 program as a plurality of identifiable video streams via the first transmission channel. Thus,headend 110 effects proper packetization and prepending of PID values to enable reception of at least a portion of the 1080P-program to receivers with different processing capabilities that are coupled tonetwork 130. - The present invention includes methods and systems capable of transmitting compressed video signals according to one or more compression video formats, where compressed video signals correspond to television channels or television programs in any of a plurality of picture formats (i.e., picture spatial resolution and picture rate), including 1080i-60 and 1080P-60 formats. The compressed video signals which correspond to television channels or television programs in any of a plurality of picture formats are received by a plurality of receivers, where each receiver may have a different maximum processing capability. Therefore, the present invention contemplates at least the following combinations for encoding, transmission and reception of video signals. In the following combinations of trio “input/receiver/display,” the input, such as 1080P-60 input in the first combination instance, refers to a compressed video stream that is received at
receiver 200 fromnetwork 130 viacommunication interface 242. The display, such as the 1080P-60 Display in the first combination instance is a television, a display, or a monitor coupled to DHCT 200 viaoutput system 248. TheDHCT 200 provides the compressed video stream corresponding to the “input” in “decoded and reconstructed” form (visible pictures) viaoutput system 248. The receiver, such as 1080P-60 Receiver in the first combination instance, refers to a receiver, such asDHCT 200, that has the processing capability specified in the trio. - In order to process a 1080P-60 compressed video signal, a 1080P-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface). The 1080P-60 compressed video signal is input by storing it in its memory and the receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the 1080P-60 video signal (or compressed video stream). A 1080P-60 capable display is driven by all the decoded 1080P-60 pictures.
- 1080i-60 input/1080P-60 Receiver/1080P-60 Display
- In order to process a 1080i-60 compressed video signal, the 1080P-60 capable receiver receives a compressed 1080i-60 video stream via a network interface (or a communication interface). The 1080P-60 compressed video signal is input by storing it in its memory and the receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the compressed 1080i-60 video signal stored in memory. The 1080P-60 receiver then deinterlaces the decoded 1080i-60 signal with a de-interlacing algorithm based on information in two or more 1080i fields, including a current 1080i field. The deinterlacing algorithm makes decisions based on spatial picture information as well as temporal information. The deinterlacing algorithm can further base decisions on motion estimation or motion detection. A 1080P-60 capable display is driven by all the decoded 1080P-60 pictures.
- In order to process a 1080P-60 compressed video signal, the 1080P-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface). When driving a non-1080P-60 display, the receiver outputs a portion of all the decoded 1080P-60 pictures or processes and scales the pictures of the decoded 1080P-60 signal for display. When driving a non-1080P-60 display such as a 1080i-60 display, the 1080P-60 capable receiver could process a 1080P-60 compressed video signal in full (as explained above) and output (or display) a portion of each of the decoded 1080P-60 pictures. The portion may be a temporally-subsampled portion, a spatially-subsampled portion, or a portion resulting from a combination of a temporal-subsampling and spatially-subsampling. Alternatively, when driving a non-1080P-60 capable display, the 1080P60-capable receiver is informed by the user or through a discovery mechanism that the display is not 1080P-60. Consequently, the 1080P-60-capable receiver can behave as if it was a 1080P-30 receiver by not processing the second video stream.
- 1080i-60 Input/1080P-60 Receiver/Non-1080P-60 Display
- When driving a non-1080P-60 display, a 1080P-60 receiver processes a 1080i-60 compressed video signal and outputs the decoded 1080i-60 pictures according to the picture format required to drive the non-1080 display, processing and scaling the pictures of the decoded 1080i-60 signal as required to drive the non-1080P-60 display.
- 1080P-60 Input/1080i-60 Receiver/Non-1080P-60 Display
- In order to process a 1080P-60 compressed video signal, a 1080i-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface). The receiver inputs a first portion of the 1080P-60 compressed video signal by storing it in memory of
receiver 200 and the receiver rejects a second and complementary portion of the 1080P compressed video signal by prohibiting it from penetrating any section, portion or buffer of its memory. Thereceiver 200 decodes with a video decoder (or decompression engine) all the pictures corresponding to the first portion of the 1080P-60 video signal; processing it as if it were a 1080i-60 compressed video signal. A 1080i-60 capable display is driven by the decoded first portion of the 1080P-60 pictures. - 1080P-60 Input/1080i-60 Receiver/1080P-60 Display—A
- In order to process a 1080P-60 compressed video signal, a 1080i-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface). The receiver inputs a first portion of the 1080P-60 compressed video signal corresponding to a 1080i-60 compressed video signal by storing it in its memory and rejects a second and complementary portion of the 1080P compressed video signal by prohibiting it from penetrating any section, portion or buffer of its memory. The receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the first portion of the 1080P-60 video signal, processing it as if it were a 1080i-60 compressed video signal. The receiver deinterlaces a decoded 1080i-60 signal with a deinterlacing algorithm based on information in two or more 1080i fields, including a current 1080i field. The deinterlacing algorithm makes decisions based on spatial picture information as well as temporal information. The deinterlacing algorithm can further base decisions on motion estimation or motion detection. A 1080P-60 capable display is driven by all the decoded and deinterlaced 1080i-60 pictures as a 1080P-60 signal.
- 1080P-60 Input/1080i-60 Receiver/1080P-60 Display—B
- In order to process a 1080P-60 compressed video signal, a 1080i-60 capable receiver receives a compressed 1080P-60 video stream via a network interface (or a communication interface). The receiver inputs a first portion of the 1080P-60 compressed video signal corresponding to a 1080i-60 compressed video signal by storing it in its memory and rejects a second and complementary portion of the 1080P-60 compressed video signal by prohibiting it from penetrating any section, portion or buffer of its memory. The receiver decodes with a video decoder (or decompression engine) all the pictures corresponding to the first portion of the 1080P-60 video signal, processing it as if it were a 1080i-60 compressed video signal. In order to drive a 1080P-60 capable display that is capable of receiving a 1080i-60 signal and internal deinterlacing, the display is driven by all the pictures of the decoded 1080i-60 compressed video signal as a 1080i-60 signal. The 1080P-60 display deinterlaces the received 1080i-60 signals according to its deinterlacing capabilities.
- The encoder produces a 1080P-60 encoded video stream according to a video specification (i.e., MPEG-2 video or MPEG-4 AVC), and assigns a first PID value to packets of every other encoded picture corresponding to the 1080P-60, and assigns a second PID value to every packet of the subsequent picture to the “every other” picture just mentioned, where the second PID value is different from the first PID value. Denoting “every other picture” by N, every subsequent picture is then N+1; and the first PID_value is used for N, while the second PID_value is used for N+1.
- The encoder in one embodiment encodes all pictures according to a single video format, e.g., MPEG-4 AVC, and adheres to the buffer model of the video specification. The encoder in a second embodiment encodes the pictures that correspond to N according to a first video specification and in compliance with the video specification's buffering model, and according to a variable-bit rate model. The encoder further encodes the alternate pictures, every “N+1” picture, according to a second video specification, the second video specification being different from the first video specification. These alternate pictures are encoded according to the syntax of the second video specification, but managed and transferred into a transmission buffer according to the first video specification's buffering model. The encoder further employs in its “encoding loop” a model, or parts thereof, of a receiver's video decoder, including reference pictures, in it's memory.
- Encode 1080P at 60 frames per second, into a single output, ensuring that every other picture (in both decode order and presentation order) is a non-reference picture. Every picture encoded is a progressive frame representing 1/60th seconds. Now, every other picture can be separated into a new PID. This new PID may be called “PID B”, and the other PID may be called “PID A”. PID B contains only non-reference pictures that can optionally be included in the decoding of PID A. In this separation process, the original picture ordering must be maintained within the multiplex. For example, a picture in one PID must end before the next picture begins in the other PID.
- For backwards-compatibility, the frame rate value in PID A should be set at 30 frames per second; and the temporal references in PID A should be corrected for the separated pictures; and as a convenience, the temporal references in PID B should be set to match those in PID A, such that each picture pair shares a temporal reference number. The 1080P-60 capable decoder will be aware that the frame rate is actually 60 frames per second, and will support the pairs of duplicate temporal references. When decoding both PID A and PID B in combination, the decoder should expect two of every temporal reference number, adjacent in presentation order. Therefore, for example, it can use the temporal reference numbers to detect a missing picture. Picture re-ordering within the decoder may be based on the sequence of picture types received, as normal.
- The following are examples of this scheme demonstrating how a decoder could receive PID A alone, or receive the combination of PID A and PID B. In these examples, the “B”-type pictures represent non-reference frames. Also, these examples are given in decode order, and the numbers represent temporal references (indicating presentation order).
- Before temporal reference number (TRN) correction:
- After TRN correction:
- Before TRN correction:
- After TRN correction:
- In the PMT, PID B can be designated by a new stream_type. A common set of audio streams may serve each case: 1) using only PID A 2) using both PID A and PID B.
- In the above described method of encoding and transmission, the separation of every other frame occurred after encoding. In an alternative embodiment, separation occurs prior to encoding. At one encoder's input, supply every other frame of a 1080P-60 hz signal. Encode this as 1080P-30 hz. Simultaneously, supply another encoding process with the alternate frames, also at 1080P-30 hz. Presentation time stamps (PTSs) shall be generated for every picture, referencing a common clock. The result is two video streams, each being legitimate 1080P-30 hz. A 1080P-60 capable decoder may decode both simultaneously, as a dual-decode operation, to be recombined in the display process. There need be no further correlation between the two PIDs than the commonly referenced PTSs. For example, the group of pictures (GOP) structures, as defined by the video specification (e.g., MPEG-2 video GOP) may be independent, and the buffering may be independent. To recombine the dual 1080P-30 streams into a single 1080P-60 output, the dual-decoder's display process will choose decoded pictures to put on display in order of PTS. If the picture for a particular time interval has not yet been decoded, possibly due to some data corruption or loss, then the previous picture will simply be repeated through that time interval. If any picture is decoded later than its PTS elapses, it is to be discarded. Even though both PIDs may be completely independent, because they reference the same clock, there is no risk that a picture from one PID is sent later than the presentation time of a following picture from the other PID, as long as each PID's buffer is maintained compliantly within the multiplex.
- PID B in the PMT may be designated by a new stream_type, which may be allocated by MPEG, or which may be a user-private stream_type that indicates a privately managed stream. The new stream_type would not be recognized by legacy receivers, so the associated PID B would be ignored. As an additional method of unambiguous identification of the special second PID, the registration descriptor may be used in the ES_descriptor_loop of the PMT to register a unique and private attribute for association with PID B. Any combination of the above methods may be used, as deemed adequate and sensible. A common set of audio streams may serve each case: 1) using only PID A 2) using both PID A and PID B. The methods described above use a separate PID to carry additional information. In those cases, the separate PID can optionally be ignored by the decoder. In another alternative embodiment, a single video PID may be used to carry both the base information and the additional information, while still providing a way to optionally reject the additional information. A separate packetized elementary stream (PES) ID can be used such that a new PMT descriptor, which would be allocated by MPEG, may designate one PES ID for the base layer, and a different PES ID for the additional information, both carried by the same PID. In this way, existing PES IDs may be identified as base, and supplemental, without the need for new PES IDs to be allocated. The decoder that needs only the base layer may discard those PES packets whose ID does not match the ID designated as the base layer in the PMT. The decoder that can use both may simply not reject either. This approach is applicable to both schemes: post-encoding-separation and prior-encoding-separation.
- The foregoing has broadly outlined some of the more pertinent aspects and features of the present invention. These should be construed to be merely illustrative of some of the more prominent features and applications of the invention. Other beneficial results can be obtained by applying the disclosed information in a different manner or by modifying the disclosed embodiments. Accordingly, other aspects and a more comprehensive understanding of the invention may be obtained by referring to the detailed description of the exemplary embodiments taken in conjunction with the accompanying drawings, in addition to the scope of the invention defined by the claims.
Claims (18)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/342,576 US20090122184A1 (en) | 2005-05-18 | 2008-12-23 | Providing identifiable video streams of different picture formats |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/132,060 US20060271990A1 (en) | 2005-05-18 | 2005-05-18 | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
US12/342,576 US20090122184A1 (en) | 2005-05-18 | 2008-12-23 | Providing identifiable video streams of different picture formats |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/132,060 Continuation US20060271990A1 (en) | 2005-05-18 | 2005-05-18 | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090122184A1 true US20090122184A1 (en) | 2009-05-14 |
Family
ID=37062182
Family Applications (15)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/132,060 Abandoned US20060271990A1 (en) | 2005-05-18 | 2005-05-18 | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
US12/342,576 Abandoned US20090122184A1 (en) | 2005-05-18 | 2008-12-23 | Providing identifiable video streams of different picture formats |
US12/342,934 Abandoned US20090144796A1 (en) | 2005-05-18 | 2008-12-23 | Processing video streams of different picture formats |
US12/342,824 Abandoned US20090122186A1 (en) | 2005-05-18 | 2008-12-23 | Adaptive processing of programs with multiple video streams |
US12/342,875 Expired - Fee Related US8848780B2 (en) | 2005-05-18 | 2008-12-23 | Video processing impermeable to additional video streams of a program |
US12/342,567 Abandoned US20090122183A1 (en) | 2005-05-18 | 2008-12-23 | Providing video programs with identifiable and manageable video streams |
US12/342,938 Abandoned US20090106814A1 (en) | 2005-05-18 | 2008-12-23 | Era-dependent receiving and processing of programs with one or more video streams |
US12/342,582 Abandoned US20090122185A1 (en) | 2005-05-18 | 2008-12-23 | Providing video streams of a program with different stream type values coded according to the same video coding specification |
US12/342,946 Abandoned US20090103605A1 (en) | 2005-05-18 | 2008-12-23 | Processing identifiable video streams of a program according to stream type values |
US12/342,569 Active 2029-04-27 US9264766B2 (en) | 2005-05-18 | 2008-12-23 | Receiving and processing multiple video streams associated with a video program |
US12/343,032 Abandoned US20090103634A1 (en) | 2005-05-18 | 2008-12-23 | Providing a video stream with alternate packet identifiers |
US12/342,914 Abandoned US20090106812A1 (en) | 2005-05-18 | 2008-12-23 | Processing different complementary streams of a program |
US12/342,572 Abandoned US20090122190A1 (en) | 2005-05-18 | 2008-12-23 | Providing complementary streams of a program coded according to different compression methods |
US12/343,059 Abandoned US20090154553A1 (en) | 2005-05-18 | 2008-12-23 | Receiving and separating an encoded video stream into plural encoded pictures with different identifiers |
US15/043,714 Active US9729906B2 (en) | 2005-05-18 | 2016-02-15 | Providing representations of a video program with multiple video streams having different stream types |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/132,060 Abandoned US20060271990A1 (en) | 2005-05-18 | 2005-05-18 | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
Family Applications After (13)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/342,934 Abandoned US20090144796A1 (en) | 2005-05-18 | 2008-12-23 | Processing video streams of different picture formats |
US12/342,824 Abandoned US20090122186A1 (en) | 2005-05-18 | 2008-12-23 | Adaptive processing of programs with multiple video streams |
US12/342,875 Expired - Fee Related US8848780B2 (en) | 2005-05-18 | 2008-12-23 | Video processing impermeable to additional video streams of a program |
US12/342,567 Abandoned US20090122183A1 (en) | 2005-05-18 | 2008-12-23 | Providing video programs with identifiable and manageable video streams |
US12/342,938 Abandoned US20090106814A1 (en) | 2005-05-18 | 2008-12-23 | Era-dependent receiving and processing of programs with one or more video streams |
US12/342,582 Abandoned US20090122185A1 (en) | 2005-05-18 | 2008-12-23 | Providing video streams of a program with different stream type values coded according to the same video coding specification |
US12/342,946 Abandoned US20090103605A1 (en) | 2005-05-18 | 2008-12-23 | Processing identifiable video streams of a program according to stream type values |
US12/342,569 Active 2029-04-27 US9264766B2 (en) | 2005-05-18 | 2008-12-23 | Receiving and processing multiple video streams associated with a video program |
US12/343,032 Abandoned US20090103634A1 (en) | 2005-05-18 | 2008-12-23 | Providing a video stream with alternate packet identifiers |
US12/342,914 Abandoned US20090106812A1 (en) | 2005-05-18 | 2008-12-23 | Processing different complementary streams of a program |
US12/342,572 Abandoned US20090122190A1 (en) | 2005-05-18 | 2008-12-23 | Providing complementary streams of a program coded according to different compression methods |
US12/343,059 Abandoned US20090154553A1 (en) | 2005-05-18 | 2008-12-23 | Receiving and separating an encoded video stream into plural encoded pictures with different identifiers |
US15/043,714 Active US9729906B2 (en) | 2005-05-18 | 2016-02-15 | Providing representations of a video program with multiple video streams having different stream types |
Country Status (4)
Country | Link |
---|---|
US (15) | US20060271990A1 (en) |
EP (1) | EP1882366A2 (en) |
CA (1) | CA2609072C (en) |
WO (1) | WO2006125052A2 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060271990A1 (en) * | 2005-05-18 | 2006-11-30 | Rodriguez Arturo A | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
US20090067507A1 (en) * | 2007-09-10 | 2009-03-12 | Cisco Technology, Inc. | Video compositing of an arbitrary number of source streams using flexible macroblock ordering |
US20110069225A1 (en) * | 2009-09-24 | 2011-03-24 | Sensio Technologies Inc. | Method and system for transmitting and processing high definition digital video signals |
US10567703B2 (en) | 2017-06-05 | 2020-02-18 | Cisco Technology, Inc. | High frame rate video compatible with existing receivers and amenable to video decoder implementation |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7010801B1 (en) | 1999-06-11 | 2006-03-07 | Scientific-Atlanta, Inc. | Video on demand system with parameter-controlled bandwidth deallocation |
US7992163B1 (en) | 1999-06-11 | 2011-08-02 | Jerding Dean F | Video-on-demand navigational system |
US6817028B1 (en) | 1999-06-11 | 2004-11-09 | Scientific-Atlanta, Inc. | Reduced screen control system for interactive program guide |
US8516525B1 (en) | 2000-06-09 | 2013-08-20 | Dean F. Jerding | Integrated searching system for interactive media guide |
US7975277B1 (en) | 2000-04-03 | 2011-07-05 | Jerding Dean F | System for providing alternative services |
US7200857B1 (en) | 2000-06-09 | 2007-04-03 | Scientific-Atlanta, Inc. | Synchronized video-on-demand supplemental commentary |
US7934232B1 (en) | 2000-05-04 | 2011-04-26 | Jerding Dean F | Navigation paradigm for access to television services |
US8069259B2 (en) | 2000-06-09 | 2011-11-29 | Rodriguez Arturo A | Managing removal of media titles from a list |
US7962370B2 (en) | 2000-06-29 | 2011-06-14 | Rodriguez Arturo A | Methods in a media service system for transaction processing |
US7340759B1 (en) | 2000-11-10 | 2008-03-04 | Scientific-Atlanta, Inc. | Systems and methods for adaptive pricing in a digital broadband delivery system |
US7512964B2 (en) * | 2001-06-29 | 2009-03-31 | Cisco Technology | System and method for archiving multiple downloaded recordable media content |
US7496945B2 (en) | 2001-06-29 | 2009-02-24 | Cisco Technology, Inc. | Interactive program guide for bidirectional services |
US8006262B2 (en) | 2001-06-29 | 2011-08-23 | Rodriguez Arturo A | Graphic user interfaces for purchasable and recordable media (PRM) downloads |
US7526788B2 (en) * | 2001-06-29 | 2009-04-28 | Scientific-Atlanta, Inc. | Graphic user interface alternate download options for unavailable PRM content |
US7334251B2 (en) | 2002-02-11 | 2008-02-19 | Scientific-Atlanta, Inc. | Management of television advertising |
US8161388B2 (en) | 2004-01-21 | 2012-04-17 | Rodriguez Arturo A | Interactive discovery of display device characteristics |
US8780957B2 (en) * | 2005-01-14 | 2014-07-15 | Qualcomm Incorporated | Optimal weights for MMSE space-time equalizer of multicode CDMA system |
KR20070117660A (en) | 2005-03-10 | 2007-12-12 | 콸콤 인코포레이티드 | Content adaptive multimedia processing |
US20060282780A1 (en) * | 2005-06-08 | 2006-12-14 | Samsung Electronics Co., Ltd. | Networked monitor |
MX2008001155A (en) | 2005-07-25 | 2008-03-13 | Thomson Licensing | Method and apparatus for the concealment of missing video frames. |
US8189472B2 (en) | 2005-09-07 | 2012-05-29 | Mcdonald James F | Optimizing bandwidth utilization to a subscriber premises |
US8879635B2 (en) * | 2005-09-27 | 2014-11-04 | Qualcomm Incorporated | Methods and device for data alignment with time domain boundary |
US8654848B2 (en) * | 2005-10-17 | 2014-02-18 | Qualcomm Incorporated | Method and apparatus for shot detection in video streaming |
US8948260B2 (en) * | 2005-10-17 | 2015-02-03 | Qualcomm Incorporated | Adaptive GOP structure in video streaming |
US20070206117A1 (en) * | 2005-10-17 | 2007-09-06 | Qualcomm Incorporated | Motion and apparatus for spatio-temporal deinterlacing aided by motion compensation for field-based video |
US20070171280A1 (en) * | 2005-10-24 | 2007-07-26 | Qualcomm Incorporated | Inverse telecine algorithm based on state machine |
US9131164B2 (en) * | 2006-04-04 | 2015-09-08 | Qualcomm Incorporated | Preprocessor method and apparatus |
US7868879B2 (en) * | 2006-05-12 | 2011-01-11 | Doremi Labs, Inc. | Method and apparatus for serving audiovisual content |
US9204159B2 (en) * | 2006-06-16 | 2015-12-01 | Via Technologies, Inc. | VPU with programmable core |
KR101310894B1 (en) * | 2006-10-17 | 2013-09-25 | 주식회사 넷앤티비 | Method and apparatus of referencing stream in other SAF session for LASeR service and apparatus for the LASeR service |
US20080120672A1 (en) * | 2006-11-21 | 2008-05-22 | Francesco Caggioni | Methods and Apparatus for Weighted Multicasting of Data Streams |
WO2009016835A1 (en) * | 2007-08-01 | 2009-02-05 | Panasonic Corporation | Digital broadcast transmission device and digital broadcast reception device |
US20090119732A1 (en) * | 2007-11-02 | 2009-05-07 | Thomas Spieker | Method and system for direct sampled digital and analog demodulator tv receiver with backwards compatibility |
US9456192B2 (en) * | 2007-12-14 | 2016-09-27 | Cable Television Laboratories, Inc. | Method of coding and transmission of progressive video using differential signal overlay |
US20100162293A1 (en) * | 2008-12-23 | 2010-06-24 | General Instrument Corporation | Method and apparatus for replacing a blacked out program in a seamless manner |
US8782267B2 (en) * | 2009-05-29 | 2014-07-15 | Comcast Cable Communications, Llc | Methods, systems, devices, and computer-readable media for delivering additional content using a multicast streaming |
US20120144441A1 (en) * | 2009-08-12 | 2012-06-07 | Chang Sik Yun | Method for diagnosing 3d state information, and broadcast receiver |
CN102447673A (en) * | 2010-09-30 | 2012-05-09 | 突触计算机系统(上海)有限公司 | Method and equipment for depacking multimedia file carrying a package format |
CA2823288C (en) * | 2011-02-16 | 2019-05-07 | Panasonic Corporation | Video encoder, video encoding method, video encoding program, video reproduction device, video reproduction method, and video reproduction program |
JPWO2012111325A1 (en) * | 2011-02-17 | 2014-07-03 | パナソニック株式会社 | Video encoding apparatus, video encoding method, video encoding program, video playback apparatus, video playback method, and video playback program |
JP5978574B2 (en) * | 2011-09-12 | 2016-08-24 | ソニー株式会社 | Transmission device, transmission method, reception device, reception method, and transmission / reception system |
JP5979948B2 (en) * | 2012-04-11 | 2016-08-31 | キヤノン株式会社 | Image data transmitting apparatus and image data receiving apparatus |
JP5979949B2 (en) | 2012-04-11 | 2016-08-31 | キヤノン株式会社 | Image data transmitting apparatus and image data receiving apparatus |
CN106303383A (en) * | 2015-05-25 | 2017-01-04 | 华硕电脑股份有限公司 | Image playing system and signal of video signal acquisition device |
US10043523B1 (en) * | 2017-06-16 | 2018-08-07 | Cypress Semiconductor Corporation | Advanced packet-based sample audio concealment |
Citations (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5055927A (en) * | 1988-09-13 | 1991-10-08 | Deutsche Thomson-Brandt Gmbh | Dual channel video signal transmission system |
US5444491A (en) * | 1993-02-26 | 1995-08-22 | Massachusetts Institute Of Technology | Television system with multiple transmission formats |
US5508746A (en) * | 1993-06-24 | 1996-04-16 | Massachusetts Institute Of Technology | Advanced television system |
US5742343A (en) * | 1993-07-13 | 1998-04-21 | Lucent Technologies Inc. | Scalable encoding and decoding of high-resolution progressive video |
US5966120A (en) * | 1995-11-21 | 1999-10-12 | Imedia Corporation | Method and apparatus for combining and distributing data with pre-formatted real-time video |
US6208382B1 (en) * | 1998-07-29 | 2001-03-27 | Florida Atlantic University | Color video processing system and method |
US20010006404A1 (en) * | 1999-12-30 | 2001-07-05 | Yun Hwa Young | Combined terrestrial wave/cable broadcast receiver and program information processing method therefor |
US6292512B1 (en) * | 1998-07-06 | 2001-09-18 | U.S. Philips Corporation | Scalable video coding system |
US6337716B1 (en) * | 1998-12-09 | 2002-01-08 | Samsung Electronics Co., Ltd. | Receiver for simultaneously displaying signals having different display formats and/or different frame rates and method thereof |
US6353613B1 (en) * | 1996-07-02 | 2002-03-05 | Sony Corporation | Information transmitter device and transmitting method |
US6377309B1 (en) * | 1999-01-13 | 2002-04-23 | Canon Kabushiki Kaisha | Image processing apparatus and method for reproducing at least an image from a digital data sequence |
US20020054638A1 (en) * | 2000-08-18 | 2002-05-09 | Tsuyoshi Hanamura | Coded signal separating and merging apparatus, method and computer program product |
US20020075954A1 (en) * | 2000-12-19 | 2002-06-20 | Vince Lawrence D. | Methods and apparatus for re-encoding a high definition television signal to create a standard definition television signal |
US20020087999A1 (en) * | 2000-04-26 | 2002-07-04 | Sony Corporation | Scalable filtering table |
US20020162114A1 (en) * | 2001-04-30 | 2002-10-31 | Bisher James A. | System and method for multicasting packets in a subscriber network |
US20030058948A1 (en) * | 2000-01-10 | 2003-03-27 | Kelly Declan Patrick | Method of setting a system time clock at the start of an mpeg sequence |
US6542518B1 (en) * | 1997-03-25 | 2003-04-01 | Sony Corporation | Transport stream generating device and method, and program transmission device |
US20030138043A1 (en) * | 2002-01-23 | 2003-07-24 | Miska Hannuksela | Grouping of image frames in video coding |
US6658056B1 (en) * | 1999-03-30 | 2003-12-02 | Sony Corporation | Digital video decoding, buffering and frame-rate converting method and apparatus |
US20040093337A1 (en) * | 2001-08-09 | 2004-05-13 | Shen Sheng Mei | Unified rights management for ipmp system |
US6757911B1 (en) * | 1996-08-30 | 2004-06-29 | Matsushita Electric Industrial Co., Ltd. | Digital broadcasting system, digital broadcasting apparatus, and a reception apparatus for digital broadcasts |
US6801575B1 (en) * | 1997-06-09 | 2004-10-05 | Sharp Laboratories Of America, Inc. | Audio/video system with auxiliary data |
US20040240860A1 (en) * | 2001-10-19 | 2004-12-02 | Bruls Wilhelmus Hendrikus Alfonsus | Apparatus, a record carrier and a method for reproducing video data signals |
US20040244059A1 (en) * | 2003-05-30 | 2004-12-02 | Lsi Logic Corporation | Digital set-top box transmodulator |
US20040264931A1 (en) * | 2003-04-28 | 2004-12-30 | Masahiro Nakashika | Information recording medium, information recording/playback method, and information recording/playback apparatus |
US20050015794A1 (en) * | 2002-12-20 | 2005-01-20 | Stmicroelectronics Sa | Audio/video decoding process and device, and video driver circuit and decoder box incorporating the same |
WO2005055605A1 (en) * | 2003-12-03 | 2005-06-16 | Koninklijke Philips Electronics N.V. | System and method for improved scalability support in mpeg-2 systems |
US20050210523A1 (en) * | 2004-03-22 | 2005-09-22 | James Parnell | System and method for transmitting files from a sender to a receiver in a television distribution network |
US20060023748A1 (en) * | 2004-07-09 | 2006-02-02 | Chandhok Ravinder P | System for layering content for scheduled delivery in a data network |
US7020205B1 (en) * | 2000-07-12 | 2006-03-28 | Thomson Licensing | Sending progressive video sequences suitable for MPEG and other data formats |
US7023992B1 (en) * | 1997-06-11 | 2006-04-04 | Sony Corporation | Data multiplexing device, program distribution system, program transmission system, pay broadcast system, program transmission method, conditional access system, and data reception device |
US20060083308A1 (en) * | 2004-10-15 | 2006-04-20 | Heiko Schwarz | Apparatus and method for generating a coded video sequence and for decoding a coded video sequence by using an intermediate layer residual value prediction |
US20060146734A1 (en) * | 2005-01-04 | 2006-07-06 | Nokia Corporation | Method and system for low-delay video mixing |
US20060271990A1 (en) * | 2005-05-18 | 2006-11-30 | Rodriguez Arturo A | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
US20070206673A1 (en) * | 2005-12-08 | 2007-09-06 | Stephen Cipolli | Systems and methods for error resilience and random access in video communication systems |
US20080037656A1 (en) * | 2006-08-08 | 2008-02-14 | Miska Hannuksela | Method, device, and system for multiplexing of video streams |
US7346055B2 (en) * | 2002-08-29 | 2008-03-18 | Broadcom Corporation | Method and system for co-relating transport packets on different channels using a unique packet identifier |
US7366462B2 (en) * | 2003-10-24 | 2008-04-29 | Qualcomm Incorporated | Method and apparatus for seamlessly switching reception between multimedia streams in a wireless communication system |
US7405765B2 (en) * | 2004-03-24 | 2008-07-29 | Realtek Semiconductor Corp. | Method and apparatus for de-interlacing video data |
US20090067507A1 (en) * | 2007-09-10 | 2009-03-12 | Cisco Technology, Inc. | Video compositing of an arbitrary number of source streams using flexible macroblock ordering |
US20100040152A1 (en) * | 2004-07-15 | 2010-02-18 | At&T Intellectual Property I.L.P. | Human Factors Based Video Compression |
US7672377B2 (en) * | 2006-04-21 | 2010-03-02 | Dilithium Holdings, Inc. | Method and system for video encoding and transcoding |
US7693220B2 (en) * | 2002-01-03 | 2010-04-06 | Nokia Corporation | Transmission of video information |
US20100142615A1 (en) * | 2003-12-01 | 2010-06-10 | Samsung Electronics Co., Ltd. | Method and apparatus for scalable video encoding and decoding |
US7747921B2 (en) * | 2005-08-05 | 2010-06-29 | Sony Corporation | Systems and methods for transmitting data over lossy networks |
US20110262106A1 (en) * | 2004-04-07 | 2011-10-27 | Hiroshi Yahata | Information recording medium wherein stream convertible at high-speed is recorded, and recording apparatus and recording method therefor |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3410467B2 (en) * | 1989-11-14 | 2003-05-26 | ドイチエ トムソン−ブラント ゲゼルシヤフト ミツト ベシユレンクテル ハフツング | Image signal transmission method and receiver |
JP2962083B2 (en) * | 1993-01-22 | 1999-10-12 | 松下電器産業株式会社 | Resolution conversion method, resolution conversion device, image encoding device, image decoding device |
DE19624948A1 (en) | 1996-06-24 | 1998-01-02 | Adiam Medizintechnik Gmbh & Co | Prosthetic heart valve |
US5923820A (en) * | 1997-01-23 | 1999-07-13 | Lexmark International, Inc. | Method and apparatus for compacting swath data for printers |
JPH10248051A (en) * | 1997-03-05 | 1998-09-14 | Matsushita Electric Ind Co Ltd | Digital data transmission method, digital data transmitter and digital data receiver |
US6369861B1 (en) * | 1997-03-31 | 2002-04-09 | Matsushita Electric Industrial Co., Ltd. | Program selection system for a digital television receiver |
US6212680B1 (en) * | 1998-03-04 | 2001-04-03 | Kabushiki Kaisha Toshiba | Multi-channel electronic programming guide and soft picture-in-picture acquisition for use with digital television |
JP2000099441A (en) * | 1998-09-25 | 2000-04-07 | Fujitsu Ltd | Device and method for controlling and presenting information |
US7975277B1 (en) * | 2000-04-03 | 2011-07-05 | Jerding Dean F | System for providing alternative services |
US20020037046A1 (en) * | 2000-09-22 | 2002-03-28 | Philips Electronics North America Corporation | Totally embedded FGS video coding with motion compensation |
US6996101B2 (en) * | 2000-11-29 | 2006-02-07 | International Business Machines Corporation | Re-mapping and interleaving transport packets of multiple transport streams for processing by a single transport demultiplexor |
US6869861B1 (en) * | 2001-03-08 | 2005-03-22 | Amkor Technology, Inc. | Back-side wafer singulation method |
US6956600B1 (en) | 2001-09-19 | 2005-10-18 | Bellsouth Intellectual Property Corporation | Minimal decoding method for spatially multiplexing digital video pictures |
KR20040072717A (en) * | 2002-01-11 | 2004-08-18 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Transmission system |
AU2003303166A1 (en) * | 2002-12-20 | 2004-07-14 | Koninklijke Philips Electronics N.V. | Method and apparatus for handling layered media data |
US20050036067A1 (en) * | 2003-08-05 | 2005-02-17 | Ryal Kim Annon | Variable perspective view of video images |
CN101341746B (en) | 2005-12-22 | 2011-11-30 | 维德约股份有限公司 | System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers |
-
2005
- 2005-05-18 US US11/132,060 patent/US20060271990A1/en not_active Abandoned
-
2006
- 2006-05-17 EP EP06760064A patent/EP1882366A2/en not_active Withdrawn
- 2006-05-17 WO PCT/US2006/019181 patent/WO2006125052A2/en active Application Filing
- 2006-05-17 CA CA2609072A patent/CA2609072C/en not_active Expired - Fee Related
-
2008
- 2008-12-23 US US12/342,576 patent/US20090122184A1/en not_active Abandoned
- 2008-12-23 US US12/342,934 patent/US20090144796A1/en not_active Abandoned
- 2008-12-23 US US12/342,824 patent/US20090122186A1/en not_active Abandoned
- 2008-12-23 US US12/342,875 patent/US8848780B2/en not_active Expired - Fee Related
- 2008-12-23 US US12/342,567 patent/US20090122183A1/en not_active Abandoned
- 2008-12-23 US US12/342,938 patent/US20090106814A1/en not_active Abandoned
- 2008-12-23 US US12/342,582 patent/US20090122185A1/en not_active Abandoned
- 2008-12-23 US US12/342,946 patent/US20090103605A1/en not_active Abandoned
- 2008-12-23 US US12/342,569 patent/US9264766B2/en active Active
- 2008-12-23 US US12/343,032 patent/US20090103634A1/en not_active Abandoned
- 2008-12-23 US US12/342,914 patent/US20090106812A1/en not_active Abandoned
- 2008-12-23 US US12/342,572 patent/US20090122190A1/en not_active Abandoned
- 2008-12-23 US US12/343,059 patent/US20090154553A1/en not_active Abandoned
-
2016
- 2016-02-15 US US15/043,714 patent/US9729906B2/en active Active
Patent Citations (59)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5055927A (en) * | 1988-09-13 | 1991-10-08 | Deutsche Thomson-Brandt Gmbh | Dual channel video signal transmission system |
US5444491A (en) * | 1993-02-26 | 1995-08-22 | Massachusetts Institute Of Technology | Television system with multiple transmission formats |
US5508746A (en) * | 1993-06-24 | 1996-04-16 | Massachusetts Institute Of Technology | Advanced television system |
US5742343A (en) * | 1993-07-13 | 1998-04-21 | Lucent Technologies Inc. | Scalable encoding and decoding of high-resolution progressive video |
US5966120A (en) * | 1995-11-21 | 1999-10-12 | Imedia Corporation | Method and apparatus for combining and distributing data with pre-formatted real-time video |
US6353613B1 (en) * | 1996-07-02 | 2002-03-05 | Sony Corporation | Information transmitter device and transmitting method |
US6757911B1 (en) * | 1996-08-30 | 2004-06-29 | Matsushita Electric Industrial Co., Ltd. | Digital broadcasting system, digital broadcasting apparatus, and a reception apparatus for digital broadcasts |
US6542518B1 (en) * | 1997-03-25 | 2003-04-01 | Sony Corporation | Transport stream generating device and method, and program transmission device |
US6801575B1 (en) * | 1997-06-09 | 2004-10-05 | Sharp Laboratories Of America, Inc. | Audio/video system with auxiliary data |
US7023992B1 (en) * | 1997-06-11 | 2006-04-04 | Sony Corporation | Data multiplexing device, program distribution system, program transmission system, pay broadcast system, program transmission method, conditional access system, and data reception device |
US6292512B1 (en) * | 1998-07-06 | 2001-09-18 | U.S. Philips Corporation | Scalable video coding system |
US6208382B1 (en) * | 1998-07-29 | 2001-03-27 | Florida Atlantic University | Color video processing system and method |
US6337716B1 (en) * | 1998-12-09 | 2002-01-08 | Samsung Electronics Co., Ltd. | Receiver for simultaneously displaying signals having different display formats and/or different frame rates and method thereof |
US6377309B1 (en) * | 1999-01-13 | 2002-04-23 | Canon Kabushiki Kaisha | Image processing apparatus and method for reproducing at least an image from a digital data sequence |
US6658056B1 (en) * | 1999-03-30 | 2003-12-02 | Sony Corporation | Digital video decoding, buffering and frame-rate converting method and apparatus |
US20010006404A1 (en) * | 1999-12-30 | 2001-07-05 | Yun Hwa Young | Combined terrestrial wave/cable broadcast receiver and program information processing method therefor |
US20030058948A1 (en) * | 2000-01-10 | 2003-03-27 | Kelly Declan Patrick | Method of setting a system time clock at the start of an mpeg sequence |
US20020087999A1 (en) * | 2000-04-26 | 2002-07-04 | Sony Corporation | Scalable filtering table |
US7020205B1 (en) * | 2000-07-12 | 2006-03-28 | Thomson Licensing | Sending progressive video sequences suitable for MPEG and other data formats |
US20020054638A1 (en) * | 2000-08-18 | 2002-05-09 | Tsuyoshi Hanamura | Coded signal separating and merging apparatus, method and computer program product |
US20020075954A1 (en) * | 2000-12-19 | 2002-06-20 | Vince Lawrence D. | Methods and apparatus for re-encoding a high definition television signal to create a standard definition television signal |
US20020162114A1 (en) * | 2001-04-30 | 2002-10-31 | Bisher James A. | System and method for multicasting packets in a subscriber network |
US20040093337A1 (en) * | 2001-08-09 | 2004-05-13 | Shen Sheng Mei | Unified rights management for ipmp system |
US20040240860A1 (en) * | 2001-10-19 | 2004-12-02 | Bruls Wilhelmus Hendrikus Alfonsus | Apparatus, a record carrier and a method for reproducing video data signals |
US7693220B2 (en) * | 2002-01-03 | 2010-04-06 | Nokia Corporation | Transmission of video information |
US20030138043A1 (en) * | 2002-01-23 | 2003-07-24 | Miska Hannuksela | Grouping of image frames in video coding |
US7346055B2 (en) * | 2002-08-29 | 2008-03-18 | Broadcom Corporation | Method and system for co-relating transport packets on different channels using a unique packet identifier |
US20050015794A1 (en) * | 2002-12-20 | 2005-01-20 | Stmicroelectronics Sa | Audio/video decoding process and device, and video driver circuit and decoder box incorporating the same |
US20040264931A1 (en) * | 2003-04-28 | 2004-12-30 | Masahiro Nakashika | Information recording medium, information recording/playback method, and information recording/playback apparatus |
US20040244059A1 (en) * | 2003-05-30 | 2004-12-02 | Lsi Logic Corporation | Digital set-top box transmodulator |
US7366462B2 (en) * | 2003-10-24 | 2008-04-29 | Qualcomm Incorporated | Method and apparatus for seamlessly switching reception between multimedia streams in a wireless communication system |
US20100142615A1 (en) * | 2003-12-01 | 2010-06-10 | Samsung Electronics Co., Ltd. | Method and apparatus for scalable video encoding and decoding |
WO2005055605A1 (en) * | 2003-12-03 | 2005-06-16 | Koninklijke Philips Electronics N.V. | System and method for improved scalability support in mpeg-2 systems |
US20050210523A1 (en) * | 2004-03-22 | 2005-09-22 | James Parnell | System and method for transmitting files from a sender to a receiver in a television distribution network |
US7405765B2 (en) * | 2004-03-24 | 2008-07-29 | Realtek Semiconductor Corp. | Method and apparatus for de-interlacing video data |
US20110262106A1 (en) * | 2004-04-07 | 2011-10-27 | Hiroshi Yahata | Information recording medium wherein stream convertible at high-speed is recorded, and recording apparatus and recording method therefor |
US20060023748A1 (en) * | 2004-07-09 | 2006-02-02 | Chandhok Ravinder P | System for layering content for scheduled delivery in a data network |
US20100040152A1 (en) * | 2004-07-15 | 2010-02-18 | At&T Intellectual Property I.L.P. | Human Factors Based Video Compression |
US20060083308A1 (en) * | 2004-10-15 | 2006-04-20 | Heiko Schwarz | Apparatus and method for generating a coded video sequence and for decoding a coded video sequence by using an intermediate layer residual value prediction |
US20060146734A1 (en) * | 2005-01-04 | 2006-07-06 | Nokia Corporation | Method and system for low-delay video mixing |
US20090103634A1 (en) * | 2005-05-18 | 2009-04-23 | Arturo Rodriguez | Providing a video stream with alternate packet identifiers |
US20090144796A1 (en) * | 2005-05-18 | 2009-06-04 | Arturo Rodriguez | Processing video streams of different picture formats |
US20090103605A1 (en) * | 2005-05-18 | 2009-04-23 | Rodriguez Arturo A | Processing identifiable video streams of a program according to stream type values |
US20090106812A1 (en) * | 2005-05-18 | 2009-04-23 | Arturo Rodriguez | Processing different complementary streams of a program |
US20090122190A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Providing complementary streams of a program coded according to different compression methods |
US20090122185A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Providing video streams of a program with different stream type values coded according to the same video coding specification |
US20090122186A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Adaptive processing of programs with multiple video streams |
US20090122858A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Receiving and processing multiple video streams associated with a video program |
US20090122183A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Providing video programs with identifiable and manageable video streams |
US20090106814A1 (en) * | 2005-05-18 | 2009-04-23 | Arturo Rodriguez | Era-dependent receiving and processing of programs with one or more video streams |
US20090141794A1 (en) * | 2005-05-18 | 2009-06-04 | Arturo Rodriguez | Video processing impermeable to additional video streams of a program |
US20090154553A1 (en) * | 2005-05-18 | 2009-06-18 | Rodriguez Arturo A | Receiving and separating an encoded video stream into plural encoded pictures with different identifiers |
US20060271990A1 (en) * | 2005-05-18 | 2006-11-30 | Rodriguez Arturo A | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
US7747921B2 (en) * | 2005-08-05 | 2010-06-29 | Sony Corporation | Systems and methods for transmitting data over lossy networks |
US20070206673A1 (en) * | 2005-12-08 | 2007-09-06 | Stephen Cipolli | Systems and methods for error resilience and random access in video communication systems |
US7672377B2 (en) * | 2006-04-21 | 2010-03-02 | Dilithium Holdings, Inc. | Method and system for video encoding and transcoding |
US20080037656A1 (en) * | 2006-08-08 | 2008-02-14 | Miska Hannuksela | Method, device, and system for multiplexing of video streams |
US20090067507A1 (en) * | 2007-09-10 | 2009-03-12 | Cisco Technology, Inc. | Video compositing of an arbitrary number of source streams using flexible macroblock ordering |
US8457214B2 (en) * | 2007-09-10 | 2013-06-04 | Cisco Technology, Inc. | Video compositing of an arbitrary number of source streams using flexible macroblock ordering |
Non-Patent Citations (1)
Title |
---|
ISO/IEC 13818-1: 1994(E) * |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090122186A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Adaptive processing of programs with multiple video streams |
US20090122190A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Providing complementary streams of a program coded according to different compression methods |
US20060271990A1 (en) * | 2005-05-18 | 2006-11-30 | Rodriguez Arturo A | Higher picture rate HD encoding and transmission with legacy HD backward compatibility |
US20090106814A1 (en) * | 2005-05-18 | 2009-04-23 | Arturo Rodriguez | Era-dependent receiving and processing of programs with one or more video streams |
US20090122183A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Providing video programs with identifiable and manageable video streams |
US20090122185A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Providing video streams of a program with different stream type values coded according to the same video coding specification |
US20090122858A1 (en) * | 2005-05-18 | 2009-05-14 | Arturo Rodriguez | Receiving and processing multiple video streams associated with a video program |
US8848780B2 (en) | 2005-05-18 | 2014-09-30 | Cisco Technology, Inc. | Video processing impermeable to additional video streams of a program |
US20090106812A1 (en) * | 2005-05-18 | 2009-04-23 | Arturo Rodriguez | Processing different complementary streams of a program |
US20090141794A1 (en) * | 2005-05-18 | 2009-06-04 | Arturo Rodriguez | Video processing impermeable to additional video streams of a program |
US20090154553A1 (en) * | 2005-05-18 | 2009-06-18 | Rodriguez Arturo A | Receiving and separating an encoded video stream into plural encoded pictures with different identifiers |
US20090144796A1 (en) * | 2005-05-18 | 2009-06-04 | Arturo Rodriguez | Processing video streams of different picture formats |
US9729906B2 (en) | 2005-05-18 | 2017-08-08 | Cisco Technology, Inc. | Providing representations of a video program with multiple video streams having different stream types |
US9264766B2 (en) | 2005-05-18 | 2016-02-16 | Cisco & Technology, Inc. | Receiving and processing multiple video streams associated with a video program |
US8457214B2 (en) | 2007-09-10 | 2013-06-04 | Cisco Technology, Inc. | Video compositing of an arbitrary number of source streams using flexible macroblock ordering |
US8934553B2 (en) | 2007-09-10 | 2015-01-13 | Cisco Technology, Inc. | Creation of composite images from a plurality of source streams |
US20090067507A1 (en) * | 2007-09-10 | 2009-03-12 | Cisco Technology, Inc. | Video compositing of an arbitrary number of source streams using flexible macroblock ordering |
US20110069225A1 (en) * | 2009-09-24 | 2011-03-24 | Sensio Technologies Inc. | Method and system for transmitting and processing high definition digital video signals |
US10567703B2 (en) | 2017-06-05 | 2020-02-18 | Cisco Technology, Inc. | High frame rate video compatible with existing receivers and amenable to video decoder implementation |
Also Published As
Publication number | Publication date |
---|---|
US20090122185A1 (en) | 2009-05-14 |
US9729906B2 (en) | 2017-08-08 |
US20090103634A1 (en) | 2009-04-23 |
EP1882366A2 (en) | 2008-01-30 |
US20090103605A1 (en) | 2009-04-23 |
US20090106814A1 (en) | 2009-04-23 |
US20060271990A1 (en) | 2006-11-30 |
US20090122858A1 (en) | 2009-05-14 |
US20090106812A1 (en) | 2009-04-23 |
WO2006125052A2 (en) | 2006-11-23 |
US20090154553A1 (en) | 2009-06-18 |
US20090122186A1 (en) | 2009-05-14 |
US20090122183A1 (en) | 2009-05-14 |
WO2006125052A3 (en) | 2007-01-04 |
US20090144796A1 (en) | 2009-06-04 |
US20090122190A1 (en) | 2009-05-14 |
CA2609072A1 (en) | 2006-11-23 |
CA2609072C (en) | 2014-04-08 |
US20090141794A1 (en) | 2009-06-04 |
US8848780B2 (en) | 2014-09-30 |
US20160165270A1 (en) | 2016-06-09 |
US9264766B2 (en) | 2016-02-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9729906B2 (en) | Providing representations of a video program with multiple video streams having different stream types | |
JP4597956B2 (en) | Robust mode staggercast to remember content | |
US8050330B2 (en) | Multiple time-base clock for processing multiple satellite signals | |
US8027381B2 (en) | Robust mode staggercasting user controlled switching modes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SCIENTIFIC-ATLANTA, LLC, GEORGIA Free format text: CHANGE OF NAME;ASSIGNOR:SCIENTIFIC-ATLANTA, INC.;REEL/FRAME:023012/0703 Effective date: 20081205 Owner name: SCIENTIFIC-ATLANTA, LLC,GEORGIA Free format text: CHANGE OF NAME;ASSIGNOR:SCIENTIFIC-ATLANTA, INC.;REEL/FRAME:023012/0703 Effective date: 20081205 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: CISCO TECHNOLOGY, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SCIENTIFIC-ATLANTA, LLC;REEL/FRAME:033328/0764 Effective date: 20140715 Owner name: SCIENTIFIC-ATLANTA, LLC, GEORGIA Free format text: CHANGE OF NAME;ASSIGNOR:SCIENTIFIC-ATLANTA, INC.;REEL/FRAME:033347/0217 Effective date: 20081205 |
|
AS | Assignment |
Owner name: SCIENTIFIC-ATLANTA, LLC, GEORGIA Free format text: CHANGE OF NAME;ASSIGNOR:SCIENTIFIC-ATLANTA, INC.;REEL/FRAME:052917/0513 Effective date: 20081205 |
|
AS | Assignment |
Owner name: SCIENTIFIC-ATLANTA, LLC, GEORGIA Free format text: CHANGE OF NAME;ASSIGNOR:SCIENTIFIC-ATLANTA, INC.;REEL/FRAME:052903/0168 Effective date: 20200227 |