US20110254917A1 - Method and apparatus for distribution of 3d television program materials - Google Patents

Method and apparatus for distribution of 3d television program materials Download PDF

Info

Publication number
US20110254917A1
US20110254917A1 US12/761,822 US76182210A US2011254917A1 US 20110254917 A1 US20110254917 A1 US 20110254917A1 US 76182210 A US76182210 A US 76182210A US 2011254917 A1 US2011254917 A1 US 2011254917A1
Authority
US
United States
Prior art keywords
conversion
services
option
video
uncompressed video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/761,822
Other versions
US9237366B2 (en
Inventor
Mark L. Schaffer
Siu-Wai Wu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google Technology Holdings LLC
Original Assignee
General Instrument Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US12/761,822 priority Critical patent/US9237366B2/en
Application filed by General Instrument Corp filed Critical General Instrument Corp
Assigned to GENERAL INSTRUMENT CORPORATION reassignment GENERAL INSTRUMENT CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WU, SIU-WAI, SCHAFFER, MARK L.
Priority to PCT/US2011/032858 priority patent/WO2011130732A1/en
Priority to CN201180019334.8A priority patent/CN102845068B/en
Publication of US20110254917A1 publication Critical patent/US20110254917A1/en
Assigned to GENERAL INSTRUMENT HOLDINGS, INC. reassignment GENERAL INSTRUMENT HOLDINGS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GENERAL INSTRUMENT CORPORATION
Assigned to MOTOROLA MOBILITY LLC reassignment MOTOROLA MOBILITY LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GENERAL INSTRUMENT HOLDINGS, INC.
Assigned to Google Technology Holdings LLC reassignment Google Technology Holdings LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MOTOROLA MOBILITY LLC
Priority to US14/966,048 priority patent/US10368050B2/en
Publication of US9237366B2 publication Critical patent/US9237366B2/en
Application granted granted Critical
Priority to US16/525,068 priority patent/US10893253B2/en
Priority to US17/145,734 priority patent/US11558596B2/en
Priority to US18/096,735 priority patent/US20230328217A1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23608Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities

Definitions

  • This invention relates to a method and apparatus for distribution of three dimensional (3D) television program materials.
  • FIGS. 1 and 2 of the drawings schematic block diagrams illustrate a conventional system for distributing television program material to viewers.
  • the schematic diagram of FIG. 1 illustrates a program uplink portion 5 of the system
  • the schematic diagram of FIG. 2 illustrates a cable network portion 15 of the system.
  • a television program provider such as a company that operates a broadcast network, may operate a production facility 6 ( FIG. 1 ) at which it produces a program signal AV having an uncompressed video signal (UVS) representing a sequence of pictures and at least one corresponding audio component.
  • the video portion of the program signal may be a 3D uncompressed video signal, using conventional left-right images.
  • the program provider In order to distribute the program signal to a wide audience of viewers, the program provider, a satellite uplink operator and a cable network operator enter into commercial arrangements whereby the program provider provides program content to the uplink operator, which delivers the content to the cable operator, which in turn delivers the content to viewers having decoding and presentation equipment connected to a cable distribution network 10 ( FIG. 2 ).
  • the commercial arrangements between the uplink operator and the cable operator may provide that the uplink operator will supply certain services (corresponding to what are commonly referred to as channels, such as NBC or FOX, in the broadcast television domain) to the cable operator.
  • the uplink operator has an interest in ensuring that the program material delivered by the cable operator to viewers meets quality standards prescribed by the program provider.
  • the uplink operator receives the uncompressed program signal AV provided by the program provider (for example on tape or by accessing a server) and supplies the program signal to an encoder/multiplexer 12 ( FIG. 1 ), which encodes the pictures using a video coding algorithm and thereby creates a bitstream that represents a corresponding sequence of coded pictures (also known as video access units).
  • an encoder/multiplexer 12 FIG. 1
  • the encoder/multiplexer also encodes the corresponding audio signal(s) and creates a bitstream representing a sequence of coded audio frames (also known as audio access units).
  • the encoder/multiplexer 12 packetizes the bitstreams as video and audio packetized elementary streams (PESs), encrypts the video and audio PESs, and combines the encrypted video and audio PESs with video and audio PESs for other services offered by the program provider to form an MPEG multi-program transport stream (MPTS).
  • a transmitter 14 employs the MPTS bitstream to modulate an RF carrier and transmits the modulated carrier via a satellite transponder (not shown) to a cable distribution system headend 20 ( FIG. 2 ).
  • Current transponder channels have sufficient capacity (up to 77 Mb/s) to transmit an MPTS containing ten or more high definition (HD) MPEG 4 services, each corresponding to a single broadcast television channel.
  • the uplink operator may also operate other encoder/multiplexers and transmitters for creating and transmitting other MPTSs containing other program signals via respective transponder channels.
  • the headend 20 includes several receivers 24 that are tuned to the transmission frequencies of the transponders respectively and recover the MPTS bitstreams from the respective RF carriers, extract the encrypted MPEG 4 bitstreams from the MPTSs, and decrypt the MPEG 4 bitstreams.
  • MPEG 4 provides substantially better compression of video material than the video coding standard known as MPEG 2, but there is an installed base of set top decoders is overwhelmingly MPEG 2 set top decoders. Accordingly, although the uplink operator typically transmits video material in the form of MPEG 4 data, as discussed above, the cable distribution system operator is constrained by the needs of the installed base to supply the video material to the subscribers in the form of MPEG 2 data. Therefore, the headend 20 also includes transcoders 26 that transcode the MPEG 4 bitstreams to MPEG 2, and a multiplexer 30 that creates one or more MPTSs each containing several MPEG 2 services. Transmitters 34 utilize respective cable channels to transmit the MPEG 2 MPTSs to subscriber nodes over the cable network 10 .
  • the decoding and presentation equipment at a subscriber node may include a set top decoder 38 and a television set 40 .
  • the set top decoder includes suitable devices for selecting a service based on a channel selection command provided by the subscriber, typically using a remote control unit, decomposing the cable channel MPTS that contains the selected service, and decoding the audio and video bitstreams for the selected service to create suitable audio and video signals for driving the television set 40 .
  • Video streams that provide three dimensional (3D) viewing are now starting to be provided by programmers to operators.
  • the 3D aspect is provided in the video streams in certain 3D systems by dedicating one half of the pixels that defined in a specified format for a left image and the other half of the pixels for a right image.
  • the left and right images are presented on the TV in such a manner that by the use of special glasses, the viewer experiences the presented image as a 3D image.
  • these video stream are presented on a legacy (two dimensional only) TV and viewed without the special 3D glasses, they are seen at best as blurry images.
  • one method for overcoming this problem is for the programmer to provide two video streams for each 3D program: a 3D video stream and a 2D video stream. This approach uses up more bandwidth than simply providing a 3D video stream to the operator.
  • a method of distributing video program material includes receiving a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options.
  • Each 3D-2D conversion option is applicable to one or more of the compressed video services as identified by each 3D-2D conversion option.
  • An uncompressed video signal is generated by performing a decoding portion of a transcoding operation for one of the one or more of the video services.
  • a determination is made from the 3D-2D conversion option whether a 3D-2D conversion is to be performed.
  • scale conversion is performed on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal.
  • a compressed video service is generated by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted.
  • a second multiprogram program transport service is generated that includes the compressed video signal that has been 3D-2D converted.
  • a processing system in a second aspect, includes an input-output function and a processor.
  • the input-output function receives a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options.
  • Each 3D-2D conversion option is applicable to one or more of the compressed video services as identified by each 3D-2D conversion option.
  • the processor generates an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services and determines from the 3D-2D conversion option whether a 3D-2D conversion is to be performed.
  • the processor When a determination is made that a 3D-2D conversion is to be performed, the processor performs a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal, and generates a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted.
  • the input-output function then generates a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
  • a tangible computer readable media includes program instructions that, when executed by a processing system, cause a programming system to receive a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options. Each 3D-2D conversion option is applicable to one or more of the compressed video services as identified by each 3D-2D conversion option.
  • the instructions further cause the programming system to generate an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services and make a determination from the 3D-2D conversion option whether a 3D-2D conversion is to be performed.
  • the instructions further cause the programming system to perform scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal.
  • the instructions further cause the programming system to generate a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted and generate a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
  • the transcoding may be from MPEG4 to HD MPEG2.
  • the uncompressed video that has been scale converted may be down converted, such as to SD MPEG2.
  • specification of the type of 3D-2D conversion may be by a default value, and the determination as to whether to perform the 3D-2D conversion is explicit in the 3D-2D conversion option.
  • the type of 3D-2D conversion may be specified by a value in the 3D-2D conversion option.
  • the unique 3D-2D conversion techniques and apparatuses described herein allow a system operator to provide 2D video streams for customer having legacy set-top boxes and 2D TVs by converting programs supplied only in 3D format to the headend. This provides video services which customers having legacy TV's would not be able to enjoy unless they acquired a set top box which performed the 3D-2D conversion, which may be unavailable or costly.
  • FIG. 1 is a schematic block diagram illustrating a program uplink portion of a system for distributing television program material to viewers
  • FIG. 2 is a schematic block diagram illustrating a cable network portion of a system for distributing television program material to viewers
  • FIG. 3 is a schematic block diagram illustrating an uplink portion of a system for distributing television program material to viewers, in accordance with certain embodiments.
  • FIG. 4 is a schematic block diagram illustrating a cable network portion of a system for distributing television program material to viewers, in accordance with certain embodiments,
  • FIG. 5 is a flow chart illustrating operation of the headend equipment of the system shown in FIGS. 3 and 4 , in accordance with certain embodiments,
  • FIG. 6 is a flow chart that illustrates some steps that may be used to accomplish a step of FIG. 4 , in accordance with certain embodiments,
  • FIG. 7 is a schematic block diagram illustrating certain embodiments of the headend equipment shown in FIGS. 3 and 4 , in accordance with certain embodiments,
  • FIG. 8 is a matrix that illustrates one exemplary table of 3D-2D scale conversions, in accordance with certain embodiments.
  • FIGS. 9-14 are illustrations that show where the left and right image pixels may be located in a picture stream, in accordance with certain embodiments.
  • FIG. 15 is a block schematic diagram of a computing machine that may be used to implement parts of the head end equipment shown in FIG. 4 , in accordance with certain embodiments.
  • An uplink operator negotiates with a cable operator to provide television program services desired by the cable operator and determines how many cable MPTSs (for example, some MPTSs may contain three HD MPEG 2 services, one or more of which may be 3D) will be required to supply these services to the subscribers and which services should be provided in a given cable MPTS in order to optimize use of the cable channel without impairing the quality of services.
  • the uplink operator's determination will be based in part on the service packages offered by the cable operator and on the bit rate requirement of the different services. For example, it would not generally be desirable to allocate more than one HD sports service to a given cable MPTS because of the high bit rate required for a satisfactory viewing experience. Let us assume that the uplink operator and the cable operator determine that m cable MPTSs will be needed.
  • the commercial arrangements between the uplink operator and the cable operator typically require that for each cable MPTS the cable operator utilize an integrated receiver/decrypter (IRD) having specific features and that the cable MPTS signal produced by the IRD should contain services specified by the uplink operator.
  • IRD integrated receiver/decrypter
  • the cable operator will utilize m IRDs, producing respective cable MPTSs, to provide the services offered by the cable operator to its subscribers. While FIG. 1 illustrates current system configuration, is it also generic enough to encompass the embodiments described herein, although certain of the items in FIG. 1 would then incorporate unique features that are described herein below.
  • FIGS. 3 and 4 schematic block diagrams illustrate a system including headend equipment for distributing television program material to viewers, in accordance with certain embodiments.
  • the schematic diagram of FIG. 3 illustrates an uplink portion 150 of the system
  • the schematic diagram of FIG. 4 illustrates a cable network portion 170 of the system.
  • the uplink operator supplies several uncompressed video signals AV 1 -AVn provided by a television program provider to an encoder/encrypter/multiplexer 112 (referred to hereinafter simply as the multiplexer 112 ).
  • the signals AV 1 -AVn may be in the HD-SDI format specified in SMPTE 292M, with the audio component embedded in the ancillary data space.
  • the uplink operator also supplies m distribution constraint signals (one for each cable MPTS) that convey distribution constraint data DC 1 -DCm to the multiplexer 112 .
  • m distribution constraint signals (one for each cable MPTS) that convey distribution constraint data DC 1 -DCm to the multiplexer 112 .
  • the headend 20 includes m Integrated Receiver Demultiplexers (IRDS), only one of which, IRD 120 , is shown in FIG. 4 .
  • IRD 120 is partially under control of the uplink operator by means of the distribution constraint data.
  • FIG. 5 of the drawings is a flow chart illustrating certain steps of operation of the headend equipment of the system shown in FIG. 4 in accordance with certain embodiments
  • the IRD 120 includes a receiver 100 that is tuned to one of the m satellite transponder channels and thus receives a carrier that is modulated with a multi-program transport stream containing, for example, ten encrypted MPEG 4 services. Assume that the IRD 120 is tuned to the transponder channel that conveys MPTS 1 and that MPTS 1 contains services AV 1 -AV 10 .
  • the receiver demodulates the carrier and outputs the MPTS bitstream, which contains not only the ten encrypted MPEG 4 services AVI-AVIO but also the packetized data stream that contains the distribution constraint data DC 1 , to a demultiplexer 104 .
  • the demultiplexer 104 receives ( FIG. 5 , step 131 ) the MPTS and extracts the packetized data stream ( FIG. 5 , step 132 ), which conveys the distribution constraint data from the MPTS and supplies the data stream to an IRD controller 108 .
  • the IRD has a unique access control address (similar in function to the MAC address assigned to a network adapter).
  • the distribution constraint data is in the form of vectors each having an access address field, a service selection field, a statmux field, and a 3D-2D conversion field. Note that in some systems, statistical multiplexing is not used, in which case the distribution constraint data may include substantially only the 3D-2D conversion data.
  • the uplink operator generates the distribution constraint data based on the commercial arrangements with the cable operators.
  • the distribution constraint data conveyed by the data stream included in MPTSj contains a vector that includes the access control address of the designated IRD, service selection data identifying the services that are to be included in the cable MPTS produced by the IRD, statmux data (discussed below) for each of those services, and 3D-2D conversion data.
  • the service selection data that is recovered from the MPEG 4 MPTS specifies the three services that are to be included in the MPEG 2 MPTS.
  • k IRDs are designated to transmit a cable MPTS containing one or more of the services contained in MPTSj and the particular IRD 120 shown in FIG. 4 is designated to produce a cable MPTS containing the services AV 1 , AV 2 and AV 3 .
  • Step 133 is accomplished, in certain embodiments, by steps 211 - 214 of FIG. 5 .
  • an index value, i is reset to 1.
  • a determination is made as to whether the index value matches the address of the IRD. When the values do not match, a test is made at step 213 to determine if the index value has reached a limit value of k.
  • Step 134 is then executed, in which IRD controller supplies the service selection data contained in the selected vector to the demultiplexer 104 , which employs this information to select (in this case) the packetized elementary streams (PESs) for the services AV 1 , AV 2 and AV 3 .
  • PESs packetized elementary streams
  • the IRD controller also outputs the statmux data and 3D-2D conversion data contained in the fields of the selected vector.
  • the statmux data is coupled to a statistical multiplexer 118 .
  • the 3D-2D conversion data is coupled to transcoders 116 . If the access control address of the IRD does not match the address field of any of the distribution constraint data vectors, the IRD is not enabled to utilize the audio and video PESs in MPTS 1 to create a cable MPTS.
  • the demultiplexer 104 supplies the encrypted audio and video PESs for the three selected services AV 1 , AV 2 and AV 3 to respective decrypters 112 , which decrypt the selected services ( FIG. 5 , step 135 ) and supply the respective decrypted MPEG 4 audio and video PESs to respective transcoders 116 .
  • the transcoders perform 3D-2D scale conversion according to the 3D-2D data in the 3D-2D field of the distribution constraint data, when the 3D-2D data indicates that a conversion is necessary and convert the MPEG 4 PESs to corresponding MPEG 2 PESs (step 136 ).
  • the transcoder 116 may decode the MPEG 4 video access units and create a sequence of decoded pictures and then perform 3D-2D conversion and encode the pictures using an MPEG 2 coder.
  • the transcoding may alternatively be accomplished without completely decoding the MPEG 4 video access units when 3D-2D conversion is not specified by the 3D-2D conversion data in the 3D-2D field of the distribution constraint data.
  • the frequency decomposition algorithms for MPEG 4 and MPEG 2 are different, it will generally be necessary to decode the MPEG 4 video access units at least to the level of blocks of chroma and luma values.
  • the transcoders 116 supply the audio and video PESs of the three MPEG 2 services to a statistical multiplexer 118 for creating a multi-program transport stream.
  • the three program streams are statistically multiplexed ( FIG. 5 , step 137 ) in order to fit in the available 38.8 Mb/s bit rate of a cable channel, but bit rate allocation decisions are made on the basis of the statmux data provided by the IRD controller 108 .
  • the statmux data may, for example, specify minimum bit rate and maximum bit rate for each service.
  • the MPTS created by the statistical multiplexer 118 is supplied to a transmitter 124 , which modulates an RF carrier with the MPTS bit stream in accordance with a quadrature amplitude modulation (QAM) scheme and transmits ( FIG. 5 , step 138 ) the modulated carrier over the cable network 110 to subscriber nodes.
  • QAM quadrature amplitude modulation
  • Another cable operator may be authorized to distribute a cable MPTS containing services AV 1 , AV 2 and AV 4 .
  • This cable operator employs headend equipment including an IRD (not shown) having a receiver that is tuned to the transponder that conveys MPTS 1 and the vector that includes the access control address of that 1 RD includes service selection data that specifies the services AV 1 , AV 2 and AV 4 and statmux data for those three services.
  • IRD not shown
  • 3D-2D conversion may be performed without the use of statistical multiplexing in an IRD that is designed for statistical multiplexing but in which the distribution constraint data does not specify the use of statistical multiplexing, or in an IRD that is not designed for statistical multiplexing.
  • the block diagram would be very similar to FIG. 4 except that the signal called STATMUX DATA could either be missing, or could simply indicate a number of MPEG signals to multiplex.
  • 3D-2D conversion could be performed in any piece of equipment that receives a compressed video stream or that internally generates a compressed video signal from some internal source, and receives 3D-2D conversion meta data that corresponds to the compressed video signal and indicates that 3D-2D conversion should be performed and what scaling to use for the conversion.
  • the piece of equipment decompresses the compressed video signal, converts and scales the uncompressed video signal according to a specified scaling conversion, and generates a compressed video signal.
  • a flow chart illustrates some steps that may be used to accomplish step 136 “transcode and perform 3D-2D conversion of services” of FIG. 5 , in accordance with certain embodiments.
  • a multiprogram program transport service is received that includes one or more compressed video services. It also includes distribution constraint data that specifies one or more 3D-2D conversion options. Each 3D-2D conversion option is applicable to one or more of the video services, as identified by each 3D-2D conversion option. Each 3D-2D conversion option may further identify whether a 3D-2D conversion is to be applied to the associated one or more of the video services. Each 3D-2D conversion option may further identify which specified type of 3D-2D scale conversion is to be performed.
  • specific data may not be needed to indicate whether or not a 3D-2D conversion is to be performed.
  • the absence of a 3D-2D conversion type in a 3D-2D conversion field may be sufficient to make the determination that 3D-2D conversion is not to be performed.
  • a simple indication that 3D-2D conversion is to be performed could indicate that a default type of 3D-2D conversion is to be performed.
  • an uncompressed video signal UVS is generated by performing a decoding portion of a transcoding operation for the one or more of the video services.
  • step 410 could be performed after the decode portion of a transcoding is performed.
  • a transcoding operation may be defined by default. In many situations the transcode operation is by default an MPEG 4 to HD MPEG 2 transcoding operation. In this instance, the transcoding type may not be specified in the 3D-2D conversion data, nor in the distribution constraint data. This would allow the decision step 410 to follow the transcode decode step 415 .
  • the method ends at step 411 .
  • a scale conversion for the one or more of the video services is then performed on the UVS at step 420 according to a specified type of 3D-2D conversion.
  • the type of 3D-2D conversion is specified by default.
  • whether to perform a 3D-2D operation may explicitly identified, such as by a binary value in the 3D-2D data.
  • one of a plurality of types of 3D-2D conversions may be specified in the 3D-2D conversion data, each by a unique value in the 3D-2D conversion data.
  • One of the left and right 3D views that are both included in the 3D video service (or services) is used as an input for the scale conversion in step 420 .
  • a compressed video service is then generated by performing an encoding portion of the transcoding at step 425 on the UVS that has been 3D-2D scale converted.
  • the type of transcoding may be by default or may be specified in the 3D-2D conversion option or elsewhere in metadata associated with the video services.
  • a second multiprogram program transport service is generated that includes the compressed video service that has been 3D-2D converted at step 430 .
  • the transcoder 116 may convert the incoming HD service to SD service in order to accommodate customers who do not subscribe to the HD level of service.
  • the transcoder 116 includes a decoder 505 that performs the decoding portion of a transcoding operation, converting the HD MPEG 4 video access units to uncompressed video signals (UVS's). Some of the pictures may be converted from 3D to 2D by a scale conversion function 510 that operated as described above and below, An encoder 515 of the transcoder 116 then encodes the PESs as HD MPEG 2 pictures, and may also downconvert the decoded HD pictures to UVS SD using a down convert function 520 .
  • An encoder 525 then encodes the SD pictures as SD MPEG 2 pictures and thus provides an SD MPEG 2 service in addition to the HD MPEG 2 service.
  • the SD MPEG 2 bit streams may be supplied to a statistical multiplexer (e.g., statistical multiplexer 118 of FIG. 2 ) that creates a cable MPTS for transmission over the cable 10 ( FIG. 4 ).
  • a statistical multiplexer e.g., statistical multiplexer 118 of FIG. 2
  • the SD cable MPTS may contain more than three services, and some of them can be 2D services obtained by the unique apparatus and methods described herein.
  • the distribution constraint data provided to the IRD that includes the transcoder and 3D-2D converter 116 shown in FIG. 7 may include the service selection data for the demultiplexer, may include statmux data for controlling statistical multiplexers, may include 3D-2D conversion option data for 3D-2D conversion and, in addition, may contain picture format data utilized by the downconverter 130 to determine how the 16 ⁇ 9 aspect ratio of the HD picture format should be adapted to the 4 ⁇ 3 aspect ratio of the SD picture format.
  • FIG. 7 illustrates an HD MPTS and an SD MPTS respectively
  • SD services and HD services may be included in the same MPTS.
  • a matrix illustrates one exemplary table of 3D-2D scale conversions that the 3D-2D conversion data may use to identify a specific type of scale conversion, in accordance with some embodiments.
  • Each of the 14 items in this table may be identified by a value that is conveyed by the 3D-2D conversion data.
  • the 14 line items may be identified by a value from 1 to 14 that is included in the 3D-2D conversion data.
  • a value of 7 may then indicate that the received picture is a line interleaved image of 1280 ⁇ 720 ⁇ 60 in a line input format (i.e., 1280 pixels wide, 720 pixels high, at a rate of 60 frames per second) that is to be scaled to an output resolution of 1280 ⁇ 720 ⁇ 60
  • the left image of the video may be conveyed in the odd scan lines and the right image may be conveyed in the even scan lines
  • the output image is scaled by using a specified default image (e.g., the right image) and producing the output image by duplicating each even scan line into the next odd scan line, or by generating the pixel values of the odd scan lines by interpolating the values of the lines preceding and succeeding an even line that is to be generated.
  • FIG. 9 illustrates a side-by-side pixel format, with the pixels for the left image of a 3D image on the left and the pixels for the right image of the 3D image on the right of each frame.
  • FIG. 10 illustrates an over-under pixel format, with the pixels for the left image of a 3D image on the top and the pixels for the right image of the 3D image on the bottom of each frame.
  • FIG. 11 illustrates a frame sequential format, with the pixels for the left image of a 3D image included in frames that alternate with frames that include the pixels for the right image of the 3D image.
  • the X's can be interpreted as left pixels and the O's as right pixels.
  • FIG. 12 and FIG. 13 respectively, illustrate pixels of left and right images arranged in alternating columns and lines in each frame, while FIG. 14 illustrates pixels arranged in a checkerboard pattern in each frame.
  • the left and right 3D views are included in the one or more video services in one of a side-by-side, over-under, alternating lines, alternating columns, checker board, or frame sequential arrangement . . . .
  • each transponder MPTS conveys only the distribution constraint data for the IRDs that are authorized to receive that particular transponder MPTS
  • the distribution constraint data is relatively static and accordingly it may be possible for each transponder MPTS to contain the distribution constraint data pertaining to all of the services.
  • the disclosed subject matter has been described with reference to distribution of television program material, it will be appreciated that the disclosed subject matter is also applicable to distribution of other video material, such as motion pictures by video-on-demand service.
  • suitable headend equipment may be implemented using a computer 160 comprising one or more processors 161 , random access memory 162 , read only memory 163 , I/O devices 164 , a user interface 165 , a CD ROM drive 166 and a hard disk drive 167 , configured in a generally conventional architecture.
  • the computer operates in accordance with a program that is stored in a computer readable medium, such as the hard disk drive 167 or a CD ROM 168 , and is loaded into the random access memory 162 for execution.
  • the program comprises instructions that when executed by the computer cause the computer to receive a bit stream representing an MPTS including a packetized data elementary stream, as described above, by way of a suitable interface included in the I/O devices 164 , the computer allocates memory to appropriate buffers and utilizes other suitable resources and functions to perform the various operations that are described above as being performed by the headend equipment, with reference to the flow charts shown in FIGS. 5-7 .
  • the program might not be loadable directly from the CD ROM 168 into the random access memory utilizing the CD ROM drive 166 and that generally the program will be stored on the CD ROM or other program distribution medium in a form that requires the program to be installed on the hard disk drive 167 from the CD ROM 168 .

Abstract

Method, apparatus and computer readable media for receiving a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options, generating an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services, determining from the 3D-2D conversion option whether a 3D-2D conversion is to be performed, performing a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, generating a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted, and generating a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.

Description

    FIELD OF THE INVENTION
  • This invention relates to a method and apparatus for distribution of three dimensional (3D) television program materials.
  • BACKGROUND OF THE INVENTION
  • Referring to FIGS. 1 and 2 of the drawings, schematic block diagrams illustrate a conventional system for distributing television program material to viewers. The schematic diagram of FIG. 1 illustrates a program uplink portion 5 of the system, and the schematic diagram of FIG. 2 illustrates a cable network portion 15 of the system. A television program provider, such as a company that operates a broadcast network, may operate a production facility 6 (FIG. 1) at which it produces a program signal AV having an uncompressed video signal (UVS) representing a sequence of pictures and at least one corresponding audio component. The video portion of the program signal may be a 3D uncompressed video signal, using conventional left-right images. In order to distribute the program signal to a wide audience of viewers, the program provider, a satellite uplink operator and a cable network operator enter into commercial arrangements whereby the program provider provides program content to the uplink operator, which delivers the content to the cable operator, which in turn delivers the content to viewers having decoding and presentation equipment connected to a cable distribution network 10 (FIG. 2).
  • The commercial arrangements between the uplink operator and the cable operator may provide that the uplink operator will supply certain services (corresponding to what are commonly referred to as channels, such as NBC or FOX, in the broadcast television domain) to the cable operator. The uplink operator has an interest in ensuring that the program material delivered by the cable operator to viewers meets quality standards prescribed by the program provider.
  • The uplink operator receives the uncompressed program signal AV provided by the program provider (for example on tape or by accessing a server) and supplies the program signal to an encoder/multiplexer 12 (FIG. 1), which encodes the pictures using a video coding algorithm and thereby creates a bitstream that represents a corresponding sequence of coded pictures (also known as video access units). For the purpose of this description we shall assume that the video coding algorithm produces a bitstream that conforms to the video coding standard known as MPEG 4. The encoder/multiplexer also encodes the corresponding audio signal(s) and creates a bitstream representing a sequence of coded audio frames (also known as audio access units). The encoder/multiplexer 12 packetizes the bitstreams as video and audio packetized elementary streams (PESs), encrypts the video and audio PESs, and combines the encrypted video and audio PESs with video and audio PESs for other services offered by the program provider to form an MPEG multi-program transport stream (MPTS). A transmitter 14 employs the MPTS bitstream to modulate an RF carrier and transmits the modulated carrier via a satellite transponder (not shown) to a cable distribution system headend 20 (FIG. 2). Current transponder channels have sufficient capacity (up to 77 Mb/s) to transmit an MPTS containing ten or more high definition (HD) MPEG 4 services, each corresponding to a single broadcast television channel. The uplink operator may also operate other encoder/multiplexers and transmitters for creating and transmitting other MPTSs containing other program signals via respective transponder channels.
  • The headend 20 includes several receivers 24 that are tuned to the transmission frequencies of the transponders respectively and recover the MPTS bitstreams from the respective RF carriers, extract the encrypted MPEG 4 bitstreams from the MPTSs, and decrypt the MPEG 4 bitstreams.
  • MPEG 4 provides substantially better compression of video material than the video coding standard known as MPEG 2, but there is an installed base of set top decoders is overwhelmingly MPEG 2 set top decoders. Accordingly, although the uplink operator typically transmits video material in the form of MPEG 4 data, as discussed above, the cable distribution system operator is constrained by the needs of the installed base to supply the video material to the subscribers in the form of MPEG 2 data. Therefore, the headend 20 also includes transcoders 26 that transcode the MPEG 4 bitstreams to MPEG 2, and a multiplexer 30 that creates one or more MPTSs each containing several MPEG 2 services. Transmitters 34 utilize respective cable channels to transmit the MPEG 2 MPTSs to subscriber nodes over the cable network 10.
  • The decoding and presentation equipment at a subscriber node may include a set top decoder 38 and a television set 40. The set top decoder includes suitable devices for selecting a service based on a channel selection command provided by the subscriber, typically using a remote control unit, decomposing the cable channel MPTS that contains the selected service, and decoding the audio and video bitstreams for the selected service to create suitable audio and video signals for driving the television set 40.
  • Video streams that provide three dimensional (3D) viewing are now starting to be provided by programmers to operators. The 3D aspect is provided in the video streams in certain 3D systems by dedicating one half of the pixels that defined in a specified format for a left image and the other half of the pixels for a right image. In these systems, the left and right images are presented on the TV in such a manner that by the use of special glasses, the viewer experiences the presented image as a 3D image. However, when these video stream are presented on a legacy (two dimensional only) TV and viewed without the special 3D glasses, they are seen at best as blurry images.
  • At this time, one method for overcoming this problem is for the programmer to provide two video streams for each 3D program: a 3D video stream and a 2D video stream. This approach uses up more bandwidth than simply providing a 3D video stream to the operator.
  • BRIEF SUMMARY OF THE INVENTION
  • In one aspect, a method of distributing video program material includes receiving a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options. Each 3D-2D conversion option is applicable to one or more of the compressed video services as identified by each 3D-2D conversion option. An uncompressed video signal is generated by performing a decoding portion of a transcoding operation for one of the one or more of the video services. A determination is made from the 3D-2D conversion option whether a 3D-2D conversion is to be performed. When a determination is made that a 3D-2D conversion is to be performed, scale conversion is performed on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal. A compressed video service is generated by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted. A second multiprogram program transport service is generated that includes the compressed video signal that has been 3D-2D converted.
  • In a second aspect, a processing system includes an input-output function and a processor. The input-output function receives a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options. Each 3D-2D conversion option is applicable to one or more of the compressed video services as identified by each 3D-2D conversion option. The processor generates an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services and determines from the 3D-2D conversion option whether a 3D-2D conversion is to be performed. When a determination is made that a 3D-2D conversion is to be performed, the processor performs a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal, and generates a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted. The input-output function then generates a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
  • In a third aspect, a tangible computer readable media includes program instructions that, when executed by a processing system, cause a programming system to receive a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options. Each 3D-2D conversion option is applicable to one or more of the compressed video services as identified by each 3D-2D conversion option. The instructions further cause the programming system to generate an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services and make a determination from the 3D-2D conversion option whether a 3D-2D conversion is to be performed. When a determination is made that a 3D-2D conversion is to be performed, the instructions further cause the programming system to perform scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal. The instructions further cause the programming system to generate a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted and generate a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
  • In any of the first or second or third aspects, the transcoding may be from MPEG4 to HD MPEG2. In any of the first or second or third aspects, the uncompressed video that has been scale converted may be down converted, such as to SD MPEG2. In any of the first or second or third aspects, specification of the type of 3D-2D conversion may be by a default value, and the determination as to whether to perform the 3D-2D conversion is explicit in the 3D-2D conversion option. In any of the first or second or third aspects, the type of 3D-2D conversion may be specified by a value in the 3D-2D conversion option.
  • The unique 3D-2D conversion techniques and apparatuses described herein allow a system operator to provide 2D video streams for customer having legacy set-top boxes and 2D TVs by converting programs supplied only in 3D format to the headend. This provides video services which customers having legacy TV's would not be able to enjoy unless they acquired a set top box which performed the 3D-2D conversion, which may be unavailable or costly.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification, and serve to further illustrate embodiments of concepts that include the claimed invention, and explain various principles and advantages of those embodiments. Reference will now be made to the accompanying drawings, in which:
  • FIG. 1 is a schematic block diagram illustrating a program uplink portion of a system for distributing television program material to viewers,
  • FIG. 2 is a schematic block diagram illustrating a cable network portion of a system for distributing television program material to viewers,
  • FIG. 3 is a schematic block diagram illustrating an uplink portion of a system for distributing television program material to viewers, in accordance with certain embodiments.
  • FIG. 4 is a schematic block diagram illustrating a cable network portion of a system for distributing television program material to viewers, in accordance with certain embodiments,
  • FIG. 5 is a flow chart illustrating operation of the headend equipment of the system shown in FIGS. 3 and 4, in accordance with certain embodiments,
  • FIG. 6 is a flow chart that illustrates some steps that may be used to accomplish a step of FIG. 4, in accordance with certain embodiments,
  • FIG. 7 is a schematic block diagram illustrating certain embodiments of the headend equipment shown in FIGS. 3 and 4, in accordance with certain embodiments,
  • FIG. 8 is a matrix that illustrates one exemplary table of 3D-2D scale conversions, in accordance with certain embodiments.
  • FIGS. 9-14 are illustrations that show where the left and right image pixels may be located in a picture stream, in accordance with certain embodiments,
  • FIG. 15 is a block schematic diagram of a computing machine that may be used to implement parts of the head end equipment shown in FIG. 4, in accordance with certain embodiments.
  • DETAILED DESCRIPTION
  • An uplink operator negotiates with a cable operator to provide television program services desired by the cable operator and determines how many cable MPTSs (for example, some MPTSs may contain three HD MPEG 2 services, one or more of which may be 3D) will be required to supply these services to the subscribers and which services should be provided in a given cable MPTS in order to optimize use of the cable channel without impairing the quality of services. The uplink operator's determination will be based in part on the service packages offered by the cable operator and on the bit rate requirement of the different services. For example, it would not generally be desirable to allocate more than one HD sports service to a given cable MPTS because of the high bit rate required for a satisfactory viewing experience. Let us assume that the uplink operator and the cable operator determine that m cable MPTSs will be needed.
  • The commercial arrangements between the uplink operator and the cable operator typically require that for each cable MPTS the cable operator utilize an integrated receiver/decrypter (IRD) having specific features and that the cable MPTS signal produced by the IRD should contain services specified by the uplink operator. In practice, of course, the cable operator will utilize m IRDs, producing respective cable MPTSs, to provide the services offered by the cable operator to its subscribers. While FIG. 1 illustrates current system configuration, is it also generic enough to encompass the embodiments described herein, although certain of the items in FIG. 1 would then incorporate unique features that are described herein below.
  • Referring now to FIGS. 3 and 4, schematic block diagrams illustrate a system including headend equipment for distributing television program material to viewers, in accordance with certain embodiments. The schematic diagram of FIG. 3 illustrates an uplink portion 150 of the system, and the schematic diagram of FIG. 4 illustrates a cable network portion 170 of the system. The uplink operator supplies several uncompressed video signals AV1-AVn provided by a television program provider to an encoder/encrypter/multiplexer 112 (referred to hereinafter simply as the multiplexer 112). The signals AV1-AVn may be in the HD-SDI format specified in SMPTE 292M, with the audio component embedded in the ancillary data space. The uplink operator also supplies m distribution constraint signals (one for each cable MPTS) that convey distribution constraint data DC1-DCm to the multiplexer 112. The nature of the distribution constraint data embodied in the distribution constraint signals will be discussed in more detail below, but it is sufficient at this point to say that the multiplexer 112 generates m MPTSs where MPTSj (j=1 . . . m) contains as many as ten HD MPEG 4 services and a packetized data elementary stream containing the distribution constraint data DCj. Since the distribution constraint data is included in the same MPTS as the services, it is in-band with the services.
  • Transmitters 114-j (1<=j<=m) employ the MPEG 4 MPTS bitstreams to modulate respective RF carriers and transmit the modulated carriers via respective satellite transponders to the cable distribution system headend 20 (FIG. 2). The headend 20 includes m Integrated Receiver Demultiplexers (IRDS), only one of which, IRD 120, is shown in FIG. 4. The IRD 120 is partially under control of the uplink operator by means of the distribution constraint data.
  • FIG. 5 of the drawings is a flow chart illustrating certain steps of operation of the headend equipment of the system shown in FIG. 4 in accordance with certain embodiments Referring now to both FIG. 4 and FIG. 5 of the drawings, the IRD 120 includes a receiver 100 that is tuned to one of the m satellite transponder channels and thus receives a carrier that is modulated with a multi-program transport stream containing, for example, ten encrypted MPEG 4 services. Assume that the IRD 120 is tuned to the transponder channel that conveys MPTS1 and that MPTS1 contains services AV1-AV10. The receiver demodulates the carrier and outputs the MPTS bitstream, which contains not only the ten encrypted MPEG 4 services AVI-AVIO but also the packetized data stream that contains the distribution constraint data DC1, to a demultiplexer 104. The demultiplexer 104 receives (FIG. 5, step 131) the MPTS and extracts the packetized data stream (FIG. 5, step 132), which conveys the distribution constraint data from the MPTS and supplies the data stream to an IRD controller 108.
  • The IRD has a unique access control address (similar in function to the MAC address assigned to a network adapter). The distribution constraint data is in the form of vectors each having an access address field, a service selection field, a statmux field, and a 3D-2D conversion field. Note that in some systems, statistical multiplexing is not used, in which case the distribution constraint data may include substantially only the 3D-2D conversion data. The uplink operator generates the distribution constraint data based on the commercial arrangements with the cable operators. For example, for each IRD that is designated to transmit a cable MPTS containing one or more of the services contained in MPTSj, the distribution constraint data conveyed by the data stream included in MPTSj contains a vector that includes the access control address of the designated IRD, service selection data identifying the services that are to be included in the cable MPTS produced by the IRD, statmux data (discussed below) for each of those services, and 3D-2D conversion data. The service selection data that is recovered from the MPEG 4 MPTS specifies the three services that are to be included in the MPEG 2 MPTS.
  • Suppose, for example, that k IRDs are designated to transmit a cable MPTS containing one or more of the services contained in MPTSj and the particular IRD 120 shown in FIG. 4 is designated to produce a cable MPTS containing the services AV1, AV2 and AV3.
  • The IRD controller 108 compares the address field of the vector i (i=1 to k) with the access control address of the particular IRD at step 133 shown in FIG. 5, and selects the particular vector whose address field matches. Step 133 is accomplished, in certain embodiments, by steps 211-214 of FIG. 5. At step 211 an index value, i, is reset to 1. At step 212, a determination is made as to whether the index value matches the address of the IRD. When the values do not match, a test is made at step 213 to determine if the index value has reached a limit value of k. When the limit value k has not been reached, the index value is incremented at step 214 and step 212 is re-executed with the new value. When the limit value k has been reached, the method ends at step 215. When, at step 212 the values do match, then the particular vector is selected and the data in the vector is used in certain of the subsequent steps. Step 134 is then executed, in which IRD controller supplies the service selection data contained in the selected vector to the demultiplexer 104, which employs this information to select (in this case) the packetized elementary streams (PESs) for the services AV1, AV2 and AV3. The IRD controller also outputs the statmux data and 3D-2D conversion data contained in the fields of the selected vector. The statmux data is coupled to a statistical multiplexer 118. The 3D-2D conversion data is coupled to transcoders 116. If the access control address of the IRD does not match the address field of any of the distribution constraint data vectors, the IRD is not enabled to utilize the audio and video PESs in MPTS1 to create a cable MPTS.
  • The demultiplexer 104 supplies the encrypted audio and video PESs for the three selected services AV1, AV2 and AV3 to respective decrypters 112, which decrypt the selected services (FIG. 5, step 135) and supply the respective decrypted MPEG 4 audio and video PESs to respective transcoders 116. The transcoders perform 3D-2D scale conversion according to the 3D-2D data in the 3D-2D field of the distribution constraint data, when the 3D-2D data indicates that a conversion is necessary and convert the MPEG 4 PESs to corresponding MPEG 2 PESs (step 136). The transcoder 116 may decode the MPEG 4 video access units and create a sequence of decoded pictures and then perform 3D-2D conversion and encode the pictures using an MPEG 2 coder. The transcoding may alternatively be accomplished without completely decoding the MPEG 4 video access units when 3D-2D conversion is not specified by the 3D-2D conversion data in the 3D-2D field of the distribution constraint data. However, because the frequency decomposition algorithms for MPEG 4 and MPEG 2 are different, it will generally be necessary to decode the MPEG 4 video access units at least to the level of blocks of chroma and luma values.
  • The transcoders 116 supply the audio and video PESs of the three MPEG 2 services to a statistical multiplexer 118 for creating a multi-program transport stream. The three program streams are statistically multiplexed (FIG. 5, step 137) in order to fit in the available 38.8 Mb/s bit rate of a cable channel, but bit rate allocation decisions are made on the basis of the statmux data provided by the IRD controller 108. The statmux data may, for example, specify minimum bit rate and maximum bit rate for each service. By including the statmux data in the transponder MPTS, the uplink operator is able to ensure that the MPEG 2 services meet the quality standards set by the uplink operator or program service provider.
  • The MPTS created by the statistical multiplexer 118 is supplied to a transmitter 124, which modulates an RF carrier with the MPTS bit stream in accordance with a quadrature amplitude modulation (QAM) scheme and transmits (FIG. 5, step 138) the modulated carrier over the cable network 110 to subscriber nodes.
  • Another cable operator may be authorized to distribute a cable MPTS containing services AV1, AV2 and AV4. This cable operator employs headend equipment including an IRD (not shown) having a receiver that is tuned to the transponder that conveys MPTS 1 and the vector that includes the access control address of that 1 RD includes service selection data that specifies the services AV 1, AV2 and AV4 and statmux data for those three services.
  • It will be appreciated that in accordance with certain embodiments, 3D-2D conversion may be performed without the use of statistical multiplexing in an IRD that is designed for statistical multiplexing but in which the distribution constraint data does not specify the use of statistical multiplexing, or in an IRD that is not designed for statistical multiplexing. In an IRD that is designed for straight multiplexing, (not statistical multiplexing) the block diagram would be very similar to FIG. 4 except that the signal called STATMUX DATA could either be missing, or could simply indicate a number of MPEG signals to multiplex.
  • It will be further appreciated that in accordance with certain embodiments, 3D-2D conversion could be performed in any piece of equipment that receives a compressed video stream or that internally generates a compressed video signal from some internal source, and receives 3D-2D conversion meta data that corresponds to the compressed video signal and indicates that 3D-2D conversion should be performed and what scaling to use for the conversion. In these embodiments, the piece of equipment decompresses the compressed video signal, converts and scales the uncompressed video signal according to a specified scaling conversion, and generates a compressed video signal.
  • Referring to FIG. 6, a flow chart illustrates some steps that may be used to accomplish step 136 “transcode and perform 3D-2D conversion of services” of FIG. 5, in accordance with certain embodiments. At step 405, a multiprogram program transport service is received that includes one or more compressed video services. It also includes distribution constraint data that specifies one or more 3D-2D conversion options. Each 3D-2D conversion option is applicable to one or more of the video services, as identified by each 3D-2D conversion option. Each 3D-2D conversion option may further identify whether a 3D-2D conversion is to be applied to the associated one or more of the video services. Each 3D-2D conversion option may further identify which specified type of 3D-2D scale conversion is to be performed. Note that in some embodiments, specific data may not be needed to indicate whether or not a 3D-2D conversion is to be performed. For example, in some embodiments, the absence of a 3D-2D conversion type in a 3D-2D conversion field may be sufficient to make the determination that 3D-2D conversion is not to be performed. In some embodiments, a simple indication that 3D-2D conversion is to be performed could indicate that a default type of 3D-2D conversion is to be performed. When a determination is made at step 410 that a 3D-2D conversion option is to be applied to one or more of the video services, an uncompressed video signal (UVS) is generated by performing a decoding portion of a transcoding operation for the one or more of the video services. Note that step 410 could be performed after the decode portion of a transcoding is performed. For example, a transcoding operation may be defined by default. In many situations the transcode operation is by default an MPEG 4 to HD MPEG 2 transcoding operation. In this instance, the transcoding type may not be specified in the 3D-2D conversion data, nor in the distribution constraint data. This would allow the decision step 410 to follow the transcode decode step 415. When a determination is made at step 410 that a 3D-2D conversion option is not to be applied to one or more of the video services, then the method ends at step 411.
  • A scale conversion for the one or more of the video services is then performed on the UVS at step 420 according to a specified type of 3D-2D conversion. In some embodiments, the type of 3D-2D conversion is specified by default. In these embodiments, whether to perform a 3D-2D operation may explicitly identified, such as by a binary value in the 3D-2D data. In some embodiments, one of a plurality of types of 3D-2D conversions may be specified in the 3D-2D conversion data, each by a unique value in the 3D-2D conversion data. One of the left and right 3D views that are both included in the 3D video service (or services) is used as an input for the scale conversion in step 420. A compressed video service is then generated by performing an encoding portion of the transcoding at step 425 on the UVS that has been 3D-2D scale converted. As noted above the type of transcoding may be by default or may be specified in the 3D-2D conversion option or elsewhere in metadata associated with the video services. A second multiprogram program transport service is generated that includes the compressed video service that has been 3D-2D converted at step 430.
  • Currently, some uplink operators provide both high definition (HD) services and standard definition (SD) services to cable operators in order to enable the cable operators to accommodate customers who do not subscribe to HD service. However, in case the uplink operator should discontinue providing SD services, the transcoder 116 may convert the incoming HD service to SD service in order to accommodate customers who do not subscribe to the HD level of service.
  • Referring to FIG. 7, a schematic block diagram illustrates certain embodiments of the headend equipment shown in FIG. 4. The transcoder 116 includes a decoder 505 that performs the decoding portion of a transcoding operation, converting the HD MPEG 4 video access units to uncompressed video signals (UVS's). Some of the pictures may be converted from 3D to 2D by a scale conversion function 510 that operated as described above and below, An encoder 515 of the transcoder 116 then encodes the PESs as HD MPEG 2 pictures, and may also downconvert the decoded HD pictures to UVS SD using a down convert function 520. An encoder 525 then encodes the SD pictures as SD MPEG 2 pictures and thus provides an SD MPEG 2 service in addition to the HD MPEG 2 service. The SD MPEG 2 bit streams may be supplied to a statistical multiplexer (e.g., statistical multiplexer 118 of FIG. 2) that creates a cable MPTS for transmission over the cable 10 (FIG. 4). It will be appreciated that the SD cable MPTS may contain more than three services, and some of them can be 2D services obtained by the unique apparatus and methods described herein.
  • The distribution constraint data provided to the IRD that includes the transcoder and 3D-2D converter 116 shown in FIG. 7 may include the service selection data for the demultiplexer, may include statmux data for controlling statistical multiplexers, may include 3D-2D conversion option data for 3D-2D conversion and, in addition, may contain picture format data utilized by the downconverter 130 to determine how the 16×9 aspect ratio of the HD picture format should be adapted to the 4×3 aspect ratio of the SD picture format.
  • Although FIG. 7 illustrates an HD MPTS and an SD MPTS respectively, it will be appreciated that SD services and HD services may be included in the same MPTS. For example, instead of providing one MPTS containing HD services and another MPTS containing SD services, it may be preferable to provide two HD services and the corresponding SD services in the same MPTS.
  • Referring to FIG. 8, a matrix illustrates one exemplary table of 3D-2D scale conversions that the 3D-2D conversion data may use to identify a specific type of scale conversion, in accordance with some embodiments. Each of the 14 items in this table may be identified by a value that is conveyed by the 3D-2D conversion data. For example, the 14 line items may be identified by a value from 1 to 14 that is included in the 3D-2D conversion data. In this example, A value of 7 may then indicate that the received picture is a line interleaved image of 1280×720×60 in a line input format (i.e., 1280 pixels wide, 720 pixels high, at a rate of 60 frames per second) that is to be scaled to an output resolution of 1280×720×60 In this instance, the left image of the video may be conveyed in the odd scan lines and the right image may be conveyed in the even scan lines, The output image is scaled by using a specified default image (e.g., the right image) and producing the output image by duplicating each even scan line into the next odd scan line, or by generating the pixel values of the odd scan lines by interpolating the values of the lines preceding and succeeding an even line that is to be generated. One such interpolation could be the average of the preceding and succeeding scan lines. The meanings of abbreviations used in FIG. 8 are OU=over under and SBS=side by side. The interpretation of some of the input and output formats is aided by FIGS. 9-14, which show where the left and right image pixels may found in the picture stream, in accordance with certain embodiments. FIG. 9 illustrates a side-by-side pixel format, with the pixels for the left image of a 3D image on the left and the pixels for the right image of the 3D image on the right of each frame. FIG. 10 illustrates an over-under pixel format, with the pixels for the left image of a 3D image on the top and the pixels for the right image of the 3D image on the bottom of each frame. FIG. 11 illustrates a frame sequential format, with the pixels for the left image of a 3D image included in frames that alternate with frames that include the pixels for the right image of the 3D image. In FIGS. 12-14, the X's can be interpreted as left pixels and the O's as right pixels. FIG. 12 and FIG. 13, respectively, illustrate pixels of left and right images arranged in alternating columns and lines in each frame, while FIG. 14 illustrates pixels arranged in a checkerboard pattern in each frame.
  • It can be seen from these figures that in the embodiments illustrated, the left and right 3D views are included in the one or more video services in one of a side-by-side, over-under, alternating lines, alternating columns, checker board, or frame sequential arrangement . . . .
  • Although the description with reference to FIGS. 4-7 indicates that each transponder MPTS conveys only the distribution constraint data for the IRDs that are authorized to receive that particular transponder MPTS, the distribution constraint data is relatively static and accordingly it may be possible for each transponder MPTS to contain the distribution constraint data pertaining to all of the services. In addition, although the disclosed subject matter has been described with reference to distribution of television program material, it will be appreciated that the disclosed subject matter is also applicable to distribution of other video material, such as motion pictures by video-on-demand service.
  • Referring to FIG. 15, suitable headend equipment may be implemented using a computer 160 comprising one or more processors 161, random access memory 162, read only memory 163, I/O devices 164, a user interface 165, a CD ROM drive 166 and a hard disk drive 167, configured in a generally conventional architecture. The computer operates in accordance with a program that is stored in a computer readable medium, such as the hard disk drive 167 or a CD ROM 168, and is loaded into the random access memory 162 for execution. The program comprises instructions that when executed by the computer cause the computer to receive a bit stream representing an MPTS including a packetized data elementary stream, as described above, by way of a suitable interface included in the I/O devices 164, the computer allocates memory to appropriate buffers and utilizes other suitable resources and functions to perform the various operations that are described above as being performed by the headend equipment, with reference to the flow charts shown in FIGS. 5-7.
  • It will be appreciated by those skilled in the art that the program might not be loadable directly from the CD ROM 168 into the random access memory utilizing the CD ROM drive 166 and that generally the program will be stored on the CD ROM or other program distribution medium in a form that requires the program to be installed on the hard disk drive 167 from the CD ROM 168.
  • It will be appreciated that the unique 3D-2D conversion techniques and apparatus described herein allow a system operator to provide 2D video streams for customer having legacy set-top boxes and 2D TVs by converting programs supplied only in 3D format at the headend. This provides video services which customers having legacy TV's would not be able to enjoy unless they acquired a set top box which performed the 3D-2D conversion, which may be unavailable or costly.
  • It will be appreciated that the invention is not restricted to the particular embodiment that has been described, and that variations may be made therein without departing from the scope of the invention as defined in the appended claims, as interpreted in accordance with principles of prevailing law, including the doctrine of equivalents or any other principle that enlarges the enforceable scope of a claim beyond its literal scope. Unless the context indicates otherwise, a reference in a claim to the number of instances of an element, be it a reference to one instance or more than one instance, requires at least the stated number of instances of the element but is not intended to exclude from the scope of the claim a structure or method having more instances of that element than stated. The word “comprise” or a derivative thereof, when used in a claim, is used in a nonexclusive sense that is not intended to exclude the presence of other elements or steps in a claimed structure or method.

Claims (20)

1. A method of distributing video program material, comprising:
receiving a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options, each 3D-2D conversion option applicable to one or more of the compressed video services as identified by each 3D-2D conversion option;
generating an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services;
determining from the 3D-2D conversion option whether a 3D-2D conversion is to be performed;
performing a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal when a determination is made that a 3D-2D conversion is to be performed;
generating a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted; and
generating a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
2. The method according to claim 1, further comprising down converting the uncompressed video that has been scale converted.
3. The method according to claim 1, wherein the transcoding operation is an MPEG 4 to HD MPEG2 operation.
4. The method according to claim 1, wherein the specification of the type of 3D-2D conversion is by a default value, and the determination as to whether to perform the 3D-2D conversion is explicit in the 3D-2D conversion option.
5. The method according to claim 1, wherein the type of 3D-2D conversion is specified by a value in the 3D-2D conversion option.
6. The method according to claim 1, wherein the 3D-2D conversion option specifies which of the left and right views is to be used for up/down rate conversion.
7. The method according to claim 1, wherein the left and right 3D views are included in the one or more video services in one of a side-by-side, over-under, alternating lines, alternating columns, checker board, or frame sequential arrangement.
8. The method according to claim 2, wherein the 3D-2D conversion option specifies one of the following scale conversion types:
Output Input Resolution Input Format Output Resolution Format 1920 X 1080 X 30 SBS 3D 1920 X 1080 X 30 2D (using one of the left and right images) OU 3D 1920 X 1080 X 30 2D (using one of the top and bottom images) Column 1920 x 1080 x 30 2D (using interleave the even columns or the odd columns) 1280 X 720 X 60 SBS 3D 1280 X 720 X 60 2D (using one of the left and right images) OU 3D 1280 X 720 X 60 2D (using one of the top and bottom images) Column 1280 X 720 X 60 2D (using interleave the even columns or the odd columns) Line interleave 1280 X 720 X 60 2D (using the even lines or the odd lines) Checkerboard 1280 X 720 X 60 2D 1920 X 1080 X 60 SBS 3D 1280 X 720 X 60 2D (using one of the left and right images) OU 3D 1280 X 720 X 60 2D (using one of the top and bottom images) Frame 1920 X 1080 X 30 2D (using the Sequential 3D odd frames or the even frames) Column 1280 X 720 X 60 2D (using interleave the even columns or odd columns) Line interleave 1280 X 720 X 60 2D (using the even lines or odd lines) Checkerboard 1280 X 720 X 60 2D
wherein SBS designates a side by side format and OU designates an over under format
9. The method according to claim 1, wherein the step of determining whether a 3D-2D conversion is to be performed is performed before the step of generating the uncompressed video signal.
10. A processing system comprising
an input-output function that receives a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options, each 3D-2D conversion option applicable to one or more of the compressed video services as identified by each 3D-2D conversion option;
a processor that
generates an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services,
determines from the 3D-2D conversion option whether a 3D-2D conversion is to be performed,
when a determination is made that a 3D-2D conversion is to be performed, performs a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal, and
generates a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted; and
wherein the input-output function generates a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
11. The processing system according to claim 10, further comprising down converting the uncompressed video that has been scale converted.
12. The processing system according to claim 10, wherein the transcoding operation is an MPEG 4 to HD MPEG2 operation.
13. The processing system according to claim 10, wherein the specification of the type of 3D-2D conversion is by a default value, and the determination as to whether to perform the 3D-2D conversion is explicit in the 3D-2D conversion option.
14. The processing system according to claim 10, wherein the type of 3D-2D conversion is specified by a value in the 3D-2D conversion option.
15. A tangible computer readable media that includes program instructions that, when executed by a processing system, cause a programming system to:
receive a multiprogram program transport service that includes one or more compressed video services and one or more 3D-2D conversion options, each 3D-2D conversion option applicable to one or more of the compressed video services as identified by each 3D-2D conversion option;
generate an uncompressed video signal by performing a decoding portion of a transcoding operation for one of the one or more of the video services;
determine from the 3D-2D conversion option whether a 3D-2D conversion is to be performed;
perform a scale conversion on the uncompressed video according to a specified type of 3D-2D conversion, using one of a left and right 3D view that are both included in the uncompressed video signal when a determination is made that a 3D-2D conversion is to be performed;
generate a compressed video service by performing an encoding portion of a transcoding operation on the uncompressed video that has been scale converted; and
generate a second multiprogram program transport service that includes the compressed video signal that has been 3D-2D converted.
16. The tangible computer readable media according to claim 15, further comprising down converting the uncompressed video that has been scale converted.
17. The tangible computer readable media according to claim 15, wherein the transcoding operation is an MPEG 4 to HD MPEG2 operation.
18. The tangible computer readable media according to claim 15, wherein the specification of the type of 3D-2D conversion is by a default value, and the determination as to whether to perform the 3D-2D conversion is explicit in the 3D-2D conversion option.
19. The tangible computer readable media according to claim 15, wherein the type of 3D-2D conversion is specified by a value in the 3D-2D conversion option.
20. The tangible computer readable media according to claim 15, wherein the left and right 3D views are included in the one or more video services in one of a side-by-side, over-under, alternating lines, alternating columns, checker board, or frame sequential arrangement.
US12/761,822 2010-04-16 2010-04-16 Method and apparatus for distribution of 3D television program materials Active 2032-01-22 US9237366B2 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
US12/761,822 US9237366B2 (en) 2010-04-16 2010-04-16 Method and apparatus for distribution of 3D television program materials
PCT/US2011/032858 WO2011130732A1 (en) 2010-04-16 2011-04-18 Method and apparatus for distribution of 3d television program materials
CN201180019334.8A CN102845068B (en) 2010-04-16 2011-04-18 The method of distribution and equipment for 3D television program material
US14/966,048 US10368050B2 (en) 2010-04-16 2015-12-11 Method and apparatus for distribution of 3D television program materials
US16/525,068 US10893253B2 (en) 2010-04-16 2019-07-29 Method and apparatus for distribution of 3D television program materials
US17/145,734 US11558596B2 (en) 2010-04-16 2021-01-11 Method and apparatus for distribution of 3D television program materials
US18/096,735 US20230328217A1 (en) 2010-04-16 2023-01-13 Method and apparatus for distribution of 3d television program materials

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/761,822 US9237366B2 (en) 2010-04-16 2010-04-16 Method and apparatus for distribution of 3D television program materials

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/966,048 Continuation US10368050B2 (en) 2010-04-16 2015-12-11 Method and apparatus for distribution of 3D television program materials

Publications (2)

Publication Number Publication Date
US20110254917A1 true US20110254917A1 (en) 2011-10-20
US9237366B2 US9237366B2 (en) 2016-01-12

Family

ID=44124721

Family Applications (5)

Application Number Title Priority Date Filing Date
US12/761,822 Active 2032-01-22 US9237366B2 (en) 2010-04-16 2010-04-16 Method and apparatus for distribution of 3D television program materials
US14/966,048 Active 2030-11-23 US10368050B2 (en) 2010-04-16 2015-12-11 Method and apparatus for distribution of 3D television program materials
US16/525,068 Active US10893253B2 (en) 2010-04-16 2019-07-29 Method and apparatus for distribution of 3D television program materials
US17/145,734 Active US11558596B2 (en) 2010-04-16 2021-01-11 Method and apparatus for distribution of 3D television program materials
US18/096,735 Pending US20230328217A1 (en) 2010-04-16 2023-01-13 Method and apparatus for distribution of 3d television program materials

Family Applications After (4)

Application Number Title Priority Date Filing Date
US14/966,048 Active 2030-11-23 US10368050B2 (en) 2010-04-16 2015-12-11 Method and apparatus for distribution of 3D television program materials
US16/525,068 Active US10893253B2 (en) 2010-04-16 2019-07-29 Method and apparatus for distribution of 3D television program materials
US17/145,734 Active US11558596B2 (en) 2010-04-16 2021-01-11 Method and apparatus for distribution of 3D television program materials
US18/096,735 Pending US20230328217A1 (en) 2010-04-16 2023-01-13 Method and apparatus for distribution of 3d television program materials

Country Status (3)

Country Link
US (5) US9237366B2 (en)
CN (1) CN102845068B (en)
WO (1) WO2011130732A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249734A1 (en) * 2011-03-28 2012-10-04 Shunsuke Takayama Electronic apparatus and display control method
US20120308193A1 (en) * 2011-05-30 2012-12-06 Shunsuke Takayama Electronic apparatus and display control method
US20130002819A1 (en) * 2008-10-10 2013-01-03 Chul Soo Lee Receiving system and method of processing data
US20130235154A1 (en) * 2012-03-09 2013-09-12 Guy Salton-Morgenstern Method and apparatus to minimize computations in real time photo realistic rendering
US20130265469A1 (en) * 2012-04-10 2013-10-10 Canon Kabushiki Kaisha Imaging apparatus
US9712803B2 (en) 2008-10-10 2017-07-18 Lg Electronics Inc. Receiving system and method of processing data
US10360139B2 (en) * 2013-03-12 2019-07-23 Entit Software Llc Identifying transport-level encoded payloads
EP3917104A1 (en) * 2020-05-29 2021-12-01 Atos Information Technology GmbH System and method for streaming content

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9542203B2 (en) 2010-12-06 2017-01-10 Microsoft Technology Licensing, Llc Universal dock for context sensitive computing device
US8923770B2 (en) 2010-12-09 2014-12-30 Microsoft Corporation Cognitive use of multiple regulatory domains
US8792429B2 (en) * 2010-12-14 2014-07-29 Microsoft Corporation Direct connection with side channel control
US8948382B2 (en) 2010-12-16 2015-02-03 Microsoft Corporation Secure protocol for peer-to-peer network
US9294545B2 (en) 2010-12-16 2016-03-22 Microsoft Technology Licensing, Llc Fast join of peer to peer group with power saving mode
US8971841B2 (en) 2010-12-17 2015-03-03 Microsoft Corporation Operating system supporting cost aware applications
CN102833566B (en) * 2012-09-03 2016-04-20 深圳市维尚境界显示技术有限公司 A kind of 3D rendering switching 2D displays the play and regulates adaptive method, device and equipment
KR20230087622A (en) * 2017-02-09 2023-06-16 페인티드 도그, 인크. Methods and apparatus for detecting, filtering, and identifying objects in streaming video
US10861196B2 (en) 2017-09-14 2020-12-08 Apple Inc. Point cloud compression
US10897269B2 (en) 2017-09-14 2021-01-19 Apple Inc. Hierarchical point cloud compression
US11818401B2 (en) 2017-09-14 2023-11-14 Apple Inc. Point cloud geometry compression using octrees and binary arithmetic encoding with adaptive look-up tables
US11113845B2 (en) 2017-09-18 2021-09-07 Apple Inc. Point cloud compression using non-cubic projections and masks
US10909725B2 (en) * 2017-09-18 2021-02-02 Apple Inc. Point cloud compression
US10607373B2 (en) 2017-11-22 2020-03-31 Apple Inc. Point cloud compression with closed-loop color conversion
US10699444B2 (en) 2017-11-22 2020-06-30 Apple Inc Point cloud occupancy map compression
US11010928B2 (en) 2018-04-10 2021-05-18 Apple Inc. Adaptive distance based point cloud compression
US10909726B2 (en) 2018-04-10 2021-02-02 Apple Inc. Point cloud compression
US10939129B2 (en) 2018-04-10 2021-03-02 Apple Inc. Point cloud compression
US10909727B2 (en) 2018-04-10 2021-02-02 Apple Inc. Hierarchical point cloud compression with smoothing
US11017566B1 (en) 2018-07-02 2021-05-25 Apple Inc. Point cloud compression with adaptive filtering
US11202098B2 (en) * 2018-07-05 2021-12-14 Apple Inc. Point cloud compression with multi-resolution video encoding
US11012713B2 (en) 2018-07-12 2021-05-18 Apple Inc. Bit stream structure for compressed point cloud data
US11386524B2 (en) 2018-09-28 2022-07-12 Apple Inc. Point cloud compression image padding
US11367224B2 (en) 2018-10-02 2022-06-21 Apple Inc. Occupancy map block-to-patch information compression
US11430155B2 (en) 2018-10-05 2022-08-30 Apple Inc. Quantized depths for projection point cloud compression
US11057564B2 (en) 2019-03-28 2021-07-06 Apple Inc. Multiple layer flexure for supporting a moving image sensor
US11562507B2 (en) 2019-09-27 2023-01-24 Apple Inc. Point cloud compression using video encoding with time consistent patches
US11627314B2 (en) 2019-09-27 2023-04-11 Apple Inc. Video-based point cloud compression with non-normative smoothing
US11538196B2 (en) 2019-10-02 2022-12-27 Apple Inc. Predictive coding for point cloud compression
US11895307B2 (en) 2019-10-04 2024-02-06 Apple Inc. Block-based predictive coding for point cloud compression
US11798196B2 (en) 2020-01-08 2023-10-24 Apple Inc. Video-based point cloud compression with predicted patches
US11625866B2 (en) 2020-01-09 2023-04-11 Apple Inc. Geometry encoding using octrees and predictive trees
US11620768B2 (en) 2020-06-24 2023-04-04 Apple Inc. Point cloud geometry compression using octrees with multiple scan orders
US11615557B2 (en) 2020-06-24 2023-03-28 Apple Inc. Point cloud compression using octrees with slicing
US11948338B1 (en) 2021-03-29 2024-04-02 Apple Inc. 3D volumetric content encoding using 2D videos and simplified 3D meshes

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030223499A1 (en) * 2002-04-09 2003-12-04 Nicholas Routhier Process and system for encoding and playback of stereoscopic video sequences
US20050259147A1 (en) * 2002-07-16 2005-11-24 Nam Jeho Apparatus and method for adapting 2d and 3d stereoscopic video signal
US20070183650A1 (en) * 2002-07-02 2007-08-09 Lenny Lipton Stereoscopic format converter
US20080085049A1 (en) * 2000-04-01 2008-04-10 Rolf-Dieter Naske Methods and systems for 2d/3d image conversion and optimization
US20090142041A1 (en) * 2007-11-29 2009-06-04 Mitsubishi Electric Corporation Stereoscopic video recording method, stereoscopic video recording medium, stereoscopic video reproducing method, stereoscopic video recording apparatus, and stereoscopic video reproducing apparatus
US20090317061A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image generating method and apparatus and image processing method and apparatus
US20100064308A1 (en) * 2008-09-05 2010-03-11 General Instrument Corporation Method and Apparatus for Constrained Distribution of Television Program Material
US20100134592A1 (en) * 2008-11-28 2010-06-03 Nac-Woo Kim Method and apparatus for transceiving multi-view video
US20100299453A1 (en) * 2009-05-19 2010-11-25 Fox Brian J System and method for dynamically transcoding data requests
US20110149029A1 (en) * 2009-12-17 2011-06-23 Marcus Kellerman Method and system for pulldown processing for 3d video
US8743178B2 (en) * 2010-01-05 2014-06-03 Dolby Laboratories Licensing Corporation Multi-view video format control

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002095018A (en) 2000-09-12 2002-03-29 Canon Inc Image display controller, image display system and method for displaying image data
EP1501316A4 (en) * 2002-04-25 2009-01-21 Sharp Kk Multimedia information generation method and multimedia information reproduction device
US6937168B2 (en) * 2002-06-14 2005-08-30 Intel Corporation Transcoding media content from a personal video recorder for a portable device
KR100554991B1 (en) * 2002-09-17 2006-02-24 샤프 가부시키가이샤 Electronics with two and three dimensional display functions
WO2006065223A1 (en) * 2004-12-13 2006-06-22 Muvee Technologies Pte Ltd A method of automatically editing media recordings
JPWO2006123744A1 (en) * 2005-05-18 2008-12-25 日本電気株式会社 Content display system and content display method
US9167176B2 (en) * 2005-07-18 2015-10-20 Thomson Licensing Method and device for handling multiple video streams using metadata
WO2008054100A1 (en) 2006-11-01 2008-05-08 Electronics And Telecommunications Research Institute Method and apparatus for decoding metadata used for playing stereoscopic contents
JP4402703B2 (en) * 2007-04-05 2010-01-20 キヤノン株式会社 Image processing apparatus and control method thereof
US20080303832A1 (en) * 2007-06-11 2008-12-11 Samsung Electronics Co., Ltd. Method of generating two-dimensional/three-dimensional convertible stereoscopic image bitstream and method and apparatus for displaying the same
EP2357811B1 (en) * 2008-06-23 2015-04-29 Onkyo Corporation Image processing apparatus
WO2010038409A1 (en) * 2008-09-30 2010-04-08 パナソニック株式会社 Reproduction device, recording medium, and integrated circuit
WO2010147289A1 (en) * 2009-06-16 2010-12-23 Lg Electronics Inc. Broadcast transmitter, broadcast receiver and 3d video processing method thereof
JP5250491B2 (en) * 2009-06-30 2013-07-31 株式会社日立製作所 Recording / playback device
US8270807B2 (en) * 2009-07-13 2012-09-18 Panasonic Corporation Recording medium, playback device, and integrated circuit

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080085049A1 (en) * 2000-04-01 2008-04-10 Rolf-Dieter Naske Methods and systems for 2d/3d image conversion and optimization
US20030223499A1 (en) * 2002-04-09 2003-12-04 Nicholas Routhier Process and system for encoding and playback of stereoscopic video sequences
US20070183650A1 (en) * 2002-07-02 2007-08-09 Lenny Lipton Stereoscopic format converter
US20050259147A1 (en) * 2002-07-16 2005-11-24 Nam Jeho Apparatus and method for adapting 2d and 3d stereoscopic video signal
US20090142041A1 (en) * 2007-11-29 2009-06-04 Mitsubishi Electric Corporation Stereoscopic video recording method, stereoscopic video recording medium, stereoscopic video reproducing method, stereoscopic video recording apparatus, and stereoscopic video reproducing apparatus
US20090317061A1 (en) * 2008-06-24 2009-12-24 Samsung Electronics Co., Ltd. Image generating method and apparatus and image processing method and apparatus
US20100064308A1 (en) * 2008-09-05 2010-03-11 General Instrument Corporation Method and Apparatus for Constrained Distribution of Television Program Material
US20100134592A1 (en) * 2008-11-28 2010-06-03 Nac-Woo Kim Method and apparatus for transceiving multi-view video
US20100299453A1 (en) * 2009-05-19 2010-11-25 Fox Brian J System and method for dynamically transcoding data requests
US20110149029A1 (en) * 2009-12-17 2011-06-23 Marcus Kellerman Method and system for pulldown processing for 3d video
US8743178B2 (en) * 2010-01-05 2014-06-03 Dolby Laboratories Licensing Corporation Multi-view video format control

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130002819A1 (en) * 2008-10-10 2013-01-03 Chul Soo Lee Receiving system and method of processing data
US9712803B2 (en) 2008-10-10 2017-07-18 Lg Electronics Inc. Receiving system and method of processing data
US20120249734A1 (en) * 2011-03-28 2012-10-04 Shunsuke Takayama Electronic apparatus and display control method
US8941719B2 (en) * 2011-03-28 2015-01-27 Kabushiki Kaisha Toshiba Electronic apparatus and display control method
US20120308193A1 (en) * 2011-05-30 2012-12-06 Shunsuke Takayama Electronic apparatus and display control method
US8687950B2 (en) * 2011-05-30 2014-04-01 Kabushiki Kaisha Toshiba Electronic apparatus and display control method
US20130235154A1 (en) * 2012-03-09 2013-09-12 Guy Salton-Morgenstern Method and apparatus to minimize computations in real time photo realistic rendering
US20130265469A1 (en) * 2012-04-10 2013-10-10 Canon Kabushiki Kaisha Imaging apparatus
US8842193B2 (en) * 2012-04-10 2014-09-23 Canon Kabushiki Kaisha Imaging apparatus
US10360139B2 (en) * 2013-03-12 2019-07-23 Entit Software Llc Identifying transport-level encoded payloads
EP3917104A1 (en) * 2020-05-29 2021-12-01 Atos Information Technology GmbH System and method for streaming content
US11399049B2 (en) * 2020-05-29 2022-07-26 Atos France System and method for streaming content

Also Published As

Publication number Publication date
US9237366B2 (en) 2016-01-12
US11558596B2 (en) 2023-01-17
US20210136343A1 (en) 2021-05-06
WO2011130732A1 (en) 2011-10-20
US10893253B2 (en) 2021-01-12
CN102845068A (en) 2012-12-26
US10368050B2 (en) 2019-07-30
US20160100151A1 (en) 2016-04-07
US20190356896A1 (en) 2019-11-21
CN102845068B (en) 2016-09-14
US20230328217A1 (en) 2023-10-12

Similar Documents

Publication Publication Date Title
US11558596B2 (en) Method and apparatus for distribution of 3D television program materials
JP6279463B2 (en) Content transmission device, content reception device, content transmission method, and content reception method
KR100689507B1 (en) Apparatus and method for adaptation of multimedia signal performing picture in picture function
US9036700B2 (en) Simulcast of stereoviews for 3D TV
JP6013920B2 (en) Apparatus and method for processing video content
EP2666286B1 (en) Video stream composed of combined video frames and methods and systems for its generation, transmission, reception and reproduction
US8462197B2 (en) 3D video transforming device
US20160142744A1 (en) Transmission apparatus and transmission/reception system
US8982186B2 (en) Method for providing and recognizing transmission mode in digital broadcasting
KR102517570B1 (en) Apparatus and method for transmitting and receiving 3dtv broadcasting
JP5042532B2 (en) Digital broadcasting system and channel switching method in the digital broadcasting system
US8532174B2 (en) Method and apparatus for distributing video program material
US9743064B2 (en) System and method for distributing high-quality 3D video in a 2D format
JP2007028601A (en) Apparatus and method for channel-switching in digital broadcasting system
US8631454B2 (en) Method and apparatus for constrained distribution of television program material
KR101277267B1 (en) Coding method and apparatus for 3D broadcasting
KR20070017498A (en) Method and system of providing signals
KR20120087869A (en) Coding method and apparatus for 3D broadcasting

Legal Events

Date Code Title Description
AS Assignment

Owner name: GENERAL INSTRUMENT CORPORATION, PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SCHAFFER, MARK L.;WU, SIU-WAI;SIGNING DATES FROM 20100419 TO 20100421;REEL/FRAME:024341/0594

AS Assignment

Owner name: MOTOROLA MOBILITY LLC, ILLINOIS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GENERAL INSTRUMENT HOLDINGS, INC.;REEL/FRAME:030866/0113

Effective date: 20130528

Owner name: GENERAL INSTRUMENT HOLDINGS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GENERAL INSTRUMENT CORPORATION;REEL/FRAME:030764/0575

Effective date: 20130415

AS Assignment

Owner name: GOOGLE TECHNOLOGY HOLDINGS LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MOTOROLA MOBILITY LLC;REEL/FRAME:034373/0001

Effective date: 20141028

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8