EP1751979A1

EP1751979A1 - Apparatus and method for transmitting/receiving 3d stereoscopic digital broadcast signal by using 3d stereoscopic video additional data

Info

Publication number: EP1751979A1
Application number: EP04808260A
Authority: EP
Inventors: Suk-Hee Cho; Byung-Jun Bae; Kug-Jin Yun; Chung-Hyun Ahn; Soo-In Lee
Original assignee: Electronics and Telecommunications Research Institute ETRI
Current assignee: Electronics and Telecommunications Research Institute ETRI
Priority date: 2004-05-21
Filing date: 2004-11-30
Publication date: 2007-02-14
Also published as: KR100585966B1; KR20050111379A; JP2008500790A; EP1751979A4; CN1954606A; JP4828535B2; CN100563324C; WO2005114998A1

Abstract

Provided are a three-dimensional (3D) stereoscopic digital broadcasting transmitting/receiving apparatus and method using 3D stereoscopic video additional data. The apparatus and method is compatible with a two-dimensional (2D) digital broadcasting system by defining and processing 3D stereoscopic video additional data, such as another 3D video, disparity information, and depth information, as an additional stream added to a 2D video transport stream, which is different from the conventional method that provides a 3D stereoscopic digital broadcasting system by using video of another viewpoint. The 3D stereoscopic digital broadcast transmitting apparatus includes: a video acquiring unit; an audio data acquiring unit, an encoding unit, a program specific information (PSI) generating unit, a packetizing unit, a transport stream (TS) generating unit, a multiplexing unit, and a modulating unit.

Description

Description APPARATUS AND METHOD FOR TRANSMITTING/ RECEIVING 3D STEREOSCOPIC DIGITAL BROADCAST SIGNAL BY USING 3D STEREOSCOPIC VIDEO ADDITIONAL DATA Technical Field

[1] The present invention relates to an apparatus and method for transmitting/receiving a three-dimensional (3D) stereoscopic digital broadcast signal by using 3D stereoscopic video additional data; and, more particularly, to a 3D stereoscopic digital broadcast transmitting/ receiving apparatus and method that is compatible with a two- dimensional (2D) digital broadcasting system by defining and processing 3D stereoscopic video additional data as an additional stream added to a 2D video transport stream, which is different from a conventional method that provides a 3D stereoscopic digital broadcasting system by using a video of another viewpoint. The 3D stereoscopic video additional data include a video of another viewpoint, disparity information and depth information. Background Art

[2] A digital broadcasting using Moving Picture Experts Group (MPEG) technology can transmit high-definition programs in the same bandwidth of a conventional analog broadcasting and transmit a plurality of standard-definition programs in one channel. In addition, the digital broadcasting can provide diverse application services, e.g., data broadcasting, interactive broadcasting and the like. In order to provide a plurality of programs and various application services in a single transmission channel, MPEG-2 transport streams (TSs) generated from service providers should be multiplexed into one channel.

[3] In the conventional analog broadcasting, since stereoscopic videos are transmitted/ received, there was no big problem. However, in the digital broadcasting, additional data for video information, audio information, and program guide information are rmltiplexed in a transport format complicatedly and videos are arrayed without order. Thus, there is a problem that it is difficult to arrange and output them.

[4] In an effort to solve the problem, suggested is a method using a packet identifier (PID) for identifying the packets of a video signal, an audio signal, and additional information and using a PID for identifying right and left videos for a stereoscopic video.

[5] However, conventional technologies for providing a 3D stereoscopic video contents service have a problem of incompatibility, because they include two video streams by defining PID values with respect to the right and left videos, which cannot be discriminated in the conventional 2D system.

[6] Data required to generate a 3D stereoscopic video are a video of two viewpoints, a video of one viewpoint and disparity information, or a video of one viewpoint and depth information. Disclosure of Invention Technical Problem

[7] It is, therefore, an object of the present invention to provide an apparatus and method for transmitting/ receiving three-dimensional (3D) stereoscopic digital broadcast by using 3D stereoscopic video additional data. The apparatus and method is compatible with a two-dimensional (2D) digital broadcast system by defining and processing the 3D stereoscopic video additional data, e.g., a video of another viewpoint, disparity information and/or depth information, as an additional stream synchronized with 2D video transport stream (TS) differently from conventional methods that support a 3D stereoscopic digital broadcasting system by using the video of another viewpoint. Technical Solution

[8] In accordance with one aspect of the present invention, there is provided a 3D stereoscopic digital broadcast transmitting apparatus using 3D stereoscopic video additional data, including: a video acquiring unit for acquiring an original video and 3D stereoscopic video additional data; an audio data acquiring unit for acquiring audio data; an encoding unit for encoding the original video and 3D stereoscopic video additional data transmitted from the video acquiring unit and the audio data transmitted from the audio data acquiring unit; a program specific information (PSI) generating unit for generating PSI for discriminating each information; a packetizing unit for generating packetized elementary stream (PES) by receiving and packetizing elementary streams (ESs) obtained from the encoding in the encoding unit; a transport stream (TS) generating unit for generating transport streams by receiving the PES from the packetizing unit and the PSI from the PSI generating unit; a miltiplexing unit for rmltiplexing the transport streams transmitted from the TS generating unit into one transmission stream; and a modulating unit for modulating the miltiplexed transport stream.

[9] In accordance with another aspect of the present invention, there is provided a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data, including: a demodulating unit for demodulating a modulated signal by receiving a modulated transport stream; a demultiplexing unit for demiltiplexing the demodulated transport stream by receiving the demodulated transport stream from the demodulating unit and program specific information from a PSI analyzing unit so as to produce transport streams; the PSI analyzing unit for analyzing PSI by receiving a transport stream (TS_PSI) for PSI from the demultiplexing unit and transmitting the analyzed PSI to the demiltiplexing unit; a TS analyzing unit for analyzing the transport streams by receiving the demiltiplexed transport streams from the demultiplexing unit so as to generate PES; a depacketizing unit for depacketizing the PES transmitted from the TS analyzing unit so as to generate elementary streams; a decoding unit for decoding the elementary streams transmitted from the depacketizing unit; a video combining unit for combining the original video and the 3D stereoscopic video additional data that are decoded in the decoding unit so as to generate a 3D stereoscopic video; and an outputting unit for outputting a 2D or 3D stereoscopic video received from the video combining unit and audio data received from the decoding unit.

[10] In accordance with another aspect of the present invention, there is provided a method for transmitting a 3D stereoscopic digital broadcast by using 3D stereoscopic video additional data, including the steps of: a) acquiring an original video, 3D stereoscopic video additional data and audio data; b) encoding the original video, the 3D stereoscopic video additional data and the audio data into a format appropriate for digital transmission to thereby generate elementary streams; c) generating packetized elementary stream by packetizing the elementary streams; d) generating program specific information for discriminating each information, such as the original video, the 3D stereoscopic video additional data, and the audio data; e) generating transport streams based on the packetized elementary streams and the program specific information; f) miltiplexing the transport streams into one transport stream; and g) modulating and transmitting the miltiplexed transport stream.

[11] In accordance with another aspect of the present invention, there is provided a method for receiving a 3D stereoscopic digital broadcast by using 3D stereoscopic video additional data, including the steps of: a) demodulating a modulated signal by receiving a modulated transport stream; b) demultiplexing a transport stream (TS_PSI) for program specific information based on packet identifier (PID); c) analyzing the program specific information based on a transport stream (TS_PSI) for program specific information; d) demiltiplexing a transport stream into transport streams based on the analyzed program specific information; e) generating a packetized elementary stream by analyzing the demiltiplexed transport streams; f) generating elementary streams by depacketizing the PES; g) decoding the depacketized elementary streams; h) generating a 3D stereoscopic video by combining the decoded original video and the decoded 3D stereoscopic video additional data; and i) outputting a 2D or 3D stereoscopic video according to selection of a user and outputting audio data. Brief Description of the Drawings [12] The above and other objects and features of the present invention will become apparent from the following description of the preferred embodiments given in conjunction with the accompanying drawings, in which: [13] Fig. 1 is a block diagram illustrating a three-dimensional (3D) stereoscopic digital broadcast transmitting apparatus using 3D stereoscopic video additional data in accordance with an embodiment of the present invention; [14] Fig. 2 is a syntax diagram of a packetized elementary stream (PES) in accordance with an embodiment of the present invention; [15] Fig. 3 is a diagram describing a 3D stereoscopic video type (3D_video_type) added to discriminate 3D stereoscopic video additional data in accordance with the present invention; [16] Fig. 4 is a syntax diagram of a transport stream (TS) having Program Association Table (PAT) information in accordance with an embodiment of the present invention; [17] Fig. 5 is a syntax diagram of a transport stream having Program Map Table (PMT) information in accordance with an embodiment of the present invention; [18] Fig. 6 is a syntax diagram of a transport stream packet in accordance with an embodiment of the present invention; [19] Fig. 7 is a block diagram showing a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data in accordance with an embodiment of the present invention; [20] Fig. 8 is a flowchart describing a 3D stereoscopic digital broadcast transmitting method using 3D stereoscopic video additional data in accordance with an embodiment of the present invention; and [21] Fig. 9 is a flowchart describing a 3D stereoscopic digital broadcast receiving method using 3D stereoscopic video additional data in accordance with an embodiment of the present invention. Best Mode for Carrying Out the Invention

[22] Other objects and aspects of the invention will become apparent from the following description of the embodiments with reference to the accompanying drawings, which is set forth hereinafter.

[23] Fig. 1 is a block diagram illustrating a three-dimensional (3D) stereoscopic digital broadcast transmitting apparatus using 3D stereoscopic video additional data in accordance with an embodiment of the present invention.

[24] As shown, the 3D stereoscopic digital broadcast transmitting apparatus of the present invention includes a video acquiring unit 110, an audio acquiring unit 120, an encoding unit 130, a program specific information (PSI) generating unit 140, a packetizing unit 150, a transport stream (TS) generating unit 160, a miltiplexing unit 170 and a modulating unit 18Q

[25] The video acquiring unit 110 acquires an original video and 3D stereoscopic video additional data. The audio acquiring unit 120 acquires audio data. The encoding unit 130 receives the original video and 3D stereoscopic video additional data from the video acquiring unit 110 and receives the audio data from the audio acquiring unit 120 and encodes them into a form appropriate for digital transmission.

[26] The PSI generating unit 140 generates PSI for identifying data. The packetizing unit 150 generates packetized elementary stream (PES) by receiving elementary streams (ES) obtained from the encoding in the encoding unit 130 and packetizing them. The TS generating unit 160 generates transport streams by receiving PES from the packetizing unit 150 and receiving PSI from the PSI generating unit 14Q The miltiplexing unit 170 receives transport streams from the TS generating unit 160 and miltiplexes them into one transport stream. The modulating unit 180 modulates the transport stream multiplexed in the miltiplexing unit 170

[27] The video acquiring unit 110 acquires a monocular video for generating an original video and one or more among a video of another viewpoint, disparity information, and depth information to generate 3D stereoscopic video additional data.

[28] The video of one viewpoint for generating an original video, which is acquired through the video acquiring unit 110, is a reference video to be compared with a video of another viewpoint. On the other hand, the video of another viewpoint, which is acquired from the video acquiring unit 110 and used for the generation of the 3D stereoscopic video additional data, is a video having a viewpoint or a plurality of viewpoints which is/are different from the viewpoint of the original video. [29] The disparity information, which is used to generate the 3D stereoscopic video additional data, is distance information between two locations where the same object is taken from different viewpoints, when the videos of milti- viewpoints or two videos each obtained from one viewpoint and from the other viewpoint are projected into one video. The depth information is far-and-near information that can be figured out by acquiring a video of another viewpoint for the same object in a predetermined distance from the video of another viewpoint.

[30] The encoding unit 130 includes a first Moving Picture Experts Group (MPEG)-2 encoder 131, an arbitrary encoder 132, which will be referred to as an X encoder, and a second MPEG-2 encoder 133. The first MPEG-2 encoder 131 receives the original video of a reference viewpoint from the video acquiring unit 110 and encodes the original video based on the MPEG-2 which is the current broadcasting standard. The X encoder 132 encodes the 3D stereoscopic video additional data transmitted from the video acquiring unit 110 efficiently. The second MPEG-2 encoder 133 encodes the audio data transmitted from the audio acquiring unit 120 into a format of the MPEG-2, which is the current broadcasting standard.

[31] The PSI generating unit 140 generates PSI for discriminating the original video, the 3D stereoscopic video additional data and the audio data. The PSI generating unit 140 uses a stream type (streamjype) defined in the video and audio of the conventional digital broadcasting without change and newly defines a stream type (streamjype) for 3D stereoscopic video additional data as a value defined as 'reserved' or 'user private' in the PID information of a Program Map Table (PMT) for discriminating transport streams for the compatibility between the 2D digital broadcasting system and the 3D stereoscopic digital broadcasting system.

[32] The packetizing unit 150 includes a first packetizer 151, a second packetizer 152 and a third packetizer 153. The first packetizer 151 generates packetized elementary stream (PES_Ori) for the original video by packetizing an elementary stream (ES_Ori) for the original video, which is transmitted from the encoding unit 13Q The second packetizer 152 generates PES (PES_3D) for 3D stereoscopic video additional data by packetizing an ES (ES_Ori) for the 3D stereoscopic video additional data, which is transmitted from the encoding unit 13Q The third packetizer 153 generates PES (PES_Au) for audio data by packetizing an ES (ES_Au) for the audio data, which is transmitted from the encoding unit 13Q

[33] The packetizing unit 150 fiirther performs a fiinction of additionally defining an input field for the type of 3D stereoscopic video additional data in a header of ES (ES_3D) for 3D stereoscopic video additional data to discriminate a video of another viewpoint, disparity information and depth information, when a new input field is needed in connection with the 3D stereoscopic video additional data.

[34] The TS generating unit 160 includes a first TS generator 161, a second TS generator 162, a third TS generator 163 and a fourth TS generator 164. The first TS generator 161 generates a transport stream (TS_Ori) for the original image by receiving a PES (PES_Ori) for the original image from the packetizing unit 150.

[35] The second TS generator 162 generates a transport stream packet (TS_3D) for a 3D stereoscopic video additional data by receiving a PES (PES_3D) for the 3D stereoscopic video additional data from the packetizing unit 150 The third TS generator 163 generates a transport stream packet (TS_Au) for audio data by receiving a PES (PES_Au) for the audio data from the packetizing unit 150 The fourth TS generator 164 generates a transport stream packet (TS_PSI) for PSI by receiving a PSI from the PSI generating unit 14Q

[36] The miltiplexing unit 170 adds Program Clock Reference (PCR) to a transport stream (TS_Ori) for the original video to use it for the detection of system time in the last process of miltiplexing.

[37] Fig. 2 is a syntax diagram of a packetized elementary stream in accordance with an embodiment of the present invention.

[38] As shown, the PES generated in the packetizing unit 150 of Fig. 1 follows the structure of MPEG-2 system standard (International Organization for Standardization (ISO)/International Electrotechnical Committee (IEC) 13818-1) and it is defined in the header of a PES when there is a new input field required in connection with 3D stereoscopic video additional data.

[39] For example, an input field for the type of 3D stereoscopic video additional data is defined additionally to discriminate the 3D stereoscopic video additional data, e.g., video of another viewpoint, disparity information, and depth information.

[40] Fig. 3 is a diagram describing an architecture for discriminating information of 3D stereoscopic video in the header of a PES in accordance with the present invention.

[41] In the embodiment presented in Fig. 3, an information type for discriminating the kind of 3D stereoscopic video additional data is added by utilizing a PES extension field data space in the header of the conventional PES of Fig. 2, when a PES is generated in the packetizing unit 150 of Fig. 1. As illustrated in Fig. 3, a 2-bit 3D stereoscopic video additional data type (3D_video_type) can be defined additionally by using PES extension field data. [42] Table 1 presents the types of 3D stereoscopic video additional data. [43] Table 1 Types of 3D stereoscopic video additional data

[44] When the 3D stereoscopic video additional data type of Fig. 3 is defined additionally, a value indicating a 3D stereoscopic video additional data type (3D_video_type) should be defined in the PES extension field data in advance. A value "00" signifies disparity information and a value "10" stands for a video of another viewpoint, while a value "11" denotes 'reserved.'

[45] Meanwhile, the PSI generating unit 140 generates PSI including four tables: Program Association Table (PAT), Program Map Table (PMT), Network Information Table (NIT) and Conditional Access Table (CAT). The PSI is inserted to a payload of a TS packet and transmitted repeatedly within a predetermined time period for initialization in a receiver. The above-mentioned tables are discriminated by different PID values and one TS packet carries only one kind of table.

[46] Table 2 shows definitions for PID values of PSI. [47] Table 2 PID of PSI and description

[48] In order to identify a transport stream including program specific information, a PID value of a section "0x00010 ~ OxlFFE" can be established arbitrarily and used, and the value and meaning of the established PID should be defined in the program map table in advance. Accordingly, the program map table establishes a PID of a transport stream and defines descriptions with respect to 3D stereoscopic video additional data additionally as well as establishing the PID of a transport stream used in the conventional digital broadcasting and defining description.

[49] Here, the PID "0x0000" denotes a Program Association Table (PAT); the PID "0x0001," Conditional Access Table (CAT); the PID "0x0002," a TS Description Table; the section "0x0003 ~ OxOOOF," 'reserved'; the section "0x00010 ~ OxlFFE," an arbitrary PID that can be established arbitrarily; and the PID "OxlFFF," a null packet.

[50] Fig. 4 is a syntax diagram of a TS having PAT information in accordance with an embodiment of the present invention.

[51] As illustrated in Fig. 4, the transport stream having PAT information follows the MPEG-2 System Standard (ISO/IEC 13818-1). It defines information on a program, e.g., a program number and a PID, which indicates what programs a transport stream is formed of in the PAT. That is, it includes a network ID (network_PID) for each program number (Program_number 0, 1, 2,..., i) and a PID (program_map_PID) for a Program Map Table.

[52] For example, 3D stereoscopic video additional data have one program number and has a PID (program_map_PID) for one program map table.

[53] Fig. 5 is a syntax diagram of a TS having PMT information in accordance with an embodiment of the present invention.

[54] As described in Fig. 5, the TS having PMT information follows a structure of the MPEG-2 System Standard (ISO/IEC 13818-1), and the PMT includes contents and PID for an elementary stream included in one program. That is, it includes a stream type (streamjype) of each information for a program, an elementary PID (elementary J°ID) of a transport stream, the length (ES nfo Jength) of elementary stream information, and a descriptor.

[55] For example, if there is a 3D content, the original video, 3D stereoscopic video additional data and audio data are required. Thus, the elementary PID (elementary J°ID) and the stream type (streamjype) for each information are included to discriminate each information.

[56] The elementary PID (elementary J°ID) denotes a PID value of a transport stream including program elements, and the stream type (streamjype) denotes the kinds of program elements included in a packet having the PID value of the elementary PID.

[57] Table 3 presents an allocation table of stream types standardized currently. [58] Table 3 Allocation of stream types

[59] As shown in Table 3, MPEG-2 video is defined as "0x02" and MPEG-2 audio is defined as "0x04" to discriminate a stream type (streamjype). However, since a stream type (streamjype) for 3D stereoscopic video additional data, if the 3D stereoscopic video additional data are defined as "0x02" just as 2D video, two video streams come to exist in one program and, thus, an error occurs in the conventional 2D digital receiver.

[60] Therefore, a 3D stereoscopic video additional data stream is defined newly with respect to one of the values defined as reserved or user private in the current standard.

[61] Fig. 6 is a syntax diagram of a transport stream packet in accordance with an embodiment of the present invention.

[62] As shown, packetized elementary streams PESs are generated in the form of a transport (TS) stream packet having a fixed length of 188 bytes and the PES is largely divided into two parts: a TS packet header and a TS packet payload. The TS packet header includes a synchronization byte and a TS packet identifier (PID) which discriminates TS packets. The TS packet payload includes packetized elementary stream for videos, i.e., PES JDri and PES_3D, PES for audio data (PES_Au) and PSI.

[63] The packetized elementary streams (PES JDri, PES_3D, and PES_Au) are generated as TS packets based on the constitution of a transport stream of the MPEG-2 System Standard (ISO/IEC 13818-1) illustrated in Fig. 6. Therefore, the TS generating unit 160 of Fig. 1 receives packetized elementary stream (PES JDri) for the original video, packetized elementary stream (PES_3D) for 3D stereoscopic video additional data, and packetized elementary stream (PES_Au) for audio data and generates TS packets by referring to PID values defined in the program map table.

[64] Each TS packet is multiplexed into a single transport stream in the miltiplexing unit 170 of Fig. 1 and modulated into a transmittable form in the modulating unit 18Q

[65] In the last process of the miltiplexing unit 170, program clock reference (PCR) is added to a transport stream (TS JDri) for the original digital video and used for detecting a system clock for synchronization. The period of adding the PCR follows the MPEG-2 System.

[66] Fig. 7 is a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data in accordance with an embodiment of the present invention.

[67] As illustrated, the 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data includes a demodulating unit 710, a demiltiplexing unit 720, a PSI analyzing unit 730, a TS analyzing unit 740, a depacketizing unit 750, a decoding unit 760, a video combining unit 770, and an outputting unit 78Q [68] The demodulating unit 710 receives a modulated transport stream and demodulates the modulated signal. The demiltiplexing unit 720 receives the demodulated transport stream from the demodulating unit 710 and PSI from the PSI analyzing unit and de- miltiplexes the one miltiplexed transport stream to thereby divide it into transport streams. The PSI analyzing unit 730 receives a transport stream (TS J°SI) for program specific information from the demultiplexing unit 720, analyzes program specific information, and transmits the analyzed result to the demiltiplexing unit 720

[69] The TS analyzing unit 740 receives demiltiplexed transport streams from the demultiplexing unit 720, analyzes the transport streams and generates packetized elementary stream. The depacketizing unit 750 receives the packetized elementary streams from the TS analyzing unit 740 and depacketizes them to thereby generate elementary streams. The decoding unit 760 receives the elementary streams from the depacketizing unit 750 and decodes the elementary streams. The video combining unit 770 receives and combines the original video and the 3D stereoscopic video additional data which are decoded in the decoding unit 760 to thereby generate a 3D stereoscopic video. The outputting unit 780 receives a 2D video or 3D stereoscopic video from the video combining unit 770, outputs it based on a display type selected by the user and receives audio data from the decoding unit 760 and outputs the audio data.

[70] The demiltiplexing unit 720 receives a demodulated TS from the demodulating unit 710, first separates a transport stream (TS J°SI) for program specific information, and transmits it to the PSI analyzing unit 730; and receives program specific information that can discriminate each information, e.g., PID information, from the PSI analyzing unit 730 and demiltiplexes it into a transport stream (TS JDri) for the original video, a transport stream (TS_3D) for 3D stereoscopic video additional data, and a transport stream (TS_Au) for audio data.

[71] That is, the demultiplexing unit 720 receives miltiplexed transport stream, finds a TS packet having PAT information whose PID value in the header of the transport stream is "0x0000" and transmits the TS packet to the PSI analyzing unit 73Q Subsequently, it receives a program number and a program map PID (program nap J°ID) from the PSI analyzing unit 730, finds out a TS packet having PMT information from the TS, and transmits it to the PSI analyzing unit 73Q Then, the demiltiplexing unit 720 receives a stream type (streamjype) of each elementary stream and elementary PID (elementary J°ID) from the PSI analyzing unit 730 and demiltiplexes them into TS for each data (TS JDri, TS_3D or TS_Au).

[72] Since the stream type (streamjype) for 3D stereoscopic is newly defined as a value defined as 'reserved' or 'user private,' if the receiver is a 2D digital broadcasting system, the demultiplexing unit 720 recognizes the 3D stereoscopic video additional data as 'reserved' or 'user private' and only the streams for video and audio are processed. Therefore, it is compatible with the conventional 2D digital broadcasting system and, in case of the 3D stereoscopic digital broadcasting system, it recognizes a newly defined stream type (streamjype) and processes video, audio and 3D stereoscopic video additional data.

[73] Also, the demiltiplexing unit 720 restores system clocks based on the PCR of the transport stream (TS JDri) for the original video for the clock synchronization of the transmitter of Fig. 1 and the receiver of Fig. 7.

[74] The PSI analyzing unit 730 receives transport stream (TS J°SI) for program specific information from the demultiplexing unit 730, analyzes PAT information and PID information of the PMT, and then outputs PSI for discriminating TSs in the demiltiplexing unit 720 to the demiltiplexing unit 720

[75] That is, the PSI analyzing unit receives a TS packet having PAT information from the demultiplexing unit 720, analyzes payload information of the TS packet, and transmits the analyzed result to the demiltiplexing unit 720 Then, it receives a TS packet having PMT information from the demultiplexing unit 720, analyzes payload information of the TS packet, and transmits the analyzed result to the demiltiplexing unit 720

[76] The TS analyzing unit 740 includes a first TS analyzer 741, a second TS analyzer 742, and a third TS analyzer 743. The first TS analyzer 741 generates packetized elementary stream (PES JDri) for the original video by receiving a transport stream (TS JDri) for the original video from the demultiplexing unit 720 and analyzing it. The second TS analyzer 742 generates packetized elementary stream (PES_3D) for the 3D stereoscopic video additional data by receiving a transport stream (TS_3D) for the 3D stereoscopic video additional data from the demultiplexing unit 720 and analyzing it. The third TS analyzer 743 generates packetized elementary stream (PES_Au) for audio data by receiving a transport stream (TS_Au) for the audio data from the demultiplexing unit 720 and analyzing it.

[77] The depacketizing unit 750 includes a first depacketizer 751, a second depacketizer 752, and a third depacketizer 753. The first depacketizer 751 generates an elementary stream (ES JDri) for the original video by receiving a packetized elementary stream (PES JDri) for the original video from the TS analyzing unit 740 and depacketizing it. The second depacketizer 752 generates an elementary stream (ES_3D) for 3D stereoscopic video additional data by receiving a packetized elementary stream (PES_3D) for the 3D stereoscopic video additional data from the TS analyzing unit 740 and depacketizing it. The third depacketizer 753 generates an elementary stream (ES_Au) for audio data by receiving a packetized elementary stream (PES_Au) for the audio data from the TS analyzing unit 740 and depacketizing it.

[78] If there is an input field inputted newly in connection with the 3D stereoscopic video additional data, as shown in Table 1, the second packetizer 752 of the depacketizing unit 750 fiirther performs a fiinction of discriminating each information by analyzing information on the 3D stereoscopic video additional data type, such as a video of another viewpoint, disparity information and depth information, in the header of the packetized elementary stream (PES_3D) for the 3D stereoscopic video additional data.

[79] The decoding unit 760 includes a first MPEG-2 decoder 761, an arbitrary decoder 762, and a third MPEG-2 decoder 763. The first MPEG-2 decoder 761 receives an elementary stream (ES JDri) for the original video from the depacketizing unit 750 and decodes it into the format of MPEG-2, which is the current broadcasting standard. The arbitrary decoder 762 receives an elementary stream (ES_3D) for 3D stereoscopic video additional data from the depacketizing unit 750 and decodes it efficiently. The third MPEG-2 decoder 763 receives an elementary stream (ES_Au) for audio data from the depacketizing unit750 and decodes it into the format of MPEG-2, which is the current broadcasting standard.

[80] The decoding unit 760 performs synchronization based on a PCR to synchronize the decoded elementary stream (ES JDri) for the original video, the decoded elementary stream (ES_3D) for the 3D stereoscopic video additional data, and the decoded elementary stream (ES_Au) for the audio data which are transmitted from the depacketizing unit 750

[81] The video combining unit 770 generates a 3D stereoscopic video by receiving the original video and 3D stereoscopic video additional data that are decoded in the decoding unit 760 and performing synchronization. Then, it outputs a 2D video of the original video for 2D display and a 3D stereoscopic video for 3D display to the video display unit 781.

[82] The video combining unit 770 synchronizes the original video and the 3D stereoscopic video additional data for generating a 3D stereoscopic video based on the PCR, which is a system clock, and Presentation Time Stamp (PTS) in a PES.

[83] The original video of the 2D video is a video of one viewpoint which becomes a reference to be compared with a video of another viewpoint. The 3D stereoscopic video additional data of the 3D stereoscopic video includes a video of another viewpoint which is different from the viewpoint of the original video or it includes a video of multi- viewpoints which has a plurality of viewpoints, and/or disparity information or depth information.

[84] The video combining unit 770 generates a 3D stereoscopic video by applying an appropriate 3D stereoscopic video generating algorithm according to the type of the 3D stereoscopic video additional data, i.e., a video of another viewpoint, disparity information and/or depth information.

[85] The outputting unit 780 includes a video displayer 781 for displaying a 2D video or a 3D stereoscopic video that are inputted from the video combining unit 770 and an audio data player 782 for outputting audio data inputted from the decoding unit 760.

[86] The outputting unit 780 outputs different information according to the display type selected by the user. If the user selects a 2D display type, it outputs a 2D video through the video displayer 781. If the user selects a 3D display type, it outputs a 3D stereoscopic video through the video displayer 781.

[87] Fig. 8 is a flowchart describing a 3D stereoscopic digital broadcast transmitting method using 3D stereoscopic video additional data in accordance with an embodiment of the present invention.

[88] At step S810, the original video and 3D stereoscopic video additional data are acquired in the video acquiring unit 110 and, at step S820, audio data are acquired in the audio acquiring unit 120

[89] Subsequently, at step S840, elementary streams are generated in the encoding unit 130 by encoding the original video and the 3D stereoscopic video additional data acquired in the video acquiring unit 110 and the audio data acquired in the audio acquiring unit 120

[90] At step S830, the acquired original video and the 3D stereoscopic video additional data are discriminated. At step S841, the original video are encoded by using an MPEG-2 encoder, which is a current broadcasting standard and, at step S842, the 3D stereoscopic video additional data are encoded by using an arbitrary encoder for efficient encoding to thereby generate transport streams. At step S843, the audio data acquired in the audio acquiring unit 120 are encoded by using the MPEG-2, which is the current broadcasting standard, to thereby generate elementary streams for the audio data.

[91] Subsequently, at step S850, program specific information is generated in the PIS generating unit 140, to discriminate the original video, 3D stereoscopic video additional data, and audio data.

[92] At step S860, packetized elementary streams are generated in the packetizing unit 150 by packetizing the elementary streams generated from the encoding process.

[93] Subsequently, at step S870, transport streams are generated in the TS generating unit 160 based on the above-generated program specific information and the above- generated packetized elementary streams.

[94] At step S880, the above-generated transport streams are multiplexed into one transport stream in the miltiplexing unit 170

[95] Subsequently, the miltiplexed transport stream is modulated in the modulating unit 180 and transmitted.

[96] Fig. 9 is a flowchart describing a 3D stereoscopic digital broadcast receiving method using 3D stereoscopic video additional data in accordance with an embodiment of the present invention.

[97] First, at step S 10, the modulated transport stream is received and demodulated in the demodulating unit 71Q

[98] Subsequently, at step S920, the transport stream (TS J°SI) for program specific information is demiltiplexed in the demiltiplexing unit 720 based on PID.

[99] At step S930, the PSI analyzing unit 730 analyzes program specific information based on the transport stream (TS J°SI) for program specific information.

[100] At step S940, the demiltiplexing unit 720 discriminates the transport streams based on the above analyzed program specific information and demiltiplexes them into transport streams.

[101] At step S950, the TS analyzing unit 740 analyzes the transport streams to thereby generate packetized elementary stream.

[102] At step S960, the depacketizing unit 750 depacketizes the above generated packetized elementary streams and generates elementary streams.

[103] At step S970 the decoding unit 760 decodes the depacketized elementary streams.

[104] At step S971, the first MPEG-2 decoder 761 decodes the elementary stream (ES JDri) for the original video into MPEG-2, which is the current broadcasting standard and, at step S972, the arbitrary decoder 762 decodes the ES for the 3D stereoscopic video additional data efficiently. At step S973, the second MPEG-2 decoder 761 decodes the elementary stream (ES_Au) for audio data into MPEG-2, which is the current broadcasting standard.

[105] Subsequently, at step S980, if a video display mode is inputted from the user and 3D is selected, the video combining unit 770 generates 3D stereoscopic video additional data by combining the decoded original video and the 3D stereoscopic video additional data. Otherwise, if 2D is selected, it bypasses original video.

[106] At step S990, the outputting unit 780 outputs a 2D video or 3D video according to the selection of the user along with audio data.

[107] Since the detailed process of the present invention is already described with re ference to Figs. 1 and 7, it will not be repeated herein.

[108] The method of the present invention can be embodied as a program and stored in a computer-readable recording medium such as CD-ROM, RAM, ROM, floppy disks, hard disks, magnetooptical disks and the like. Since the process can be easily implemented by those of ordinary skill in the art, it will not be described any firther herein.

[109] While the present invention has been described with respect to certain preferred embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the following claims.

[110] The present invention can secure compatibility with a 2D digital broadcasting system by defining and processing the 3D stereoscopic video additional data, such as a video of another viewpoint, disparity information or depth information as a transport stream synchronized with a 2D transport stream, which is different from the conventional method that supports only a 3D digital broadcasting system using a video of another viewpoint.

[Ill] Therefore, according to the present invention, although a broadcasting content based on a 3D stereoscopic video is received, users having the conventional digital broadcasting receiver can enjoy a 2D video broadcast and those having a 3D stereoscopic digital broadcast receiver can enjoy a 2D or 3D stereoscopic video broadcast.

[112] In addition, the 3D stereoscopic digital broadcast receiver of the present invention can be embodied in a simple manner.

Claims

[1] An apparatus for transmitting a three-dimensional (3D) stereoscopic digital broadcast signal using 3D stereoscopic video additional data, the apparatus comprising: a video acquiring means for acquiring an original video and 3D stereoscopic video additional data; an audio data acquiring means for acquiring audio data; an encoding means for encoding the original video and 3D stereoscopic video additional data transmitted from the video acquiring means and the audio data transmitted from the audio data acquiring means; a program specific information (PSI) generating means for generating PSI for discriminating each information; a packetizing means for generating packetized elementary stream (PES) by receiving and packetizing elementary streams (ESs) obtained from the encoding in the encoding means; a transport stream (TS) generating means for generating transport streams by receiving the PES from the packetizing means and the PSI from the PSI generating means; a miltiplexing means for miltiplexing the transport streams transmitted from the TS generating means into one transmission stream; and a modulating means for modulating the miltiplexed transport stream.

[2] The apparatus as recited in claim 1, wherein the 3D stereoscopic video additional data includes at least any one selected from the group containing another 3D video, which is a video of another viewpoint, disparity information, and depth information.

[3] The apparatus as recited in claim 1, wherein the PSI generating means generates PSI for discriminating the original video, the 3D stereoscopic video additional data, and audio data from each other.

[4] The apparatus as recited in claim 3, wherein the PSI generating means uses stream types (streamjype) defined in video and audio of a conventional digital broadcasting and newly defines a stream type (streamjype) of the 3D stereoscopic video additional data as a value defined as 'reserved' or 'user private' in the packet identifier (PID) information of a program map table (PMT) for performing discrimination based on each transport stream for compatibility between a two-dimensional (2D) digital broadcasting program and a 3D stereoscopic digital broadcasting system.

[5] The apparatus as recited in claim 1, wherein the packetizing means iurther performs a fiinction of additionally defining an input field for a 3D stereoscopic video additional data type in a header of a packetized elementary stream (PES_3D) for the 3D stereoscopic video additional data in order to discriminate the video of another viewpoint, the disparity information, the depth information, if there is a new input field needed in connection with the 3D stereoscopic video additional data.

[6] An apparatus for receiving a three-dimensional (3D) stereoscopic digital broadcast signal using 3D stereoscopic video additional data, the apparatus comprising: a demodulating means for demodulating a modulated signal by receiving a modulated transport stream (TS); a demultiplexing means for demiltiplexing the demodulated transport stream by receiving the demodulated transport stream from the demodulating means and program specific information (PSI) from a PSI analyzing means so as to produce transport streams; the PSI analyzing means for analyzing PSI by receiving a transport stream (TS J°SI) for PSI from the demultiplexing means and transmitting the analyzed PSI to the demiltiplexing means; a TS analyzing means for analyzing the transport streams by receiving the demiltiplexed transport streams from the demultiplexing means so as to generate PES; a depacketizing means for depacketizing the PES transmitted from the TS analyzing means so as to generate elementary streams (ESs); a decoding means for decoding the elementary streams transmitted from the depacketizing means; a video combining means for combining the original video and the 3D stereoscopic video additional data that are decoded in the decoding means so as to generate a 3D stereoscopic video; and an outputting means for outputting a 2D or 3D stereoscopic video received from the video combining means and audio data received from the decoding means.

[7] The apparatus as recited in claim 6, wherein the 3D stereoscopic video additional data include at least any one selected from the group consisting of another 3D video, which is a video of another viewpoint, disparity information, and depth information.

[8] The apparatus as recited in claim 6, wherein the demiltiplexing means separates a transport stream (TS J°SI) for program specific information from the demodulated transport stream transmitted from the demodulating means and transmits the TS J°SI to the PSI analyzing means, receives the PSI for discriminating each information such as packet identifier (PID) from the PSI analyzing means, and demiltiplexes a transport stream (TS JDri) for the original video, a transport stream (TS_3D) for the 3D stereoscopic video additional data, and a transport stream (TS_Au) for the audio data.

[9] The apparatus as recited in claim 8, wherein the demiltiplexing means transmits a TS packet having program association table (PAT) information to the PSI analyzing means by checking a PID value in a header of a demodulated transport stream transmitted from the demodulating means and finding out the TS packet having the PAT information, transmits a TS packet having a program map table (PMT) information to the PSI analyzing means by receiving a program number and a PID (Program nap °ID) for a PMT from the PSI analyzing means and finding out the TS packet having PMT information from a transport stream, and receives and demiltiplexes an elementary stream type (streamjype) and an elementary PID (elementary J°ID) from the PSI analyzing means into transport streams for each information, i.e., TS JDri, TS_3D and TS_Au.

[10] The apparatus as recited in claim 8, wherein the demiltiplexing means restores a system clock based on the program clock reference (PCR) of the transport stream (TS JDri) for the original video in order to synchronize the clock between the transmitting and receiving apparatuses.

[11] The apparatus as recited in claim 8, wherein the PSI analyzing means transmits PSI for discriminating each transport stream to the demultiplexing means by receiving a transport stream (TS J°SI) for program specific information from the demultiplexing means and analyzing PAT information and/or PID of a program map table.

[12] The apparatus as recited in claim 9, wherein the PSI analyzing means analyzes and transmits payload information of a TS packet having PAT information by receiving the TS packet having PAT information from the demultiplexing means to the demiltiplexing means; and analyzes and transmits payload information of a TS packet having PMT information by receiving the TS packet having PMT in- formation from the demultiplexing means to the demiltiplexing means.

[13] The apparatus as recited in claim 6, wherein the depacketizing means fiirther performs a fiinction of discriminating each information by analyzing a 3D stereoscopic video additional data type, such as a video of another viewpoint, disparity information and depth information, in the header of the packetized elementary stream (PES_3D) for 3D stereoscopic video additional data, if there is a new input field added in connection with the 3D stereoscopic video additional data.

[14] The apparatus as recited in claim 6, wherein the decoding means synchronizes an elementary stream (ES JDri) for the original video, an elementary stream (ES_3D) for 3D stereoscopic video additional data, and an elementary stream (ES_Au) for audio data, which are inputted from the depacketizing means, by using program clock reference (PCR).

[15] The apparatus as recited in claim 6, wherein the video combining means generates a 3D stereoscopic video by applying a 3D stereoscopic video generating algorithm based on the 3D stereoscopic video additional data tyep, such as a video of another viewpoint, disparity information, or depth information.

[16] The apparatus as recited in claim 6, wherein the video combining means synchronizes the original video and the 3D stereoscopic video additional data based on the PCR, which is a system clock, and PTS (PTS) of the PES.

[17] The apparatus as recited in claim 6, wherein the outputting means outputs a 2D video through a video displayer if the display type of a user selection signal is 2D and outputs a 3D stereoscopic video through the video displayer if the display type of a user selection signal is 3D.

[18] A method for transmitting a three-dimensional (3D) stereoscopic digital broadcast signal by using 3D stereoscopic video additional data, the method comprising the steps of: a) acquiring an original video, 3D stereoscopic video additional data and audio data; b) encoding the original video, the 3D stereoscopic video additional data and the audio data into a format appropriate for digital transmission to thereby generate elementary streams (ESs); c) generating packetized elementary stream (PES) by packetizing the elementary streams; d) generating program specific information (PSI) for discriminating each information, such as the original video, the 3D stereoscopic video additional data, and the audio data; e) generating transport streams based on the packetized elementary streams and the program specific information (PSI); f) miltiplexing the transport streams into one transport stream; and g) modulating and transmitting the miltiplexed transport stream.

[19] The method as recited in claim 18, wherein the 3D stereoscopic video additional data include at least any one selected from the group consisting of another 3D video, which is a video of another viewpoint, disparity information, and depth information.

[20] The method as recited in claim 18, wherein, in the step d), stream types (streamjype) defined in video and audio of a conventional digital broadcasting are used without change and a stream type (streamjype) of the 3D stereoscopic video additional data are newly defined as a value defined as 'reserved' or 'user private' in the PID of a program map table (PMT) for discriminating each transport stream for compatibility between a 2D digital broadcasting system and a 3D stereoscopic digital broadcasting system.

[21] A method for receiving a three-dimensional (3D) stereoscopic digital broadcast signal by using 3D stereoscopic video additional data, the method comprising the steps of: a) demodulating a modulated signal by receiving a modulated transport stream (TS); b) demultiplexing a transport stream (TS J°SI) for program specific information (PSI) based on packet identifier (PID); c) analyzing the program specific information based on a transport stream (TS J°SI) for program specific information; d) demiltiplexing a transport stream into transport streams based on the analyzed program specific information; e) generating a packetized elementary stream (PES) by analyzing the demiltiplexed transport streams; f) generating elementary streams (ESs) by depacketizing the PES; g) decoding the depacketized elementary streams; h) generating a 3D stereoscopic video by combining the decoded original video and the decoded 3D stereoscopic video additional data; and i) outputting a 2D or 3D stereoscopic video according to selection of a user and outputting audio data. [22] The method as recited in claim 21, wherein the 3D stereoscopic video additional data include at least any one selected from the group consisting of a video of another viewpoint, disparity information, and depth information. [23] The method as recited in claim 21, wherein, in the step c), PSI for discriminating each transport stream is generated by receiving a transport stream (TS J°SI) for program specific information and analyzing PAT information and/or PID of a program map table.