EP0788289A2 - Multimedia information processing system - Google Patents
Multimedia information processing system Download PDFInfo
- Publication number
- EP0788289A2 EP0788289A2 EP96112767A EP96112767A EP0788289A2 EP 0788289 A2 EP0788289 A2 EP 0788289A2 EP 96112767 A EP96112767 A EP 96112767A EP 96112767 A EP96112767 A EP 96112767A EP 0788289 A2 EP0788289 A2 EP 0788289A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- transmission
- stream
- multimedia information
- processing system
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/54—Store-and-forward switching systems
- H04L12/56—Packet switching systems
- H04L12/5601—Transfer mode dependent, e.g. ATM
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/04—Selecting arrangements for multiplex systems for time-division multiplexing
- H04Q11/0428—Integrated services digital network, i.e. systems for transmission of different types of digitised signals, e.g. speech, data, telecentral, television signals
- H04Q11/0478—Provisions for broadband connections
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/54—Store-and-forward switching systems
- H04L12/56—Packet switching systems
- H04L12/5601—Transfer mode dependent, e.g. ATM
- H04L2012/5603—Access techniques
- H04L2012/5609—Topology
- H04L2012/561—Star, e.g. cross-connect, concentrator, subscriber group equipment, remote electronics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/54—Store-and-forward switching systems
- H04L12/56—Packet switching systems
- H04L12/5601—Transfer mode dependent, e.g. ATM
- H04L2012/5614—User Network Interface
- H04L2012/5616—Terminal equipment, e.g. codecs, synch.
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/54—Store-and-forward switching systems
- H04L12/56—Packet switching systems
- H04L12/5601—Transfer mode dependent, e.g. ATM
- H04L2012/5638—Services, e.g. multimedia, GOS, QOS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/54—Store-and-forward switching systems
- H04L12/56—Packet switching systems
- H04L12/5601—Transfer mode dependent, e.g. ATM
- H04L2012/5638—Services, e.g. multimedia, GOS, QOS
- H04L2012/5646—Cell characteristics, e.g. loss, delay, jitter, sequence integrity
- H04L2012/5652—Cell construction, e.g. including header, packetisation, depacketisation, assembly, reassembly
Definitions
- the present invention relates to a multimedia information processing system in which a digitalized video signal, an audio signal and other data are coded, multiplexed, and then, transmitted or stored, and the transmitted signal or the stored signal are demultiplexed, and then, decoded to generate the video signal, audio signal and other data.
- a video on demand (VOD) a digital broadcasting system
- a video conference system a video conference system
- Fig. 10 is a block diagram showing a structure of a video encoder (transmitter) forming a conventional multimedia information processing system described in "A Video Codec for Digital Satellite News gathering Systems", Mitsubishi Electric Corporation Technical Publication, Vol. 67, No. 7, pp 33 - 38, 1993.
- reference numeral 91 is an information-source coding section which inputs a video signal 101, an audio signal 102, and the other data signal 103 and executes data compression for those signals.
- a video coding portion 51 executes information-source coding of the video signal 101 to generate the video coded bits sequence 111.
- An audio coding portion 512 executes information-source coding of one or more audio signals 102 to generate one or more audio coded bits sequences 112.
- the data coding portion 513 executes various processings concerning the data signal 103 relating to the video signal 101 or the audio signal 102 to generate a data coded bits sequence 113.
- a media multiplexing section 92 multiplexes the video coded bits sequence 111, the audio coded bits sequence 112 and the data coded bits sequence 113 from the information-source coding section 91 to generate one multiplexed bits sequence 122.
- a transmission processing section 93 provides the multiplexed bits sequence 122 with scramble processing and error correction coding in accordance with the types and characteristics of the transmission line. The transmission processing section 93 further executes channel multiplexing processing for the multiplexed bits sequence 122 and one or more other multiplexed bits sequences 123. Furthermore, the transmission processing section 93 executes the formation of a transmission frame and modulating processing and so on are executed to generate a transmission signal 141.
- Fig. 11 is a block diagram showing a structure of a video decoder (receiver) forming the multimedia information processing system described in the above report.
- reference numeral 96 denotes a receive processing section which receives the transmission signal 141, executes demodulating processing, synchronization of the transmission frame, regeneration of the transmission frame and separation of the channel multiplexing processing to select a specific channel signal.
- the receive processing section 96 further executes error detecting processing, error correcting processing and descramble processing or the like to reproduce multiplexed bits sequence 122 or one or more other multiplexed bits sequences 123.
- a media demultiplexing section 95 separates the multiplexed bits sequence 122 into the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113.
- An information-source decoding section 94 inputs the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113 and also outputs the video signal 101, one or more audio signals 102 and one or more data signals 103.
- a video decoding portion 514 executes information-source decoding of the video coded bits sequence 111 to reproduce the video signal 101.
- An audio decoding portion 515 executes information-source decoding of the one or more audio coded bits sequences 112 to reproduce the audio signal 102 relating to the video signal 101.
- a data decoding portion 516 executes various reverse processings to the data coded bits sequence 113 to reproduce the data signal 103 relating to the video signal 101 and audio signal 102.
- Fig. 13 is an explanatory diagram showing a general function of the transmission processing section 93 and the receive processing section 96.
- the transmission processing section 93 inputs multiplexed bits sequences and produces transmission signals by performing a framing process, modulation process and physical layer process.
- the receive processing section 96 receives transmission signals and reproduces multiplexed bits sequences by performing physical layer process, demodulation process and deframing process.
- the information-source coding section 91 reduces redundant components of the respective signals by use of information-source coding method.
- Information of the video signal 101 and the one or more audio signals 102 which are accompanied therewith are coded in a video coding portion 511 and audio coding portion 512 respectively.
- Information of the data signal 103 including synchronization signals and control signals relating to the video signal and audio signal are also coded in a data coding portion 513 as in the case of the video signal and audio signal, thereby converting the data structure to form one or more data coded bits sequences 113.
- the media multiplexing section 92 multiplexes the video coded bits sequence 111, audio coded bits sequence 112 and data coded bits sequence 113 into one multiplexed bits sequence 122.
- the multiplexing is executed by use of a given frame as a unit.
- Fig. 12 is an explanatory view explaining multiplexed frame generated in the media multiplexing section 92.
- a predetermined sized multiplexed frame 80 is composed of a synchronizing information area 81 for securing the synchronization of the multiplexed frame, a video information area 82, audio information area 83 and a data information area 84.
- the video coded bits sequence 111, the audio coded bits sequence 112 and the data coded bits sequence 113 are provided in the video information area 82, the audio information area 83, and the data information area 84 respectively and are read out in the order shown with arrow in Fig. 12 (from the left upper portion to the right lower portion), so that the multiplexed bits sequence 122 is generated.
- structure multiplexing To multiplex signals using such a multiplexed frame as a unit is referred to as "structure multiplexing" in this specification.
- the transmission processing section 93 executes scramble processing for the multiplexed bits sequence 122 and adds error correcting codes to the multiplexed bits sequence 122. Further, the transmission processing section 93 executes channel multiplexing for the multiplexed bits sequence 122 and other one or more multiplexed bits sequences 123 to generate a transmission frame. The transmission processing section 93 then executes modulation processing or the like for the transmission frame to generate a transmission signal 141.
- Fig. 14 (a) shows one example of a circuit that realize a scramble processing referred to as a PN (Pseudo Noise) signal summing system.
- reference numeral 73a denotes a pseudo random number generator for scramble and 75 an exclusive-OR circuit.
- the random number generator 73a generates a pseudo random number sequence 74a responsive to an initial value 72a.
- the exclusive-OR circuit 75 executes exclusive-OR operation of original data 71 and the pseudo random number sequence 74 a as a bit unit to obtain scrambled data 76.
- Fig. 15 is a block diagram of an error correction frame 77 in a case where the Reed-Solomon (RS) code is used as the error correction code.
- reference numeral 78a denotes synchronizing information to establish synchronization of the error correction frame 77, 78b M bytes code word (RS (M, M- N) code word), 79a an information field which stores N bytes information symbols which is protected by the error correction coding, and 79b a check field which stores check symbols which is added to detect error detection.
- RS Reed-Solomon
- a channel multiplexing method for the P channels in the transmission processing section 93 will be described with reference to Fig. 16. Each channel corresponds to each program in television broadcasting for example.
- a channel multiplexing frame 90 includes synchronizing information 90a to establish synchronization of the channel multiplexing frame 90. The channel multiplexing is executed by using the structure multiplexing system.
- a transmission frame 85 is defined in dependence on the characteristics of the transmission line.
- Various transmission frames are defined in accordance with the respective types such as the cable transmission, satellite wave transmission and ground wave transmission and so on.
- Fig. 17 shows one embodiment of a structure of a transmission frame.
- a transmission frame 85 is composed of an additional information area 86 and a transmission information area (payload) 87. Timing information, synchronizing information and information that is used for securing the transmission line, or the like are contained in the additional information area 86.
- the information that forms the transmission frame 85 is read out in a desired order shown with the arrows in Fig. 17. After the transmission frame 85 was modulated, it is sent to a transmission line as a transmission signal 141.
- the receive processing section 96 demodulated the received transmission signal 141, it establishes the synchronization of the transmission frame 85 and reproduces, using the synchronizing information in the additional information area 86, and takes out the transmission information area 87.
- the receive processing section 96 establishes the synchronization of the channel multiplexing frame 90 and reproduces, using the synchronizing information 90a, and separates the respective channel information.
- the receive processing section 96 establishes synchronization of the error correction frame 77 and reproduces, using the synchronizing information 78a. After that, the receive processing section 96 detects errors and correct them.
- Fig. 14 (b) Descramble processing in the receive processing section 96 will be described using Fig. 14 (b).
- reference numeral 73b denotes a pseudo random number generator for descramble and 75 an exclusive-OR circuit.
- the pseudo random number generator 73b to which an initial value 72b is given generates a pseudo random number sequence 74b.
- the pseudo random number generator 73b in a descramble circuit has the same structure as the pseudo random number generator 73a shown in Fig. 14 (a).
- the initial value 72a is the same as the initial value 72b.
- the value of the pseudo random number sequence 74a coincides with that of the pseudo random number sequence 74b.
- the media demultiplexing section 95 separates the multiplexed bits sequence 122 into the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113.
- the generation of the multiplexing frame 80 necessary for the separation is executed by using synchronizing information contained in the synchronizing information area 81 within the multiplexing frame 80.
- the video coded bits sequence 111, audio coded bits sequence 112, and data coded bits sequence 113 are respectively decoded through information-source decoding or various reverse processing by the video decoding section 514, audio decoding section 515 and data decoding section 516 to reproduce the video signal 101, the audio signal 102 relating to the video signal 101 and the data signal 103 relating to the video signal 101 or audio signal 102.
- the video signal, audio signal, and other data have been structure-multiplexed by storing them in given areas in multiplexing frames, multiplexing processing difficult to deal with change in the transmission speed of information to be multiplexed from the respective media and existence of information from the respective media. Further, in a case where the number of media are large, the size of the multiplexing frame must be enlarged. As a result, long time has been required for establishing synchronization of the multiplexing frame on the receiver side.
- the transmission processing section 93 and the receive processing section 96 are realized as shown in Fig. 13.
- the transmission processing section 93 and the receive processing section 96 should perform ATM physical layer process, ATM layer process, and ATM adaptation layer process as shown in Fig. 18.
- adapters are required. The adapters must include both functions shown in Figs. 13 and 18 if multiplexed bits streams in both systems are same.
- the present invention has been made to solve the above problems.
- the object of the present invention is to provide a multimedia information processing system which can exchange contents of media easily if different transmission means are used and to provide a multimedia information processing system which can rapidly transmit contents to another system through a plurality of transmission means.
- a transmitter comprises: information-source coding processing means for inputting a plurality of media information and coding each media information independently to other media information; packet multiplexing means for producing a multiplexed stream by packet-multiplexing coded bits streams produced by the information-source coding processing means, each stream independent to other streams; fixed length packet producing means for allocating the multiplexed stream into a fixed length packet; and transmission coding means for producing a transmission signal from the fixed length packet.
- processes from a process of inputting elements of media to a process of remultiplexing and transmitting are constructed hierarchically.
- Such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on.
- the fixed length packet producing means allocates the multiplexed stream into an ATM cell.
- the system can easily adopt to ATM cells which are fixed length packets.
- the transmission coding means executes transmission processing of ATM physical layer. Thus, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
- a receiver comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal; fixed length packet disassembling means for extracting a multiplexed stream from the fixed packets stream; media separating means for reproducing coded bits streams for respective media from the multiplexed stream, each bits stream independent to other bits stream; and information-source decoding processing means for decoding the coded bits streams for respective media.
- processes from a receiving process to reproducing process of elements of media are constructed hierarchically.
- Such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on.
- the fixed length packet disassembling means extracts the multiplexed stream from an ATM cells stream.
- the system can easily adopt to ATM cells which are fixed length packets.
- the transmission decoding means executes receive processing of ATM physical layer. Thus, it becomes to be possible to receive and decode transmit signals which adapt to a characteristic of the ATM network.
- a relay station comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal from a transmitter; signal change processing means for executing changing process for the fixed packets stream; and transmission coding means for producing a transmission signal corresponding to a characteristic of a transmission line from the fixed packets stream.
- the construction for exchanging signals between different transmission means is simplified. Thus, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system.
- the transmission decoding means reproduces an ATM cells stream as the fixed packets stream, and the transmission coding means produces the transmission signal from said ATM cells stream.
- the signal change processing means includes broadcast processing means for executing broadcast control so as to transmit the transmission signal to a plurality of receivers.
- the broadcast processing means writes addresses of receivers in headers of the fixed length packets.
- the broadcast processing section can add destination addresses to the fixed packets stream directly.
- a broadcast transmission is easily achieved.
- Fig. 1 is a block diagram showing another transmitter of a multimedia information processing system according to the present invention.
- reference numeral 100 denotes an information-source coding section for performing information-source coding a video signal 11a, an audio signal 11b and a data signal 11c, 200 a media multiplexing section for producing a multiplexed stream 12 by multiplexing coded bits stream 12a, 12b, 12c from the information-source coding section 100, 300 a fixed length packet generating section for producing a fixed length packet 14 from a multiplexed stream 13, and 400 a transmission coding section for producing a transmission signal 15.
- Fig. 2 is a block diagram showing a construction of the information-source coding section 100.
- the information-source coding section 100 comprises a video coding portion 61 coding video signals 11a, an audio coding portion 62 coding audio signals 11b and a data coding portion 63 coding data signals 11c.
- the video coding portion 61 cuts redundant components of the video signal 11a by using one of a plurality of information-source coding methods and produces a video coded bits stream 12a.
- the video coding portion 61 outputs the video coded bits stream 12a.
- the audio coding portion 62 cuts redundant components of the audio signal 11b by using one of a plurality of information-source coding methods and produces an audio coded bits stream 12b.
- the audio coding portion 62 outputs the audio coded bits stream 12b.
- the data coding portion 63 inputs synchronizing signals, controlling signals and so on of the video signal 11a and the audio signal 11b, and cuts redundant components of the data signal 11c as same as those of the video signals 11a and the audio signals 11b. If required, the data coding portion 63 changes data structure of data signal 11c and produces a data coded bits stream 12c. The data coding portion 63 outputs the data coded bits stream 12c.
- the media multiplexing section 200 performs a media multiplexing of coded bits streams 12a, 12b, 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard.
- the media multiplexing section 200 performs multiplexing in a unit of a packet and produces a multiplexed stream so-called transport stream (TS) or program stream (PS).
- TS transport stream
- PS program stream
- the fixed length packet generating section 300 allocates multiplexed stream 13 into a fixed length packet 14.
- Fig. 3 is an explanatory diagram showing a reference between a multiplexed stream 13 using TS packet and a fixed length packet 14 using an ATM cell.
- two TS packets are allocated into a payload on CPCS (Common Part Convergence Sublayer)-PDU (Protocol data Unit) of ATM adaptation layer (AAL), type 5.
- a TS packet comprises 188 bytes.
- PS packets are allocated into an ATM cell, it is suitable that they are set in a CPCS-PDU payload of AAL, type 5 such that a leading portion of the PS packet, generally variable length packet, is coincide to a leading portion of the payload. It is also suitable that PS packets are set in a CPCS-PDU payload of AAL, type 5 such that a length of PS packet is equivalent to a length of the CPCS-PDU payload and a leading portion of the PS packet is coincide to a leading portion of the payload. Further, it is possible that variable length PS packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
- TS or PS packets are packed into a payload (47 bytes) of AAL, type 1.
- TS or PS packets are packed into a payload such that a leading portion of the TS or PS packet is coincide to a leading portion of the payload as same as in the case regarding ALL, type 5.
- variable length packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
- Fig. 4 is a block diagram showing a construction of the transmission coding section 400.
- the transmission coding section 400 inputs fixed length packets stream such as an ATM cells stream and produces transmission signals by framing including scrambling and adding error correction codes, modulating and performing physical layer process corresponding to a variation and a characteristic of the transmission line.
- the transmission coding section 400 includes a function of ATM physical layer processing as shown in Fig. 5.
- processes from a process of inputting elements of media to a process of re-multiplexing and transmitting are constructed hierarchically.
- such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on.
- the fixed length packet generating section 300 allocates multiplexed stream 13 into a fixed length packet, the system can easily adopt to ATM cells which are fixed length packets.
- the transmission coding section 400 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
- Fig. 6 is a block diagram showing another receiver of a multimedia information processing system according to the present invention.
- reference numeral 500 denotes a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixed length packets 14, 600 a fixed packet demultiplexing section for disassembling a fixed length packet 14 into a multiplexed stream 13, 700 a media demultiplexing section for reproducing coded bits streams 12a, 12b, 12c by demultiplexing a fixed length packet 14, and 800 a information-source decoding section for reproducing a video signal 11a, an audio signal 11b and a data signal 11c from the bits streams 12a, 12b, 12c.
- Fig. 7 is a block diagram showing a construction of the information-source decoding section 800.
- the information-source decoding section 800 comprises a video decoding portion 64 decoding and reproducing video signals 11a, an audio decoding portion 65 decoding and reproducing audio signals 11b and a data decoding portion 66 decoding and reproducing data signals 11c.
- the transmission decoding section 500 performs demodulating process when the section 500 receives a transmission signal 15. Next, the section 500 synchronizes demodulated transmission frame and reproduces a transmission frame. Further, the section 500 reproduces fixed length packets 14 by correcting errors in the frame and so forth.
- the transmission decoding section 500 should include a function of ATM physical layer processing as shown in Fig. 5.
- the fixed packet demultiplexing section 600 extracts payloads from fixed length packets 14 and reproduces a multiplexed stream 13.
- a multiplexed stream 13 based on TS packets is reproduced as shown in Fig. 5.
- the media demultiplexing section 700 demultiplexes the multiplexed stream into a video coded stream 12a, an audio coded stream 12b and a data coded stream 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard.
- the video decoding portion 64 reproduces video signals 11a from the video coded stream 12a by contrary processing of the processing in the video coding portion 61.
- the audio decoding portion 65 reproduces audio signals 11b from the audio coded stream 12b by contrary processing of the processing in the audio coding portion 62.
- the data decoding portion 66 reproduces data signals 11c from the data coded stream 12c by contrary processing of the processing in the data coding portion 63.
- processes from a receiving process to reproducing process of elements of media are constructed hierarchically.
- such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on.
- the fixed length packet demultiplexing section 600 extracts multiplexed stream 13 from fixed length packets, the system can easily adopt to ATM cells which are fixed length packets.
- the transmission decoding section 500 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to receive and decode transmitted signals which adapt to a characteristic of the ATM network.
- Fig. 8 is a block diagram showing a relay station of a multimedia information processing system according to the present invention.
- reference numeral 400 denotes a transmission coding section for producing a transmission signal 15, 500 a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixed length packets 14, and 900 a broadcast processing section for adding information based on destination address information 16 to a fixed length packet 14 if necessary.
- the broadcast processing section 900 is an example of signal change processing means for changing signals of a fixed length packet stream.
- the section 900 can perform signal changing process, address adding process in this case, for a fixed length packet stream which is independent from a characteristic of each transmission line connected to the system.
- Fig. 9 is a system construction diagram showing an aspect of connections between multimedia information processing systems.
- 1001 denotes a transmission station, 201 a relay station, 301 a receiver on an ATM network connected to a relay station 201 through an ATM switch 280, 301 a receiver connected directly to a relay station.
- relay stations 201 are connected to the transmission station 1001 through an ATM network. It will be explained that a relay station 201 connected to the ATM switch 280 and the receivers 302 transmits a transmission signal from the transmission station 1001 to the receivers 301 through the ATM switch 280.
- ATM cells are used as fixed length packets 14 for example.
- the transmission decoding section 500 includes a function of ATM physical layer processing as shown in Fig. 5.
- the transmission coding section 400 in each relay station 201 connected to the ATM switch 280 among all relay stations 201 includes a function of ATM physical layer processing as shown in Fig. 5.
- the transmission decoding section 500 in the relay station 201 which is connected to the ATM switch 280, receives a transmission signal 15 from the transmission station 1001 and reproduces fixed length packets 14.
- the packets 14 are transferred to the broadcast processing section 900.
- the broadcast processing section 900 reproduces a plurality of fixed length packets 14 for destination receivers by copying input fixed length packet 14.
- the section 900 adds each address to a header of each packet 14.
- Each packet 14 is transferred to the transmission coding section 400.
- the section 400 delivers each packet 14 to each address. In this case, the section 400 delivers the packet 14 to the ATM network through the ATM switch 280. In the ATM network, each packet 14 is transferred to each receiver 301 corresponding to the address.
- each receiver 301 can receive a signal modulated by QAM.
- the transmission coding section 400 in each relay station 201 which is connected to the ATM switch 280 and receivers 302, includes a function of a framing process containing scrambling process and error correcting process, modulating process of QAM modulation for example, and physical layer process as shown in Fig. 4 in addition to the ATM physical layer process as shown in Fig. 5.
- the transmission decoding section 500 in the relay station 201 receives a transmission signal 15 from the transmission station 1001 and reproduces fixed length packets 14.
- the packets 14 are transferred to the broadcast processing section 900.
- the broadcast processing section 900 transfers the packet 14 to the transmission coding section 400 as it is.
- the section 400 produces a transmission signal 15 based on QAM modulation from input packets 14.
- the transmission signal 15 is transmitted to the receivers 302.
- a relay station 201 which does not include the ATM network as a destination of transmitted signals, can be constructed without a broadcast processing section 900.
- the relay station is constructed such that the transmission decoding section 500 reproduces a fixed length packet stream instead of a multiplexed bits stream from received transmission signal 15 and the transmission coding section 400 changes the fixed length packet stream into a transmission signal 15 corresponding to a characteristic of the transmission line, the construction for exchanging signals between different transmission means is simplified. In other words, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system. Further, a transmission of contents through a plurality of transmission means is rapidly performed by simpler construction.
- the transmission coding section 400 for transmitting a signal based on QAM or PSK modulation is constructed as shown in Fig. 4.
- the transmission decoding section 500 for receiving a signal based on QAM or PSK modulation is also constructed as shown in Fig. 4.
- the transmission coding section 400 for transmitting a signal to an ATM network is constructed as shown in Fig. 5.
- the transmission decoding section 500 for receiving a signal to an ATM network is also constructed as shown in Fig. 5.
- an adapter for exchanging contents of media between a multimedia information processing system connected to an ATM network and another multimedia information processing system connected to a transmission means transmitting QAM modulated wave may include functions shown in Figs. 4 and 5.
- an adapter should include functions shown in Figs. 13 and 18.
- a fixed packets stream is transferred between the transmission decoding section 500 and the transmission coding section 400 in the relay station 201.
- the transmission decoding section 500 reproduces an ATM cells stream from an ATM transmission signal outputted from an ATM network or a QAM modulated wave as a transmission signal.
- the transmission coding section 400 produces an ATM transmission signal or a QAM modulated wave as a transmission signal from an ATM cells stream.
- the broadcast processing section 900 can add destination addresses to the fixed packets stream directly. Thus, a broadcast transmission is easily achieved.
Abstract
Description
- The present invention relates to a multimedia information processing system in which a digitalized video signal, an audio signal and other data are coded, multiplexed, and then, transmitted or stored, and the transmitted signal or the stored signal are demultiplexed, and then, decoded to generate the video signal, audio signal and other data. As specific applications of the multimedia information processing system, there are a video on demand (VOD), a digital broadcasting system, and a video conference system.
- Fig. 10 is a block diagram showing a structure of a video encoder (transmitter) forming a conventional multimedia information processing system described in "A Video Codec for Digital Satellite News gathering Systems", Mitsubishi Electric Corporation Technical Publication, Vol. 67, No. 7, pp 33 - 38, 1993.
- In Fig. 10,
reference numeral 91 is an information-source coding section which inputs avideo signal 101, anaudio signal 102, and theother data signal 103 and executes data compression for those signals. In the information-source coding section 91, a video coding portion 51 executes information-source coding of thevideo signal 101 to generate the video codedbits sequence 111. Anaudio coding portion 512 executes information-source coding of one ormore audio signals 102 to generate one or more audio codedbits sequences 112. Thedata coding portion 513 executes various processings concerning thedata signal 103 relating to thevideo signal 101 or theaudio signal 102 to generate a data codedbits sequence 113. - A
media multiplexing section 92 multiplexes the video codedbits sequence 111, the audio codedbits sequence 112 and the data codedbits sequence 113 from the information-source coding section 91 to generate onemultiplexed bits sequence 122. Atransmission processing section 93 provides themultiplexed bits sequence 122 with scramble processing and error correction coding in accordance with the types and characteristics of the transmission line. Thetransmission processing section 93 further executes channel multiplexing processing for themultiplexed bits sequence 122 and one or more othermultiplexed bits sequences 123. Furthermore, thetransmission processing section 93 executes the formation of a transmission frame and modulating processing and so on are executed to generate atransmission signal 141. - Fig. 11 is a block diagram showing a structure of a video decoder (receiver) forming the multimedia information processing system described in the above report. In Fig. 11,
reference numeral 96 denotes a receive processing section which receives thetransmission signal 141, executes demodulating processing, synchronization of the transmission frame, regeneration of the transmission frame and separation of the channel multiplexing processing to select a specific channel signal. The receiveprocessing section 96 further executes error detecting processing, error correcting processing and descramble processing or the like to reproducemultiplexed bits sequence 122 or one or more othermultiplexed bits sequences 123. - A
media demultiplexing section 95 separates themultiplexed bits sequence 122 into the video codedbits sequence 111, one or more audio codedbits sequences 112 and one or more data codedbits sequences 113. - An information-
source decoding section 94 inputs the video codedbits sequence 111, one or more audio codedbits sequences 112 and one or more data codedbits sequences 113 and also outputs thevideo signal 101, one ormore audio signals 102 and one ormore data signals 103. In the information-source decoding section 94, avideo decoding portion 514 executes information-source decoding of the video codedbits sequence 111 to reproduce thevideo signal 101. Anaudio decoding portion 515 executes information-source decoding of the one or more audio codedbits sequences 112 to reproduce theaudio signal 102 relating to thevideo signal 101. Adata decoding portion 516 executes various reverse processings to the data codedbits sequence 113 to reproduce thedata signal 103 relating to thevideo signal 101 andaudio signal 102. - Fig. 13 is an explanatory diagram showing a general function of the
transmission processing section 93 and thereceive processing section 96. As shown in Fig. 13, thetransmission processing section 93 inputs multiplexed bits sequences and produces transmission signals by performing a framing process, modulation process and physical layer process. The receiveprocessing section 96 receives transmission signals and reproduces multiplexed bits sequences by performing physical layer process, demodulation process and deframing process. - Operations in the transmission side of the multimedia information processing system will now be described. The information-
source coding section 91 reduces redundant components of the respective signals by use of information-source coding method. Information of thevideo signal 101 and the one ormore audio signals 102 which are accompanied therewith are coded in avideo coding portion 511 andaudio coding portion 512 respectively. Information of thedata signal 103 including synchronization signals and control signals relating to the video signal and audio signal are also coded in adata coding portion 513 as in the case of the video signal and audio signal, thereby converting the data structure to form one or more data codedbits sequences 113. - The
media multiplexing section 92 multiplexes the video codedbits sequence 111, audio codedbits sequence 112 and data codedbits sequence 113 into onemultiplexed bits sequence 122. The multiplexing is executed by use of a given frame as a unit. Fig. 12 is an explanatory view explaining multiplexed frame generated in themedia multiplexing section 92. As shown in Fig. 12, a predetermined sized multiplexedframe 80 is composed of a synchronizinginformation area 81 for securing the synchronization of the multiplexed frame, avideo information area 82,audio information area 83 and adata information area 84. The video codedbits sequence 111, the audio codedbits sequence 112 and the data codedbits sequence 113 are provided in thevideo information area 82, theaudio information area 83, and thedata information area 84 respectively and are read out in the order shown with arrow in Fig. 12 (from the left upper portion to the right lower portion), so that themultiplexed bits sequence 122 is generated. To multiplex signals using such a multiplexed frame as a unit is referred to as "structure multiplexing" in this specification. - The
transmission processing section 93 executes scramble processing for themultiplexed bits sequence 122 and adds error correcting codes to themultiplexed bits sequence 122. Further, thetransmission processing section 93 executes channel multiplexing for themultiplexed bits sequence 122 and other one or moremultiplexed bits sequences 123 to generate a transmission frame. Thetransmission processing section 93 then executes modulation processing or the like for the transmission frame to generate atransmission signal 141. - The scramble processing in the
transmission processing section 93 will be described using Fig. 14 (a). Fig. 14 (a) shows one example of a circuit that realize a scramble processing referred to as a PN (Pseudo Noise) signal summing system. In Fig. 14 (a),reference numeral 73a denotes a pseudo random number generator for scramble and 75 an exclusive-OR circuit. Therandom number generator 73a generates a pseudorandom number sequence 74a responsive to an initial value 72a. The exclusive-OR circuit 75 executes exclusive-OR operation oforiginal data 71 and the pseudorandom number sequence 74 a as a bit unit to obtain scrambleddata 76. - A structure of the error correction frame in a case where the
transmission processing section 93 executes error correction coding will be described. Fig. 15 is a block diagram of anerror correction frame 77 in a case where the Reed-Solomon (RS) code is used as the error correction code. In Fig. 15reference numeral 78a denotes synchronizing information to establish synchronization of theerror correction frame - A channel multiplexing method for the P channels in the
transmission processing section 93 will be described with reference to Fig. 16. Each channel corresponds to each program in television broadcasting for example. Achannel multiplexing frame 90 includes synchronizinginformation 90a to establish synchronization of thechannel multiplexing frame 90. The channel multiplexing is executed by using the structure multiplexing system. - A transmission frame will be described with reference to Fig. 17. The transmission frame is defined in dependence on the characteristics of the transmission line. Various transmission frames are defined in accordance with the respective types such as the cable transmission, satellite wave transmission and ground wave transmission and so on. Fig. 17 shows one embodiment of a structure of a transmission frame. As shown in Fig. 17, a
transmission frame 85 is composed of anadditional information area 86 and a transmission information area (payload) 87. Timing information, synchronizing information and information that is used for securing the transmission line, or the like are contained in theadditional information area 86. The information that forms thetransmission frame 85 is read out in a desired order shown with the arrows in Fig. 17. After thetransmission frame 85 was modulated, it is sent to a transmission line as atransmission signal 141. - Next, operations on the receive side of the multimedia information processing system will be described. The operations on the receive side is reverse to those on the transmission side, which were previously described. Namely, after the receive
processing section 96 demodulated the receivedtransmission signal 141, it establishes the synchronization of thetransmission frame 85 and reproduces, using the synchronizing information in theadditional information area 86, and takes out thetransmission information area 87. In a case where a signal in thetransmission information area 87 is channel multiplexed, the receiveprocessing section 96 establishes the synchronization of thechannel multiplexing frame 90 and reproduces, using the synchronizinginformation 90a, and separates the respective channel information. When each channel information is an error correction coded signal, the receiveprocessing section 96 establishes synchronization of theerror correction frame 77 and reproduces, using the synchronizinginformation 78a. After that, the receiveprocessing section 96 detects errors and correct them. - Descramble processing in the receive
processing section 96 will be described using Fig. 14 (b). In Fig. 14 (b),reference numeral 73b denotes a pseudo random number generator for descramble and 75 an exclusive-OR circuit. The pseudorandom number generator 73b to which aninitial value 72b is given generates a pseudorandom number sequence 74b. The pseudorandom number generator 73b in a descramble circuit has the same structure as the pseudorandom number generator 73a shown in Fig. 14 (a). The initial value 72a is the same as theinitial value 72b. The value of the pseudorandom number sequence 74a coincides with that of the pseudorandom number sequence 74b. - The
media demultiplexing section 95 separates the multiplexedbits sequence 122 into the video codedbits sequence 111, one or more audio codedbits sequences 112 and one or more data codedbits sequences 113. The generation of themultiplexing frame 80 necessary for the separation is executed by using synchronizing information contained in the synchronizinginformation area 81 within the multiplexingframe 80. - In the information-
source decoding section 94, The video codedbits sequence 111, audio codedbits sequence 112, and data codedbits sequence 113 are respectively decoded through information-source decoding or various reverse processing by thevideo decoding section 514,audio decoding section 515 anddata decoding section 516 to reproduce thevideo signal 101, theaudio signal 102 relating to thevideo signal 101 and the data signal 103 relating to thevideo signal 101 oraudio signal 102. - Since a conventional multimedia information processing system is constructed as described above, the processing contents in each processing section and the interface signal between the respective processing sections are fixedly indexed. Consequently, the conventional multimedia information lacks wide usableness.
- Therefore, it is difficult to execute data exchange service among broadcasting system, communication system and storage system in computer. Further, it has been difficult to build hardware and add processing functions while maintaining interchangeable properties with other multimedia information processing systems.
- Since, in the conventional multimedia information processing system, the video signal, audio signal, and other data have been structure-multiplexed by storing them in given areas in multiplexing frames, multiplexing processing difficult to deal with change in the transmission speed of information to be multiplexed from the respective media and existence of information from the respective media. Further, in a case where the number of media are large, the size of the multiplexing frame must be enlarged. As a result, long time has been required for establishing synchronization of the multiplexing frame on the receiver side.
- In case the transmission line is a general line and the transmission signal is a modulated wave by Quadrature Amplitude Modulation (QAM) or Phase Shift Keying (PSK) for example, functions of the
transmission processing section 93 and the receiveprocessing section 96 are realized as shown in Fig. 13. However, in case the transmission line is an ATM network, thetransmission processing section 93 and the receiveprocessing section 96 should perform ATM physical layer process, ATM layer process, and ATM adaptation layer process as shown in Fig. 18. In case contents of media are exchanged between a multimedia information processing system connected to an ATM network and another multimedia information processing system connected to a general transmission line, adapters are required. The adapters must include both functions shown in Figs. 13 and 18 if multiplexed bits streams in both systems are same. - The present invention has been made to solve the above problems. The object of the present invention is to provide a multimedia information processing system which can exchange contents of media easily if different transmission means are used and to provide a multimedia information processing system which can rapidly transmit contents to another system through a plurality of transmission means.
- In a multimedia information processing system according to the present invention, a transmitter comprises: information-source coding processing means for inputting a plurality of media information and coding each media information independently to other media information; packet multiplexing means for producing a multiplexed stream by packet-multiplexing coded bits streams produced by the information-source coding processing means, each stream independent to other streams; fixed length packet producing means for allocating the multiplexed stream into a fixed length packet; and transmission coding means for producing a transmission signal from the fixed length packet.
- According to such a structure, processes from a process of inputting elements of media to a process of remultiplexing and transmitting are constructed hierarchically. Thus, such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on.
- The fixed length packet producing means allocates the multiplexed stream into an ATM cell. Thus, the system can easily adopt to ATM cells which are fixed length packets.
- The transmission coding means executes transmission processing of ATM physical layer. Thus, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
- In a multimedia information processing system according to the present invention, a receiver comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal; fixed length packet disassembling means for extracting a multiplexed stream from the fixed packets stream; media separating means for reproducing coded bits streams for respective media from the multiplexed stream, each bits stream independent to other bits stream; and information-source decoding processing means for decoding the coded bits streams for respective media.
- According to such a structure, processes from a receiving process to reproducing process of elements of media are constructed hierarchically. Thus, such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on.
- The fixed length packet disassembling means extracts the multiplexed stream from an ATM cells stream. Thus, the system can easily adopt to ATM cells which are fixed length packets.
- The transmission decoding means executes receive processing of ATM physical layer. Thus, it becomes to be possible to receive and decode transmit signals which adapt to a characteristic of the ATM network.
- In a multimedia information processing system according to the present invention, a relay station comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal from a transmitter; signal change processing means for executing changing process for the fixed packets stream; and transmission coding means for producing a transmission signal corresponding to a characteristic of a transmission line from the fixed packets stream.
- The construction for exchanging signals between different transmission means is simplified. Thus, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system.
- The transmission decoding means reproduces an ATM cells stream as the fixed packets stream, and the transmission coding means produces the transmission signal from said ATM cells stream.
- The signal change processing means includes broadcast processing means for executing broadcast control so as to transmit the transmission signal to a plurality of receivers.
- The broadcast processing means writes addresses of receivers in headers of the fixed length packets.
- According to such a structure, the broadcast processing section can add destination addresses to the fixed packets stream directly. Thus, a broadcast transmission is easily achieved.
-
- Fig. 1 is a block diagram showing a structure of a receiver in a multimedia information processing system according to the first embodiment of the present invention;
- Fig. 2. is a block diagram showing a construction of information-source coding section;
- Fig. 3 is an explanatory diagram showing a reference between a multiplexed bits stream using TS packet and a fixed length packet using ATM cell;
- Fig. 4 is an explanatory diagram showing a general function of the section for transmission line;
- Fig. 5 is an explanatory diagram showing a general function of the transmission coding section in case an ATM network is used as a transmission line;
- Fig. 6 is a block diagram showing a structure of a receiver in a multimedia information processing system according to the second embodiment of the present invention;
- Fig. 7. is a block diagram showing a construction of information-source decoding section;
- Fig. 8 is a block diagram showing a structure of a relay station in a multimedia information processing system according to the third embodiment of the present invention;
- Fig. 9 is a connection diagram showing a connection of multimedia information processing systems.
- Fig. 10 is a block diagram showing a structure of a transmitter in a conventional multimedia information processing system;
- Fig. 11 is a block diagram showing a structure of a receiver in a conventional multimedia information processing system;
- Fig. 12 is a view explaining a structure of a multiplexed frame in a multimedia information processing system;
- Fig. 13 is an explanatory diagram showing a general function of the transmission processing section and the receive processing section in case ATM network is not used.
- Fig. 14(a) is a view explaining scramble processing in a multimedia information processing system;
- Fig. 14(b) is a view explaining de-scramble processing in a multimedia information processing system;
- Fig. 15 is a block diagram showing a structure of an error correction frame when a Reed-Solomon code is used as an error correction code;
- Fig. 16 is a view explaining a structure of a channel multiplexed frame in a multimedia information processing system;
- Fig. 17 is a view explaining a structure of a transmission frame in a multimedia information processing system;
- Fig. 18 is a explanatory diagram showing a general function of the transmission processing section and the receive processing section in case ATM network is used.
- Embodiments of the multimedia information processing system according to the present invention will be described below, with reference to drawings.
- Fig. 1 is a block diagram showing another transmitter of a multimedia information processing system according to the present invention. In Fig. 1,
reference numeral 100 denotes an information-source coding section for performing information-source coding avideo signal 11a, anaudio signal 11b and adata signal 11c, 200 a media multiplexing section for producing a multiplexedstream 12 by multiplexing codedbits stream source coding section 100, 300 a fixed length packet generating section for producing a fixedlength packet 14 from a multiplexedstream 13, and 400 a transmission coding section for producing atransmission signal 15. - Fig. 2 is a block diagram showing a construction of the information-
source coding section 100. As shown in Fig. 2, the information-source coding section 100 comprises avideo coding portion 61coding video signals 11a, anaudio coding portion 62 coding audio signals 11b and adata coding portion 63 coding data signals 11c. - Next, operation is described. In the information-
source coding section 100, thevideo coding portion 61 cuts redundant components of thevideo signal 11a by using one of a plurality of information-source coding methods and produces a video codedbits stream 12a. Thevideo coding portion 61 outputs the video codedbits stream 12a. Theaudio coding portion 62 cuts redundant components of theaudio signal 11b by using one of a plurality of information-source coding methods and produces an audiocoded bits stream 12b. Theaudio coding portion 62 outputs the audio codedbits stream 12b. Thedata coding portion 63 inputs synchronizing signals, controlling signals and so on of thevideo signal 11a and theaudio signal 11b, and cuts redundant components of the data signal 11c as same as those of the video signals 11a and theaudio signals 11b. If required, thedata coding portion 63 changes data structure of data signal 11c and produces a data codedbits stream 12c. Thedata coding portion 63 outputs the data codedbits stream 12c. - The
media multiplexing section 200 performs a media multiplexing of coded bits streams 12a, 12b, 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard. Here, themedia multiplexing section 200 performs multiplexing in a unit of a packet and produces a multiplexed stream so-called transport stream (TS) or program stream (PS). - The fixed length
packet generating section 300 allocates multiplexedstream 13 into a fixedlength packet 14. Fig. 3 is an explanatory diagram showing a reference between a multiplexedstream 13 using TS packet and a fixedlength packet 14 using an ATM cell. As shown in Fig. 3, two TS packets are allocated into a payload on CPCS (Common Part Convergence Sublayer)-PDU (Protocol data Unit) of ATM adaptation layer (AAL), type 5. Here, a TS packet comprises 188 bytes. - In case PS packets are allocated into an ATM cell, it is suitable that they are set in a CPCS-PDU payload of AAL, type 5 such that a leading portion of the PS packet, generally variable length packet, is coincide to a leading portion of the payload. It is also suitable that PS packets are set in a CPCS-PDU payload of AAL, type 5 such that a length of PS packet is equivalent to a length of the CPCS-PDU payload and a leading portion of the PS packet is coincide to a leading portion of the payload. Further, it is possible that variable length PS packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
- It is also possible that TS or PS packets are packed into a payload (47 bytes) of AAL,
type 1. In the case, TS or PS packets are packed into a payload such that a leading portion of the TS or PS packet is coincide to a leading portion of the payload as same as in the case regarding ALL, type 5. Alternatively, it is also possible that variable length packets are packed in sequence into the payloads with taking no account to boundaries of the payloads. - Fig. 4 is a block diagram showing a construction of the
transmission coding section 400. Thetransmission coding section 400 inputs fixed length packets stream such as an ATM cells stream and produces transmission signals by framing including scrambling and adding error correction codes, modulating and performing physical layer process corresponding to a variation and a characteristic of the transmission line. In case an ATM network is used as the transmission line, thetransmission coding section 400 includes a function of ATM physical layer processing as shown in Fig. 5. - As described above, according to the present embodiment, processes from a process of inputting elements of media to a process of re-multiplexing and transmitting are constructed hierarchically. Thus, such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on. Further, since the fixed length
packet generating section 300 allocates multiplexedstream 13 into a fixed length packet, the system can easily adopt to ATM cells which are fixed length packets. Moreover, since thetransmission coding section 400 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network. - Fig. 6 is a block diagram showing another receiver of a multimedia information processing system according to the present invention. In Fig. 6,
reference numeral 500 denotes a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixedlength packets 14, 600 a fixed packet demultiplexing section for disassembling a fixedlength packet 14 into a multiplexedstream 13, 700 a media demultiplexing section for reproducing coded bits streams 12a, 12b, 12c by demultiplexing a fixedlength packet 14, and 800 a information-source decoding section for reproducing avideo signal 11a, anaudio signal 11b and adata signal 11c from the bits streams 12a, 12b, 12c. - Fig. 7 is a block diagram showing a construction of the information-
source decoding section 800. As shown in Fig. 7, the information-source decoding section 800 comprises avideo decoding portion 64 decoding and reproducingvideo signals 11a, anaudio decoding portion 65 decoding and reproducingaudio signals 11b and adata decoding portion 66 decoding and reproducingdata signals 11c. - Next, operation is described. The
transmission decoding section 500 performs demodulating process when thesection 500 receives atransmission signal 15. Next, thesection 500 synchronizes demodulated transmission frame and reproduces a transmission frame. Further, thesection 500 reproduces fixedlength packets 14 by correcting errors in the frame and so forth. Here, in case an ATM network is used as a transmission line, thetransmission decoding section 500 should include a function of ATM physical layer processing as shown in Fig. 5. - The fixed
packet demultiplexing section 600 extracts payloads from fixedlength packets 14 and reproduces a multiplexedstream 13. In case the fixedlength packet 14 is an ATM cell, a multiplexedstream 13 based on TS packets is reproduced as shown in Fig. 5. Themedia demultiplexing section 700 demultiplexes the multiplexed stream into a video codedstream 12a, an audiocoded stream 12b and a data codedstream 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard. - In the information-source decoding section, the
video decoding portion 64 reproducesvideo signals 11a from the video codedstream 12a by contrary processing of the processing in thevideo coding portion 61. Theaudio decoding portion 65 reproducesaudio signals 11b from the audiocoded stream 12b by contrary processing of the processing in theaudio coding portion 62. Thedata decoding portion 66 reproduces data signals 11c from the data codedstream 12c by contrary processing of the processing in thedata coding portion 63. - As described above, according to the present embodiment, processes from a receiving process to reproducing process of elements of media are constructed hierarchically. Thus, such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on. Further, since the fixed length
packet demultiplexing section 600 extracts multiplexedstream 13 from fixed length packets, the system can easily adopt to ATM cells which are fixed length packets. Moreover, since thetransmission decoding section 500 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to receive and decode transmitted signals which adapt to a characteristic of the ATM network. - Fig. 8 is a block diagram showing a relay station of a multimedia information processing system according to the present invention. In Fig. 8,
reference numeral 400 denotes a transmission coding section for producing atransmission signal 15, 500 a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixedlength packets 14, and 900 a broadcast processing section for adding information based on destination address information 16 to a fixedlength packet 14 if necessary. Thebroadcast processing section 900 is an example of signal change processing means for changing signals of a fixed length packet stream. Thesection 900 can perform signal changing process, address adding process in this case, for a fixed length packet stream which is independent from a characteristic of each transmission line connected to the system. - Fig. 9 is a system construction diagram showing an aspect of connections between multimedia information processing systems. In Fig. 9, 1001 denotes a transmission station, 201 a relay station, 301 a receiver on an ATM network connected to a
relay station 201 through anATM switch 280, 301 a receiver connected directly to a relay station. - Next, operation is described. In the system shown in Fig. 9,
relay stations 201 are connected to the transmission station 1001 through an ATM network. It will be explained that arelay station 201 connected to theATM switch 280 and thereceivers 302 transmits a transmission signal from the transmission station 1001 to thereceivers 301 through theATM switch 280. Here, ATM cells are used as fixedlength packets 14 for example. Thus, in eachrelay station 201, thetransmission decoding section 500 includes a function of ATM physical layer processing as shown in Fig. 5. Further, thetransmission coding section 400 in eachrelay station 201 connected to theATM switch 280 among all relaystations 201 includes a function of ATM physical layer processing as shown in Fig. 5. - The
transmission decoding section 500 in therelay station 201, which is connected to theATM switch 280, receives atransmission signal 15 from the transmission station 1001 and reproduces fixedlength packets 14. Thepackets 14 are transferred to thebroadcast processing section 900. Thebroadcast processing section 900 reproduces a plurality of fixedlength packets 14 for destination receivers by copying input fixedlength packet 14. Thesection 900 adds each address to a header of eachpacket 14. Eachpacket 14 is transferred to thetransmission coding section 400. Thesection 400 delivers eachpacket 14 to each address. In this case, thesection 400 delivers thepacket 14 to the ATM network through theATM switch 280. In the ATM network, eachpacket 14 is transferred to eachreceiver 301 corresponding to the address. - Next, It will be explained that a
relay station 201 connected to theATM switch 280 and thereceivers 302 transmits a transmission signal from the transmission station 1001 to thereceivers 302. Here, eachreceiver 301 can receive a signal modulated by QAM. Thus, thetransmission coding section 400 in eachrelay station 201, which is connected to theATM switch 280 andreceivers 302, includes a function of a framing process containing scrambling process and error correcting process, modulating process of QAM modulation for example, and physical layer process as shown in Fig. 4 in addition to the ATM physical layer process as shown in Fig. 5. - The
transmission decoding section 500 in therelay station 201 receives atransmission signal 15 from the transmission station 1001 and reproduces fixedlength packets 14. Thepackets 14 are transferred to thebroadcast processing section 900. In this case, thebroadcast processing section 900 transfers thepacket 14 to thetransmission coding section 400 as it is. Thesection 400 produces atransmission signal 15 based on QAM modulation frominput packets 14. Thetransmission signal 15 is transmitted to thereceivers 302. - In this embodiment, a
relay station 201 which does not include the ATM network as a destination of transmitted signals, can be constructed without abroadcast processing section 900. - As described above, since the relay station is constructed such that the
transmission decoding section 500 reproduces a fixed length packet stream instead of a multiplexed bits stream from receivedtransmission signal 15 and thetransmission coding section 400 changes the fixed length packet stream into atransmission signal 15 corresponding to a characteristic of the transmission line, the construction for exchanging signals between different transmission means is simplified. In other words, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system. Further, a transmission of contents through a plurality of transmission means is rapidly performed by simpler construction. - For example, the
transmission coding section 400 for transmitting a signal based on QAM or PSK modulation is constructed as shown in Fig. 4. Thetransmission decoding section 500 for receiving a signal based on QAM or PSK modulation is also constructed as shown in Fig. 4. Thetransmission coding section 400 for transmitting a signal to an ATM network is constructed as shown in Fig. 5. Thetransmission decoding section 500 for receiving a signal to an ATM network is also constructed as shown in Fig. 5. Thus, an adapter for exchanging contents of media between a multimedia information processing system connected to an ATM network and another multimedia information processing system connected to a transmission means transmitting QAM modulated wave may include functions shown in Figs. 4 and 5. In the conventional system, an adapter should include functions shown in Figs. 13 and 18. - In this embodiment, a fixed packets stream is transferred between the
transmission decoding section 500 and thetransmission coding section 400 in therelay station 201. In case an ATM cells stream are utilized as the fixed packets stream, thetransmission decoding section 500 reproduces an ATM cells stream from an ATM transmission signal outputted from an ATM network or a QAM modulated wave as a transmission signal. Thetransmission coding section 400 produces an ATM transmission signal or a QAM modulated wave as a transmission signal from an ATM cells stream. Thus, exchanging of contents of media between an ATM network and a non-ATM network is rapidly performed by a simplified construction. - Since a fixed packets stream is transferred between the
transmission decoding section 500 and thetransmission coding section 400, thebroadcast processing section 900 can add destination addresses to the fixed packets stream directly. Thus, a broadcast transmission is easily achieved.
Claims (10)
- A multimedia information processing system executing transmission and/or storage of multimedia information comprises:information-source coding processing means (100) for inputting a plurality of media information (11a,11b,11c) and coding each media information independently to other media information;packet multiplexing means (200) for producing a multiplexed stream (13) by packet-multiplexing coded bits streams (12a, 12b, 12c) produced by said information-source coding processing means, each stream independent to other streams;fixed length packet producing means (300) for allocating said multiplexed stream (13) into a fixed length packet (14); andtransmission coding means (400) for producing a transmission signal (15) from said fixed length packet (14).
- A multimedia information processing system according to claim 1, wherein said fixed length packet producing means (300) allocates the multiplexed stream into an ATM cell.
- A multimedia information processing system according to claim 1 or 2, wherein said transmission coding means (400) executes transmission processing of ATM physical layer.
- A multimedia information processing system executing transmission and/or storage of multimedia information comprises:transmission decoding means (500) for reproducing a fixed packets stream (14) from received transmission signal (15);fixed length packet disassembling means (600) for extracting a multiplexed stream (13) from said fixed packets stream (14);media separating means (700) for reproducing coded bits streams (12a,12b,12c) for respective media from said multiplexed stream, each bits stream independent to other bits stream (13); andinformation-source decoding processing means (800) for decoding said coded bits streams (12a,12b,12c) for respective media.
- A multimedia information processing system according to claim 4, wherein said fixed length packet disassembling means (600) extracts the multiplexed stream (13) from an ATM cells stream.
- A multimedia information processing system according to claim 4 or 5, wherein said transmission decoding means (500) executes receive processing of ATM physical layer.
- A multimedia information processing system executing transmission and/or storage of multimedia information comprises:transmission decoding means (500) for reproducing a fixed packets stream (14) from received transmission signal (15) from a transmitter (1001);signal change processing means (900) for executing changing process for said fixed packets stream (14); andcoding means for transmission line (400) for producing a transmission signal (15) corresponding to a characteristic of a transmission line from said fixed packets stream (14).
- A multimedia information processing system according to claim 7, wherein said transmission decoding means (500) reproduces an ATM cells stream as the fixed packets stream (14), and wherein said transmission coding means (400) produces the transmission signal (15) from said ATM cells stream.
- A multimedia information processing system according to claim 7 or 8, wherein said signal change processing means includes broadcast processing means (900) for executing broadcast control so as to transmit the transmission signal to a plurality of receivers (301).
- A multimedia information processing system according to claim 9, wherein said broadcast processing means (900) writes addresses of receivers in headers of the fixed length packets (14).
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP16754/96 | 1996-02-01 | ||
JP1675496A JP3172425B2 (en) | 1995-02-09 | 1996-02-01 | Multimedia information transmission system, multimedia information reception system, multimedia information transmission method, and multimedia information reception method |
JP1675496 | 1996-02-01 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP0788289A2 true EP0788289A2 (en) | 1997-08-06 |
EP0788289A3 EP0788289A3 (en) | 2000-04-12 |
Family
ID=11925041
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP96112767A Withdrawn EP0788289A3 (en) | 1996-02-01 | 1996-08-08 | Multimedia information processing system |
Country Status (4)
Country | Link |
---|---|
US (1) | US5930251A (en) |
EP (1) | EP0788289A3 (en) |
KR (1) | KR100220873B1 (en) |
AU (1) | AU6077196A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0933941A2 (en) * | 1998-01-31 | 1999-08-04 | Ricoh Company | Multi-media data automatic delivery system |
EP1583315A2 (en) * | 1998-11-30 | 2005-10-05 | Microsoft Corporation | Proxy for video on demand server control |
US7913283B2 (en) | 1998-11-30 | 2011-03-22 | Microsoft Corporation | Video on demand methods and systems |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR19990044344A (en) * | 1996-07-02 | 1999-06-25 | 이데이 노부유끼 | Information transmission device and transmission method |
USRE39771E1 (en) * | 1996-07-31 | 2007-08-14 | Matsushita Electric Industrial Co., Ltd. | Code conversion method and apparatus, code recording medium, code recording apparatus and code reproducing apparatus |
US6084910A (en) * | 1997-01-31 | 2000-07-04 | Hughes Electronics Corporation | Statistical multiplexer for video signals |
KR100236965B1 (en) * | 1997-11-28 | 2000-01-15 | 정선종 | Apparatus and method for protecting atm header from the burst error |
JP3990813B2 (en) * | 1998-05-22 | 2007-10-17 | キヤノン株式会社 | Encoding apparatus, encoding method, digital transmission apparatus, and digital transmission system |
US6658620B1 (en) * | 2000-01-11 | 2003-12-02 | Northrop Grumman Corporation | Burst and packet wireless transmission using product codes with iterative decoding |
JP2001229137A (en) * | 2000-02-17 | 2001-08-24 | Toyo Eng Corp | Hosting system |
US6714562B1 (en) | 2000-03-10 | 2004-03-30 | International Business Machines Corporation | Method and apparatus for segmenting network traffic variable length frames |
US7017075B1 (en) * | 2000-05-12 | 2006-03-21 | Intel Corporation | Recovering from video driver errors |
JP3888642B2 (en) * | 2001-10-05 | 2007-03-07 | アルパイン株式会社 | Multimedia information providing method and apparatus |
WO2003061299A1 (en) * | 2002-01-18 | 2003-07-24 | Koninklijke Philips Electronics N.V. | Audio coding |
KR100581060B1 (en) * | 2003-11-12 | 2006-05-22 | 한국전자통신연구원 | Apparatus and method for transmission synchronized the five senses with A/V data |
KR100690797B1 (en) * | 2005-01-27 | 2007-03-09 | 엘지전자 주식회사 | Conditional access broadcasting system and method thereof |
US7965736B2 (en) * | 2005-08-24 | 2011-06-21 | Qualcomm Incorporated | Transmission of multiplex protocol data units in physical layer packets |
US20070058730A1 (en) * | 2005-09-09 | 2007-03-15 | Microsoft Corporation | Media stream error correction |
JP4275167B2 (en) * | 2006-11-24 | 2009-06-10 | 株式会社エヌ・ティ・ティ・ドコモ | Transmitter |
JP5266450B2 (en) * | 2007-08-27 | 2013-08-21 | アップル インコーポレイテッド | Method and communication apparatus in radio communication system |
US9300412B2 (en) * | 2007-09-11 | 2016-03-29 | The Directv Group, Inc. | Method and system for operating a receiving circuit for multiple types of input channel signals |
US20090070829A1 (en) * | 2007-09-11 | 2009-03-12 | The Directv Group, Inc. | Receiving circuit module for receiving and encoding channel signals and method for operating the same |
US8973058B2 (en) * | 2007-09-11 | 2015-03-03 | The Directv Group, Inc. | Method and system for monitoring and simultaneously displaying a plurality of signal channels in a communication system |
US9756290B2 (en) * | 2007-09-11 | 2017-09-05 | The Directv Group, Inc. | Method and system for communicating between a local collection facility and a remote facility |
US9313457B2 (en) | 2007-09-11 | 2016-04-12 | The Directv Group, Inc. | Method and system for monitoring a receiving circuit module and controlling switching to a back-up receiving circuit module at a local collection facility from a remote facility |
US8988986B2 (en) | 2007-09-12 | 2015-03-24 | The Directv Group, Inc. | Method and system for controlling a back-up multiplexer in a local collection facility from a remote facility |
US8724635B2 (en) * | 2007-09-12 | 2014-05-13 | The Directv Group, Inc. | Method and system for controlling a back-up network adapter in a local collection facility from a remote facility |
US9037074B2 (en) * | 2007-10-30 | 2015-05-19 | The Directv Group, Inc. | Method and system for monitoring and controlling a local collection facility from a remote facility through an IP network |
US9049354B2 (en) * | 2007-10-30 | 2015-06-02 | The Directv Group, Inc. | Method and system for monitoring and controlling a back-up receiver in local collection facility from a remote facility using an IP network |
US9049037B2 (en) * | 2007-10-31 | 2015-06-02 | The Directv Group, Inc. | Method and system for monitoring and encoding signals in a local facility and communicating the signals between a local collection facility and a remote facility using an IP network |
JP5205075B2 (en) * | 2008-02-13 | 2013-06-05 | パナソニック株式会社 | Encryption processing method, encryption processing device, decryption processing method, and decryption processing device |
US9762973B2 (en) * | 2008-11-04 | 2017-09-12 | The Directv Group, Inc. | Method and system for operating a receiving circuit module to encode a channel signal into multiple encoding formats |
KR101401746B1 (en) | 2009-10-29 | 2014-05-30 | 한국전자통신연구원 | Apparatus and method for multiplexing of multimedia data |
US9831971B1 (en) | 2011-04-05 | 2017-11-28 | The Directv Group, Inc. | Method and system for operating a communication system encoded into multiple independently communicated encoding formats |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0271866A2 (en) * | 1986-12-18 | 1988-06-22 | Mitsubishi Denki Kabushiki Kaisha | Subrate multimedia data transmission control system |
EP0571647A1 (en) * | 1992-05-25 | 1993-12-01 | Siemens Aktiengesellschaft | Method of broadcasting information cells transmitted according to an asynchronous transfer mode |
EP0624040A2 (en) * | 1993-05-03 | 1994-11-09 | AT&T Corp. | System for composing multimedia signals for interactive television services |
US5459506A (en) * | 1993-12-28 | 1995-10-17 | At&T Corp. | Enhanced pay per view system |
US5467342A (en) * | 1994-01-12 | 1995-11-14 | Scientific-Atlanta, Inc. | Methods and apparatus for time stamp correction in an asynchronous transfer mode network |
CA2124610A1 (en) * | 1994-05-30 | 1995-12-01 | Charles Kevin Huscroft | Integrated User Network Interface Device |
EP0691759A2 (en) * | 1994-07-07 | 1996-01-10 | Gpt Limited | PON (Passive Optical Network) with spectrum division for starting up and configuration the network |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3002471B2 (en) * | 1988-08-19 | 2000-01-24 | 株式会社日立製作所 | Program distribution device |
DE69230481T2 (en) * | 1991-01-22 | 2000-05-18 | Canon Kk | Multimedia transmission arrangement |
JPH05122391A (en) * | 1991-05-08 | 1993-05-18 | Fujitsu Ltd | Information collection service system |
JP3262142B2 (en) * | 1992-01-16 | 2002-03-04 | 富士通株式会社 | ATM cell forming apparatus, ATM cell forming method, node, and multiplexing method in node |
JP3002348B2 (en) * | 1992-11-30 | 2000-01-24 | シャープ株式会社 | Image communication system |
EP1024664B1 (en) * | 1993-12-24 | 2002-05-29 | Sharp Kabushiki Kaisha | Image-information storage regenerating device |
US5600633A (en) * | 1995-02-24 | 1997-02-04 | Lucent Technologies Inc. | Wireless telecommunication base station for integrated wireless services with ATM processing |
US5627836A (en) * | 1995-01-31 | 1997-05-06 | Bell Atlantic Network Services, Inc. | VPI/VCI administration |
US5671226A (en) * | 1995-02-09 | 1997-09-23 | Mitsubishi Denki Kabushiki Kaisha | Multimedia information processing system |
US5544161A (en) * | 1995-03-28 | 1996-08-06 | Bell Atlantic Network Services, Inc. | ATM packet demultiplexer for use in full service network having distributed architecture |
US5684799A (en) * | 1995-03-28 | 1997-11-04 | Bell Atlantic Network Services, Inc. | Full service network having distributed architecture |
JPH08331141A (en) * | 1995-06-01 | 1996-12-13 | Hitachi Ltd | Cell/packet assembling/disassembling device and network system |
-
1996
- 1996-07-29 AU AU60771/96A patent/AU6077196A/en not_active Abandoned
- 1996-08-08 EP EP96112767A patent/EP0788289A3/en not_active Withdrawn
- 1996-09-24 KR KR1019960041882A patent/KR100220873B1/en not_active IP Right Cessation
- 1996-11-08 US US08/751,770 patent/US5930251A/en not_active Expired - Lifetime
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0271866A2 (en) * | 1986-12-18 | 1988-06-22 | Mitsubishi Denki Kabushiki Kaisha | Subrate multimedia data transmission control system |
EP0571647A1 (en) * | 1992-05-25 | 1993-12-01 | Siemens Aktiengesellschaft | Method of broadcasting information cells transmitted according to an asynchronous transfer mode |
EP0624040A2 (en) * | 1993-05-03 | 1994-11-09 | AT&T Corp. | System for composing multimedia signals for interactive television services |
US5459506A (en) * | 1993-12-28 | 1995-10-17 | At&T Corp. | Enhanced pay per view system |
US5467342A (en) * | 1994-01-12 | 1995-11-14 | Scientific-Atlanta, Inc. | Methods and apparatus for time stamp correction in an asynchronous transfer mode network |
CA2124610A1 (en) * | 1994-05-30 | 1995-12-01 | Charles Kevin Huscroft | Integrated User Network Interface Device |
EP0691759A2 (en) * | 1994-07-07 | 1996-01-10 | Gpt Limited | PON (Passive Optical Network) with spectrum division for starting up and configuration the network |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0933941A2 (en) * | 1998-01-31 | 1999-08-04 | Ricoh Company | Multi-media data automatic delivery system |
EP0933941A3 (en) * | 1998-01-31 | 2001-09-12 | Ricoh Company | Multi-media data automatic delivery system |
US6725460B1 (en) | 1998-01-31 | 2004-04-20 | Ricoh Company, Ltd. | Multi-media data automatic delivery system |
US7350223B2 (en) | 1998-01-31 | 2008-03-25 | Ricoh Company, Ltd. | Multi-media data automatic delivery system |
EP1583315A2 (en) * | 1998-11-30 | 2005-10-05 | Microsoft Corporation | Proxy for video on demand server control |
EP1583315A3 (en) * | 1998-11-30 | 2005-12-28 | Microsoft Corporation | Proxy for video on demand server control |
US7865919B2 (en) | 1998-11-30 | 2011-01-04 | Microsoft Corporation | Proxy for video on demand server control |
US7913283B2 (en) | 1998-11-30 | 2011-03-22 | Microsoft Corporation | Video on demand methods and systems |
Also Published As
Publication number | Publication date |
---|---|
KR970063018A (en) | 1997-09-12 |
KR100220873B1 (en) | 1999-09-15 |
EP0788289A3 (en) | 2000-04-12 |
AU6077196A (en) | 1997-08-07 |
US5930251A (en) | 1999-07-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5930251A (en) | Multimedia information processing system | |
CA2176131C (en) | Interactive information services control system | |
US5671226A (en) | Multimedia information processing system | |
US6034732A (en) | Digital broadcast receiving terminal apparatus | |
Smith | Digital transmission systems | |
US5828403A (en) | Method and system for selecting and receiving digitally transmitted signals at a plurality of television receivers | |
JP2933133B2 (en) | Digital video signal multiplexing and separation systems | |
US5856988A (en) | Method and apparatus for data transmission | |
KR19990044344A (en) | Information transmission device and transmission method | |
US5488653A (en) | Facsimile interface unit (FIU) enhanced capabilities negotiation | |
CN101517553A (en) | Methods and apparatus for packetization of content for transmission over a network | |
JP2000295189A (en) | Transmitter and receiver | |
US7415528B2 (en) | Apparatus and method for transmitting hierarchically multimedia data TS to prevent jitter of timing information and for recovering the multimedia data TS | |
US6636531B1 (en) | Communication device and method | |
KR100579132B1 (en) | Apparatus and Method of the hierarchical transmission of a multimedia data TS for preventing the jitter of timing information, and Apparatus and Method of recovering a multimedia data TS transmitted hierarchically | |
US5978361A (en) | ATM digital radio transmission method and system therefor | |
JP3172425B2 (en) | Multimedia information transmission system, multimedia information reception system, multimedia information transmission method, and multimedia information reception method | |
US6108348A (en) | 2.4-to-3 kbps rate adaptation apparatus for use in narrowband data and facsimile communications systems | |
JP2001078158A (en) | Transmitting device, multiplexing device and receiving device for cable television | |
JP3512916B2 (en) | Data transmission system | |
JP5012840B2 (en) | Sender network and broadcasting system | |
KR100403889B1 (en) | OOB physical layer processing equipment applying to POD module of the open cable | |
JP3361786B2 (en) | Data storage communication device | |
US6801495B1 (en) | High capacity robust modem for multiple classes of services | |
KR100199960B1 (en) | Apparatus for generating and reproducing sync. clock |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): DE FR GB |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): DE FR GB |
|
17P | Request for examination filed |
Effective date: 20000824 |
|
17Q | First examination report despatched |
Effective date: 20010622 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20030917 |