EP0788289A2 - Multimedia information processing system - Google Patents

Multimedia information processing system Download PDF

Info

Publication number
EP0788289A2
EP0788289A2 EP96112767A EP96112767A EP0788289A2 EP 0788289 A2 EP0788289 A2 EP 0788289A2 EP 96112767 A EP96112767 A EP 96112767A EP 96112767 A EP96112767 A EP 96112767A EP 0788289 A2 EP0788289 A2 EP 0788289A2
Authority
EP
European Patent Office
Prior art keywords
transmission
stream
multimedia information
processing system
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP96112767A
Other languages
German (de)
French (fr)
Other versions
EP0788289A3 (en
Inventor
Tokumichi C/O Mitsubishi Denki K.K. Murakami
Kazuhiro C/O Mitsubishi Denki K.K. Matsuzaki
Yoshiaki C/O Mitsubishi Denki K.K. Kato
Hideo C/O Mitsubishi Denki K.K. Ohira
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP1675496A external-priority patent/JP3172425B2/en
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of EP0788289A2 publication Critical patent/EP0788289A2/en
Publication of EP0788289A3 publication Critical patent/EP0788289A3/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q11/00Selecting arrangements for multiplex systems
    • H04Q11/04Selecting arrangements for multiplex systems for time-division multiplexing
    • H04Q11/0428Integrated services digital network, i.e. systems for transmission of different types of digitised signals, e.g. speech, data, telecentral, television signals
    • H04Q11/0478Provisions for broadband connections
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5603Access techniques
    • H04L2012/5609Topology
    • H04L2012/561Star, e.g. cross-connect, concentrator, subscriber group equipment, remote electronics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5614User Network Interface
    • H04L2012/5616Terminal equipment, e.g. codecs, synch.
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5638Services, e.g. multimedia, GOS, QOS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/54Store-and-forward switching systems 
    • H04L12/56Packet switching systems
    • H04L12/5601Transfer mode dependent, e.g. ATM
    • H04L2012/5638Services, e.g. multimedia, GOS, QOS
    • H04L2012/5646Cell characteristics, e.g. loss, delay, jitter, sequence integrity
    • H04L2012/5652Cell construction, e.g. including header, packetisation, depacketisation, assembly, reassembly

Definitions

  • the present invention relates to a multimedia information processing system in which a digitalized video signal, an audio signal and other data are coded, multiplexed, and then, transmitted or stored, and the transmitted signal or the stored signal are demultiplexed, and then, decoded to generate the video signal, audio signal and other data.
  • a video on demand (VOD) a digital broadcasting system
  • a video conference system a video conference system
  • Fig. 10 is a block diagram showing a structure of a video encoder (transmitter) forming a conventional multimedia information processing system described in "A Video Codec for Digital Satellite News gathering Systems", Mitsubishi Electric Corporation Technical Publication, Vol. 67, No. 7, pp 33 - 38, 1993.
  • reference numeral 91 is an information-source coding section which inputs a video signal 101, an audio signal 102, and the other data signal 103 and executes data compression for those signals.
  • a video coding portion 51 executes information-source coding of the video signal 101 to generate the video coded bits sequence 111.
  • An audio coding portion 512 executes information-source coding of one or more audio signals 102 to generate one or more audio coded bits sequences 112.
  • the data coding portion 513 executes various processings concerning the data signal 103 relating to the video signal 101 or the audio signal 102 to generate a data coded bits sequence 113.
  • a media multiplexing section 92 multiplexes the video coded bits sequence 111, the audio coded bits sequence 112 and the data coded bits sequence 113 from the information-source coding section 91 to generate one multiplexed bits sequence 122.
  • a transmission processing section 93 provides the multiplexed bits sequence 122 with scramble processing and error correction coding in accordance with the types and characteristics of the transmission line. The transmission processing section 93 further executes channel multiplexing processing for the multiplexed bits sequence 122 and one or more other multiplexed bits sequences 123. Furthermore, the transmission processing section 93 executes the formation of a transmission frame and modulating processing and so on are executed to generate a transmission signal 141.
  • Fig. 11 is a block diagram showing a structure of a video decoder (receiver) forming the multimedia information processing system described in the above report.
  • reference numeral 96 denotes a receive processing section which receives the transmission signal 141, executes demodulating processing, synchronization of the transmission frame, regeneration of the transmission frame and separation of the channel multiplexing processing to select a specific channel signal.
  • the receive processing section 96 further executes error detecting processing, error correcting processing and descramble processing or the like to reproduce multiplexed bits sequence 122 or one or more other multiplexed bits sequences 123.
  • a media demultiplexing section 95 separates the multiplexed bits sequence 122 into the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113.
  • An information-source decoding section 94 inputs the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113 and also outputs the video signal 101, one or more audio signals 102 and one or more data signals 103.
  • a video decoding portion 514 executes information-source decoding of the video coded bits sequence 111 to reproduce the video signal 101.
  • An audio decoding portion 515 executes information-source decoding of the one or more audio coded bits sequences 112 to reproduce the audio signal 102 relating to the video signal 101.
  • a data decoding portion 516 executes various reverse processings to the data coded bits sequence 113 to reproduce the data signal 103 relating to the video signal 101 and audio signal 102.
  • Fig. 13 is an explanatory diagram showing a general function of the transmission processing section 93 and the receive processing section 96.
  • the transmission processing section 93 inputs multiplexed bits sequences and produces transmission signals by performing a framing process, modulation process and physical layer process.
  • the receive processing section 96 receives transmission signals and reproduces multiplexed bits sequences by performing physical layer process, demodulation process and deframing process.
  • the information-source coding section 91 reduces redundant components of the respective signals by use of information-source coding method.
  • Information of the video signal 101 and the one or more audio signals 102 which are accompanied therewith are coded in a video coding portion 511 and audio coding portion 512 respectively.
  • Information of the data signal 103 including synchronization signals and control signals relating to the video signal and audio signal are also coded in a data coding portion 513 as in the case of the video signal and audio signal, thereby converting the data structure to form one or more data coded bits sequences 113.
  • the media multiplexing section 92 multiplexes the video coded bits sequence 111, audio coded bits sequence 112 and data coded bits sequence 113 into one multiplexed bits sequence 122.
  • the multiplexing is executed by use of a given frame as a unit.
  • Fig. 12 is an explanatory view explaining multiplexed frame generated in the media multiplexing section 92.
  • a predetermined sized multiplexed frame 80 is composed of a synchronizing information area 81 for securing the synchronization of the multiplexed frame, a video information area 82, audio information area 83 and a data information area 84.
  • the video coded bits sequence 111, the audio coded bits sequence 112 and the data coded bits sequence 113 are provided in the video information area 82, the audio information area 83, and the data information area 84 respectively and are read out in the order shown with arrow in Fig. 12 (from the left upper portion to the right lower portion), so that the multiplexed bits sequence 122 is generated.
  • structure multiplexing To multiplex signals using such a multiplexed frame as a unit is referred to as "structure multiplexing" in this specification.
  • the transmission processing section 93 executes scramble processing for the multiplexed bits sequence 122 and adds error correcting codes to the multiplexed bits sequence 122. Further, the transmission processing section 93 executes channel multiplexing for the multiplexed bits sequence 122 and other one or more multiplexed bits sequences 123 to generate a transmission frame. The transmission processing section 93 then executes modulation processing or the like for the transmission frame to generate a transmission signal 141.
  • Fig. 14 (a) shows one example of a circuit that realize a scramble processing referred to as a PN (Pseudo Noise) signal summing system.
  • reference numeral 73a denotes a pseudo random number generator for scramble and 75 an exclusive-OR circuit.
  • the random number generator 73a generates a pseudo random number sequence 74a responsive to an initial value 72a.
  • the exclusive-OR circuit 75 executes exclusive-OR operation of original data 71 and the pseudo random number sequence 74 a as a bit unit to obtain scrambled data 76.
  • Fig. 15 is a block diagram of an error correction frame 77 in a case where the Reed-Solomon (RS) code is used as the error correction code.
  • reference numeral 78a denotes synchronizing information to establish synchronization of the error correction frame 77, 78b M bytes code word (RS (M, M- N) code word), 79a an information field which stores N bytes information symbols which is protected by the error correction coding, and 79b a check field which stores check symbols which is added to detect error detection.
  • RS Reed-Solomon
  • a channel multiplexing method for the P channels in the transmission processing section 93 will be described with reference to Fig. 16. Each channel corresponds to each program in television broadcasting for example.
  • a channel multiplexing frame 90 includes synchronizing information 90a to establish synchronization of the channel multiplexing frame 90. The channel multiplexing is executed by using the structure multiplexing system.
  • a transmission frame 85 is defined in dependence on the characteristics of the transmission line.
  • Various transmission frames are defined in accordance with the respective types such as the cable transmission, satellite wave transmission and ground wave transmission and so on.
  • Fig. 17 shows one embodiment of a structure of a transmission frame.
  • a transmission frame 85 is composed of an additional information area 86 and a transmission information area (payload) 87. Timing information, synchronizing information and information that is used for securing the transmission line, or the like are contained in the additional information area 86.
  • the information that forms the transmission frame 85 is read out in a desired order shown with the arrows in Fig. 17. After the transmission frame 85 was modulated, it is sent to a transmission line as a transmission signal 141.
  • the receive processing section 96 demodulated the received transmission signal 141, it establishes the synchronization of the transmission frame 85 and reproduces, using the synchronizing information in the additional information area 86, and takes out the transmission information area 87.
  • the receive processing section 96 establishes the synchronization of the channel multiplexing frame 90 and reproduces, using the synchronizing information 90a, and separates the respective channel information.
  • the receive processing section 96 establishes synchronization of the error correction frame 77 and reproduces, using the synchronizing information 78a. After that, the receive processing section 96 detects errors and correct them.
  • Fig. 14 (b) Descramble processing in the receive processing section 96 will be described using Fig. 14 (b).
  • reference numeral 73b denotes a pseudo random number generator for descramble and 75 an exclusive-OR circuit.
  • the pseudo random number generator 73b to which an initial value 72b is given generates a pseudo random number sequence 74b.
  • the pseudo random number generator 73b in a descramble circuit has the same structure as the pseudo random number generator 73a shown in Fig. 14 (a).
  • the initial value 72a is the same as the initial value 72b.
  • the value of the pseudo random number sequence 74a coincides with that of the pseudo random number sequence 74b.
  • the media demultiplexing section 95 separates the multiplexed bits sequence 122 into the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113.
  • the generation of the multiplexing frame 80 necessary for the separation is executed by using synchronizing information contained in the synchronizing information area 81 within the multiplexing frame 80.
  • the video coded bits sequence 111, audio coded bits sequence 112, and data coded bits sequence 113 are respectively decoded through information-source decoding or various reverse processing by the video decoding section 514, audio decoding section 515 and data decoding section 516 to reproduce the video signal 101, the audio signal 102 relating to the video signal 101 and the data signal 103 relating to the video signal 101 or audio signal 102.
  • the video signal, audio signal, and other data have been structure-multiplexed by storing them in given areas in multiplexing frames, multiplexing processing difficult to deal with change in the transmission speed of information to be multiplexed from the respective media and existence of information from the respective media. Further, in a case where the number of media are large, the size of the multiplexing frame must be enlarged. As a result, long time has been required for establishing synchronization of the multiplexing frame on the receiver side.
  • the transmission processing section 93 and the receive processing section 96 are realized as shown in Fig. 13.
  • the transmission processing section 93 and the receive processing section 96 should perform ATM physical layer process, ATM layer process, and ATM adaptation layer process as shown in Fig. 18.
  • adapters are required. The adapters must include both functions shown in Figs. 13 and 18 if multiplexed bits streams in both systems are same.
  • the present invention has been made to solve the above problems.
  • the object of the present invention is to provide a multimedia information processing system which can exchange contents of media easily if different transmission means are used and to provide a multimedia information processing system which can rapidly transmit contents to another system through a plurality of transmission means.
  • a transmitter comprises: information-source coding processing means for inputting a plurality of media information and coding each media information independently to other media information; packet multiplexing means for producing a multiplexed stream by packet-multiplexing coded bits streams produced by the information-source coding processing means, each stream independent to other streams; fixed length packet producing means for allocating the multiplexed stream into a fixed length packet; and transmission coding means for producing a transmission signal from the fixed length packet.
  • processes from a process of inputting elements of media to a process of remultiplexing and transmitting are constructed hierarchically.
  • Such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on.
  • the fixed length packet producing means allocates the multiplexed stream into an ATM cell.
  • the system can easily adopt to ATM cells which are fixed length packets.
  • the transmission coding means executes transmission processing of ATM physical layer. Thus, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
  • a receiver comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal; fixed length packet disassembling means for extracting a multiplexed stream from the fixed packets stream; media separating means for reproducing coded bits streams for respective media from the multiplexed stream, each bits stream independent to other bits stream; and information-source decoding processing means for decoding the coded bits streams for respective media.
  • processes from a receiving process to reproducing process of elements of media are constructed hierarchically.
  • Such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on.
  • the fixed length packet disassembling means extracts the multiplexed stream from an ATM cells stream.
  • the system can easily adopt to ATM cells which are fixed length packets.
  • the transmission decoding means executes receive processing of ATM physical layer. Thus, it becomes to be possible to receive and decode transmit signals which adapt to a characteristic of the ATM network.
  • a relay station comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal from a transmitter; signal change processing means for executing changing process for the fixed packets stream; and transmission coding means for producing a transmission signal corresponding to a characteristic of a transmission line from the fixed packets stream.
  • the construction for exchanging signals between different transmission means is simplified. Thus, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system.
  • the transmission decoding means reproduces an ATM cells stream as the fixed packets stream, and the transmission coding means produces the transmission signal from said ATM cells stream.
  • the signal change processing means includes broadcast processing means for executing broadcast control so as to transmit the transmission signal to a plurality of receivers.
  • the broadcast processing means writes addresses of receivers in headers of the fixed length packets.
  • the broadcast processing section can add destination addresses to the fixed packets stream directly.
  • a broadcast transmission is easily achieved.
  • Fig. 1 is a block diagram showing another transmitter of a multimedia information processing system according to the present invention.
  • reference numeral 100 denotes an information-source coding section for performing information-source coding a video signal 11a, an audio signal 11b and a data signal 11c, 200 a media multiplexing section for producing a multiplexed stream 12 by multiplexing coded bits stream 12a, 12b, 12c from the information-source coding section 100, 300 a fixed length packet generating section for producing a fixed length packet 14 from a multiplexed stream 13, and 400 a transmission coding section for producing a transmission signal 15.
  • Fig. 2 is a block diagram showing a construction of the information-source coding section 100.
  • the information-source coding section 100 comprises a video coding portion 61 coding video signals 11a, an audio coding portion 62 coding audio signals 11b and a data coding portion 63 coding data signals 11c.
  • the video coding portion 61 cuts redundant components of the video signal 11a by using one of a plurality of information-source coding methods and produces a video coded bits stream 12a.
  • the video coding portion 61 outputs the video coded bits stream 12a.
  • the audio coding portion 62 cuts redundant components of the audio signal 11b by using one of a plurality of information-source coding methods and produces an audio coded bits stream 12b.
  • the audio coding portion 62 outputs the audio coded bits stream 12b.
  • the data coding portion 63 inputs synchronizing signals, controlling signals and so on of the video signal 11a and the audio signal 11b, and cuts redundant components of the data signal 11c as same as those of the video signals 11a and the audio signals 11b. If required, the data coding portion 63 changes data structure of data signal 11c and produces a data coded bits stream 12c. The data coding portion 63 outputs the data coded bits stream 12c.
  • the media multiplexing section 200 performs a media multiplexing of coded bits streams 12a, 12b, 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard.
  • the media multiplexing section 200 performs multiplexing in a unit of a packet and produces a multiplexed stream so-called transport stream (TS) or program stream (PS).
  • TS transport stream
  • PS program stream
  • the fixed length packet generating section 300 allocates multiplexed stream 13 into a fixed length packet 14.
  • Fig. 3 is an explanatory diagram showing a reference between a multiplexed stream 13 using TS packet and a fixed length packet 14 using an ATM cell.
  • two TS packets are allocated into a payload on CPCS (Common Part Convergence Sublayer)-PDU (Protocol data Unit) of ATM adaptation layer (AAL), type 5.
  • a TS packet comprises 188 bytes.
  • PS packets are allocated into an ATM cell, it is suitable that they are set in a CPCS-PDU payload of AAL, type 5 such that a leading portion of the PS packet, generally variable length packet, is coincide to a leading portion of the payload. It is also suitable that PS packets are set in a CPCS-PDU payload of AAL, type 5 such that a length of PS packet is equivalent to a length of the CPCS-PDU payload and a leading portion of the PS packet is coincide to a leading portion of the payload. Further, it is possible that variable length PS packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
  • TS or PS packets are packed into a payload (47 bytes) of AAL, type 1.
  • TS or PS packets are packed into a payload such that a leading portion of the TS or PS packet is coincide to a leading portion of the payload as same as in the case regarding ALL, type 5.
  • variable length packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
  • Fig. 4 is a block diagram showing a construction of the transmission coding section 400.
  • the transmission coding section 400 inputs fixed length packets stream such as an ATM cells stream and produces transmission signals by framing including scrambling and adding error correction codes, modulating and performing physical layer process corresponding to a variation and a characteristic of the transmission line.
  • the transmission coding section 400 includes a function of ATM physical layer processing as shown in Fig. 5.
  • processes from a process of inputting elements of media to a process of re-multiplexing and transmitting are constructed hierarchically.
  • such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on.
  • the fixed length packet generating section 300 allocates multiplexed stream 13 into a fixed length packet, the system can easily adopt to ATM cells which are fixed length packets.
  • the transmission coding section 400 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
  • Fig. 6 is a block diagram showing another receiver of a multimedia information processing system according to the present invention.
  • reference numeral 500 denotes a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixed length packets 14, 600 a fixed packet demultiplexing section for disassembling a fixed length packet 14 into a multiplexed stream 13, 700 a media demultiplexing section for reproducing coded bits streams 12a, 12b, 12c by demultiplexing a fixed length packet 14, and 800 a information-source decoding section for reproducing a video signal 11a, an audio signal 11b and a data signal 11c from the bits streams 12a, 12b, 12c.
  • Fig. 7 is a block diagram showing a construction of the information-source decoding section 800.
  • the information-source decoding section 800 comprises a video decoding portion 64 decoding and reproducing video signals 11a, an audio decoding portion 65 decoding and reproducing audio signals 11b and a data decoding portion 66 decoding and reproducing data signals 11c.
  • the transmission decoding section 500 performs demodulating process when the section 500 receives a transmission signal 15. Next, the section 500 synchronizes demodulated transmission frame and reproduces a transmission frame. Further, the section 500 reproduces fixed length packets 14 by correcting errors in the frame and so forth.
  • the transmission decoding section 500 should include a function of ATM physical layer processing as shown in Fig. 5.
  • the fixed packet demultiplexing section 600 extracts payloads from fixed length packets 14 and reproduces a multiplexed stream 13.
  • a multiplexed stream 13 based on TS packets is reproduced as shown in Fig. 5.
  • the media demultiplexing section 700 demultiplexes the multiplexed stream into a video coded stream 12a, an audio coded stream 12b and a data coded stream 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard.
  • the video decoding portion 64 reproduces video signals 11a from the video coded stream 12a by contrary processing of the processing in the video coding portion 61.
  • the audio decoding portion 65 reproduces audio signals 11b from the audio coded stream 12b by contrary processing of the processing in the audio coding portion 62.
  • the data decoding portion 66 reproduces data signals 11c from the data coded stream 12c by contrary processing of the processing in the data coding portion 63.
  • processes from a receiving process to reproducing process of elements of media are constructed hierarchically.
  • such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on.
  • the fixed length packet demultiplexing section 600 extracts multiplexed stream 13 from fixed length packets, the system can easily adopt to ATM cells which are fixed length packets.
  • the transmission decoding section 500 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to receive and decode transmitted signals which adapt to a characteristic of the ATM network.
  • Fig. 8 is a block diagram showing a relay station of a multimedia information processing system according to the present invention.
  • reference numeral 400 denotes a transmission coding section for producing a transmission signal 15, 500 a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixed length packets 14, and 900 a broadcast processing section for adding information based on destination address information 16 to a fixed length packet 14 if necessary.
  • the broadcast processing section 900 is an example of signal change processing means for changing signals of a fixed length packet stream.
  • the section 900 can perform signal changing process, address adding process in this case, for a fixed length packet stream which is independent from a characteristic of each transmission line connected to the system.
  • Fig. 9 is a system construction diagram showing an aspect of connections between multimedia information processing systems.
  • 1001 denotes a transmission station, 201 a relay station, 301 a receiver on an ATM network connected to a relay station 201 through an ATM switch 280, 301 a receiver connected directly to a relay station.
  • relay stations 201 are connected to the transmission station 1001 through an ATM network. It will be explained that a relay station 201 connected to the ATM switch 280 and the receivers 302 transmits a transmission signal from the transmission station 1001 to the receivers 301 through the ATM switch 280.
  • ATM cells are used as fixed length packets 14 for example.
  • the transmission decoding section 500 includes a function of ATM physical layer processing as shown in Fig. 5.
  • the transmission coding section 400 in each relay station 201 connected to the ATM switch 280 among all relay stations 201 includes a function of ATM physical layer processing as shown in Fig. 5.
  • the transmission decoding section 500 in the relay station 201 which is connected to the ATM switch 280, receives a transmission signal 15 from the transmission station 1001 and reproduces fixed length packets 14.
  • the packets 14 are transferred to the broadcast processing section 900.
  • the broadcast processing section 900 reproduces a plurality of fixed length packets 14 for destination receivers by copying input fixed length packet 14.
  • the section 900 adds each address to a header of each packet 14.
  • Each packet 14 is transferred to the transmission coding section 400.
  • the section 400 delivers each packet 14 to each address. In this case, the section 400 delivers the packet 14 to the ATM network through the ATM switch 280. In the ATM network, each packet 14 is transferred to each receiver 301 corresponding to the address.
  • each receiver 301 can receive a signal modulated by QAM.
  • the transmission coding section 400 in each relay station 201 which is connected to the ATM switch 280 and receivers 302, includes a function of a framing process containing scrambling process and error correcting process, modulating process of QAM modulation for example, and physical layer process as shown in Fig. 4 in addition to the ATM physical layer process as shown in Fig. 5.
  • the transmission decoding section 500 in the relay station 201 receives a transmission signal 15 from the transmission station 1001 and reproduces fixed length packets 14.
  • the packets 14 are transferred to the broadcast processing section 900.
  • the broadcast processing section 900 transfers the packet 14 to the transmission coding section 400 as it is.
  • the section 400 produces a transmission signal 15 based on QAM modulation from input packets 14.
  • the transmission signal 15 is transmitted to the receivers 302.
  • a relay station 201 which does not include the ATM network as a destination of transmitted signals, can be constructed without a broadcast processing section 900.
  • the relay station is constructed such that the transmission decoding section 500 reproduces a fixed length packet stream instead of a multiplexed bits stream from received transmission signal 15 and the transmission coding section 400 changes the fixed length packet stream into a transmission signal 15 corresponding to a characteristic of the transmission line, the construction for exchanging signals between different transmission means is simplified. In other words, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system. Further, a transmission of contents through a plurality of transmission means is rapidly performed by simpler construction.
  • the transmission coding section 400 for transmitting a signal based on QAM or PSK modulation is constructed as shown in Fig. 4.
  • the transmission decoding section 500 for receiving a signal based on QAM or PSK modulation is also constructed as shown in Fig. 4.
  • the transmission coding section 400 for transmitting a signal to an ATM network is constructed as shown in Fig. 5.
  • the transmission decoding section 500 for receiving a signal to an ATM network is also constructed as shown in Fig. 5.
  • an adapter for exchanging contents of media between a multimedia information processing system connected to an ATM network and another multimedia information processing system connected to a transmission means transmitting QAM modulated wave may include functions shown in Figs. 4 and 5.
  • an adapter should include functions shown in Figs. 13 and 18.
  • a fixed packets stream is transferred between the transmission decoding section 500 and the transmission coding section 400 in the relay station 201.
  • the transmission decoding section 500 reproduces an ATM cells stream from an ATM transmission signal outputted from an ATM network or a QAM modulated wave as a transmission signal.
  • the transmission coding section 400 produces an ATM transmission signal or a QAM modulated wave as a transmission signal from an ATM cells stream.
  • the broadcast processing section 900 can add destination addresses to the fixed packets stream directly. Thus, a broadcast transmission is easily achieved.

Abstract

In a multimedia information processing system, a relay station (201) comprises: transmission decoding section (500) for reproducing a fixed packets stream (14) from received transmission signal (15) from a transmitter (1001); signal change processing means (900) for executing changing process for the fixed packets stream (14); and transmission coding section (400) for producing a transmission signal (15) corresponding to a characteristic of a transmission line from the fixed packets stream (14). The construction for exchanging signals between different transmission means is simplified. Thus, it is achieved to exchange contents of media between different transmission means by a simple construction.
Figure imgaf001

Description

    BACKGROUND OF THE INVENTION Field of the Invention
  • The present invention relates to a multimedia information processing system in which a digitalized video signal, an audio signal and other data are coded, multiplexed, and then, transmitted or stored, and the transmitted signal or the stored signal are demultiplexed, and then, decoded to generate the video signal, audio signal and other data. As specific applications of the multimedia information processing system, there are a video on demand (VOD), a digital broadcasting system, and a video conference system.
  • Description of the Prior Art
  • Fig. 10 is a block diagram showing a structure of a video encoder (transmitter) forming a conventional multimedia information processing system described in "A Video Codec for Digital Satellite News gathering Systems", Mitsubishi Electric Corporation Technical Publication, Vol. 67, No. 7, pp 33 - 38, 1993.
  • In Fig. 10, reference numeral 91 is an information-source coding section which inputs a video signal 101, an audio signal 102, and the other data signal 103 and executes data compression for those signals. In the information-source coding section 91, a video coding portion 51 executes information-source coding of the video signal 101 to generate the video coded bits sequence 111. An audio coding portion 512 executes information-source coding of one or more audio signals 102 to generate one or more audio coded bits sequences 112. The data coding portion 513 executes various processings concerning the data signal 103 relating to the video signal 101 or the audio signal 102 to generate a data coded bits sequence 113.
  • A media multiplexing section 92 multiplexes the video coded bits sequence 111, the audio coded bits sequence 112 and the data coded bits sequence 113 from the information-source coding section 91 to generate one multiplexed bits sequence 122. A transmission processing section 93 provides the multiplexed bits sequence 122 with scramble processing and error correction coding in accordance with the types and characteristics of the transmission line. The transmission processing section 93 further executes channel multiplexing processing for the multiplexed bits sequence 122 and one or more other multiplexed bits sequences 123. Furthermore, the transmission processing section 93 executes the formation of a transmission frame and modulating processing and so on are executed to generate a transmission signal 141.
  • Fig. 11 is a block diagram showing a structure of a video decoder (receiver) forming the multimedia information processing system described in the above report. In Fig. 11, reference numeral 96 denotes a receive processing section which receives the transmission signal 141, executes demodulating processing, synchronization of the transmission frame, regeneration of the transmission frame and separation of the channel multiplexing processing to select a specific channel signal. The receive processing section 96 further executes error detecting processing, error correcting processing and descramble processing or the like to reproduce multiplexed bits sequence 122 or one or more other multiplexed bits sequences 123.
  • A media demultiplexing section 95 separates the multiplexed bits sequence 122 into the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113.
  • An information-source decoding section 94 inputs the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113 and also outputs the video signal 101, one or more audio signals 102 and one or more data signals 103. In the information-source decoding section 94, a video decoding portion 514 executes information-source decoding of the video coded bits sequence 111 to reproduce the video signal 101. An audio decoding portion 515 executes information-source decoding of the one or more audio coded bits sequences 112 to reproduce the audio signal 102 relating to the video signal 101. A data decoding portion 516 executes various reverse processings to the data coded bits sequence 113 to reproduce the data signal 103 relating to the video signal 101 and audio signal 102.
  • Fig. 13 is an explanatory diagram showing a general function of the transmission processing section 93 and the receive processing section 96. As shown in Fig. 13, the transmission processing section 93 inputs multiplexed bits sequences and produces transmission signals by performing a framing process, modulation process and physical layer process. The receive processing section 96 receives transmission signals and reproduces multiplexed bits sequences by performing physical layer process, demodulation process and deframing process.
  • Operations in the transmission side of the multimedia information processing system will now be described. The information-source coding section 91 reduces redundant components of the respective signals by use of information-source coding method. Information of the video signal 101 and the one or more audio signals 102 which are accompanied therewith are coded in a video coding portion 511 and audio coding portion 512 respectively. Information of the data signal 103 including synchronization signals and control signals relating to the video signal and audio signal are also coded in a data coding portion 513 as in the case of the video signal and audio signal, thereby converting the data structure to form one or more data coded bits sequences 113.
  • The media multiplexing section 92 multiplexes the video coded bits sequence 111, audio coded bits sequence 112 and data coded bits sequence 113 into one multiplexed bits sequence 122. The multiplexing is executed by use of a given frame as a unit. Fig. 12 is an explanatory view explaining multiplexed frame generated in the media multiplexing section 92. As shown in Fig. 12, a predetermined sized multiplexed frame 80 is composed of a synchronizing information area 81 for securing the synchronization of the multiplexed frame, a video information area 82, audio information area 83 and a data information area 84. The video coded bits sequence 111, the audio coded bits sequence 112 and the data coded bits sequence 113 are provided in the video information area 82, the audio information area 83, and the data information area 84 respectively and are read out in the order shown with arrow in Fig. 12 (from the left upper portion to the right lower portion), so that the multiplexed bits sequence 122 is generated. To multiplex signals using such a multiplexed frame as a unit is referred to as "structure multiplexing" in this specification.
  • The transmission processing section 93 executes scramble processing for the multiplexed bits sequence 122 and adds error correcting codes to the multiplexed bits sequence 122. Further, the transmission processing section 93 executes channel multiplexing for the multiplexed bits sequence 122 and other one or more multiplexed bits sequences 123 to generate a transmission frame. The transmission processing section 93 then executes modulation processing or the like for the transmission frame to generate a transmission signal 141.
  • The scramble processing in the transmission processing section 93 will be described using Fig. 14 (a). Fig. 14 (a) shows one example of a circuit that realize a scramble processing referred to as a PN (Pseudo Noise) signal summing system. In Fig. 14 (a), reference numeral 73a denotes a pseudo random number generator for scramble and 75 an exclusive-OR circuit. The random number generator 73a generates a pseudo random number sequence 74a responsive to an initial value 72a. The exclusive-OR circuit 75 executes exclusive-OR operation of original data 71 and the pseudo random number sequence 74 a as a bit unit to obtain scrambled data 76.
  • A structure of the error correction frame in a case where the transmission processing section 93 executes error correction coding will be described. Fig. 15 is a block diagram of an error correction frame 77 in a case where the Reed-Solomon (RS) code is used as the error correction code. In Fig. 15 reference numeral 78a denotes synchronizing information to establish synchronization of the error correction frame 77, 78b M bytes code word (RS (M, M- N) code word), 79a an information field which stores N bytes information symbols which is protected by the error correction coding, and 79b a check field which stores check symbols which is added to detect error detection.
  • A channel multiplexing method for the P channels in the transmission processing section 93 will be described with reference to Fig. 16. Each channel corresponds to each program in television broadcasting for example. A channel multiplexing frame 90 includes synchronizing information 90a to establish synchronization of the channel multiplexing frame 90. The channel multiplexing is executed by using the structure multiplexing system.
  • A transmission frame will be described with reference to Fig. 17. The transmission frame is defined in dependence on the characteristics of the transmission line. Various transmission frames are defined in accordance with the respective types such as the cable transmission, satellite wave transmission and ground wave transmission and so on. Fig. 17 shows one embodiment of a structure of a transmission frame. As shown in Fig. 17, a transmission frame 85 is composed of an additional information area 86 and a transmission information area (payload) 87. Timing information, synchronizing information and information that is used for securing the transmission line, or the like are contained in the additional information area 86. The information that forms the transmission frame 85 is read out in a desired order shown with the arrows in Fig. 17. After the transmission frame 85 was modulated, it is sent to a transmission line as a transmission signal 141.
  • Next, operations on the receive side of the multimedia information processing system will be described. The operations on the receive side is reverse to those on the transmission side, which were previously described. Namely, after the receive processing section 96 demodulated the received transmission signal 141, it establishes the synchronization of the transmission frame 85 and reproduces, using the synchronizing information in the additional information area 86, and takes out the transmission information area 87. In a case where a signal in the transmission information area 87 is channel multiplexed, the receive processing section 96 establishes the synchronization of the channel multiplexing frame 90 and reproduces, using the synchronizing information 90a, and separates the respective channel information. When each channel information is an error correction coded signal, the receive processing section 96 establishes synchronization of the error correction frame 77 and reproduces, using the synchronizing information 78a. After that, the receive processing section 96 detects errors and correct them.
  • Descramble processing in the receive processing section 96 will be described using Fig. 14 (b). In Fig. 14 (b), reference numeral 73b denotes a pseudo random number generator for descramble and 75 an exclusive-OR circuit. The pseudo random number generator 73b to which an initial value 72b is given generates a pseudo random number sequence 74b. The pseudo random number generator 73b in a descramble circuit has the same structure as the pseudo random number generator 73a shown in Fig. 14 (a). The initial value 72a is the same as the initial value 72b. The value of the pseudo random number sequence 74a coincides with that of the pseudo random number sequence 74b.
  • The media demultiplexing section 95 separates the multiplexed bits sequence 122 into the video coded bits sequence 111, one or more audio coded bits sequences 112 and one or more data coded bits sequences 113. The generation of the multiplexing frame 80 necessary for the separation is executed by using synchronizing information contained in the synchronizing information area 81 within the multiplexing frame 80.
  • In the information-source decoding section 94, The video coded bits sequence 111, audio coded bits sequence 112, and data coded bits sequence 113 are respectively decoded through information-source decoding or various reverse processing by the video decoding section 514, audio decoding section 515 and data decoding section 516 to reproduce the video signal 101, the audio signal 102 relating to the video signal 101 and the data signal 103 relating to the video signal 101 or audio signal 102.
  • Since a conventional multimedia information processing system is constructed as described above, the processing contents in each processing section and the interface signal between the respective processing sections are fixedly indexed. Consequently, the conventional multimedia information lacks wide usableness.
  • Therefore, it is difficult to execute data exchange service among broadcasting system, communication system and storage system in computer. Further, it has been difficult to build hardware and add processing functions while maintaining interchangeable properties with other multimedia information processing systems.
  • Since, in the conventional multimedia information processing system, the video signal, audio signal, and other data have been structure-multiplexed by storing them in given areas in multiplexing frames, multiplexing processing difficult to deal with change in the transmission speed of information to be multiplexed from the respective media and existence of information from the respective media. Further, in a case where the number of media are large, the size of the multiplexing frame must be enlarged. As a result, long time has been required for establishing synchronization of the multiplexing frame on the receiver side.
  • In case the transmission line is a general line and the transmission signal is a modulated wave by Quadrature Amplitude Modulation (QAM) or Phase Shift Keying (PSK) for example, functions of the transmission processing section 93 and the receive processing section 96 are realized as shown in Fig. 13. However, in case the transmission line is an ATM network, the transmission processing section 93 and the receive processing section 96 should perform ATM physical layer process, ATM layer process, and ATM adaptation layer process as shown in Fig. 18. In case contents of media are exchanged between a multimedia information processing system connected to an ATM network and another multimedia information processing system connected to a general transmission line, adapters are required. The adapters must include both functions shown in Figs. 13 and 18 if multiplexed bits streams in both systems are same.
  • SUMMARY OF THE INVENTION
  • The present invention has been made to solve the above problems. The object of the present invention is to provide a multimedia information processing system which can exchange contents of media easily if different transmission means are used and to provide a multimedia information processing system which can rapidly transmit contents to another system through a plurality of transmission means.
  • In a multimedia information processing system according to the present invention, a transmitter comprises: information-source coding processing means for inputting a plurality of media information and coding each media information independently to other media information; packet multiplexing means for producing a multiplexed stream by packet-multiplexing coded bits streams produced by the information-source coding processing means, each stream independent to other streams; fixed length packet producing means for allocating the multiplexed stream into a fixed length packet; and transmission coding means for producing a transmission signal from the fixed length packet.
  • According to such a structure, processes from a process of inputting elements of media to a process of remultiplexing and transmitting are constructed hierarchically. Thus, such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on.
  • The fixed length packet producing means allocates the multiplexed stream into an ATM cell. Thus, the system can easily adopt to ATM cells which are fixed length packets.
  • The transmission coding means executes transmission processing of ATM physical layer. Thus, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
  • In a multimedia information processing system according to the present invention, a receiver comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal; fixed length packet disassembling means for extracting a multiplexed stream from the fixed packets stream; media separating means for reproducing coded bits streams for respective media from the multiplexed stream, each bits stream independent to other bits stream; and information-source decoding processing means for decoding the coded bits streams for respective media.
  • According to such a structure, processes from a receiving process to reproducing process of elements of media are constructed hierarchically. Thus, such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on.
  • The fixed length packet disassembling means extracts the multiplexed stream from an ATM cells stream. Thus, the system can easily adopt to ATM cells which are fixed length packets.
  • The transmission decoding means executes receive processing of ATM physical layer. Thus, it becomes to be possible to receive and decode transmit signals which adapt to a characteristic of the ATM network.
  • In a multimedia information processing system according to the present invention, a relay station comprises: transmission decoding means for reproducing a fixed packets stream from received transmission signal from a transmitter; signal change processing means for executing changing process for the fixed packets stream; and transmission coding means for producing a transmission signal corresponding to a characteristic of a transmission line from the fixed packets stream.
  • The construction for exchanging signals between different transmission means is simplified. Thus, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system.
  • The transmission decoding means reproduces an ATM cells stream as the fixed packets stream, and the transmission coding means produces the transmission signal from said ATM cells stream.
  • The signal change processing means includes broadcast processing means for executing broadcast control so as to transmit the transmission signal to a plurality of receivers.
  • The broadcast processing means writes addresses of receivers in headers of the fixed length packets.
  • According to such a structure, the broadcast processing section can add destination addresses to the fixed packets stream directly. Thus, a broadcast transmission is easily achieved.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • Fig. 1 is a block diagram showing a structure of a receiver in a multimedia information processing system according to the first embodiment of the present invention;
    • Fig. 2. is a block diagram showing a construction of information-source coding section;
    • Fig. 3 is an explanatory diagram showing a reference between a multiplexed bits stream using TS packet and a fixed length packet using ATM cell;
    • Fig. 4 is an explanatory diagram showing a general function of the section for transmission line;
    • Fig. 5 is an explanatory diagram showing a general function of the transmission coding section in case an ATM network is used as a transmission line;
    • Fig. 6 is a block diagram showing a structure of a receiver in a multimedia information processing system according to the second embodiment of the present invention;
    • Fig. 7. is a block diagram showing a construction of information-source decoding section;
    • Fig. 8 is a block diagram showing a structure of a relay station in a multimedia information processing system according to the third embodiment of the present invention;
    • Fig. 9 is a connection diagram showing a connection of multimedia information processing systems.
    • Fig. 10 is a block diagram showing a structure of a transmitter in a conventional multimedia information processing system;
    • Fig. 11 is a block diagram showing a structure of a receiver in a conventional multimedia information processing system;
    • Fig. 12 is a view explaining a structure of a multiplexed frame in a multimedia information processing system;
    • Fig. 13 is an explanatory diagram showing a general function of the transmission processing section and the receive processing section in case ATM network is not used.
    • Fig. 14(a) is a view explaining scramble processing in a multimedia information processing system;
    • Fig. 14(b) is a view explaining de-scramble processing in a multimedia information processing system;
    • Fig. 15 is a block diagram showing a structure of an error correction frame when a Reed-Solomon code is used as an error correction code;
    • Fig. 16 is a view explaining a structure of a channel multiplexed frame in a multimedia information processing system;
    • Fig. 17 is a view explaining a structure of a transmission frame in a multimedia information processing system;
    • Fig. 18 is a explanatory diagram showing a general function of the transmission processing section and the receive processing section in case ATM network is used.
    DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Embodiments of the multimedia information processing system according to the present invention will be described below, with reference to drawings.
  • Embodiment 1
  • Fig. 1 is a block diagram showing another transmitter of a multimedia information processing system according to the present invention. In Fig. 1, reference numeral 100 denotes an information-source coding section for performing information-source coding a video signal 11a, an audio signal 11b and a data signal 11c, 200 a media multiplexing section for producing a multiplexed stream 12 by multiplexing coded bits stream 12a, 12b, 12c from the information-source coding section 100, 300 a fixed length packet generating section for producing a fixed length packet 14 from a multiplexed stream 13, and 400 a transmission coding section for producing a transmission signal 15.
  • Fig. 2 is a block diagram showing a construction of the information-source coding section 100. As shown in Fig. 2, the information-source coding section 100 comprises a video coding portion 61 coding video signals 11a, an audio coding portion 62 coding audio signals 11b and a data coding portion 63 coding data signals 11c.
  • Next, operation is described. In the information-source coding section 100, the video coding portion 61 cuts redundant components of the video signal 11a by using one of a plurality of information-source coding methods and produces a video coded bits stream 12a. The video coding portion 61 outputs the video coded bits stream 12a. The audio coding portion 62 cuts redundant components of the audio signal 11b by using one of a plurality of information-source coding methods and produces an audio coded bits stream 12b. The audio coding portion 62 outputs the audio coded bits stream 12b. The data coding portion 63 inputs synchronizing signals, controlling signals and so on of the video signal 11a and the audio signal 11b, and cuts redundant components of the data signal 11c as same as those of the video signals 11a and the audio signals 11b. If required, the data coding portion 63 changes data structure of data signal 11c and produces a data coded bits stream 12c. The data coding portion 63 outputs the data coded bits stream 12c.
  • The media multiplexing section 200 performs a media multiplexing of coded bits streams 12a, 12b, 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard. Here, the media multiplexing section 200 performs multiplexing in a unit of a packet and produces a multiplexed stream so-called transport stream (TS) or program stream (PS).
  • The fixed length packet generating section 300 allocates multiplexed stream 13 into a fixed length packet 14. Fig. 3 is an explanatory diagram showing a reference between a multiplexed stream 13 using TS packet and a fixed length packet 14 using an ATM cell. As shown in Fig. 3, two TS packets are allocated into a payload on CPCS (Common Part Convergence Sublayer)-PDU (Protocol data Unit) of ATM adaptation layer (AAL), type 5. Here, a TS packet comprises 188 bytes.
  • In case PS packets are allocated into an ATM cell, it is suitable that they are set in a CPCS-PDU payload of AAL, type 5 such that a leading portion of the PS packet, generally variable length packet, is coincide to a leading portion of the payload. It is also suitable that PS packets are set in a CPCS-PDU payload of AAL, type 5 such that a length of PS packet is equivalent to a length of the CPCS-PDU payload and a leading portion of the PS packet is coincide to a leading portion of the payload. Further, it is possible that variable length PS packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
  • It is also possible that TS or PS packets are packed into a payload (47 bytes) of AAL, type 1. In the case, TS or PS packets are packed into a payload such that a leading portion of the TS or PS packet is coincide to a leading portion of the payload as same as in the case regarding ALL, type 5. Alternatively, it is also possible that variable length packets are packed in sequence into the payloads with taking no account to boundaries of the payloads.
  • Fig. 4 is a block diagram showing a construction of the transmission coding section 400. The transmission coding section 400 inputs fixed length packets stream such as an ATM cells stream and produces transmission signals by framing including scrambling and adding error correction codes, modulating and performing physical layer process corresponding to a variation and a characteristic of the transmission line. In case an ATM network is used as the transmission line, the transmission coding section 400 includes a function of ATM physical layer processing as shown in Fig. 5.
  • As described above, according to the present embodiment, processes from a process of inputting elements of media to a process of re-multiplexing and transmitting are constructed hierarchically. Thus, such efficient multiplexing process is performed as is free from a difference between output speeds of information of media to be multiplexed, lack of media and so on. Further, since the fixed length packet generating section 300 allocates multiplexed stream 13 into a fixed length packet, the system can easily adopt to ATM cells which are fixed length packets. Moreover, since the transmission coding section 400 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to transmit signals which adapt to a characteristic of the ATM network.
  • Embodiment 2
  • Fig. 6 is a block diagram showing another receiver of a multimedia information processing system according to the present invention. In Fig. 6, reference numeral 500 denotes a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixed length packets 14, 600 a fixed packet demultiplexing section for disassembling a fixed length packet 14 into a multiplexed stream 13, 700 a media demultiplexing section for reproducing coded bits streams 12a, 12b, 12c by demultiplexing a fixed length packet 14, and 800 a information-source decoding section for reproducing a video signal 11a, an audio signal 11b and a data signal 11c from the bits streams 12a, 12b, 12c.
  • Fig. 7 is a block diagram showing a construction of the information-source decoding section 800. As shown in Fig. 7, the information-source decoding section 800 comprises a video decoding portion 64 decoding and reproducing video signals 11a, an audio decoding portion 65 decoding and reproducing audio signals 11b and a data decoding portion 66 decoding and reproducing data signals 11c.
  • Next, operation is described. The transmission decoding section 500 performs demodulating process when the section 500 receives a transmission signal 15. Next, the section 500 synchronizes demodulated transmission frame and reproduces a transmission frame. Further, the section 500 reproduces fixed length packets 14 by correcting errors in the frame and so forth. Here, in case an ATM network is used as a transmission line, the transmission decoding section 500 should include a function of ATM physical layer processing as shown in Fig. 5.
  • The fixed packet demultiplexing section 600 extracts payloads from fixed length packets 14 and reproduces a multiplexed stream 13. In case the fixed length packet 14 is an ATM cell, a multiplexed stream 13 based on TS packets is reproduced as shown in Fig. 5. The media demultiplexing section 700 demultiplexes the multiplexed stream into a video coded stream 12a, an audio coded stream 12b and a data coded stream 12c according to ISO/IEC 13813-1 (MPEG-2 SYSTEM) standard.
  • In the information-source decoding section, the video decoding portion 64 reproduces video signals 11a from the video coded stream 12a by contrary processing of the processing in the video coding portion 61. The audio decoding portion 65 reproduces audio signals 11b from the audio coded stream 12b by contrary processing of the processing in the audio coding portion 62. The data decoding portion 66 reproduces data signals 11c from the data coded stream 12c by contrary processing of the processing in the data coding portion 63.
  • As described above, according to the present embodiment, processes from a receiving process to reproducing process of elements of media are constructed hierarchically. Thus, such efficient demultiplexing process is performed as is free from a difference between input speeds of information of media, lack of media and so on. Further, since the fixed length packet demultiplexing section 600 extracts multiplexed stream 13 from fixed length packets, the system can easily adopt to ATM cells which are fixed length packets. Moreover, since the transmission decoding section 500 performs ATM physical layer processing in case an ATM network is used as a transmission line, it becomes to be possible to receive and decode transmitted signals which adapt to a characteristic of the ATM network.
  • Embodiment 3
  • Fig. 8 is a block diagram showing a relay station of a multimedia information processing system according to the present invention. In Fig. 8, reference numeral 400 denotes a transmission coding section for producing a transmission signal 15, 500 a transmission decoding section for receiving a transmission signal, synchronizing a transmission frame, correcting errors in the frame and so on forth and for reproducing fixed length packets 14, and 900 a broadcast processing section for adding information based on destination address information 16 to a fixed length packet 14 if necessary. The broadcast processing section 900 is an example of signal change processing means for changing signals of a fixed length packet stream. The section 900 can perform signal changing process, address adding process in this case, for a fixed length packet stream which is independent from a characteristic of each transmission line connected to the system.
  • Fig. 9 is a system construction diagram showing an aspect of connections between multimedia information processing systems. In Fig. 9, 1001 denotes a transmission station, 201 a relay station, 301 a receiver on an ATM network connected to a relay station 201 through an ATM switch 280, 301 a receiver connected directly to a relay station.
  • Next, operation is described. In the system shown in Fig. 9, relay stations 201 are connected to the transmission station 1001 through an ATM network. It will be explained that a relay station 201 connected to the ATM switch 280 and the receivers 302 transmits a transmission signal from the transmission station 1001 to the receivers 301 through the ATM switch 280. Here, ATM cells are used as fixed length packets 14 for example. Thus, in each relay station 201, the transmission decoding section 500 includes a function of ATM physical layer processing as shown in Fig. 5. Further, the transmission coding section 400 in each relay station 201 connected to the ATM switch 280 among all relay stations 201 includes a function of ATM physical layer processing as shown in Fig. 5.
  • The transmission decoding section 500 in the relay station 201, which is connected to the ATM switch 280, receives a transmission signal 15 from the transmission station 1001 and reproduces fixed length packets 14. The packets 14 are transferred to the broadcast processing section 900. The broadcast processing section 900 reproduces a plurality of fixed length packets 14 for destination receivers by copying input fixed length packet 14. The section 900 adds each address to a header of each packet 14. Each packet 14 is transferred to the transmission coding section 400. The section 400 delivers each packet 14 to each address. In this case, the section 400 delivers the packet 14 to the ATM network through the ATM switch 280. In the ATM network, each packet 14 is transferred to each receiver 301 corresponding to the address.
  • Next, It will be explained that a relay station 201 connected to the ATM switch 280 and the receivers 302 transmits a transmission signal from the transmission station 1001 to the receivers 302. Here, each receiver 301 can receive a signal modulated by QAM. Thus, the transmission coding section 400 in each relay station 201, which is connected to the ATM switch 280 and receivers 302, includes a function of a framing process containing scrambling process and error correcting process, modulating process of QAM modulation for example, and physical layer process as shown in Fig. 4 in addition to the ATM physical layer process as shown in Fig. 5.
  • The transmission decoding section 500 in the relay station 201 receives a transmission signal 15 from the transmission station 1001 and reproduces fixed length packets 14. The packets 14 are transferred to the broadcast processing section 900. In this case, the broadcast processing section 900 transfers the packet 14 to the transmission coding section 400 as it is. The section 400 produces a transmission signal 15 based on QAM modulation from input packets 14. The transmission signal 15 is transmitted to the receivers 302.
  • In this embodiment, a relay station 201 which does not include the ATM network as a destination of transmitted signals, can be constructed without a broadcast processing section 900.
  • As described above, since the relay station is constructed such that the transmission decoding section 500 reproduces a fixed length packet stream instead of a multiplexed bits stream from received transmission signal 15 and the transmission coding section 400 changes the fixed length packet stream into a transmission signal 15 corresponding to a characteristic of the transmission line, the construction for exchanging signals between different transmission means is simplified. In other words, it is achieved to exchange contents of media between different transmission means by a simple construction. In addition, exchanging of contents is performed faster than that in the conventional system. Further, a transmission of contents through a plurality of transmission means is rapidly performed by simpler construction.
  • For example, the transmission coding section 400 for transmitting a signal based on QAM or PSK modulation is constructed as shown in Fig. 4. The transmission decoding section 500 for receiving a signal based on QAM or PSK modulation is also constructed as shown in Fig. 4. The transmission coding section 400 for transmitting a signal to an ATM network is constructed as shown in Fig. 5. The transmission decoding section 500 for receiving a signal to an ATM network is also constructed as shown in Fig. 5. Thus, an adapter for exchanging contents of media between a multimedia information processing system connected to an ATM network and another multimedia information processing system connected to a transmission means transmitting QAM modulated wave may include functions shown in Figs. 4 and 5. In the conventional system, an adapter should include functions shown in Figs. 13 and 18.
  • In this embodiment, a fixed packets stream is transferred between the transmission decoding section 500 and the transmission coding section 400 in the relay station 201. In case an ATM cells stream are utilized as the fixed packets stream, the transmission decoding section 500 reproduces an ATM cells stream from an ATM transmission signal outputted from an ATM network or a QAM modulated wave as a transmission signal. The transmission coding section 400 produces an ATM transmission signal or a QAM modulated wave as a transmission signal from an ATM cells stream. Thus, exchanging of contents of media between an ATM network and a non-ATM network is rapidly performed by a simplified construction.
  • Since a fixed packets stream is transferred between the transmission decoding section 500 and the transmission coding section 400, the broadcast processing section 900 can add destination addresses to the fixed packets stream directly. Thus, a broadcast transmission is easily achieved.

Claims (10)

  1. A multimedia information processing system executing transmission and/or storage of multimedia information comprises:
    information-source coding processing means (100) for inputting a plurality of media information (11a,11b,11c) and coding each media information independently to other media information;
    packet multiplexing means (200) for producing a multiplexed stream (13) by packet-multiplexing coded bits streams (12a, 12b, 12c) produced by said information-source coding processing means, each stream independent to other streams;
    fixed length packet producing means (300) for allocating said multiplexed stream (13) into a fixed length packet (14); and
    transmission coding means (400) for producing a transmission signal (15) from said fixed length packet (14).
  2. A multimedia information processing system according to claim 1, wherein said fixed length packet producing means (300) allocates the multiplexed stream into an ATM cell.
  3. A multimedia information processing system according to claim 1 or 2, wherein said transmission coding means (400) executes transmission processing of ATM physical layer.
  4. A multimedia information processing system executing transmission and/or storage of multimedia information comprises:
    transmission decoding means (500) for reproducing a fixed packets stream (14) from received transmission signal (15);
    fixed length packet disassembling means (600) for extracting a multiplexed stream (13) from said fixed packets stream (14);
    media separating means (700) for reproducing coded bits streams (12a,12b,12c) for respective media from said multiplexed stream, each bits stream independent to other bits stream (13); and
    information-source decoding processing means (800) for decoding said coded bits streams (12a,12b,12c) for respective media.
  5. A multimedia information processing system according to claim 4, wherein said fixed length packet disassembling means (600) extracts the multiplexed stream (13) from an ATM cells stream.
  6. A multimedia information processing system according to claim 4 or 5, wherein said transmission decoding means (500) executes receive processing of ATM physical layer.
  7. A multimedia information processing system executing transmission and/or storage of multimedia information comprises:
    transmission decoding means (500) for reproducing a fixed packets stream (14) from received transmission signal (15) from a transmitter (1001);
    signal change processing means (900) for executing changing process for said fixed packets stream (14); and
    coding means for transmission line (400) for producing a transmission signal (15) corresponding to a characteristic of a transmission line from said fixed packets stream (14).
  8. A multimedia information processing system according to claim 7, wherein said transmission decoding means (500) reproduces an ATM cells stream as the fixed packets stream (14), and wherein said transmission coding means (400) produces the transmission signal (15) from said ATM cells stream.
  9. A multimedia information processing system according to claim 7 or 8, wherein said signal change processing means includes broadcast processing means (900) for executing broadcast control so as to transmit the transmission signal to a plurality of receivers (301).
  10. A multimedia information processing system according to claim 9, wherein said broadcast processing means (900) writes addresses of receivers in headers of the fixed length packets (14).
EP96112767A 1996-02-01 1996-08-08 Multimedia information processing system Withdrawn EP0788289A3 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP16754/96 1996-02-01
JP1675496A JP3172425B2 (en) 1995-02-09 1996-02-01 Multimedia information transmission system, multimedia information reception system, multimedia information transmission method, and multimedia information reception method
JP1675496 1996-02-01

Publications (2)

Publication Number Publication Date
EP0788289A2 true EP0788289A2 (en) 1997-08-06
EP0788289A3 EP0788289A3 (en) 2000-04-12

Family

ID=11925041

Family Applications (1)

Application Number Title Priority Date Filing Date
EP96112767A Withdrawn EP0788289A3 (en) 1996-02-01 1996-08-08 Multimedia information processing system

Country Status (4)

Country Link
US (1) US5930251A (en)
EP (1) EP0788289A3 (en)
KR (1) KR100220873B1 (en)
AU (1) AU6077196A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0933941A2 (en) * 1998-01-31 1999-08-04 Ricoh Company Multi-media data automatic delivery system
EP1583315A2 (en) * 1998-11-30 2005-10-05 Microsoft Corporation Proxy for video on demand server control
US7913283B2 (en) 1998-11-30 2011-03-22 Microsoft Corporation Video on demand methods and systems

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19990044344A (en) * 1996-07-02 1999-06-25 이데이 노부유끼 Information transmission device and transmission method
USRE39771E1 (en) * 1996-07-31 2007-08-14 Matsushita Electric Industrial Co., Ltd. Code conversion method and apparatus, code recording medium, code recording apparatus and code reproducing apparatus
US6084910A (en) * 1997-01-31 2000-07-04 Hughes Electronics Corporation Statistical multiplexer for video signals
KR100236965B1 (en) * 1997-11-28 2000-01-15 정선종 Apparatus and method for protecting atm header from the burst error
JP3990813B2 (en) * 1998-05-22 2007-10-17 キヤノン株式会社 Encoding apparatus, encoding method, digital transmission apparatus, and digital transmission system
US6658620B1 (en) * 2000-01-11 2003-12-02 Northrop Grumman Corporation Burst and packet wireless transmission using product codes with iterative decoding
JP2001229137A (en) * 2000-02-17 2001-08-24 Toyo Eng Corp Hosting system
US6714562B1 (en) 2000-03-10 2004-03-30 International Business Machines Corporation Method and apparatus for segmenting network traffic variable length frames
US7017075B1 (en) * 2000-05-12 2006-03-21 Intel Corporation Recovering from video driver errors
JP3888642B2 (en) * 2001-10-05 2007-03-07 アルパイン株式会社 Multimedia information providing method and apparatus
WO2003061299A1 (en) * 2002-01-18 2003-07-24 Koninklijke Philips Electronics N.V. Audio coding
KR100581060B1 (en) * 2003-11-12 2006-05-22 한국전자통신연구원 Apparatus and method for transmission synchronized the five senses with A/V data
KR100690797B1 (en) * 2005-01-27 2007-03-09 엘지전자 주식회사 Conditional access broadcasting system and method thereof
US7965736B2 (en) * 2005-08-24 2011-06-21 Qualcomm Incorporated Transmission of multiplex protocol data units in physical layer packets
US20070058730A1 (en) * 2005-09-09 2007-03-15 Microsoft Corporation Media stream error correction
JP4275167B2 (en) * 2006-11-24 2009-06-10 株式会社エヌ・ティ・ティ・ドコモ Transmitter
JP5266450B2 (en) * 2007-08-27 2013-08-21 アップル インコーポレイテッド Method and communication apparatus in radio communication system
US9300412B2 (en) * 2007-09-11 2016-03-29 The Directv Group, Inc. Method and system for operating a receiving circuit for multiple types of input channel signals
US20090070829A1 (en) * 2007-09-11 2009-03-12 The Directv Group, Inc. Receiving circuit module for receiving and encoding channel signals and method for operating the same
US8973058B2 (en) * 2007-09-11 2015-03-03 The Directv Group, Inc. Method and system for monitoring and simultaneously displaying a plurality of signal channels in a communication system
US9756290B2 (en) * 2007-09-11 2017-09-05 The Directv Group, Inc. Method and system for communicating between a local collection facility and a remote facility
US9313457B2 (en) 2007-09-11 2016-04-12 The Directv Group, Inc. Method and system for monitoring a receiving circuit module and controlling switching to a back-up receiving circuit module at a local collection facility from a remote facility
US8988986B2 (en) 2007-09-12 2015-03-24 The Directv Group, Inc. Method and system for controlling a back-up multiplexer in a local collection facility from a remote facility
US8724635B2 (en) * 2007-09-12 2014-05-13 The Directv Group, Inc. Method and system for controlling a back-up network adapter in a local collection facility from a remote facility
US9037074B2 (en) * 2007-10-30 2015-05-19 The Directv Group, Inc. Method and system for monitoring and controlling a local collection facility from a remote facility through an IP network
US9049354B2 (en) * 2007-10-30 2015-06-02 The Directv Group, Inc. Method and system for monitoring and controlling a back-up receiver in local collection facility from a remote facility using an IP network
US9049037B2 (en) * 2007-10-31 2015-06-02 The Directv Group, Inc. Method and system for monitoring and encoding signals in a local facility and communicating the signals between a local collection facility and a remote facility using an IP network
JP5205075B2 (en) * 2008-02-13 2013-06-05 パナソニック株式会社 Encryption processing method, encryption processing device, decryption processing method, and decryption processing device
US9762973B2 (en) * 2008-11-04 2017-09-12 The Directv Group, Inc. Method and system for operating a receiving circuit module to encode a channel signal into multiple encoding formats
KR101401746B1 (en) 2009-10-29 2014-05-30 한국전자통신연구원 Apparatus and method for multiplexing of multimedia data
US9831971B1 (en) 2011-04-05 2017-11-28 The Directv Group, Inc. Method and system for operating a communication system encoded into multiple independently communicated encoding formats

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0271866A2 (en) * 1986-12-18 1988-06-22 Mitsubishi Denki Kabushiki Kaisha Subrate multimedia data transmission control system
EP0571647A1 (en) * 1992-05-25 1993-12-01 Siemens Aktiengesellschaft Method of broadcasting information cells transmitted according to an asynchronous transfer mode
EP0624040A2 (en) * 1993-05-03 1994-11-09 AT&T Corp. System for composing multimedia signals for interactive television services
US5459506A (en) * 1993-12-28 1995-10-17 At&T Corp. Enhanced pay per view system
US5467342A (en) * 1994-01-12 1995-11-14 Scientific-Atlanta, Inc. Methods and apparatus for time stamp correction in an asynchronous transfer mode network
CA2124610A1 (en) * 1994-05-30 1995-12-01 Charles Kevin Huscroft Integrated User Network Interface Device
EP0691759A2 (en) * 1994-07-07 1996-01-10 Gpt Limited PON (Passive Optical Network) with spectrum division for starting up and configuration the network

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3002471B2 (en) * 1988-08-19 2000-01-24 株式会社日立製作所 Program distribution device
DE69230481T2 (en) * 1991-01-22 2000-05-18 Canon Kk Multimedia transmission arrangement
JPH05122391A (en) * 1991-05-08 1993-05-18 Fujitsu Ltd Information collection service system
JP3262142B2 (en) * 1992-01-16 2002-03-04 富士通株式会社 ATM cell forming apparatus, ATM cell forming method, node, and multiplexing method in node
JP3002348B2 (en) * 1992-11-30 2000-01-24 シャープ株式会社 Image communication system
EP1024664B1 (en) * 1993-12-24 2002-05-29 Sharp Kabushiki Kaisha Image-information storage regenerating device
US5600633A (en) * 1995-02-24 1997-02-04 Lucent Technologies Inc. Wireless telecommunication base station for integrated wireless services with ATM processing
US5627836A (en) * 1995-01-31 1997-05-06 Bell Atlantic Network Services, Inc. VPI/VCI administration
US5671226A (en) * 1995-02-09 1997-09-23 Mitsubishi Denki Kabushiki Kaisha Multimedia information processing system
US5544161A (en) * 1995-03-28 1996-08-06 Bell Atlantic Network Services, Inc. ATM packet demultiplexer for use in full service network having distributed architecture
US5684799A (en) * 1995-03-28 1997-11-04 Bell Atlantic Network Services, Inc. Full service network having distributed architecture
JPH08331141A (en) * 1995-06-01 1996-12-13 Hitachi Ltd Cell/packet assembling/disassembling device and network system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0271866A2 (en) * 1986-12-18 1988-06-22 Mitsubishi Denki Kabushiki Kaisha Subrate multimedia data transmission control system
EP0571647A1 (en) * 1992-05-25 1993-12-01 Siemens Aktiengesellschaft Method of broadcasting information cells transmitted according to an asynchronous transfer mode
EP0624040A2 (en) * 1993-05-03 1994-11-09 AT&T Corp. System for composing multimedia signals for interactive television services
US5459506A (en) * 1993-12-28 1995-10-17 At&T Corp. Enhanced pay per view system
US5467342A (en) * 1994-01-12 1995-11-14 Scientific-Atlanta, Inc. Methods and apparatus for time stamp correction in an asynchronous transfer mode network
CA2124610A1 (en) * 1994-05-30 1995-12-01 Charles Kevin Huscroft Integrated User Network Interface Device
EP0691759A2 (en) * 1994-07-07 1996-01-10 Gpt Limited PON (Passive Optical Network) with spectrum division for starting up and configuration the network

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0933941A2 (en) * 1998-01-31 1999-08-04 Ricoh Company Multi-media data automatic delivery system
EP0933941A3 (en) * 1998-01-31 2001-09-12 Ricoh Company Multi-media data automatic delivery system
US6725460B1 (en) 1998-01-31 2004-04-20 Ricoh Company, Ltd. Multi-media data automatic delivery system
US7350223B2 (en) 1998-01-31 2008-03-25 Ricoh Company, Ltd. Multi-media data automatic delivery system
EP1583315A2 (en) * 1998-11-30 2005-10-05 Microsoft Corporation Proxy for video on demand server control
EP1583315A3 (en) * 1998-11-30 2005-12-28 Microsoft Corporation Proxy for video on demand server control
US7865919B2 (en) 1998-11-30 2011-01-04 Microsoft Corporation Proxy for video on demand server control
US7913283B2 (en) 1998-11-30 2011-03-22 Microsoft Corporation Video on demand methods and systems

Also Published As

Publication number Publication date
KR970063018A (en) 1997-09-12
KR100220873B1 (en) 1999-09-15
EP0788289A3 (en) 2000-04-12
AU6077196A (en) 1997-08-07
US5930251A (en) 1999-07-27

Similar Documents

Publication Publication Date Title
US5930251A (en) Multimedia information processing system
CA2176131C (en) Interactive information services control system
US5671226A (en) Multimedia information processing system
US6034732A (en) Digital broadcast receiving terminal apparatus
Smith Digital transmission systems
US5828403A (en) Method and system for selecting and receiving digitally transmitted signals at a plurality of television receivers
JP2933133B2 (en) Digital video signal multiplexing and separation systems
US5856988A (en) Method and apparatus for data transmission
KR19990044344A (en) Information transmission device and transmission method
US5488653A (en) Facsimile interface unit (FIU) enhanced capabilities negotiation
CN101517553A (en) Methods and apparatus for packetization of content for transmission over a network
JP2000295189A (en) Transmitter and receiver
US7415528B2 (en) Apparatus and method for transmitting hierarchically multimedia data TS to prevent jitter of timing information and for recovering the multimedia data TS
US6636531B1 (en) Communication device and method
KR100579132B1 (en) Apparatus and Method of the hierarchical transmission of a multimedia data TS for preventing the jitter of timing information, and Apparatus and Method of recovering a multimedia data TS transmitted hierarchically
US5978361A (en) ATM digital radio transmission method and system therefor
JP3172425B2 (en) Multimedia information transmission system, multimedia information reception system, multimedia information transmission method, and multimedia information reception method
US6108348A (en) 2.4-to-3 kbps rate adaptation apparatus for use in narrowband data and facsimile communications systems
JP2001078158A (en) Transmitting device, multiplexing device and receiving device for cable television
JP3512916B2 (en) Data transmission system
JP5012840B2 (en) Sender network and broadcasting system
KR100403889B1 (en) OOB physical layer processing equipment applying to POD module of the open cable
JP3361786B2 (en) Data storage communication device
US6801495B1 (en) High capacity robust modem for multiple classes of services
KR100199960B1 (en) Apparatus for generating and reproducing sync. clock

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE FR GB

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE FR GB

17P Request for examination filed

Effective date: 20000824

17Q First examination report despatched

Effective date: 20010622

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20030917