US20030161324A1 - System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost - Google Patents

System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost Download PDF

Info

Publication number
US20030161324A1
US20030161324A1 US10/341,950 US34195003A US2003161324A1 US 20030161324 A1 US20030161324 A1 US 20030161324A1 US 34195003 A US34195003 A US 34195003A US 2003161324 A1 US2003161324 A1 US 2003161324A1
Authority
US
United States
Prior art keywords
data
audio
samples
receiver
bits
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/341,950
Inventor
Robert Clemens
Thomas Metcalf
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Square 1 Bank
Original Assignee
Aviom Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aviom Inc filed Critical Aviom Inc
Priority to US10/341,950 priority Critical patent/US20030161324A1/en
Assigned to AVIOM, INC. reassignment AVIOM, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CLEMENS, ROBERT P., METCALF, THOMAS D.
Publication of US20030161324A1 publication Critical patent/US20030161324A1/en
Assigned to SQUARE 1 BANK reassignment SQUARE 1 BANK ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AVIOM, INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0078Avoidance of errors by organising the transmitted data in a format specifically designed to deal with errors, e.g. location
    • H04L1/0083Formatting with frames or packets; Protocol or part of protocol for error control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/28Arrangements for simultaneous broadcast of plural pieces of information
    • H04H20/30Arrangements for simultaneous broadcast of plural pieces of information by a single channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H20/00Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/65Arrangements characterised by transmission systems for broadcast
    • H04H20/76Wired systems
    • H04H20/82Wired systems using signals not modulated onto a carrier
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/09Arrangements for device control with a direct linkage to broadcast information or to broadcast space-time; Arrangements for control of broadcast-related services
    • H04H60/11Arrangements for counter-measures when a portion of broadcast information is unavailable
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0041Arrangements at the transmitter end
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0045Arrangements at the receiver end
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056Systems characterized by the type of code used
    • H04L1/0057Block codes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056Systems characterized by the type of code used
    • H04L1/0061Error detection codes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056Systems characterized by the type of code used
    • H04L1/007Unequal error protection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/20Arrangements for detecting or preventing errors in the information received using signal quality detector
    • H04L1/203Details of error rate determination, e.g. BER, FER or WER
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1854Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with non-centralised forwarding system, e.g. chaincast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1101Session protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/70Media network packetisation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/281Protocol or standard connector for transmission of analog or digital data to or from an electrophonic musical instrument
    • G10H2240/311MIDI transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04HBROADCAST COMMUNICATION
    • H04H60/00Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/02Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information
    • H04H60/04Studio equipment; Interconnection of studios
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0002Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/0001Systems modifying transmission characteristics according to link quality, e.g. power backoff
    • H04L1/0023Systems modifying transmission characteristics according to link quality, e.g. power backoff characterised by the signalling
    • H04L1/0026Transmission of channel quality indication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0056Systems characterized by the type of code used
    • H04L1/0071Use of interleaving

Definitions

  • the invention relates generally to digital audio and video data transmission, and in particular, to transmitting multiple channels of digital audio and video data over serial data links.
  • a packet-switched network system or circuit-switched network system provides some of the most common methods of transmitting and receiving electronic data. It should be noted, however, that transmission errors may exist in any kind of data transmission.
  • a packet-switched network for instance, can be affected by transmission errors such as loss of packets.
  • control data bits such as check sum bits or parity bits
  • this method of adding control data bits can help minimize transmission errors, it may not be desirable in all situations.
  • a parity bit scheme could be used to detect certain transmission errors, it may not be able to detect errors in which an even number of bits in the same data unit are changed due to electrical noise.
  • a packet-switched system may be used for transmitting and receiving audio or video data in real-time.
  • any transmission error can cause significant impact on the audio or video receiver, and may result in a transmission delay.
  • the delay can cause severe impact on the quality of the output audio or video data.
  • An audio mixer for example, is a device that typically relies on real-time communication of data.
  • An audio mixer allows multiple audio sources (i.e., input data channels) to be individually controlled and added together (hence the name “mixer”) to produce one or more audio outputs suitable for broadcast to many users.
  • Audio mixers are used today in a variety of applications, providing many functions, including, among others, transmitting, receiving, recording, enhancing, and presenting audio data. Any data transmission problems, such as loss or delay of data packets, may result in the reduced functionality of the audio mixer.
  • the present invention is directed to a data transmission and distribution system that includes a series of payloads, where each of the payloads is formed from bits of audio or video information, and where different levels of protection are applied to different sets of bits in each payload.
  • the system divides the bits associated with each payload into high priority bits and low priority bits and forms a group of check bits for each payload by applying an error correction algorithm to the high priority bits in the payload.
  • the system also forms each payload from a first set of the high priority bits, the check bits, the low priority bits and a redundant set of the high priority bits and the check bits and transmits the payloads formed from the first set of the high priority bits, the check bits, the low priority bits and the redundant set of the high priority bits and the check bits.
  • the present invention is also directed to a data transmission and distribution system that includes a transmitter and a receiver.
  • the transmitter transmits a count value associated with a data clock of the transmitter to the receiver over an asynchronous link as part of an information payload that also includes audio or video information.
  • the data clock is synchronously recreated at the receiver using only a system clock associated with the receiver and the transmitted count value.
  • the present invention is also directed to a data transmission and distribution system that includes a series of payloads.
  • Each of the payloads is formed from samples of audio or video information.
  • the system interleaves the audio or video samples in each payload where no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples.
  • the present invention is also directed to a system for transmitting and distributing audio or video information.
  • the system includes a plurality of input modules arranged in series along at least one chain of high speed serial data links that end with a master module.
  • Each input module receives mixing instructions addressed to that module and then passes a signal mixed in accordance with the instructions to the next input module in the chain where no human perceptible delay is introduced into the mixed signal as it moves through the chain.
  • the system includes a plurality of control surfaces for simultaneously controlling system parameters associated with each of the input modules and output busses.
  • One or more of the control surfaces are physically separated in location from the input, output and master modules.
  • the system includes a digitally remote controlled microphone preamp controlled from a control surface that is physically separated from the preamp, the input, output and master modules.
  • the control data is sent from the control surface to adjust the microphone preamp's gain at an input module.
  • the system includes a protocol that automatically enumerates each audio channel of at least one of the input modules in a manner that assigns the each audio channel of the at least one input module to a given channel regardless of the order in which the input modules are connected along the chain.
  • the system includes a one or more output modules.
  • Each input module in the chain has a defined delay that is used to maintain a final mix in a time aligned format.
  • the present invention is also directed to a system for transmitting and distributing audio or video information.
  • the system includes a multi-channel input module and multiple receivers arranged along at least one chain of high speed serial data links where each receiver can tap into a common set of digital channels generated by a transmitter.
  • Each receiver can create its own user adjustable mix based on one or more signals from the common set of digital channels.
  • each receiver can output one or more signals from the common set of digital channels.
  • each receiver employs a digitally controlled analog master audio gain control that automatically adjusts itself to keep an overall output volume constant when an individual channel's volume is raised to its maximum digital level.
  • the system automatically lowers the digital volume levels of all other channels and raises the master gain, thereby effectively raising the volume of the channel that is at its maximum digital level thus allowing greater dynamic range control of the digital mix.
  • FIG. 1 is a block diagram showing one embodiment of a data transmission system, in accordance with the present invention.
  • FIG. 2 is a diagram showing a detailed representation of the payload, in accordance with the present invention.
  • FIG. 3 is a diagram showing a detailed representation of one 24-bit sample used in the payload, in accordance with the present invention.
  • FIG. 4 is a diagram showing detailed representation of low priority bits used in the payload, in accordance with the present invention.
  • FIG. 5 is a block diagram showing a data transmission and data clock recreation system, in accordance with the present invention.
  • FIG. 6 is a diagram showing one embodiment of a data mixing and distribution system, in accordance with the present invention.
  • FIG. 7 is a block diagram showing an expanded view of the transmitter in FIG. 6, in accordance with the present invention.
  • FIG. 8 is a block diagram showing an expanded view of the receiver in FIG. 6, in accordance with the present invention.
  • FIG. 9 is a block diagram showing another embodiment of a data mixing and distribution system, in accordance with the present invention.
  • FIG. 10 is a block diagram showing an expanded view of the master module in FIG. 9, in accordance with the present invention.
  • FIG. 11 is a block diagram showing an expanded view of the input module in FIG. 9, in accordance with the present invention.
  • FIG. 12 is a block diagram showing an expanded view of the receiver in FIG. 9, in accordance with the present invention.
  • FIG. 13 is a block diagram showing an expanded view of the control surface in FIG. 9, in accordance with the present invention.
  • FIG. 14 is a diagram showing yet another embodiment of data mixing and distribution system, in accordance with the present invention.
  • ASIC Application-Specific Integrated Circuit
  • Bit Clock shall mean a clock signal that tracks the bits of audio data coming out of the A/D (analog to digital) or going into the D/A (digital to analog) converters.
  • Center Section shall mean a section of data that contains the lower bits of the audio sample data.
  • Channel shall mean a separate line of audio data, where each channel represents a stream of audio data.
  • “Critical data” shall mean the data that cannot be lost without having to interpolate missing data on the receiver.
  • CRC Cyclic Redundancy Check
  • ECC Error Correction Code
  • Ethernet L/R Count or “ELR Count” shall mean the number of Ethernet clocks per payload (defined by a fixed number of L/R clocks), as counted on the transmitter and sent to the receiver.
  • Ethernet Clock shall mean the clock signal that drives the data across the Ethernet.
  • FEC Forward Error Correction
  • data can be encoded with extra “check” bits prior to transmission.
  • the check bits provide a way of not only detecting bit errors, but correcting them as well, avoiding retransmission (which would not be acceptable for audio or video streaming applications). See ECC.
  • “Frame” shall mean a package of data that is recognized by the hardware interfacing with the outside world. Data sent using Ethernet drivers must be framed following the Ethernet protocol. The application-specific data contained within the frame is independent of the Ethernet standard.
  • Idle shall mean the time between frames that the line has no activity.
  • Left/Right Clock or “L/R Clock” shall mean the clock signal that tracks the start of each new sample.
  • Medium Access Control or “MAC” shall mean the layer of hardware that resides above the Physical Layer. At this layer, data packets are encoded and decoded.
  • Master Clock shall mean the clock signal that drives the A/D's and D/A's.
  • Payload shall mean a collection of frames that contains the encoded data that is sent over the CAT-5 wire.
  • Phased Lock Loop or “PLL” shall mean a section of hardware that can be used to smooth out irregularities in a clock signal, such as a “jitter filter,” or it can be used as a frequency multiplier.
  • Physical Layer or “PHY Layer” or “PHY” shall mean the lowest hardwood layer where the data meets the wire. This layer conveys the bit stream, including electrical impulse, light or radio signal, through the network at the electrical and mechanical level.
  • Preamble shall mean a series of eight (8) specific bytes, dictated by the Ethernet standard and recognized by the hardware, that indicate the start of a frame.
  • Primary Section shall mean a section of data that contains the higher bits of the audio or video sample data. The data in this section is critical and warrants the highest protection in the system.
  • Redundant Section shall mean a section of data that contains a copy of the Priority Section. It is provided as a backup of the data in the event that some or all of the data in the Priority Section is lost.
  • sample shall mean an item of data that represents voltage level of an analog voltage waveform at a given point in time.
  • Sample Rate shall mean the number of samples of an analog signal that are taken per second to represent the event digitally.
  • a novel system and method for facilitating data transmission and distribution, and in particular, transmission and distribution of audio data and/or video data is provided.
  • the system and method of the present invention can be implemented in a variety of system configurations, including without limitation, a multiplexer system that combines multiple signals, including analog or digital or combination thereof, received from multiple input sources for transmission over a single line or medium.
  • FIG. 1 One embodiment of the present invention relating to data transmission using data transmission system 100 is illustrated in FIG. 1. It should be noted that the configuration of data transmission system 100 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • system 100 includes transmitter 105 coupled to receiver 107 .
  • Transmitter 105 receives data from one or more channels 110 and transmit it over link 120 to receiver 107 .
  • transmitter 105 uses data packets to transmit data.
  • the data packets used in system 100 follow a data transmission protocol (“DTP”), which provides efficient data transmission while maintaining a high level of data integrity. More specifically, upon receiving data from channels 110 , transmitter 105 packetizes (or constructs) the received data into one or more packets using the DTP and transmits the packets to receiver 107 over link 120 . Once received, the packets are de-packetized into (or reassembled into) the data using the DTP at receiver 107 .
  • DTP data transmission protocol
  • System 100 includes link 120 comprising Category-5 (or Cat-5) cable, along with standard Ethernet 100 Mbit PHY hardware.
  • link 120 comprising Cat-5 cable and the standard Ethernet 100 Mbit PHY hardware allows a 100 Mb serial data transmission rate between transmitter 105 and receiver 107 .
  • the configuration allows over 48 channels (i.e., audio channels) 110 to fit onto transmitter 105 .
  • link 120 may comprise other types of communication medium, including without limitation, CAT-5 10-baseT, CAT-5 100-baseT, 1 gigabit Ethernet, 100 gigabit Ethernet, other versions of Ethernet, infra-red, RF, wired, wireless, optical, or laser link.
  • transmitter 105 receives data from one or more input channels 110 , packetizes the data, and transmits the packetized data to receiver 107 .
  • the DTP has bi-directional capability and supports transmission and distribution of multiple types of data, such as audio data, video data, and other generic data, including control data.
  • Some examples of data protocols supported are Musical Instrument Digital Interface (MIDI), USITT DMX512/1990 (DMX), mouse, keyboard, and proprietary system control data.
  • the DTP is a protocol for multiplexing many channels of data—i.e., the DTP is used to receive data from multiple sources, packetize the data, transmit the packetized data over a serial data link, and de-packetize and reconstruct the source data.
  • the DTP provides, among other things, a variable bit protection scheme, error detection and correction scheme, and data smoothing technique scheme. These schemes provided by the DTP facilitate efficient and effective data transmission and distribution while maintaining data integrity.
  • the DTP allows a scalable data transmission and distribution (e.g., the number of data channels and the quality of data channels can be scaled) to suit a particular system configuration having a particular transmission link bandwidth.
  • a data packet which follows the DTP, in accordance with the present invention, includes the payload that can be configured to best suit the given configuration of a given data transmission and/or distribution system. More specifically, the DTP provides, among other things, a payload structure that yields less delay time, more channels, and a higher sample rate, all of which may be required to suit the need of the given system configuration.
  • the payload structure of the DTP is designed to withstand a noise burst, which can destroy over half of the payload, without having to interpolate a missed sample.
  • FIG. 2 shows the structure of payload 200 included in a data packet that follows the DTP to transmit data over a serial data link. Note that the embodiment of payload 200 as shown in FIG. 2 relates to receiving, packetizing, transmitting, and distributing 48 input channels of 24-bit audio data over Category-5 cable using standard Ethernet 100 Mbit PHY hardware. This configuration results in a 100 Mb serial data transmission rate.
  • payload 200 as shown in FIG. 2 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • payload 200 is equally applicable to other types of data, such as video data and other generic data including control data.
  • the DTP provides for, as noted, adjusting of channel count, channel quality, and channel type (audio data, video data, and/or control data), based on the available link bandwidth and desired system robustness (error immunity) for a given system's architecture and purpose.
  • payload 200 is used to receive more than (or alternatively, less than) 48 channels of data.
  • payload 200 is designed to provide varying levels of protection on different sets of bits in payload 200 .
  • bit-splitting audio data into several sets of varying priorities, the most important bits can be protected with an FEC algorithm and redundancy, the moderately important bits protected with redundancy alone, and the least important bits protected by that what is inherent within the transmission medium's physical layer.
  • payload 200 facilitates a robust data transmission and distribution within the time allotted while maintaining data integrity.
  • payload 200 comprises three sections: priority section 210 , center section 220 , and redundant section 230 .
  • Redundant section 230 is an exact copy of priority section 210 .
  • the priority section 210 contains all of the critical data of payload 200 .
  • the “critical data” is the data that cannot be lost without having to interpolate missing data on the receiver.
  • the ELR count which is used to generate the L/R Clock on a receiver, for example, is contained in priority section 210 .
  • Priority section 210 comprises twenty frames 240 (i.e., Frame Nos. 1-20). Note that each frame 240 in priority section 210 includes preamble 250 , audio data 252 , reserved data 254 , and CRC-32 checksum 256 . Also note that, for the purposes of completeness, idle time 258 is included at the end of each frame 240 .
  • Audio data 252 includes, as described below, high priority bits of data required to deliver proper audio information.
  • Preamble 250 comprises 8 bytes of preamble data that are defined by the Ethernet standard.
  • the preamble data includes a sequence of bytes that the PHY Layer needs to see in order to recognize the start of frame 240 .
  • the line At the end of frame 240 , the line must go idle for 960 ns, a period of time which is equivalent to 12 bytes. This period allows the PHY Layer to reset and begin searching for the next preamble.
  • CRC-32 checksum 256 of each frame 240 .
  • the 32 bit CRC serves as a first line of protection against data transmission errors. If the CRC for frame 240 is good, for instance, it is assumed that frame 240 is valid and no further error detection or data recovery needs to occur.
  • the DTP is a protocol for handling multiple channels of incoming data.
  • Reserved data 254 includes a reserved space for accommodating additional or future data.
  • the ELR count resides in reserved data 254 .
  • MIDI files use reserved data 254 during data transmission and/or distribution.
  • redundant section 230 of payload 200 contains an exact copy of the frames that appear in priority section 210 .
  • redundant section 230 comprises twenty frames 240 ′ (i.e., Frame Nos. 23-42).
  • each frame 240 ′ in redundant section 230 includes preamble 250 ′, audio data 252 ′, reserved data 254 ′, CRC-32 checksum 256 ′, and idle time 258 ′.
  • including a duplicate copy of priority section 210 in payload 200 provides a protection against two types of common errors: a burst error that can wipe out the entire set of frames in priority section 210 and a single bit error in preamble 250 that could cause a frame 240 to be dropped by the PHY Layer.
  • These types of data transmission errors can be greatly minimized by including redundant section 240 ′ in addition to priority section 240 in payload 200 .
  • receiver 107 After receiving packetized data, receiver 107 has several options if an error is detected. The first approach for error detection and recovery would be, as noted, to check the CRC (i.e., 32-bit CRC checksum 256 ) of priority frames 240 . If the CRC is good, the priority frame 240 can be used. On the other hand, if the CRC is bad, the respective redundant frame 240 ′ can be checked. If the redundant CRC is good, the respective redundant frame 240 ′ can be used.
  • CRC i.e., 32-bit CRC checksum 256
  • payload 200 further comprises center section 220 , which includes two (2) frames (i.e., Frame Nos. 21 and 22). Like that of priority section 210 and redundant section 230 , each frame 240 ′′ in center section 220 includes preamble 250 ′′, audio data 252 ′′, reserved data 254 ′′, CRC-32 checksum 256 ′′, and idle time 258 ′′.
  • each frame 240 of priority section 210 includes five samples, resulting in the total of 100 samples per priority section 210 (or five samples per frame times twenty frames). Likewise, the same number of samples exist in redundant section 230 since it is an exact copy of priority section 210 .
  • the number of samples per payload 200 could be modified. That is, the number of samples could be changed to another figure—e.g., 96 samples per payload 200 . If 96 samples are used, for instance, priority section 210 would include 16 frames with 6 samples per frame 240 .
  • each sample comprises 24-bit data.
  • each 24-bit sample is designated as having 11 bits of high priority data required to deliver proper audio information (to a receiver or other receiving unit) and 13 low priority data that adds dynamic range and definition. From the eleven bits in the high priority data, 9 bits are considered critical. Accordingly, these twenty-four bits can be divided into three sets of varying audio priorities—i.e., a first set having bits 1 - 9 that are high priority and critical, a second set having bits 10 - 11 that are high priority but non-critical, and a third set having bits 12 - 24 that are not high priority. These 24 bits can be treated differently based on the significance attached to each set of bits.
  • FIG. 3 is a detailed representation of one 24-bit sample data 310 .
  • FIG. 3 illustrates a scheme of splitting bits of sample data 310 into multiple sets of priorities.
  • the first eleven bits are designated as high priority bits 312 .
  • the first nine bits are designated as critical bits 314 and the remaining two bits are designated as high priority, non-critical bits 316 .
  • the remaining 13 bits in sample data 310 i.e., bits 12 - 24 ) are designated as low priority bits 320 .
  • FIG. 4 shows a detailed representation of how low priority bits 320 of each sample are sample-split into Frames Nos. 21 and 22 in center section 220 .
  • the low priority bits 320 from samples 1 - 50 are placed in Frame No. 21 of center section 220 .
  • the low priority bits 320 from samples 51 - 100 are placed in Frame No. 22 of center section 220 .
  • each of the two frames (i.e., Frames 21 and 22 ) in center section 220 contains the 13 bits of low priority bits 320 for 50 samples.
  • each frame 240 of priority section 210 comprises eight bytes in preamble 250 , four hundred twenty (420) bytes of 11-bit high priority audio data and FEC bits in audio data 252 , four bytes of checksum in CRC-32 checksum 256 , and twelve bytes of time in idle time 258 . Additionally, as noted, each frame 240 may also contain bytes in reserved data 254 .
  • each frame 240 ′ of redundant section 230 there are eight bytes in preamble 250 ′, four hundred twenty (420) bytes of 11-bit high priority audio data and FEC bits in audio data 252 ′, four bytes of checksum in CRC-32 checksum 256 ′, and twelve bytes of time in idle time 258 ′. Also, each frame 240 ′ may also contain bytes in reserved data 254 ′.
  • each frame 240 ′′ of center section 220 includes eight bytes in preamble 250 ′′, four bytes of checksum in CRC-32 checksum 256 ′′, twelve bytes of time in idle time 258 ′′, and thirty-nine hundred bytes (3900) (or 13 bits of low priority bits times 50 samples times 48 channels divided by 8 bits per byte) of low priority audio data are placed in audio data 252 ′′.
  • center section 220 serves as a buffer to provide a cushion between the two copies of the high priority data bits 312 .
  • payload 200 can lose either priority section 210 or redundant section 230 and still be able to provide 24-bit audio data.
  • payload 200 can lose either priority section 210 or redundant section 230 as well as center section 220 and still provide an 11-bit audio data sample.
  • the placement of center section 220 between priority section 210 and redundant section 230 containing high priority data bits 312 minimizes the chance that a long noise burst would corrupt data from both priority section 210 and redundant section 230 .
  • center section 220 by further splitting center section 220 into two frames (i.e., Frames 21 and 22 ), the risk of an error burst causing the entire payload to drop to 11-bit resolution is minimized. While any error to center section 220 results in a loss of dynamics from 24 to 11 bits, this loss would only last for 1 ms if the error burst was limited to only one of the two center frames 240 ′′.
  • the bits in low priority bits 320 could also be split by channel instead of by sample number. Under this configuration (e.g., splitting the bits in low priority bits 320 by channel), the loss of resolution would go to 11 bits for the entire 2 ms payload time, but only half of the channels (i.e., 24 channels) would be affected.
  • bit-splitting sample data 310 by bit-splitting sample data 310 , only the bits in high priority bits 312 are stored in priority section 210 , thereby increasing the rate of data transmission while minimizing data transmission errors.
  • the bits in critical data bits 314 i.e., the first 9 bits in high priority bits 312
  • the method of including multiple samples in payload 200 facilitates interleaving of the samples, whereby no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples. In fact, consecutive samples are guaranteed to be at least 4 frames apart.
  • the bits in critical bits 314 of each sample are encoded with an FEC algorithm. Being the most critical audio data, these bits in critical bits 314 are encoded to allow recovery on the receiving side in the event that a bit is lost during transfer. Due to the nature of the FEC algorithm, 18 bits of raw data are required to perform the encoding. For that reason, in accordance with the present invention, the error encoding will take place on two samples.
  • a 24/18 Hamming Code is used. This algorithm will take 18 bits of input data (i.e., the first 9 bits of 2 samples), and encode them with 6 check bits. The resulting output is a 24 bit stream of error encoded data. The 24/18 FEC algorithm will detect up to 2 bit errors within the 24-bit packet. It will be able to detect and correct 1 bit error within the 24-bit packet.
  • payload 200 can be easily modified based on a particular system configuration.
  • the size of payload 200 can be increased to provide more error protection, if needed. While increasing the size of payload 200 may require more processing time and memory, larger payload 200 allows greater protection of critical data that can be retransmitted many times with full error detection and correction encoding.
  • payload 200 can be adjusted, but also the format of the data within payload 200 can be adjusted to provide various degrees of protection of the data. While much of the description herein pertains to transmitter 105 receiving 48-channel, 24-bit digital audio data, it should be noted that transmitter 105 can be adjusted to provide a greater protection over fewer channels. The channel count could be reduced, for example, from 48 to 16. The extra bandwidth within payload 200 could be used to provide redundant protection of more data bits within each sample. Likewise, in one embodiment, payload 200 can be formatted to offer an 8-bit audio data delivery system over 144 channels.
  • the method of including multiple samples in payload 200 facilitates interleaving of the samples.
  • the samples by interleaving the samples, no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples during data transmission. This is so since, the system and method of interleaving data samples using the DTP ensures that consecutive samples are at least 4 frames apart from one another.
  • consecutive audio samples can be spread out to the point that a noise burst could destroy 4 consecutive frames of data and no two consecutive audio samples would be lost. These missing (non-consecutive) audio samples may then be more accurately reconstructed with interpolation.
  • Table 1 below shows an exemplary embodiment of the sample interleaving scheme, in accordance with the present invention, that will result in the maximum transmission time between consecutive audio samples. As shown below, each frame contains 5 samples (A-E). There are 20 frames in the priority section. Samples are numbered 1 - 100 .
  • the exemplary embodiment of the sample interleaving scheme shown in Table 1 above can be established using the following algorithm. For a given payload of x frames per priority section and y samples per frame:
  • FRAME_SAMPLE_BIAS INT(SAMPLES_PER_FRAME/2);
  • Dest_Frame_Start SAMPLES_PER_FRAME—FRAME_SAMPLE_BIAS;
  • Dest_Buffer which is pointed to by Dest_Buffer_Ptr.
  • a system and method for transmitting data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver.
  • the system and method of the present invention can be used to recreate (or regenerate) the transmitter's data clock in the receiver with nothing more than the Ethernet clock (or any system clock—ie., a transmission clock—that is recovered by the receiver for a non-Ethernet system).
  • FIG. 5 shows data transmission and data clock recreation system 500 , in accordance with the present invention.
  • transmitter 510 is coupled to receiver 550 over link 505 .
  • link 505 comprises any asynchronous link, including without limitation, a transformer, optical, or RF isolated data connection.
  • system 500 of FIG. 5 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, while much of the description herein relates to transmitting and recreating an audio data clock, system 500 of the present invention can be used to transmit and recreate a video clock.
  • transmitter 510 comprises, among other things, count generator 520 , data packetizer 530 , and Ethernet PHY 540 .
  • Count generator 520 receives signals from audio data clock 512 and Ethernet clock 514 and generates count values 522 .
  • Ethernet clock 514 drives Ethernet PHY 540 and that audio data clock 512 drives A/D's (not shown here). It should be noted that audio data clock 512 and Ethernet clock 514 are asynchronous.
  • Audio data clock 512 represents a clock that is synchronized with data (i.e., audio data 526 ) going into transmitter 510 .
  • Audio data clock 512 may comprise any clock, including without limitation, a L/R clock, bit clock, or master clock, that is associated with the data (i.e., audio data 526 ) from which all other data timing signals (i.e., count value 522 ) can be generated.
  • audio data clock comprises the L/R clock.
  • count generator 520 compares and counts the number of asynchronous Ethernet clocks 514 per each audio data clock 512 . More specifically, count generator 520 re-clocks audio data clock 512 with Ethernet clock 514 . Doing so creates re-clocked audio data clock 572 . It should be noted that, in accordance with the present invention, re-clocked audio data clock 572 is edge-synchronous with Ethernet clock 514 and comprises the same asynchronous frequency as the original audio data clock 512 . In other words, re-clocked audio data clock 572 represents audio data clock 512 with jitter. Thereafter, count generator 520 counts the number of Ethernet clock 514 cycles per audio clock 512 cycle and transmits the resulting count value 522 to data packetizer 530 .
  • data packetizer 530 receives the count value 522 , along with generic data 524 and audio data 526 .
  • audio data 526 enters transmitter 510 through an A/D converter (not shown) and is digitized.
  • Data packetizer 530 packetizes the count value 522 , generic data 524 , and audio data 526 into a payload. Accordingly, the payload now contains the count value 522 that will be used to generate the L/R Clock for that payload. In other words, the count value 522 is transferred to receiver 550 via the payload.
  • the packetized payloads 535 are then sent to Ethernet PHY 540 .
  • the Ethernet PHY 540 is the lowest hardware layer where data meets the wire. This layer conveys the bit stream, including electrical impulse, light or radio signal, through the network at the electrical and mechanical level.
  • the packetized data 535 is transmitted to receiver 550 via link 505 .
  • receiver 550 Upon receiving the packetized data 535 , receiver 550 synchronizes its local Ethernet clock 562 to the packetized data 535 . In other words, Ethernet clock 514 from transmitter 510 and Ethernet clock 562 from receiver 550 are synchronized and locked with one another.
  • receiver Ethernet PHY which includes PHY receiver 555 and recovery unit 560 , recovers and transmits the Ethernet data 564 and Ethernet clock 562 to data de-packetizer 565 .
  • data de-packetizer 565 After receiving the Ethernet data 564 and Ethernet clock 562 , data de-packetizer 565 separates the count value 522 , generic data 524 , and audio data 526 .
  • data de-packetizer 565 sends the count value 522 to audio data clock generator 570 , which, as shown, uses the count value 522 and Ethernet clock 562 (from recovery unit 560 ) to create the re-clocked audio data clock 572 .
  • the re-clocked audio data clock 572 is recreated (or regenerated) to represent the original audio data clock 512 by changing edges based on the count value 522 .
  • re-clocked audio data clock 572 is edge-synchronized with the recovered Ethernet clock 562 , and, as such, represents an accurate representation of the original audio data clock 512 , but with jitter.
  • PLL circuit 580 receives audio data clock 572 and removes the jitter. That is, using re-clocked audio data clock 572 , PLL circuit 580 provides jitter free data clock 582 and a higher frequency master clock 584 . By using the jitter free audio data clock 582 and master clock 584 , all other data timing signals can be reproduced. In other words, the jitter free audio data clock 582 can be used to create master clock 584 for driving D/A's (not shown) in receiver 550 . It should be noted that, therefore, jitter free audio data clock 582 and master clock 584 are synchronous with the audio data 526 transmitted from data de-packetizer 565 .
  • system 500 of the present invention can be used transmit and recreate video data clock and that there are other variations of recreating the data clock thereof that incorporate the inventive concept of the present invention and are within the scope and spirit of the present invention.
  • FIG. 6 shows one embodiment of personal mixing and distribution system 600 that can be used to transmit and distribute data over multiple receivers.
  • system 600 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • FIG. 6 shows only four receivers 650
  • the number of receivers 650 can be, in accordance with present invention, easily increased or decreased depending on the system configuration.
  • the number of input channels 610 can be easily increased or decreased depending on the system configuration.
  • transmitter 605 takes one or more audio data channels 610 and packetizes the data. It should be noted that transmitter 605 can receive over 48 high-quality digital audio channels 610 , making system 600 suitable for multi-channel professional audio solutions. The packetized data is transmitted to receivers 650 over link 620 . It should be noted that while the embodiment of system 600 , as shown in FIG. 6, follows the DTP, system 600 , in accordance with the present invention, can follow other protocols, including without limitation, traditional Ethernet.
  • link 620 comprises a high speed, serial data transmission link.
  • the embodiment of system 600 as shown in FIG. 6, includes link 620 comprising Category-5 cable in conjunction with standard Ethernet 100 Mbit PHY hardware. This configuration provides a 100 Mb serial data transmission rate.
  • link 620 may include any one or more of Cat-5/PHY in a 10 Mbit or 1000 Mbit form, IR, Wireless (e.g., 802.11 link), or laser.
  • transmitter 605 is connected to a group of receivers 650 via link 620 in a daisy-chain configuration.
  • each receiver 650 can provide dynamic and intelligent scaling functions to its output channels 695 .
  • each receiver 650 can monitor the error counts in real-time as it receives data. More specifically, receivers 650 can receive the data, analyze the payload for the priority information (e.g., channel count, audio fidelity, error tolerance, etc.), and then feed back control data to transmitter 605 , instructing transmitter 605 to dynamically scale the payload to provide the best payload format to achieve the desired results in the given environment. Alternatively or additionally, receivers 650 may simply feed back the raw error count information, leaving the analysis and subsequent scaling decision algorithm to transmitter 605 .
  • the priority information e.g., channel count, audio fidelity, error tolerance, etc.
  • receivers 650 can be grouped so that one receiver 650 can receive a specific set of channels 610 at one quality level, while another receiver 650 gets another quality level of audio data over a different set of channels 610 .
  • system 600 can be adapted to a variety of environments and/or applications.
  • each receiver 650 can craft a unique mix of audio data that does not affect the mix of the other receivers 650 and can be controlled by separate users.
  • each receiver 650 can read the data transmitted from transmitter 605 and then immediately pass the data to additional receivers 650 .
  • this configuration allows each receiver 650 to “tap” off the packetized data transmitted from transmitter 605 (or from other receivers 650 ) and read the specific channels 610 as desired.
  • two or more receivers 650 can receive the data transmission and de-packetize (or reconstruct) the data simultaneously. Thereafter, each receiver 650 can mix the data to suit the respective local listening environment serviced by one or more output channels 695 .
  • each receiver 650 can tap into a common set of digital channels generated by transmitter 605 and, thereafter, each receiver 650 can output one or more signals from the common set of digital channels.
  • system 600 allows each receiver 650 to employ a standard analog master gain control.
  • system 600 allows each receiver 650 to employ output circuit 677 , which, in one embodiment, comprises a digitally controlled analog master audio gain control that can be used to provide an auto-gain adjustment system. This means that, each receiver 650 can provide intelligent functionalities.
  • each receiver 650 As the volume of a specific channel 610 is increased to the point of near clipping, that channel 610 can be effectively limited while other remaining channels 610 are reduced in volume, maintaining the desired relative level between all of the channels 610 . To assure that the user (at output channels 695 ) perceives the change as an increase in the desired channel, the digitally controlled post D/A's master volume is then increased accordingly by the digitally controlled analog master audio gain control 677 .
  • system 600 allows each receiver 650 to automatically adjust itself to keep an overall output volume constant when an individual channel 610 's volume is raised to its maximum digital level. Thereafter, system 600 automatically lowers the digital volume levels of all other channels 610 and raises the master gain, thereby effectively raising the volume of the channel 610 that is at its maximum digital level thus allowing greater dynamic range control of the digital mix.
  • FIG. 7 shows an expanded view of transmitter 605 of FIG. 6.
  • audio data enters transmitter 605 through one or more channels 610 .
  • the data is digitized using one or more A/D converters 612 .
  • the digitized data is transmitted to transmitter ASIC 616 over a serial bus 614 .
  • bus 614 comprises Inter-IC Sound (I2S), which typically handles audio data separately from clock signals.
  • I2S Inter-IC Sound
  • optional serial data 622 , word clock 624 , and/or video sync 626 can also drive transmitter ASIC 616 .
  • transmitter ASIC 616 packetizes the digitized data. During this process, transmitter ASIC 616 converts digitized audio data into data packets. Note that transmitter ASIC 616 interfaces to transmitter Ethernet PHY 632 through a standard Ethernet MII interface 630 . Accordingly, the packetized data is passed from transmitter ASIC 616 to transmitter connector 634 through Ethernet MII interface 630 and transmitter Ethernet PHY 632 .
  • transmitter connector 634 comprises an RJ-45 Category-5 approved connector. It should be noted, as described below, there is a power supply circuit 910 supplying power to transmitter 605 .
  • FIG. 8 shows an expanded view of a receiver 650 shown in FIG. 6.
  • the data enters receiver 650 through receiver connector 652 .
  • receiver connector 652 comprises an RJ-45 Category-5 approved connector.
  • transmitter Ethernet PHY 654 interfaces with receiver ASIC 660 through a standard Ethernet MII interface 630 .
  • the transmission (of data) is immediately repeated, with virtually no delay, to transmitter Ethernet PHY 632 and to transmitter connector 634 .
  • the repeated transmission is destined to additional receivers 650 .
  • receiver ASIC 660 de-packetizes (or reconstructs) the data. During this time, receiver ASIC 660 performs an error detection and correction (EDAC) process, following the DTP. Following the EDAC process, receiver ASIC 660 presents individual I2S audio signals 662 , serial data 664 , and word clock outputs 668 .
  • EDAC error detection and correction
  • receiver ASIC 660 performs digital mixing of forty-eight audio channels with mixer 670 . Thereafter, receiver ASIC 660 presents a single I2S output 672 to a stereo D/A converter 675 and the optional digitally controlled analog master audio gain control at output circuit 677 . As noted, the final output is transmitted to one or more output channels 695 .
  • mixer 670 is large enough to accommodate more audio channels (i.e., up to the number of channels in the input stream).
  • receiver 650 includes microprocessor 680 , volume rotary encoder 682 , pan rotary encoder 684 , buttons 686 , and LEDs 688 .
  • Receiver 650 also includes a power supply circuit 910 supplying power to receiver 650 .
  • a novel system and method of using the DTP to transmit and distribute audio or video data over a network having multiple modules is provided.
  • a novel system and method of using serial data links to communicate with functional mixing blocks, such as input modules, master modules, receivers, mixers, and/or controls surfaces is provided.
  • FIG. 9 illustrates data distribution and mixing system 900 that uses the DTP to, among other things, receive, transmit, distribute, and mix audio or video data. It should be noted that the configuration of system 900 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • audio mixers in general, have all input and output connectors in one physical package and in relatively close proximity to one another. Also, audio mixers typically have their control elements integrated into the same physical package as their input and output connections, and, as such, all control is performed from a central location. Therefore, input signals are carried from their origin to the mixer over a relatively long distance using analog or digital cables. Similarly, output signals from the mixer are carried to their destinations over a relatively long distance using analog or digital cables. As a result, an audio mixer system may comprise a complex set up, including many cables that are costly and prone to damage.
  • data distribution and mixing system 900 can be used in such a situation to communicate with functional mixing blocks over a serial data link.
  • system 900 comprises multiple control surfaces that can control all or part of system 900 simultaneously or separately from different physical locations.
  • data distribution and mixing system 900 includes master module 905 , input modules 930 , and receivers 950 .
  • Input modules 930 are linked to one another in a daisy-chained configuration and operatively coupled to master module 905 via link 920 .
  • receivers 950 are linked to one another in a daisy-chained configuration and operatively coupled to master module 905 via link 920 .
  • link 920 comprises a high speed, asynchronous serial link, such as a CAT-5 10-baseT, CAT-5 100-baseT, 1 gigabit Ethernet, 100 gigabit Ethernet, other versions of Ethernet, infra-red, RF, wired, wireless, optical, or laser link.
  • asynchronous serial link such as a CAT-5 10-baseT, CAT-5 100-baseT, 1 gigabit Ethernet, 100 gigabit Ethernet, other versions of Ethernet, infra-red, RF, wired, wireless, optical, or laser link.
  • the functions of master module 905 can be controlled remotely by primary control surface 915 and/or secondary control surface 915 ′. Alternatively or additionally, the functions can be controlled wirelessly by wireless control surface 915 ′′. Note that primary control surface 915 , secondary control surface 915 ′, and wireless control surface 915 ′′ are sometimes collectively referred to as control surfaces 915 .
  • the link between master module 905 and control surfaces 915 can provide audio as well as control data, thereby allowing remote effects units to be local to control surfaces 915 .
  • control surfaces 915 , 915 ′, and 915 ′′ can use different transmission media, with different bandwidth to connect to master module 905 . It should also be noted that any number of the control surfaces 915 can be added to master module 905 .
  • master module 905 gathers all of the control information from control surfaces 915 . Thereafter, master module 905 initiates the mixing process by adding any input signals created in master module 905 to mix busses dictated by the control data gathered from control surfaces 915 .
  • master module 905 of system 900 A detailed illustration of master module 905 of system 900 , distributing and mixing audio data is shown in FIG. 10. It should be noted that the embodiment of master module 905 , as shown, is an exemplary embodiment, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, while the discussion herein relates to audio data, master module 905 can be used to distribute and mix other types of data, including without limitation, video data.
  • master module 905 gathers all of the control information from control surfaces 915 . Accordingly, as shown in FIG. 10, master module 905 gathers the control data (and audio data if necessary) from control surfaces 915 via inputs 907 . As shown, inputs 907 are communicatively coupled to connectors 924 . Multiple inputs 907 are provided to support simultaneous connections to control surfaces 915 .
  • data de-packetizers 911 which de-packetize and separate the control data and audio data.
  • the control data are merged in control data merger 913 .
  • data de-packetizers 911 may also drive D/A circuits 914 to provide additional analog outputs without using busses on asynchronous serial data link 920 .
  • the output from D/A circuits 914 is provided to local audio outputs 917 .
  • master module 905 starts the mixing process by mixing any local input signals 916 to master module 905 and any audio data from control surfaces 915 that is destined to mix busses, in digital audio mixing block 918 .
  • input circuit 919 comprises a digitally remote controlled microphone preamp.
  • the digitally remote controlled microphone preamp can be controlled remotely from any one of control surfaces 915 , 915 ′, 915 ′′ such that control data is sent from any one of control surfaces 915 , 915 ′, 915 ′′ to adjust the microphone preamp's gain at master module 905 .
  • digital audio mixing block 918 also provides equalization (EQ) and effects. Thereafter, master module 905 takes this mixed audio and control information and packetizes them in data packetizer 922 for transmission (over link 920 ) via output driver circuit 923 . It should be noted that link 920 carries actual mixing bus information as well as control data through system 900 . In one embodiment, output driver circuit 923 is communicatively coupled to connector 924 , which couples to the first input module 930 in system 900 .
  • the output from data packetizer 922 of master module 905 is connected to the first input module 930 .
  • the first input module 930 is also designated as input module 930 ′.
  • the output from data packetizer 922 is conveyed to other input modules 930 in the chain until it reaches the last input module 930 , which is also designated as input module 930 ′′.
  • Last input module 930 ′′ then sends the data to master module 905 over link 920 via data input circuit 925 .
  • data input circuit 925 is communicatively coupled to connector 924 .
  • the data is then split and sent to output circuit 926 communicatively coupled to receivers 950 and/or control surfaces 915 .
  • the other part of the split data is sent to de-packetizer 927 , which splits the data into audio data and control data and drives digital audio mixing block 928 .
  • the data is split to make local audio outputs 917 on master module 905 .
  • digital audio mixing block 928 mixes, adds EQ and effects, and drives D/A 929 to provide analog audio outputs to local audio outputs 917 .
  • connectors 924 comprise any link, including without limitation, a transformer, optical, or RF isolated data connection.
  • FIG. 11 shows a detailed illustration of input module 930 , of system 900 , distributing and mixing audio data, in accordance with the present invention.
  • a control bus independently addresses each of input modules 930 in system 900 .
  • the control bus in accordance with the present invention, includes information for varying a gain, frequency, or effects associated with an input channel, output bus, or a mix.
  • each input module 930 processes its own input signals. Some of the processes that input module 930 performs include, without limitation, an A/D conversion, equalization, effects, and time alignment delay. After processing, input module 930 adds the signals to the busses carried on data link 920 .
  • input data enters input module 930 via connector 924 at module receiver 932 . It should be noted that input data is coming from either master module 905 or preceding input module 930 . Data is then de-packetized by data de-packetizer 934 where data is split into mix bus audio data 941 and control data 942 . It should be noted that local audio signals 935 enter input module 930 at input circuit 936 and are digitized.
  • input circuit 936 comprises a digitally remote controlled microphone preamp.
  • the digitally remote controlled microphone preamp can be controlled remotely from any one of control surfaces 915 , 915 ′, 915 ′′ such that control data is sent from any one of control surfaces 915 , 915 ′, 915 ′′ to adjust the microphone preamp's gain at input module 930 .
  • the digitized local audio signals 935 are delayed by the necessary sample amount in sample buffer/delay generator 938 .
  • the amount of delay is determined by the position of input module 930 in the input module loop (i.e., daisy-chain), as shown in FIG. 9. This is done to time align the mixed audio output with sample level accuracy. That is, because mix busses are built in time, a specific delay is associated with each input module 930 . In other words, each input module 930 has a defined delay that is used to maintain a final mix in a time aligned format.
  • system 900 that comprises six input modules 930 where each input module 930 takes one audio sample period to process its input signals onto the mix busses, first input module 930 ′ would mix onto the busses its current sample, the second input module 930 would mix onto the busses one sample previous to its current sample (from memory), the next input module would mix onto the busses two samples previous to its current sample (from memory), and so on, until last input module 930 ′′ (i.e., sixth) would mix onto the busses five samples previous to its current sample (i.e. input module 930 ′′ would require memory to store five samples of audio data).
  • digital audio mixing block 940 mixes and provides EQ and effects to the digitized and delayed local audio signals 935 per control data instructions 942 . That is, the output from digital audio mixing block 940 represents updated digital audio busses with local audio mixed in per the control data 942 .
  • the output of digital audio mixing block 940 is then packetized by data packetizer 943 and transmitted to next input module 930 by output driver 944 .
  • Output data 946 is then sent to subsequent (or following) input module 930 in the chain.
  • input module 930 must de-packetize input data coming into input module 930 and split into audio data 941 and control data 942 , followed by digitally mixing audio data 941 and its local audio signals 935 into the mixer busses per control 942 that governs input module 930 's inputs. Also, input module 930 must preserve all control data 942 and re-packetize the digital audio data (i.e., 935 and 941 ) and control data 942 for retransmission to the next input module 930 where the entire process, as described, repeats.
  • any number of receivers 950 can be connected to master module 905 and provide independent mixes of the system audio busses. Using this configuration, an infinite amount of mixes can be provided. It should be noted that the configuration of FIG. 9 allows each input module 930 to receive mixing instructions addressed to that module 930 and then passes a signal mixed in with the instructions to next input module 930 . In accordance with the present invention, this process can be done while no human perceptible delay is introduced into the mixed signal as it moves through link 920 .
  • FIG. 12 shows a detailed view of receiver 950 of system 900 shown in FIG. 9, in accordance with the present invention.
  • data enters receiver 950 through receiver connector 1252 and is passed to receiver PHY 1254 .
  • Receiver connector 1252 comprises an RJ-45 Category-5 approved connector.
  • Receiver 950 receives the requisite system data via the input data from receiver connector 1252 . It should be noted that the transmission (of data) is immediately repeated, with virtually no delay, to Ethernet PHY 1232 and to other receiver connector 1234 to provide daisy chained data to other receivers 950 by buffering it and re-clocking it in ASIC 1260 via Ethernet MII interface 1230 .
  • receiver ASIC 1260 After receiving the transmission, receiver ASIC 1260 de-packetizes (or reconstructs) the data. After de-packetizing the data, receiver ASIC 1260 sends separate audio I2S signals 1262 and data signals 1264 to other components such as D/A converters, digital signal processors, and/or microprocessors (not shown).
  • receiver ASIC 1260 performs digital mixing of audio channels (forty-eight channels are shown in the embodiment) with mixer 1270 .
  • Digital audio mixer block 1270 mixes the audio channels into a stereo pair, converts the mixed signals to an I2S signal in converter 1272 , and outputs through D/A 1275 and analog connections output circuit 1277 . The output is transmitted via one or more output channels 1295 .
  • mixer 1270 also adds EQ and effects and is controlled by the microprocessor 1280 , which also controls indicators 1288 and reacts to rotary encoders 1282 , potentiometers 1284 , and switches 1286 .
  • data distribution and mixing system 900 includes a plurality of control surfaces 915 , each of which can be used to control the functions of master module 905 .
  • FIG. 13 shows, in accordance with the present invention, a detailed representation of one embodiment of control surface 915 .
  • miroprocessor 1380 is coupled to multiple input and/or output devices. These devices are used to, among other things, communicate with users. For instance, a user can enter input to microprocessor 1380 by using rotary encoders 1382 , potentiometers 1384 , and/or switches 1385 . Microprocessor 1380 can provide to the user the system status information by using indicators 1388 and/or display 1389 .
  • control data is output from microprocessor 1380 per the control settings.
  • the control data is sent to data packetizer 1320 , which merges and packetizes the control data with any local audio 1310 coming in from A/D 1312 and transmits the packetized data to master module 905 via output circuit 1322 .
  • data from master module 905 enters control surface 915 at input circuit 1330 .
  • data de-packetizer 1332 separates the control data and audio data and sends the control data to microprocessor 1380 . This allows display 1389 to be synchronized with changes made by other control surfaces 915 (or other system components, such as input modules 930 ).
  • data de-packetizer 1332 sends the audio data to audio channel selector 1334 , which selects and sends digital audio to output circuit 1338 for local audio outputs 1340 .
  • D/A converter 1336 which can be used to convert signal, is placed between audio channel selector 1334 and output circuit 1338 . Note that audio outputs 1340 can drive the local EQs and effects units.
  • each audio channel can have many different parameters, such as EQ (frequency, boost/cut, or Q), gain, FX (reverb type, reverb time, reverb density, or delay).
  • microprocessor 1380 keeps track of the parameters that control surface 915 can change. For instance, note that in a system having multiple control surfaces 915 , not all control surfaces need to control all parameters. In such a situation, it may be desirable to control only a subset of the parameters on some or all of control surfaces 915 . Thus, it may be desirable to make control surfaces 915 control exclusive parameters for controlling their own respective local space.
  • system 900 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • system 900 uses the DTP comprising a protocol that will automatically enumerate each audio channel of input module 930 in a manner that assigns each audio channel of input module 930 to a given mixer channel regardless of the order in which input modules 930 are connected along the chain.
  • a data transmission and distribution system having multiple receivers is provided, whereby each receiver can repeat data signals that are in Ethernet format. Additionally, a system where each receiver includes an isolated power supply is provided.
  • FIG. 14 shows transmitter 1405 communicatively coupled to receivers 1450 via link 1420 .
  • Transmitter 1405 and receivers 1450 in FIG. 14 are shown in an exemplary embodiment to illustrate the inventive concepts of the present invention, and there are multiple variations thereof within the scope and spirit of the present invention.
  • either transmitter 1405 or receiver 1450 can be replaced with transmitter 105 , transmitter 510 , transmitter 605 , master module 905 , input module 930 , control surface 915 , receiver 950 , receiver 550 , receiver 650 , or receiver 107 .
  • transmitters 1405 and receiver 1450 can be used with any ground isolated data link.
  • transmitter 1405 and receivers 1450 can receive, transmit, and distribute data signals that are in Ethernet format, and such signals are repeated along receivers 1450 using a daisy-chained topology. This is accomplished by first keeping link 1420 isolated with a transformer, optical or RF isolation, and then by implementing a ground isolated floating power supply 1415 . This combination allows the ground reference of receiver 1450 to float to the ground potential of external amp 1422 and speaker 1424 .
  • each receiver 1450 can eliminate audio hum and/or visual artifacts.
  • the present invention provides the system for each receiver in a chain to repeat data signals that are in Ethernet format. In accordance with the present invention, this is accomplished by wrapping the data (received from transmitter 1405 or receiver 1450 ) to an output driver 1434 . More specifically, the output data from transmitter 1405 (or receiver 1450 ) is transmitted to input receiver 1430 and then to data loop buffer 1432 . The data is then sent to output driver 1434 .
  • this configuration requires data loop buffer 1432 to account for the asynchronous nature of the recovered transmitter Ethernet clock and the receiver Ethernet clock. Also note that, using this configuration as shown in FIG. 14, a daisy-chained system can be implemented using the Ethernet topology. As known, Ethernet only follows either star topology or bus topology. This is very useful since, in the configuration of FIG. 14, each receiver 1450 can act as a repeater while following the Ethernet topology. As a result, receivers 1450 can have a maximum distance of over several hundred feet between one another.

Abstract

A data transmission and distribution system that includes a series of payloads. Each of the payloads is formed from samples of audio or video information. The system interleaves the audio or video samples in each payload where no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application claims priority to provisional patent application No. 60/349,114, entitled “Soniqnet, a Protocol for Transmitting Digital Audio and Video Data and Product Implementations Utilizing the Soniqnet Protocol,” filed Jan. 16, 2002, incorporated herein by reference.[0001]
  • FIELD OF THE INVENTION
  • The invention relates generally to digital audio and video data transmission, and in particular, to transmitting multiple channels of digital audio and video data over serial data links. [0002]
  • BACKGROUND OF INVENTION
  • In today's technologically demanding society, there is a growing need to transmit and receive electronic data more efficiently. To that end, several means of transmitting and receiving electronic data currently exist. A packet-switched network system or circuit-switched network system, for instance, provides some of the most common methods of transmitting and receiving electronic data. It should be noted, however, that transmission errors may exist in any kind of data transmission. A packet-switched network, for instance, can be affected by transmission errors such as loss of packets. [0003]
  • Transmission errors can severely hinder the efficiency of data transmission. Consider, for instance, a situation where a data packet is lost during data transmission. This is a relatively frequent problem encountered in packet switched networks. In such a case, the problem may be more complex than it may seem initially. When a data packet is lost during transmission, not only the data in the packet is affected, but also the data in other packets transmitted during the same transmission is affected. This is because data packets are generally transmitted in an organized sequence and that loss of one packet may affect the sequence of data transmission for the entire sequence of packets. As a result, a transmission error causing loss of one packet may further render all subsequent packets out of order and therefore useless. [0004]
  • To combat this kind of situation, several means of detecting, correcting or combination of both have been introduced. For instance, one of the most common methods of reducing transmission errors is to add certain control data bits, such as check sum bits or parity bits, in data packets during data transmission. It should be noted that, however, while this method of adding control data bits can help minimize transmission errors, it may not be desirable in all situations. For example, although a parity bit scheme could be used to detect certain transmission errors, it may not be able to detect errors in which an even number of bits in the same data unit are changed due to electrical noise. [0005]
  • Furthermore, these error detection and/or correction methods provide the same level of protection to the entire length of data, without assigning any particular importance to a particular section of data, which may represent a critical part of the data. As a result, data packets using some of the known transmission error detection and/or correction methods are unnecessarily bulky, thereby reducing the rate of transmission. Some network systems, therefore, use the type of communication medium that allows greater bandwidth, such as fiber optics, rather than using the traditional metal cables. However, one of the disadvantages of fiber optics is that they are very expensive to install and maintain. Furthermore, fiber optics are very fragile, and as such, are difficult to split. Thus, use of fiber optics, in many situations, can be uneconomical. [0006]
  • A packet-switched system may be used for transmitting and receiving audio or video data in real-time. In such a situation, any transmission error can cause significant impact on the audio or video receiver, and may result in a transmission delay. The delay can cause severe impact on the quality of the output audio or video data. This is significant since many devices today rely on real-time communication of data. An audio mixer, for example, is a device that typically relies on real-time communication of data. An audio mixer allows multiple audio sources (i.e., input data channels) to be individually controlled and added together (hence the name “mixer”) to produce one or more audio outputs suitable for broadcast to many users. Audio mixers are used today in a variety of applications, providing many functions, including, among others, transmitting, receiving, recording, enhancing, and presenting audio data. Any data transmission problems, such as loss or delay of data packets, may result in the reduced functionality of the audio mixer. [0007]
  • Thus, there exists a need for a system and method of transmitting and receiving data efficiently, reliably, and economically. In particular, there exists a need for a system and method of transmitting and receiving digital audio and video data. There exists a further need for a system and method of enhancing the functionalities of devices that transmit and receive digital audio and video data. There exists yet a further need for a system and method of providing an error-tolerant system that allows transmission of real-time, high quality, multi-channel audio and video data as well as generic digital data over any serial data link. [0008]
  • SUMMARY OF THE INVENTION
  • The present invention is directed to a data transmission and distribution system that includes a series of payloads, where each of the payloads is formed from bits of audio or video information, and where different levels of protection are applied to different sets of bits in each payload. The system divides the bits associated with each payload into high priority bits and low priority bits and forms a group of check bits for each payload by applying an error correction algorithm to the high priority bits in the payload. The system also forms each payload from a first set of the high priority bits, the check bits, the low priority bits and a redundant set of the high priority bits and the check bits and transmits the payloads formed from the first set of the high priority bits, the check bits, the low priority bits and the redundant set of the high priority bits and the check bits. [0009]
  • The present invention is also directed to a data transmission and distribution system that includes a transmitter and a receiver. The transmitter transmits a count value associated with a data clock of the transmitter to the receiver over an asynchronous link as part of an information payload that also includes audio or video information. The data clock is synchronously recreated at the receiver using only a system clock associated with the receiver and the transmitted count value. [0010]
  • The present invention is also directed to a data transmission and distribution system that includes a series of payloads. Each of the payloads is formed from samples of audio or video information. The system interleaves the audio or video samples in each payload where no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples. [0011]
  • The present invention is also directed to a system for transmitting and distributing audio or video information. The system includes a plurality of input modules arranged in series along at least one chain of high speed serial data links that end with a master module. Each input module receives mixing instructions addressed to that module and then passes a signal mixed in accordance with the instructions to the next input module in the chain where no human perceptible delay is introduced into the mixed signal as it moves through the chain. [0012]
  • In one embodiment, the system includes a plurality of control surfaces for simultaneously controlling system parameters associated with each of the input modules and output busses. One or more of the control surfaces are physically separated in location from the input, output and master modules. [0013]
  • In one embodiment, the system includes a digitally remote controlled microphone preamp controlled from a control surface that is physically separated from the preamp, the input, output and master modules. The control data is sent from the control surface to adjust the microphone preamp's gain at an input module. [0014]
  • In one embodiment, the system includes a protocol that automatically enumerates each audio channel of at least one of the input modules in a manner that assigns the each audio channel of the at least one input module to a given channel regardless of the order in which the input modules are connected along the chain. [0015]
  • In one embodiment, the system includes a one or more output modules. Each input module in the chain has a defined delay that is used to maintain a final mix in a time aligned format. [0016]
  • The present invention is also directed to a system for transmitting and distributing audio or video information. The system includes a multi-channel input module and multiple receivers arranged along at least one chain of high speed serial data links where each receiver can tap into a common set of digital channels generated by a transmitter. Each receiver can create its own user adjustable mix based on one or more signals from the common set of digital channels. [0017]
  • In one embodiment, each receiver can output one or more signals from the common set of digital channels. [0018]
  • In one embodiment, each receiver employs a digitally controlled analog master audio gain control that automatically adjusts itself to keep an overall output volume constant when an individual channel's volume is raised to its maximum digital level. The system automatically lowers the digital volume levels of all other channels and raises the master gain, thereby effectively raising the volume of the channel that is at its maximum digital level thus allowing greater dynamic range control of the digital mix. [0019]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram showing one embodiment of a data transmission system, in accordance with the present invention. [0020]
  • FIG. 2 is a diagram showing a detailed representation of the payload, in accordance with the present invention. [0021]
  • FIG. 3 is a diagram showing a detailed representation of one 24-bit sample used in the payload, in accordance with the present invention. [0022]
  • FIG. 4 is a diagram showing detailed representation of low priority bits used in the payload, in accordance with the present invention. [0023]
  • FIG. 5 is a block diagram showing a data transmission and data clock recreation system, in accordance with the present invention. [0024]
  • FIG. 6 is a diagram showing one embodiment of a data mixing and distribution system, in accordance with the present invention. [0025]
  • FIG. 7 is a block diagram showing an expanded view of the transmitter in FIG. 6, in accordance with the present invention. [0026]
  • FIG. 8 is a block diagram showing an expanded view of the receiver in FIG. 6, in accordance with the present invention. [0027]
  • FIG. 9 is a block diagram showing another embodiment of a data mixing and distribution system, in accordance with the present invention. [0028]
  • FIG. 10 is a block diagram showing an expanded view of the master module in FIG. 9, in accordance with the present invention. [0029]
  • FIG. 11 is a block diagram showing an expanded view of the input module in FIG. 9, in accordance with the present invention. [0030]
  • FIG. 12 is a block diagram showing an expanded view of the receiver in FIG. 9, in accordance with the present invention. [0031]
  • FIG. 13 is a block diagram showing an expanded view of the control surface in FIG. 9, in accordance with the present invention. [0032]
  • FIG. 14 is a diagram showing yet another embodiment of data mixing and distribution system, in accordance with the present invention.[0033]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • For purposes of the present invention, each of the terms set forth below shall be defined in accordance with the corresponding definitions set forth below: [0034]
  • “Application-Specific Integrated Circuit” or “ASIC” shall mean a microchip designed for a special application, such as a particular kind of transmission protocol. [0035]
  • “Bit Clock” shall mean a clock signal that tracks the bits of audio data coming out of the A/D (analog to digital) or going into the D/A (digital to analog) converters. [0036]
  • “Center Section” shall mean a section of data that contains the lower bits of the audio sample data. [0037]
  • “Channel” shall mean a separate line of audio data, where each channel represents a stream of audio data. [0038]
  • “Critical data” shall mean the data that cannot be lost without having to interpolate missing data on the receiver. [0039]
  • “Cyclic Redundancy Check” or “CRC” shall mean a checksum that is calculated on a stream of data to provide a security check that the data arrived at the receiver without error. CRC-32 means that the checksum algorithm is calculated out to 32 bits. [0040]
  • “Error Correction Code” or “ECC” shall mean appended data that is being read or transmitted to allow for error checking and correcting on the fly. See FEC. [0041]
  • “Ethernet L/R Count” or “ELR Count” shall mean the number of Ethernet clocks per payload (defined by a fixed number of L/R clocks), as counted on the transmitter and sent to the receiver. [0042]
  • “Ethernet Clock” shall mean the clock signal that drives the data across the Ethernet. [0043]
  • “Forward Error Correction” or “FEC” shall mean a method where data can be encoded with extra “check” bits prior to transmission. At the receiver, the check bits provide a way of not only detecting bit errors, but correcting them as well, avoiding retransmission (which would not be acceptable for audio or video streaming applications). See ECC. [0044]
  • “Frame” shall mean a package of data that is recognized by the hardware interfacing with the outside world. Data sent using Ethernet drivers must be framed following the Ethernet protocol. The application-specific data contained within the frame is independent of the Ethernet standard. [0045]
  • “Idle” shall mean the time between frames that the line has no activity. [0046]
  • “Left/Right Clock” or “L/R Clock” shall mean the clock signal that tracks the start of each new sample. [0047]
  • “Medium Access Control” or “MAC” shall mean the layer of hardware that resides above the Physical Layer. At this layer, data packets are encoded and decoded. [0048]
  • “Master Clock” shall mean the clock signal that drives the A/D's and D/A's. [0049]
  • “Payload” shall mean a collection of frames that contains the encoded data that is sent over the CAT-5 wire. [0050]
  • “Phased Lock Loop” or “PLL” shall mean a section of hardware that can be used to smooth out irregularities in a clock signal, such as a “jitter filter,” or it can be used as a frequency multiplier. [0051]
  • “Physical Layer” or “PHY Layer” or “PHY” shall mean the lowest hardwood layer where the data meets the wire. This layer conveys the bit stream, including electrical impulse, light or radio signal, through the network at the electrical and mechanical level. [0052]
  • “Preamble” shall mean a series of eight (8) specific bytes, dictated by the Ethernet standard and recognized by the hardware, that indicate the start of a frame. [0053]
  • “Priority Section” shall mean a section of data that contains the higher bits of the audio or video sample data. The data in this section is critical and warrants the highest protection in the system. [0054]
  • “Redundant Section” shall mean a section of data that contains a copy of the Priority Section. It is provided as a backup of the data in the event that some or all of the data in the Priority Section is lost. [0055]
  • “Sample” shall mean an item of data that represents voltage level of an analog voltage waveform at a given point in time. [0056]
  • “Sample Rate” shall mean the number of samples of an analog signal that are taken per second to represent the event digitally. [0057]
  • System Overview [0058]
  • In accordance with the present invention, a novel system and method for facilitating data transmission and distribution, and in particular, transmission and distribution of audio data and/or video data, is provided. The system and method of the present invention can be implemented in a variety of system configurations, including without limitation, a multiplexer system that combines multiple signals, including analog or digital or combination thereof, received from multiple input sources for transmission over a single line or medium. [0059]
  • It should be noted that while much of the description herein regarding the systems and methods of the present invention pertains to data transmission and distribution of audio data, the systems and methods, in accordance with the present invention, are equally applicable to transmission and distribution of video data and other generic data, including without limitation, control data. [0060]
  • One embodiment of the present invention relating to data transmission using [0061] data transmission system 100 is illustrated in FIG. 1. It should be noted that the configuration of data transmission system 100 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • As shown, [0062] system 100 includes transmitter 105 coupled to receiver 107. Transmitter 105 receives data from one or more channels 110 and transmit it over link 120 to receiver 107. In accordance with the present invention, transmitter 105 uses data packets to transmit data. As described below, the data packets used in system 100 follow a data transmission protocol (“DTP”), which provides efficient data transmission while maintaining a high level of data integrity. More specifically, upon receiving data from channels 110, transmitter 105 packetizes (or constructs) the received data into one or more packets using the DTP and transmits the packets to receiver 107 over link 120. Once received, the packets are de-packetized into (or reassembled into) the data using the DTP at receiver 107.
  • It should be noted that, as described below, the DTP allows data transmission over a serial data link. [0063] System 100, therefore, includes link 120 comprising Category-5 (or Cat-5) cable, along with standard Ethernet 100 Mbit PHY hardware. This configuration of link 120 comprising Cat-5 cable and the standard Ethernet 100 Mbit PHY hardware allows a 100 Mb serial data transmission rate between transmitter 105 and receiver 107. Furthermore, the configuration allows over 48 channels (i.e., audio channels) 110 to fit onto transmitter 105.
  • In accordance with the present invention, link [0064] 120 may comprise other types of communication medium, including without limitation, CAT-5 10-baseT, CAT-5 100-baseT, 1 gigabit Ethernet, 100 gigabit Ethernet, other versions of Ethernet, infra-red, RF, wired, wireless, optical, or laser link.
  • Data Transmission Protocol (DTP) [0065]
  • As mentioned above, using the DTP, [0066] transmitter 105 receives data from one or more input channels 110, packetizes the data, and transmits the packetized data to receiver 107. It should be noted that, in accordance with the present invention, the DTP has bi-directional capability and supports transmission and distribution of multiple types of data, such as audio data, video data, and other generic data, including control data. Some examples of data protocols supported are Musical Instrument Digital Interface (MIDI), USITT DMX512/1990 (DMX), mouse, keyboard, and proprietary system control data. In one aspect, the DTP is a protocol for multiplexing many channels of data—i.e., the DTP is used to receive data from multiple sources, packetize the data, transmit the packetized data over a serial data link, and de-packetize and reconstruct the source data.
  • In accordance with the present invention, as described further below, the DTP provides, among other things, a variable bit protection scheme, error detection and correction scheme, and data smoothing technique scheme. These schemes provided by the DTP facilitate efficient and effective data transmission and distribution while maintaining data integrity. In particular, the DTP allows a scalable data transmission and distribution (e.g., the number of data channels and the quality of data channels can be scaled) to suit a particular system configuration having a particular transmission link bandwidth. [0067]
  • It should be noted that a data packet, which follows the DTP, in accordance with the present invention, includes the payload that can be configured to best suit the given configuration of a given data transmission and/or distribution system. More specifically, the DTP provides, among other things, a payload structure that yields less delay time, more channels, and a higher sample rate, all of which may be required to suit the need of the given system configuration. In particular, the payload structure of the DTP is designed to withstand a noise burst, which can destroy over half of the payload, without having to interpolate a missed sample. [0068]
  • FIG. 2 shows the structure of [0069] payload 200 included in a data packet that follows the DTP to transmit data over a serial data link. Note that the embodiment of payload 200 as shown in FIG. 2 relates to receiving, packetizing, transmitting, and distributing 48 input channels of 24-bit audio data over Category-5 cable using standard Ethernet 100 Mbit PHY hardware. This configuration results in a 100 Mb serial data transmission rate.
  • It should be noted that the embodiment of [0070] payload 200 as shown in FIG. 2 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, while much of the description herein relates to transmission and/or distribution of audio data bits using payload 200, it should be noted that payload 200 is equally applicable to other types of data, such as video data and other generic data including control data. Furthermore, the DTP provides for, as noted, adjusting of channel count, channel quality, and channel type (audio data, video data, and/or control data), based on the available link bandwidth and desired system robustness (error immunity) for a given system's architecture and purpose. Accordingly, in other embodiments, payload 200 is used to receive more than (or alternatively, less than) 48 channels of data.
  • In accordance with the present invention, [0071] payload 200 is designed to provide varying levels of protection on different sets of bits in payload 200. As described below, by “bit-splitting” audio data into several sets of varying priorities, the most important bits can be protected with an FEC algorithm and redundancy, the moderately important bits protected with redundancy alone, and the least important bits protected by that what is inherent within the transmission medium's physical layer. Using this variable bit protection scheme, payload 200 facilitates a robust data transmission and distribution within the time allotted while maintaining data integrity.
  • As shown in FIG. 2, [0072] payload 200 comprises three sections: priority section 210, center section 220, and redundant section 230. Redundant section 230 is an exact copy of priority section 210. The priority section 210 contains all of the critical data of payload 200. As noted, the “critical data” is the data that cannot be lost without having to interpolate missing data on the receiver. The ELR count, which is used to generate the L/R Clock on a receiver, for example, is contained in priority section 210.
  • Priority section [0073] 210 comprises twenty frames 240 (i.e., Frame Nos. 1-20). Note that each frame 240 in priority section 210 includes preamble 250, audio data 252, reserved data 254, and CRC-32 checksum 256. Also note that, for the purposes of completeness, idle time 258 is included at the end of each frame 240.
  • Audio data [0074] 252 includes, as described below, high priority bits of data required to deliver proper audio information. Preamble 250 comprises 8 bytes of preamble data that are defined by the Ethernet standard. The preamble data includes a sequence of bytes that the PHY Layer needs to see in order to recognize the start of frame 240. At the end of frame 240, the line must go idle for 960 ns, a period of time which is equivalent to 12 bytes. This period allows the PHY Layer to reset and begin searching for the next preamble.
  • Note that a 32-bit CRC value is included in CRC-32 [0075] checksum 256 of each frame 240. The 32 bit CRC serves as a first line of protection against data transmission errors. If the CRC for frame 240 is good, for instance, it is assumed that frame 240 is valid and no further error detection or data recovery needs to occur.
  • As noted, the DTP is a protocol for handling multiple channels of incoming data. Reserved data [0076] 254 includes a reserved space for accommodating additional or future data. In one embodiment, the ELR count resides in reserved data 254. In another embodiment, MIDI files use reserved data 254 during data transmission and/or distribution.
  • As noted, [0077] redundant section 230 of payload 200 contains an exact copy of the frames that appear in priority section 210. Thus, redundant section 230 comprises twenty frames 240′ (i.e., Frame Nos. 23-42). Like that of priority section 210, each frame 240′ in redundant section 230 includes preamble 250′, audio data 252′, reserved data 254′, CRC-32 checksum 256′, and idle time 258′.
  • It should be noted that, in accordance with the present invention, including a duplicate copy of priority section [0078] 210 in payload 200 provides a protection against two types of common errors: a burst error that can wipe out the entire set of frames in priority section 210 and a single bit error in preamble 250 that could cause a frame 240 to be dropped by the PHY Layer. These types of data transmission errors can be greatly minimized by including redundant section 240′ in addition to priority section 240 in payload 200. For instance, after receiving packetized data, receiver 107 has several options if an error is detected. The first approach for error detection and recovery would be, as noted, to check the CRC (i.e., 32-bit CRC checksum 256) of priority frames 240. If the CRC is good, the priority frame 240 can be used. On the other hand, if the CRC is bad, the respective redundant frame 240′ can be checked. If the redundant CRC is good, the respective redundant frame 240′ can be used.
  • As shown in FIG. 2, [0079] payload 200 further comprises center section 220, which includes two (2) frames (i.e., Frame Nos. 21 and 22). Like that of priority section 210 and redundant section 230, each frame 240″ in center section 220 includes preamble 250″, audio data 252″, reserved data 254″, CRC-32 checksum 256″, and idle time 258″.
  • A method of bit-splitting sample data into multiple sections in [0080] payload 200, in accordance with the present invention, is described herein. As noted, while the embodiment of payload 200 shown in FIG. 2 relates to 48-channels of input, the discussion that follows herein uses 1-channel for purposes of simplicity. Similarly, it should be noted that a total of 100 samples are used in the embodiment of payload 200 shown in FIG. 2. Thus, each frame 240 of priority section 210 includes five samples, resulting in the total of 100 samples per priority section 210 (or five samples per frame times twenty frames). Likewise, the same number of samples exist in redundant section 230 since it is an exact copy of priority section 210. In accordance with the present invention, it should be noted that the number of samples per payload 200 could be modified. That is, the number of samples could be changed to another figure—e.g., 96 samples per payload 200. If 96 samples are used, for instance, priority section 210 would include 16 frames with 6 samples per frame 240.
  • As noted, each sample comprises 24-bit data. For bit-splitting purposes, each 24-bit sample is designated as having 11 bits of high priority data required to deliver proper audio information (to a receiver or other receiving unit) and 13 low priority data that adds dynamic range and definition. From the eleven bits in the high priority data, 9 bits are considered critical. Accordingly, these twenty-four bits can be divided into three sets of varying audio priorities—i.e., a first set having bits [0081] 1-9 that are high priority and critical, a second set having bits 10-11 that are high priority but non-critical, and a third set having bits 12-24 that are not high priority. These 24 bits can be treated differently based on the significance attached to each set of bits.
  • FIG. 3 is a detailed representation of one 24-[0082] bit sample data 310. In particular, FIG. 3 illustrates a scheme of splitting bits of sample data 310 into multiple sets of priorities. As shown, from 24-bit sample data 310, the first eleven bits are designated as high priority bits 312. Further, from the bits in high priority bits 312, the first nine bits are designated as critical bits 314 and the remaining two bits are designated as high priority, non-critical bits 316. The remaining 13 bits in sample data 310 (i.e., bits 12-24) are designated as low priority bits 320.
  • From each twenty-four bit sample, only the bits in high priority bits [0083] 312 (i.e., bits 1-11) are placed in priority section 210. The remaining bits of sample data 310 (i.e., the bits 12-24 in low priority bits 320) are placed in center section 220. It should be noted that the bits in high priority bits 312, by being placed in priority section 210, are transmitted twice—once in priority section 210 and then again in redundant section 230. Note that, from the eleven bits from high priority bits 312, only the bits from critical bits 314 (i.e., the bits 1-9) are given extra data protection (i.e., by encoding with an FEC algorithm). The remaining bits from high priority bits 312 (i.e., the bits in high priority, non-critical bits 316) are not encoded.
  • After the high priority bits (i.e., bits [0084] 1-11) of each sample are bit-split and placed into priority section 210, the remaining 13 bits of low priority bits (i.e., bits 12-24) of each sample are destined for center frames 240″ in center section 220 (i.e., Frames 21 and 22). These low priority bits 320 are “sample split” into Frame 21 and Frame 22 in center section 220 so in the event that one of frames 240″ is lost, only half of the samples will degrade to 11 bits of dynamic range.
  • FIG. 4 shows a detailed representation of how [0085] low priority bits 320 of each sample are sample-split into Frames Nos. 21 and 22 in center section 220. As shown, the low priority bits 320 from samples 1-50 are placed in Frame No. 21 of center section 220. Similarly, the low priority bits 320 from samples 51-100 are placed in Frame No. 22 of center section 220. Accordingly, each of the two frames (i.e., Frames 21 and 22) in center section 220 contains the 13 bits of low priority bits 320 for 50 samples.
  • Accordingly, in accordance with the present invention, after receiving and packetizing data from all 48-channels, each [0086] frame 240 of priority section 210 comprises eight bytes in preamble 250, four hundred twenty (420) bytes of 11-bit high priority audio data and FEC bits in audio data 252, four bytes of checksum in CRC-32 checksum 256, and twelve bytes of time in idle time 258. Additionally, as noted, each frame 240 may also contain bytes in reserved data 254.
  • Likewise, in each [0087] frame 240′ of redundant section 230, there are eight bytes in preamble 250′, four hundred twenty (420) bytes of 11-bit high priority audio data and FEC bits in audio data 252′, four bytes of checksum in CRC-32 checksum 256′, and twelve bytes of time in idle time 258′. Also, each frame 240′ may also contain bytes in reserved data 254′.
  • In addition, each [0088] frame 240″ of center section 220 includes eight bytes in preamble 250″, four bytes of checksum in CRC-32 checksum 256″, twelve bytes of time in idle time 258″, and thirty-nine hundred bytes (3900) (or 13 bits of low priority bits times 50 samples times 48 channels divided by 8 bits per byte) of low priority audio data are placed in audio data 252″.
  • In accordance with the present invention, it should be noted that, one of the advantages achieved by placing lower [0089] priority data bits 320 in center section 220 is to provide a length of time between priority section 210 and the subsequent redundant section 230. Center section 220 serves as a buffer to provide a cushion between the two copies of the high priority data bits 312. Under this scheme, payload 200 can lose either priority section 210 or redundant section 230 and still be able to provide 24-bit audio data. Similarly, payload 200 can lose either priority section 210 or redundant section 230 as well as center section 220 and still provide an 11-bit audio data sample. The placement of center section 220 between priority section 210 and redundant section 230 containing high priority data bits 312 minimizes the chance that a long noise burst would corrupt data from both priority section 210 and redundant section 230.
  • Furthermore, as noted, by further splitting [0090] center section 220 into two frames (i.e., Frames 21 and 22), the risk of an error burst causing the entire payload to drop to 11-bit resolution is minimized. While any error to center section 220 results in a loss of dynamics from 24 to 11 bits, this loss would only last for 1 ms if the error burst was limited to only one of the two center frames 240″. In accordance with the present invention, it should be noted that the bits in low priority bits 320 could also be split by channel instead of by sample number. Under this configuration (e.g., splitting the bits in low priority bits 320 by channel), the loss of resolution would go to 11 bits for the entire 2 ms payload time, but only half of the channels (i.e., 24 channels) would be affected.
  • Based on the foregoing, it should be apparent that there are several reasons for bit-splitting and sample-splitting audio data bit samples into multiple sections. First, by bit-[0091] splitting sample data 310, only the bits in high priority bits 312 are stored in priority section 210, thereby increasing the rate of data transmission while minimizing data transmission errors. Second, as described further below, the bits in critical data bits 314 (i.e., the first 9 bits in high priority bits 312) can be encoded with a forward error correction scheme that allows receiver 107 to detect and correct errors upon receiving the data. Furthermore, as described below, in accordance with the present invention, the method of including multiple samples in payload 200 facilitates interleaving of the samples, whereby no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples. In fact, consecutive samples are guaranteed to be at least 4 frames apart.
  • In any event and in accordance with the present invention, in one embodiment, the bits in [0092] critical bits 314 of each sample are encoded with an FEC algorithm. Being the most critical audio data, these bits in critical bits 314 are encoded to allow recovery on the receiving side in the event that a bit is lost during transfer. Due to the nature of the FEC algorithm, 18 bits of raw data are required to perform the encoding. For that reason, in accordance with the present invention, the error encoding will take place on two samples.
  • In one embodiment, a 24/18 Hamming Code is used. This algorithm will take 18 bits of input data (i.e., the first 9 bits of 2 samples), and encode them with 6 check bits. The resulting output is a 24 bit stream of error encoded data. The 24/18 FEC algorithm will detect up to 2 bit errors within the 24-bit packet. It will be able to detect and correct 1 bit error within the 24-bit packet. [0093]
  • As noted, the structure or format of [0094] payload 200 shown in FIG. 2 represents one embodiment that is used to carry out the inventive concepts of the present invention, and that there are multiple variations thereof. Accordingly, payload 200 can be easily modified based on a particular system configuration. The size of payload 200, for example, can be increased to provide more error protection, if needed. While increasing the size of payload 200 may require more processing time and memory, larger payload 200 allows greater protection of critical data that can be retransmitted many times with full error detection and correction encoding.
  • Note that not only the size of [0095] payload 200 can be adjusted, but also the format of the data within payload 200 can be adjusted to provide various degrees of protection of the data. While much of the description herein pertains to transmitter 105 receiving 48-channel, 24-bit digital audio data, it should be noted that transmitter 105 can be adjusted to provide a greater protection over fewer channels. The channel count could be reduced, for example, from 48 to 16. The extra bandwidth within payload 200 could be used to provide redundant protection of more data bits within each sample. Likewise, in one embodiment, payload 200 can be formatted to offer an 8-bit audio data delivery system over 144 channels.
  • Data Interleaving [0096]
  • As noted, the method of including multiple samples in [0097] payload 200 facilitates interleaving of the samples. In accordance with the present invention, by interleaving the samples, no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples during data transmission. This is so since, the system and method of interleaving data samples using the DTP ensures that consecutive samples are at least 4 frames apart from one another.
  • If an error burst takes out one [0098] frame 240 of data in priority section 210, a copy (i.e., frame 240′) of this frame 240 is available in redundant section 230 within the same payload 200. However, there may be a situation where more protection is needed during data transmission. For instance, if an error burst was long enough to corrupt the entire priority section 210 and a second error burst destroyed one frame 240′ within redundant section 230, then the entire five audio samples across all 48 channels in the frame 240 would be lost.
  • Normally, losing 5 samples within an audio data stream would be irrecoverable. However, by interleaving the samples across the entire priority section [0099] 210, a frame 240 can be lost in its entirety and the worst that can happen is that there would be 5 places on each channel within the 2 mS audio data stream where a single sample would need to be interpolated.
  • In accordance with the present invention, using a proper interleaving scheme, consecutive audio samples can be spread out to the point that a noise burst could destroy 4 consecutive frames of data and no two consecutive audio samples would be lost. These missing (non-consecutive) audio samples may then be more accurately reconstructed with interpolation. [0100]
  • Table 1 below shows an exemplary embodiment of the sample interleaving scheme, in accordance with the present invention, that will result in the maximum transmission time between consecutive audio samples. As shown below, each frame contains 5 samples (A-E). There are 20 frames in the priority section. Samples are numbered [0101] 1-100.
    TABLE 1
    Frame # Sample A Sample B Sample C Sample D Sample E
    1 03 23 43 63 83
    2 07 27 47 67 87
    3 11 31 51 71 91
    4 15 35 55 75 95
    5 19 39 59 79 99
    6 01 21 41 61 81
    7 05 25 45 65 85
    8 09 29 49 69 89
    9 13 33 53 73 93
    10 17 37 57 77 97
    11 04 24 44 64 84
    12 08 28 48 68 88
    13 12 32 52 72 92
    14 16 36 56 76 96
    15 20 40 60 80 100
    16 02 22 42 62 82
    17 06 26 46 66 86
    15 20 40 60 80 100
    16 02 22 2 62 82
    17 06 26 46 66 86
    18 10 30 50 70 90
    19 14 34 54 74 94
    20 18 38 58 78 98
  • In general and in accordance with the present invention, the exemplary embodiment of the sample interleaving scheme shown in Table 1 above can be established using the following algorithm. For a given payload of x frames per priority section and y samples per frame: [0102]
  • SAMPLES_PER_FRAME=y; [0103]
  • FRAMES_PER_SECTION=x; [0104]
  • FRAME_SAMPLE_BIAS=INT(SAMPLES_PER_FRAME/2); [0105]
  • At initial startup, variables are initialized as follows: [0106]
  • Frame=0; [0107]
  • Frame_Sample=0; [0108]
  • Dest_Frame_Start=SAMPLES_PER_FRAME—FRAME_SAMPLE_BIAS; [0109]
  • Dest_Sample=Dest_Frame_Start; [0110]
  • Note that a buffer exists, Dest_Buffer, which is pointed to by Dest_Buffer_Ptr. SAMPLE_SIZE is processor-dependent and is used for calculating the location of the new sample in the destination buffer. It represents the number of memory locations required to represent the sample. The algorithm runs as each sample is being loaded in the priority section of the payload. [0111]
    /* Calculate destination buffer pointer based on Destination Samle number.*/
    Dest_Buffer_Ptr = Dest_Buffer_Start + ((Dest_Sample − 1)*SAMPLE_SIZE)
    Copy the incoming sample to the destination buffer at the location pointed to by
    Dest_Buffer_Ptr.
    /* Calculate Next Destination Sample Number */
    Frame = Frame + 1
    If (Frame <FRAMES_PER_SECTION)
    If (Frame_Sample <(SAMPLES_PER_FRAME − 1)
    Frame_Sample = Frame Sample + 1
    Dest_Sample = Dest Sample + FRAMES_PER_SECTION
    Else
    /* Calculate new Dest_Frame_Start */
    Dest_Frame_Start = Dest_Frame_Start − FRAME_SAMPLE_BIAS
    If (Dest_Frame_Start <= 0)
    Dest_Frame Start Dest_Frame_Start + SAMPLES_PER_FRAME
    Endif
    Dest_Sample = Dest_Frame_Start
    Endif
    Else /* Last frame in transmission, payload interleaving complete */
    Frame − 0
    Frame_Sample = 0
    Dest_Frame_Start = SAMPLES_PER_FRAME − FRAME_SAMPLE_BIAS
    Dest_Sample Dest_Frame_Start
    Endif
  • Using the sample interleaving algorithm illustrated above, the risk of losing two consecutive samples can be greatly minimized. It should be noted, however, that the algorithm described above illustrates an exemplary algorithm, and, as such, there are multiple variations of algorithms that can be used with the present invention and within the scope and spirit of the present invention. For instance, it should be noted that while the system and method of sample interleaving, including the algorithm shown above, relate to the samples in priority section [0112] 210 and redundant section 230, the system and method of sample interleaving, in accordance with the present invention, are equally applicable to the samples in center section 220. That is, the system and method of the present invention can be used to interleave not only the high priority bits in priority section 210 (and redundant section 230), but also the low priority bits in center section 220.
  • Data Clock Recreation [0113]
  • In accordance with the present invention, a system and method is provided for transmitting data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver. In one aspect, the system and method of the present invention can be used to recreate (or regenerate) the transmitter's data clock in the receiver with nothing more than the Ethernet clock (or any system clock—ie., a transmission clock—that is recovered by the receiver for a non-Ethernet system). [0114]
  • FIG. 5 shows data transmission and data [0115] clock recreation system 500, in accordance with the present invention. As shown, transmitter 510 is coupled to receiver 550 over link 505. In accordance with one aspect of the present invention, link 505 comprises any asynchronous link, including without limitation, a transformer, optical, or RF isolated data connection.
  • It should be noted that the embodiment of [0116] system 500 of FIG. 5 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, while much of the description herein relates to transmitting and recreating an audio data clock, system 500 of the present invention can be used to transmit and recreate a video clock.
  • As shown, [0117] transmitter 510 comprises, among other things, count generator 520, data packetizer 530, and Ethernet PHY 540. Count generator 520 receives signals from audio data clock 512 and Ethernet clock 514 and generates count values 522. Note that Ethernet clock 514 drives Ethernet PHY 540 and that audio data clock 512 drives A/D's (not shown here). It should be noted that audio data clock 512 and Ethernet clock 514 are asynchronous.
  • [0118] Audio data clock 512 represents a clock that is synchronized with data (i.e., audio data 526) going into transmitter 510. Audio data clock 512 may comprise any clock, including without limitation, a L/R clock, bit clock, or master clock, that is associated with the data (i.e., audio data 526) from which all other data timing signals (i.e., count value 522) can be generated. in the embodiment of system 500 shown in FIG. 5, audio data clock comprises the L/R clock.
  • To generate [0119] count values 522, count generator 520 compares and counts the number of asynchronous Ethernet clocks 514 per each audio data clock 512. More specifically, count generator 520 re-clocks audio data clock 512 with Ethernet clock 514. Doing so creates re-clocked audio data clock 572. It should be noted that, in accordance with the present invention, re-clocked audio data clock 572 is edge-synchronous with Ethernet clock 514 and comprises the same asynchronous frequency as the original audio data clock 512. In other words, re-clocked audio data clock 572 represents audio data clock 512 with jitter. Thereafter, count generator 520 counts the number of Ethernet clock 514 cycles per audio clock 512 cycle and transmits the resulting count value 522 to data packetizer 530.
  • As shown, [0120] data packetizer 530 receives the count value 522, along with generic data 524 and audio data 526. Note that audio data 526 enters transmitter 510 through an A/D converter (not shown) and is digitized. Data packetizer 530 packetizes the count value 522, generic data 524, and audio data 526 into a payload. Accordingly, the payload now contains the count value 522 that will be used to generate the L/R Clock for that payload. In other words, the count value 522 is transferred to receiver 550 via the payload.
  • The packetized [0121] payloads 535 are then sent to Ethernet PHY 540. As noted, the Ethernet PHY 540 is the lowest hardware layer where data meets the wire. This layer conveys the bit stream, including electrical impulse, light or radio signal, through the network at the electrical and mechanical level. The packetized data 535 is transmitted to receiver 550 via link 505.
  • Upon receiving the [0122] packetized data 535, receiver 550 synchronizes its local Ethernet clock 562 to the packetized data 535. In other words, Ethernet clock 514 from transmitter 510 and Ethernet clock 562 from receiver 550 are synchronized and locked with one another. Upon synchronization, receiver Ethernet PHY, which includes PHY receiver 555 and recovery unit 560, recovers and transmits the Ethernet data 564 and Ethernet clock 562 to data de-packetizer 565. After receiving the Ethernet data 564 and Ethernet clock 562, data de-packetizer 565 separates the count value 522, generic data 524, and audio data 526.
  • Thereafter, data de-packetizer [0123] 565 sends the count value 522 to audio data clock generator 570, which, as shown, uses the count value 522 and Ethernet clock 562 (from recovery unit 560) to create the re-clocked audio data clock 572. It should be noted that the re-clocked audio data clock 572 is recreated (or regenerated) to represent the original audio data clock 512 by changing edges based on the count value 522. In other words, re-clocked audio data clock 572 is edge-synchronized with the recovered Ethernet clock 562, and, as such, represents an accurate representation of the original audio data clock 512, but with jitter.
  • [0124] PLL circuit 580 receives audio data clock 572 and removes the jitter. That is, using re-clocked audio data clock 572, PLL circuit 580 provides jitter free data clock 582 and a higher frequency master clock 584. By using the jitter free audio data clock 582 and master clock 584, all other data timing signals can be reproduced. In other words, the jitter free audio data clock 582 can be used to create master clock 584 for driving D/A's (not shown) in receiver 550. It should be noted that, therefore, jitter free audio data clock 582 and master clock 584 are synchronous with the audio data 526 transmitted from data de-packetizer 565.
  • As noted, while much of the description herein relates to transmitting and recreating audio data clock, [0125] system 500 of the present invention can be used transmit and recreate video data clock and that there are other variations of recreating the data clock thereof that incorporate the inventive concept of the present invention and are within the scope and spirit of the present invention.
  • Personal Mixing and Distribution System [0126]
  • In accordance with the present invention, FIG. 6 shows one embodiment of personal mixing and [0127] distribution system 600 that can be used to transmit and distribute data over multiple receivers. It should be noted that system 600 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, while FIG. 6 shows only four receivers 650, the number of receivers 650 can be, in accordance with present invention, easily increased or decreased depending on the system configuration. Likewise, the number of input channels 610 can be easily increased or decreased depending on the system configuration.
  • As shown in FIG. 6, in accordance with the present invention, [0128] transmitter 605 takes one or more audio data channels 610 and packetizes the data. It should be noted that transmitter 605 can receive over 48 high-quality digital audio channels 610, making system 600 suitable for multi-channel professional audio solutions. The packetized data is transmitted to receivers 650 over link 620. It should be noted that while the embodiment of system 600, as shown in FIG. 6, follows the DTP, system 600, in accordance with the present invention, can follow other protocols, including without limitation, traditional Ethernet.
  • In accordance with the present ivention, link [0129] 620 comprises a high speed, serial data transmission link. The embodiment of system 600, as shown in FIG. 6, includes link 620 comprising Category-5 cable in conjunction with standard Ethernet 100 Mbit PHY hardware. This configuration provides a 100 Mb serial data transmission rate. It should be noted that, however, in accordance with the present invention, link 620 may include any one or more of Cat-5/PHY in a 10 Mbit or 1000 Mbit form, IR, Wireless (e.g., 802.11 link), or laser.
  • It should be noted that, in [0130] system 600, transmitter 605 is connected to a group of receivers 650 via link 620 in a daisy-chain configuration. As described below, using the DTP in a daisy-chained configuration, each receiver 650 can provide dynamic and intelligent scaling functions to its output channels 695. In particular, each receiver 650 can monitor the error counts in real-time as it receives data. More specifically, receivers 650 can receive the data, analyze the payload for the priority information (e.g., channel count, audio fidelity, error tolerance, etc.), and then feed back control data to transmitter 605, instructing transmitter 605 to dynamically scale the payload to provide the best payload format to achieve the desired results in the given environment. Alternatively or additionally, receivers 650 may simply feed back the raw error count information, leaving the analysis and subsequent scaling decision algorithm to transmitter 605.
  • In accordance with the present invention, as long as [0131] transmitter 605 provides a format identifier with the packet, receivers 650 can be grouped so that one receiver 650 can receive a specific set of channels 610 at one quality level, while another receiver 650 gets another quality level of audio data over a different set of channels 610. With this flexibility, system 600 can be adapted to a variety of environments and/or applications. For instance, in accordance with the present invention, each receiver 650 can craft a unique mix of audio data that does not affect the mix of the other receivers 650 and can be controlled by separate users.
  • In particular, under the configuration of [0132] system 600, each receiver 650 can read the data transmitted from transmitter 605 and then immediately pass the data to additional receivers 650. In other words, this configuration allows each receiver 650 to “tap” off the packetized data transmitted from transmitter 605 (or from other receivers 650) and read the specific channels 610 as desired. Also, two or more receivers 650 can receive the data transmission and de-packetize (or reconstruct) the data simultaneously. Thereafter, each receiver 650 can mix the data to suit the respective local listening environment serviced by one or more output channels 695. Alternatively or additionally, in one embodiment, each receiver 650 can tap into a common set of digital channels generated by transmitter 605 and, thereafter, each receiver 650 can output one or more signals from the common set of digital channels.
  • It should be noted that, in accordance with the present invention, [0133] system 600 allows each receiver 650 to employ a standard analog master gain control. Alternatively or additionally, system 600 allows each receiver 650 to employ output circuit 677, which, in one embodiment, comprises a digitally controlled analog master audio gain control that can be used to provide an auto-gain adjustment system. This means that, each receiver 650 can provide intelligent functionalities.
  • For instance, at each [0134] receiver 650, as the volume of a specific channel 610 is increased to the point of near clipping, that channel 610 can be effectively limited while other remaining channels 610 are reduced in volume, maintaining the desired relative level between all of the channels 610. To assure that the user (at output channels 695) perceives the change as an increase in the desired channel, the digitally controlled post D/A's master volume is then increased accordingly by the digitally controlled analog master audio gain control 677.
  • In other words, [0135] system 600 allows each receiver 650 to automatically adjust itself to keep an overall output volume constant when an individual channel 610's volume is raised to its maximum digital level. Thereafter, system 600 automatically lowers the digital volume levels of all other channels 610 and raises the master gain, thereby effectively raising the volume of the channel 610 that is at its maximum digital level thus allowing greater dynamic range control of the digital mix.
  • In accordance with the present invention, FIG. 7 shows an expanded view of [0136] transmitter 605 of FIG. 6. As shown, audio data enters transmitter 605 through one or more channels 610. Thereafter, the data is digitized using one or more A/D converters 612. The digitized data is transmitted to transmitter ASIC 616 over a serial bus 614. In accordance with the present invention, bus 614 comprises Inter-IC Sound (I2S), which typically handles audio data separately from clock signals. It should be noted that optional serial data 622, word clock 624, and/or video sync 626 can also drive transmitter ASIC 616.
  • Thereafter, [0137] transmitter ASIC 616 packetizes the digitized data. During this process, transmitter ASIC 616 converts digitized audio data into data packets. Note that transmitter ASIC 616 interfaces to transmitter Ethernet PHY 632 through a standard Ethernet MII interface 630. Accordingly, the packetized data is passed from transmitter ASIC 616 to transmitter connector 634 through Ethernet MII interface 630 and transmitter Ethernet PHY 632. In accordance with the present invention, transmitter connector 634 comprises an RJ-45 Category-5 approved connector. It should be noted, as described below, there is a power supply circuit 910 supplying power to transmitter 605.
  • In accordance with the present invention, FIG. 8 shows an expanded view of a [0138] receiver 650 shown in FIG. 6. As shown, the data enters receiver 650 through receiver connector 652. Like transmitter connector 634, receiver connector 652 comprises an RJ-45 Category-5 approved connector. Note that transmitter Ethernet PHY 654 interfaces with receiver ASIC 660 through a standard Ethernet MII interface 630.
  • It should be noted that, in accordance with the present invention, the transmission (of data) is immediately repeated, with virtually no delay, to [0139] transmitter Ethernet PHY 632 and to transmitter connector 634. The repeated transmission is destined to additional receivers 650.
  • In any event and in accordance with the present invention, after receiving the transmission, [0140] receiver ASIC 660 de-packetizes (or reconstructs) the data. During this time, receiver ASIC 660 performs an error detection and correction (EDAC) process, following the DTP. Following the EDAC process, receiver ASIC 660 presents individual I2S audio signals 662, serial data 664, and word clock outputs 668.
  • It should be noted that in the embodiment of [0141] receiver 650, as shown in FIG. 8, receiver ASIC 660 performs digital mixing of forty-eight audio channels with mixer 670. Thereafter, receiver ASIC 660 presents a single I2S output 672 to a stereo D/A converter 675 and the optional digitally controlled analog master audio gain control at output circuit 677. As noted, the final output is transmitted to one or more output channels 695.
  • It should also be noted that, in one embodiment, [0142] mixer 670 is large enough to accommodate more audio channels (i.e., up to the number of channels in the input stream). As shown further in FIG. 8, in accordance with the present invention, receiver 650 includes microprocessor 680, volume rotary encoder 682, pan rotary encoder 684, buttons 686, and LEDs 688. Receiver 650 also includes a power supply circuit 910 supplying power to receiver 650.
  • Data Distribution and Mixing System [0143]
  • In accordance with the present invention, a novel system and method of using the DTP to transmit and distribute audio or video data over a network having multiple modules is provided. In particular, a novel system and method of using serial data links to communicate with functional mixing blocks, such as input modules, master modules, receivers, mixers, and/or controls surfaces is provided. [0144]
  • FIG. 9 illustrates data distribution and [0145] mixing system 900 that uses the DTP to, among other things, receive, transmit, distribute, and mix audio or video data. It should be noted that the configuration of system 900 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention.
  • As described, audio mixers, in general, have all input and output connectors in one physical package and in relatively close proximity to one another. Also, audio mixers typically have their control elements integrated into the same physical package as their input and output connections, and, as such, all control is performed from a central location. Therefore, input signals are carried from their origin to the mixer over a relatively long distance using analog or digital cables. Similarly, output signals from the mixer are carried to their destinations over a relatively long distance using analog or digital cables. As a result, an audio mixer system may comprise a complex set up, including many cables that are costly and prone to damage. [0146]
  • In accordance with the present invention, data distribution and [0147] mixing system 900 can be used in such a situation to communicate with functional mixing blocks over a serial data link. In particular, system 900 comprises multiple control surfaces that can control all or part of system 900 simultaneously or separately from different physical locations.
  • As shown in FIG. 9, data distribution and [0148] mixing system 900 includes master module 905, input modules 930, and receivers 950. Input modules 930 are linked to one another in a daisy-chained configuration and operatively coupled to master module 905 via link 920. Similarly, receivers 950 are linked to one another in a daisy-chained configuration and operatively coupled to master module 905 via link 920. In accordance with the present invention, link 920 comprises a high speed, asynchronous serial link, such as a CAT-5 10-baseT, CAT-5 100-baseT, 1 gigabit Ethernet, 100 gigabit Ethernet, other versions of Ethernet, infra-red, RF, wired, wireless, optical, or laser link.
  • In accordance with the present invention, the functions of [0149] master module 905, which acts as a mixer, can be controlled remotely by primary control surface 915 and/or secondary control surface 915′. Alternatively or additionally, the functions can be controlled wirelessly by wireless control surface 915″. Note that primary control surface 915, secondary control surface 915′, and wireless control surface 915″ are sometimes collectively referred to as control surfaces 915. The link between master module 905 and control surfaces 915 can provide audio as well as control data, thereby allowing remote effects units to be local to control surfaces 915. It should be noted that, in accordance with the present invention, different control surfaces 915, 915′, and 915″ can use different transmission media, with different bandwidth to connect to master module 905. It should also be noted that any number of the control surfaces 915 can be added to master module 905.
  • As described in more detail below, in accordance with the present invention, [0150] master module 905 gathers all of the control information from control surfaces 915. Thereafter, master module 905 initiates the mixing process by adding any input signals created in master module 905 to mix busses dictated by the control data gathered from control surfaces 915.
  • A detailed illustration of [0151] master module 905 of system 900, distributing and mixing audio data is shown in FIG. 10. It should be noted that the embodiment of master module 905, as shown, is an exemplary embodiment, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, while the discussion herein relates to audio data, master module 905 can be used to distribute and mix other types of data, including without limitation, video data.
  • As noted, [0152] master module 905 gathers all of the control information from control surfaces 915. Accordingly, as shown in FIG. 10, master module 905 gathers the control data (and audio data if necessary) from control surfaces 915 via inputs 907. As shown, inputs 907 are communicatively coupled to connectors 924. Multiple inputs 907 are provided to support simultaneous connections to control surfaces 915.
  • Once received, the data are sent to [0153] data de-packetizers 911, which de-packetize and separate the control data and audio data. The control data are merged in control data merger 913. In accordance with the present invention, data de-packetizers 911 may also drive D/A circuits 914 to provide additional analog outputs without using busses on asynchronous serial data link 920. The output from D/A circuits 914 is provided to local audio outputs 917.
  • Note that [0154] master module 905 starts the mixing process by mixing any local input signals 916 to master module 905 and any audio data from control surfaces 915 that is destined to mix busses, in digital audio mixing block 918. Also note that, in one embodiment, input circuit 919 comprises a digitally remote controlled microphone preamp. In accordance with the present invention, the digitally remote controlled microphone preamp can be controlled remotely from any one of control surfaces 915, 915′, 915″ such that control data is sent from any one of control surfaces 915, 915′, 915″ to adjust the microphone preamp's gain at master module 905.
  • In any event and in accordance with the present invention, note that digital [0155] audio mixing block 918 also provides equalization (EQ) and effects. Thereafter, master module 905 takes this mixed audio and control information and packetizes them in data packetizer 922 for transmission (over link 920) via output driver circuit 923. It should be noted that link 920 carries actual mixing bus information as well as control data through system 900. In one embodiment, output driver circuit 923 is communicatively coupled to connector 924, which couples to the first input module 930 in system 900.
  • Referring again to FIG. 9, note that the output from data packetizer [0156] 922 of master module 905 is connected to the first input module 930. As shown, the first input module 930 is also designated as input module 930′. Using the daisy-chained topology, the output from data packetizer 922 is conveyed to other input modules 930 in the chain until it reaches the last input module 930, which is also designated as input module 930″.
  • [0157] Last input module 930″ then sends the data to master module 905 over link 920 via data input circuit 925. As shown, data input circuit 925 is communicatively coupled to connector 924. The data is then split and sent to output circuit 926 communicatively coupled to receivers 950 and/or control surfaces 915. The other part of the split data is sent to de-packetizer 927, which splits the data into audio data and control data and drives digital audio mixing block 928. It should be noted that, in accordance with the present invention, the data is split to make local audio outputs 917 on master module 905. Accordingly, digital audio mixing block 928 mixes, adds EQ and effects, and drives D/A 929 to provide analog audio outputs to local audio outputs 917.
  • It should be noted, in accordance with the present invention, [0158] connectors 924 comprise any link, including without limitation, a transformer, optical, or RF isolated data connection.
  • Recall that the output from data packetizer [0159] 922 (in master module 905) is sent over link 920 to first input module 930′. This data is conveyed to all input modules 930 and eventually reaches last input module 930″. Last input module 930″ then conveys the data back to master module 905 at data input circuit 925.
  • FIG. 11 shows a detailed illustration of [0160] input module 930, of system 900, distributing and mixing audio data, in accordance with the present invention. It should be noted that a control bus independently addresses each of input modules 930 in system 900. The control bus, in accordance with the present invention, includes information for varying a gain, frequency, or effects associated with an input channel, output bus, or a mix.
  • Further, each [0161] input module 930 processes its own input signals. Some of the processes that input module 930 performs include, without limitation, an A/D conversion, equalization, effects, and time alignment delay. After processing, input module 930 adds the signals to the busses carried on data link 920.
  • As shown in FIG. 11, input data enters [0162] input module 930 via connector 924 at module receiver 932. It should be noted that input data is coming from either master module 905 or preceding input module 930. Data is then de-packetized by data de-packetizer 934 where data is split into mix bus audio data 941 and control data 942. It should be noted that local audio signals 935 enter input module 930 at input circuit 936 and are digitized.
  • Note that, in one embodiment, input circuit [0163] 936 comprises a digitally remote controlled microphone preamp. In accordance with the present invention, the digitally remote controlled microphone preamp can be controlled remotely from any one of control surfaces 915, 915′, 915″ such that control data is sent from any one of control surfaces 915, 915′, 915″ to adjust the microphone preamp's gain at input module 930.
  • In any event and in accordance with the present invention, the digitized local audio signals [0164] 935 are delayed by the necessary sample amount in sample buffer/delay generator 938. Note that the amount of delay is determined by the position of input module 930 in the input module loop (i.e., daisy-chain), as shown in FIG. 9. This is done to time align the mixed audio output with sample level accuracy. That is, because mix busses are built in time, a specific delay is associated with each input module 930. In other words, each input module 930 has a defined delay that is used to maintain a final mix in a time aligned format.
  • For instance, in one embodiment of [0165] system 900 that comprises six input modules 930 where each input module 930 takes one audio sample period to process its input signals onto the mix busses, first input module 930′ would mix onto the busses its current sample, the second input module 930 would mix onto the busses one sample previous to its current sample (from memory), the next input module would mix onto the busses two samples previous to its current sample (from memory), and so on, until last input module 930″ (i.e., sixth) would mix onto the busses five samples previous to its current sample (i.e. input module 930″ would require memory to store five samples of audio data).
  • In any event and in accordance with the present invention, digital [0166] audio mixing block 940 mixes and provides EQ and effects to the digitized and delayed local audio signals 935 per control data instructions 942. That is, the output from digital audio mixing block 940 represents updated digital audio busses with local audio mixed in per the control data 942. The output of digital audio mixing block 940 is then packetized by data packetizer 943 and transmitted to next input module 930 by output driver 944. Output data 946 is then sent to subsequent (or following) input module 930 in the chain.
  • In accordance with the present invention, [0167] input module 930 must de-packetize input data coming into input module 930 and split into audio data 941 and control data 942, followed by digitally mixing audio data 941 and its local audio signals 935 into the mixer busses per control 942 that governs input module 930's inputs. Also, input module 930 must preserve all control data 942 and re-packetize the digital audio data (i.e., 935 and 941) and control data 942 for retransmission to the next input module 930 where the entire process, as described, repeats.
  • Referring again to FIG. 9, it should be noted that, in accordance with the present invention, any number of [0168] receivers 950 can be connected to master module 905 and provide independent mixes of the system audio busses. Using this configuration, an infinite amount of mixes can be provided. It should be noted that the configuration of FIG. 9 allows each input module 930 to receive mixing instructions addressed to that module 930 and then passes a signal mixed in with the instructions to next input module 930. In accordance with the present invention, this process can be done while no human perceptible delay is introduced into the mixed signal as it moves through link 920.
  • FIG. 12 shows a detailed view of [0169] receiver 950 of system 900 shown in FIG. 9, in accordance with the present invention. As shown, data enters receiver 950 through receiver connector 1252 and is passed to receiver PHY 1254. Receiver connector 1252 comprises an RJ-45 Category-5 approved connector. Receiver 950 receives the requisite system data via the input data from receiver connector 1252. It should be noted that the transmission (of data) is immediately repeated, with virtually no delay, to Ethernet PHY 1232 and to other receiver connector 1234 to provide daisy chained data to other receivers 950 by buffering it and re-clocking it in ASIC 1260 via Ethernet MII interface 1230.
  • After receiving the transmission, [0170] receiver ASIC 1260 de-packetizes (or reconstructs) the data. After de-packetizing the data, receiver ASIC 1260 sends separate audio I2S signals 1262 and data signals 1264 to other components such as D/A converters, digital signal processors, and/or microprocessors (not shown).
  • Additionally, [0171] receiver ASIC 1260 performs digital mixing of audio channels (forty-eight channels are shown in the embodiment) with mixer 1270. Digital audio mixer block 1270 mixes the audio channels into a stereo pair, converts the mixed signals to an I2S signal in converter 1272, and outputs through D/A 1275 and analog connections output circuit 1277. The output is transmitted via one or more output channels 1295. Note that mixer 1270 also adds EQ and effects and is controlled by the microprocessor 1280, which also controls indicators 1288 and reacts to rotary encoders 1282, potentiometers 1284, and switches 1286.
  • Referring again to FIG. 9, recall that data distribution and [0172] mixing system 900 includes a plurality of control surfaces 915, each of which can be used to control the functions of master module 905. FIG. 13 shows, in accordance with the present invention, a detailed representation of one embodiment of control surface 915.
  • Note that, in accordance with the [0173] present invention miroprocessor 1380 is coupled to multiple input and/or output devices. These devices are used to, among other things, communicate with users. For instance, a user can enter input to microprocessor 1380 by using rotary encoders 1382, potentiometers 1384, and/or switches 1385. Microprocessor 1380 can provide to the user the system status information by using indicators 1388 and/or display 1389.
  • In accordance with the present invention, control data is output from [0174] microprocessor 1380 per the control settings. The control data is sent to data packetizer 1320, which merges and packetizes the control data with any local audio 1310 coming in from A/D 1312 and transmits the packetized data to master module 905 via output circuit 1322.
  • Note that data from [0175] master module 905 enters control surface 915 at input circuit 1330. Thereafter, data de-packetizer 1332 separates the control data and audio data and sends the control data to microprocessor 1380. This allows display 1389 to be synchronized with changes made by other control surfaces 915 (or other system components, such as input modules 930). Furthermore, data de-packetizer 1332 sends the audio data to audio channel selector 1334, which selects and sends digital audio to output circuit 1338 for local audio outputs 1340. D/A converter 1336, which can be used to convert signal, is placed between audio channel selector 1334 and output circuit 1338. Note that audio outputs 1340 can drive the local EQs and effects units.
  • It should be noted that, each audio channel can have many different parameters, such as EQ (frequency, boost/cut, or Q), gain, FX (reverb type, reverb time, reverb density, or delay). In accordance with the present invention, [0176] microprocessor 1380 keeps track of the parameters that control surface 915 can change. For instance, note that in a system having multiple control surfaces 915, not all control surfaces need to control all parameters. In such a situation, it may be desirable to control only a subset of the parameters on some or all of control surfaces 915. Thus, it may be desirable to make control surfaces 915 control exclusive parameters for controlling their own respective local space.
  • As noted, the configuration of [0177] system 900 represents one embodiment that is used to carry out the inventive concepts of the present invention, and, as such, there are multiple variations thereof within the scope and spirit of the present invention. For instance, one embodiment of system 900 uses the DTP comprising a protocol that will automatically enumerate each audio channel of input module 930 in a manner that assigns each audio channel of input module 930 to a given mixer channel regardless of the order in which input modules 930 are connected along the chain.
  • Isolated Grounding and Data Loopback Scheme [0178]
  • In accordance with the present invention, a data transmission and distribution system having multiple receivers is provided, whereby each receiver can repeat data signals that are in Ethernet format. Additionally, a system where each receiver includes an isolated power supply is provided. [0179]
  • In accordance with the present invention, FIG. 14 [0180] shows transmitter 1405 communicatively coupled to receivers 1450 via link 1420. Transmitter 1405 and receivers 1450 in FIG. 14 are shown in an exemplary embodiment to illustrate the inventive concepts of the present invention, and there are multiple variations thereof within the scope and spirit of the present invention.
  • For instance, in FIG. 14, either [0181] transmitter 1405 or receiver 1450 can be replaced with transmitter 105, transmitter 510, transmitter 605, master module 905, input module 930, control surface 915, receiver 950, receiver 550, receiver 650, or receiver 107. Also it should be noted that while the embodiment shown in FIG. 14 relates to data signals in Ethernet format, other embodiments of transmitters 1405 and receiver 1450 can be used with any ground isolated data link.
  • In accordance with the present invention, [0182] transmitter 1405 and receivers 1450 can receive, transmit, and distribute data signals that are in Ethernet format, and such signals are repeated along receivers 1450 using a daisy-chained topology. This is accomplished by first keeping link 1420 isolated with a transformer, optical or RF isolation, and then by implementing a ground isolated floating power supply 1415. This combination allows the ground reference of receiver 1450 to float to the ground potential of external amp 1422 and speaker 1424.
  • It should be noted that providing isolated grounding is very useful since, in a typical audio and/or video distribution system, ground loops can cause audio hum or visual artifacts. By providing isolated grounding to [0183] receivers 1450 that are chained together in a daisy-chain, each receiver 1450 can eliminate audio hum and/or visual artifacts.
  • As noted, the present invention provides the system for each receiver in a chain to repeat data signals that are in Ethernet format. In accordance with the present invention, this is accomplished by wrapping the data (received from [0184] transmitter 1405 or receiver 1450) to an output driver 1434. More specifically, the output data from transmitter 1405 (or receiver 1450) is transmitted to input receiver 1430 and then to data loop buffer 1432. The data is then sent to output driver 1434.
  • Note that this configuration requires [0185] data loop buffer 1432 to account for the asynchronous nature of the recovered transmitter Ethernet clock and the receiver Ethernet clock. Also note that, using this configuration as shown in FIG. 14, a daisy-chained system can be implemented using the Ethernet topology. As known, Ethernet only follows either star topology or bus topology. This is very useful since, in the configuration of FIG. 14, each receiver 1450 can act as a repeater while following the Ethernet topology. As a result, receivers 1450 can have a maximum distance of over several hundred feet between one another.
  • While much of the description herein regarding the systems and methods of the present invention pertains to audio data, the systems and methods, in accordance with the present invention, are equally applicable to any other types of data, such as video data and generic data, including control data. [0186]
  • Likewise, while much of the description herein regarding the systems and methods of the present invention pertains to a physical Ethernet serial data link, the systems and methods, in accordance with the present invention, are equally applicable to any other types of data links, including without limitation, optical, RF, and copper links. [0187]
  • It will be appreciated by those skilled in the art that changes could be made to the embodiments described above without departing from the broad inventive concept thereof. It is understood, therefore, that this invention is not limited to the particular embodiments disclosed, but is intended to cover modifications within the spirit and scope of the present invention as defined in the appended claims. [0188]

Claims (6)

What is claimed is:
1. A method for transmitting a series of payloads each of which is formed from samples of audio or video information, comprising the step of interleaving the audio or video samples in each payload; whereby no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples.
2. The method of claim 1, further comprising the step of recovering all lost samples resulting from the loss of the entire frame of interleaved samples using an interpolation over one sample.
3. The method of claim 1, wherein the audio or video samples are partial samples containing only high priority bits.
4. The method of claim 1, wherein the audio or video samples are partial samples containing only low priority bits.
5. A data transmission and distribution system comprising:
a series of payloads, each of the payloads formed from samples of audio or video information;
wherein the data transmission and distribution system interleaves the audio or video samples in each payload, and wherein no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples.
6. A data transmission and distribution system for transmitting a series of payloads, wherein each of the payloads is formed from samples of audio or video information, comprising:
means for interleaving the audio or video samples in each payload, wherein no two consecutive samples are lost upon a loss of an entire frame of the interleaved samples.
US10/341,950 2002-01-16 2003-01-14 System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost Abandoned US20030161324A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/341,950 US20030161324A1 (en) 2002-01-16 2003-01-14 System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US34911402P 2002-01-16 2002-01-16
US10/341,950 US20030161324A1 (en) 2002-01-16 2003-01-14 System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost

Publications (1)

Publication Number Publication Date
US20030161324A1 true US20030161324A1 (en) 2003-08-28

Family

ID=27613248

Family Applications (7)

Application Number Title Priority Date Filing Date
US10/341,878 Expired - Lifetime US7043671B2 (en) 2002-01-16 2003-01-14 System and method for transmitting audio or video data using multiple levels of protection
US10/341,950 Abandoned US20030161324A1 (en) 2002-01-16 2003-01-14 System and method for transmitting and reconstructing audio or video data using intelligent sample interleaving of transmitted data requiring fewer orders of interpolation to accurately reconstruct audio or video data at the receiver in the event of data lost
US10/342,066 Expired - Fee Related US7403828B2 (en) 2002-01-16 2003-01-14 System and method for transmitting and distributing audio or video data over a network system having multiple receivers
US10/341,958 Abandoned US20030165163A1 (en) 2002-01-16 2003-01-14 System and method for transmitting, distributing and mixing audio or video data over a network system having multiple input modules and control surfaces, without data degradation and delay
US10/342,067 Active 2025-10-28 US7301966B2 (en) 2002-01-16 2003-01-14 System and method for transmitting audio and video data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver
US11/379,843 Expired - Fee Related US7523362B2 (en) 2002-01-16 2006-04-24 System and method for transmitting audio or video data using multiple levels of protection
US12/176,790 Abandoned US20080310461A1 (en) 2002-01-16 2008-07-21 System and method for transmitting and distributing audio or video data over a network system having multiple receivers

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/341,878 Expired - Lifetime US7043671B2 (en) 2002-01-16 2003-01-14 System and method for transmitting audio or video data using multiple levels of protection

Family Applications After (5)

Application Number Title Priority Date Filing Date
US10/342,066 Expired - Fee Related US7403828B2 (en) 2002-01-16 2003-01-14 System and method for transmitting and distributing audio or video data over a network system having multiple receivers
US10/341,958 Abandoned US20030165163A1 (en) 2002-01-16 2003-01-14 System and method for transmitting, distributing and mixing audio or video data over a network system having multiple input modules and control surfaces, without data degradation and delay
US10/342,067 Active 2025-10-28 US7301966B2 (en) 2002-01-16 2003-01-14 System and method for transmitting audio and video data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver
US11/379,843 Expired - Fee Related US7523362B2 (en) 2002-01-16 2006-04-24 System and method for transmitting audio or video data using multiple levels of protection
US12/176,790 Abandoned US20080310461A1 (en) 2002-01-16 2008-07-21 System and method for transmitting and distributing audio or video data over a network system having multiple receivers

Country Status (5)

Country Link
US (7) US7043671B2 (en)
EP (2) EP1476947A4 (en)
JP (1) JP2005516485A (en)
AU (1) AU2003210505A1 (en)
WO (1) WO2003063465A2 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030161347A1 (en) * 2002-01-16 2003-08-28 Aviom, Inc. System and method for transmitting audio and video data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver
US20050122958A1 (en) * 2003-12-05 2005-06-09 Shim Choon B. System and method for managing a VoIP network
US20120070004A1 (en) * 2010-09-22 2012-03-22 Crestron Electronics, Inc. Digital Audio Distribution
US8150918B1 (en) 2003-01-29 2012-04-03 Adobe Systems Incorporated Client controllable server-side playlists
US8166191B1 (en) * 2009-08-17 2012-04-24 Adobe Systems Incorporated Hint based media content streaming
US8412841B1 (en) 2009-08-17 2013-04-02 Adobe Systems Incorporated Media content streaming using stream message fragments
CN106788844A (en) * 2016-12-16 2017-05-31 深圳市声菲特科技技术有限公司 A kind of MCVF multichannel voice frequency synchronous transfer circuit
US10937434B2 (en) * 2018-05-17 2021-03-02 Mediatek Inc. Audio output monitoring for failure detection of warning sound playback
US10972520B1 (en) * 2016-03-18 2021-04-06 Audio Fusion Systems, Inc. Monitor mixing system that distributes real-time multichannel audio over a wireless digital network

Families Citing this family (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7346332B2 (en) * 2002-01-25 2008-03-18 Ksc Industries Incorporated Wired, wireless, infrared, and powerline audio entertainment systems
US8103009B2 (en) * 2002-01-25 2012-01-24 Ksc Industries, Inc. Wired, wireless, infrared, and powerline audio entertainment systems
US7853341B2 (en) 2002-01-25 2010-12-14 Ksc Industries, Inc. Wired, wireless, infrared, and powerline audio entertainment systems
US7251241B1 (en) * 2002-08-21 2007-07-31 Cisco Technology, Inc. Devices, softwares and methods for predicting reconstruction of encoded frames and for adjusting playout delay of jitter buffer
US7130660B2 (en) * 2003-08-04 2006-10-31 Lucent Technologies Inc. Method and system for receiving and transmitting signals in a cellular radio network
US8494071B2 (en) * 2003-12-08 2013-07-23 Kabushiki Kaisha Kenwood Device and method for correcting a data error in communication path
JP4220365B2 (en) * 2003-12-08 2009-02-04 株式会社ケンウッド Transmitting apparatus, receiving apparatus, data transmitting method, and data receiving method
US7523305B2 (en) * 2003-12-17 2009-04-21 International Business Machines Corporation Employing cyclic redundancy checks to provide data security
JP4388366B2 (en) * 2003-12-26 2009-12-24 株式会社ケンウッド Transmission device, reception device, data transmission method, data reception method, and program
US7483538B2 (en) 2004-03-02 2009-01-27 Ksc Industries, Inc. Wireless and wired speaker hub for a home theater system
US8094562B1 (en) * 2004-06-24 2012-01-10 Cypress Semiconductor Corporation Transmission of a continuous datastream through a re-clocked frame-based transport network
US7792158B1 (en) 2004-08-18 2010-09-07 Atheros Communications, Inc. Media streaming synchronization
US8149880B1 (en) 2004-08-18 2012-04-03 Qualcomm Atheros, Inc. Media streaming synchronization
JP4542405B2 (en) * 2004-09-30 2010-09-15 株式会社ケンウッド Baseband signal generation apparatus, baseband signal generation method, and program
ATE511721T1 (en) * 2004-10-06 2011-06-15 Nokia Corp COMPILE FORWARD ERROR CORRECTION FRAMEWORK
ES2785025T3 (en) 2005-03-10 2020-10-05 Panasonic Ip Corp America Radio receiving apparatus and radio transmitting apparatus
US9658473B2 (en) 2005-10-07 2017-05-23 Percept Technologies Inc Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8212693B2 (en) * 2005-10-12 2012-07-03 Samsung Electronics Co., Ltd. Bit-stream processing/transmitting and/or receiving/processing method, medium, and apparatus
EP1966981B1 (en) 2005-12-19 2012-08-01 ST-Ericsson SA A method of communicating via a network
KR101225082B1 (en) 2006-01-17 2013-01-22 삼성전자주식회사 Apparatus and method for transmitting/receiving uncompressed AV data
US8020047B2 (en) * 2006-01-17 2011-09-13 Xyratex Technology Limited Method and apparatus for managing storage of data
US7813823B2 (en) * 2006-01-17 2010-10-12 Sigmatel, Inc. Computer audio system and method
US20070192819A1 (en) * 2006-02-10 2007-08-16 Lewis Scott W System for distribution of media utilized with a receiver/set top box
US9740552B2 (en) * 2006-02-10 2017-08-22 Percept Technologies Inc. Method and system for error correction utilized with a system for distribution of media
US8451850B2 (en) * 2006-02-10 2013-05-28 Scott W. Lewis Method and system for distribution of media including a gigablock
US8566894B2 (en) * 2006-02-10 2013-10-22 Scott W. Lewis Method and system for distribution of media
JP4193865B2 (en) * 2006-04-27 2008-12-10 ソニー株式会社 Digital signal switching device and switching method thereof
US20070263584A1 (en) * 2006-05-09 2007-11-15 Samsung Electronics Co., Ltd. Method and apparatus for transmitting/receiving uncompressed audio/video data
US20070270103A1 (en) * 2006-05-16 2007-11-22 Samsung Electronics Co., Ltd. Method and apparatus for transmitting/receiving uncompressed audio/video data
US20090228763A1 (en) * 2006-06-29 2009-09-10 Koninklijke Philips Electronics N.V. Method and apparatus for encoding and decoding data with error correction
US20080049707A1 (en) * 2006-07-12 2008-02-28 Samsung Electronics Co., Ltd. Transmission packet for wireless transmission in a high frequency band, and method and apparatus for transmission/receiving using the same
KR101225081B1 (en) * 2006-07-14 2013-01-22 삼성전자주식회사 Transmission packet structure for transmitting uncompressed audio/video data and transceiving apparatus using it
US8126983B2 (en) * 2006-09-28 2012-02-28 Broadcom Corporation Method and system for distributed infrastructure for streaming data via multiple access points
US8102853B2 (en) * 2006-08-09 2012-01-24 Samsung Electronics Co., Ltd. System and method for wireless communication of uncompressed video having fixed size MAC header with an extension
KR101298641B1 (en) * 2006-11-10 2013-08-21 삼성전자주식회사 Method and apparatus for orthogonal frequency division muliplexing communication
US20080117933A1 (en) * 2006-11-10 2008-05-22 Ubroadcast, Inc. Internet broadcasting
US9386056B1 (en) * 2006-11-14 2016-07-05 Arris Enterprises, Inc. System, method and computer readable medium for providing media stream fragments
US20080130561A1 (en) * 2006-12-04 2008-06-05 Samsung Electronics Co., Ltd. System and method for wireless communication
KR101116617B1 (en) * 2007-07-20 2012-03-07 삼성전자주식회사 Method and apparatus for transmitting and processing audio with I2S format
DE102007038338A1 (en) * 2007-08-14 2009-02-19 Rohde & Schwarz Gmbh & Co. Kg Method and device for logging communication links at very high data rates
US8386630B1 (en) * 2007-09-09 2013-02-26 Arris Solutions, Inc. Video-aware P2P streaming and download with support for real-time content alteration
US8418032B2 (en) * 2007-12-10 2013-04-09 France Telecom Processing of bit errors in a digital audio bit frame
US20090220104A1 (en) * 2008-03-03 2009-09-03 Ultimate Ears, Llc Venue private network
FI20085676A0 (en) * 2008-06-30 2008-06-30 Nokia Corp Transmission of delay tolerant data
US8689343B2 (en) 2008-10-24 2014-04-01 Manufacturing Resources International, Inc. System and method for securely transmitting video data
US9542341B2 (en) 2008-12-19 2017-01-10 St-Ericsson Sa Resolving contention between data bursts
US8441574B2 (en) * 2009-02-16 2013-05-14 Manufacturing Resources International, Inc. Visual identifier for images on an electronic display
KR20110120327A (en) * 2009-02-16 2011-11-03 매뉴팩처링 리소시스 인터내셔널 인코포레이티드 Display characteristic feedback loop
US9812047B2 (en) 2010-02-25 2017-11-07 Manufacturing Resources International, Inc. System and method for remotely monitoring the operating life of electronic displays
AU2010218090A1 (en) * 2009-02-24 2011-09-22 Manufacturing Resources International, Inc. System for distributing a plurality of unique video/audio streams
US8948286B2 (en) * 2009-10-20 2015-02-03 Wisconsin Alumni Research Foundation Wireless communication system mapping data bits to symbol bit positions according to error rates of those bit positions and data content
DE102010040534A1 (en) * 2010-09-10 2012-03-15 Robert Bosch Gmbh Light pipe system for a display device and display device
JP2012205050A (en) 2011-03-25 2012-10-22 Roland Corp Multimedia data recording/reproduction device
US9021313B2 (en) * 2012-11-21 2015-04-28 Microsoft Technology Licensing, Llc Priority-assignment interface to enhance approximate computing
US11181740B1 (en) 2013-03-15 2021-11-23 Percept Technologies Inc Digital eyewear procedures related to dry eyes
US10372527B2 (en) * 2013-07-15 2019-08-06 Intel Corporation Method of encoding data
US10319408B2 (en) 2015-03-30 2019-06-11 Manufacturing Resources International, Inc. Monolithic display with separately controllable sections
US10922736B2 (en) 2015-05-15 2021-02-16 Manufacturing Resources International, Inc. Smart electronic display for restaurants
US10269156B2 (en) 2015-06-05 2019-04-23 Manufacturing Resources International, Inc. System and method for blending order confirmation over menu board background
KR102056069B1 (en) 2015-09-10 2020-01-22 매뉴팩처링 리소시스 인터내셔널 인코포레이티드 System and method for systematic detection of display error
US10319271B2 (en) 2016-03-22 2019-06-11 Manufacturing Resources International, Inc. Cyclic redundancy check for electronic displays
JP6786871B2 (en) 2016-05-18 2020-11-18 ソニー株式会社 Communication devices, communication methods, programs, and communication systems
CA3024512C (en) 2016-05-31 2020-12-29 Manufacturing Resources International, Inc. Electronic display remote image verification system and method
WO2018031717A2 (en) 2016-08-10 2018-02-15 Manufacturing Resources International, Inc. Dynamic dimming led backlight for lcd array
US10075671B2 (en) 2016-09-26 2018-09-11 Samsung Display Co., Ltd. System and method for electronic data communication
US10616383B2 (en) * 2016-09-26 2020-04-07 Samsung Display Co., Ltd. System and method for electronic data communication
US10523895B2 (en) 2016-09-26 2019-12-31 Samsung Display Co., Ltd. System and method for electronic data communication
US10469857B2 (en) 2016-09-26 2019-11-05 Samsung Display Co., Ltd. System and method for electronic data communication
US10908863B2 (en) 2018-07-12 2021-02-02 Manufacturing Resources International, Inc. System and method for providing access to co-located operations data for an electronic display
CN110782906B (en) * 2018-07-30 2022-08-05 南京中感微电子有限公司 Audio data recovery method and device and Bluetooth equipment
US10887467B2 (en) * 2018-11-20 2021-01-05 Shure Acquisition Holdings, Inc. System and method for distributed call processing and audio reinforcement in conferencing environments
US11402940B2 (en) 2019-02-25 2022-08-02 Manufacturing Resources International, Inc. Monitoring the status of a touchscreen
US11137847B2 (en) 2019-02-25 2021-10-05 Manufacturing Resources International, Inc. Monitoring the status of a touchscreen
US11921010B2 (en) 2021-07-28 2024-03-05 Manufacturing Resources International, Inc. Display assemblies with differential pressure sensors
US11895362B2 (en) 2021-10-29 2024-02-06 Manufacturing Resources International, Inc. Proof of play for images displayed at electronic displays

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4864562A (en) * 1986-12-18 1989-09-05 Mitsubishi Denki Kabushiki Kaisha Sub-rate multi-media data transmission control system
US5130985A (en) * 1988-11-25 1992-07-14 Hitachi, Ltd. Speech packet communication system and method
US5414566A (en) * 1991-08-28 1995-05-09 Nippon Hoso Kyokai Apparatus and method for generating high speed dubbing signal
US6014694A (en) * 1997-06-26 2000-01-11 Citrix Systems, Inc. System for adaptive video/audio transport over a network
US6134243A (en) * 1998-01-15 2000-10-17 Apple Computer, Inc. Method and apparatus for media data transmission
US6502135B1 (en) * 1998-10-30 2002-12-31 Science Applications International Corporation Agile network protocol for secure communications with assured system availability
US6532250B1 (en) * 1999-12-21 2003-03-11 Telefonaktiebolaget Lm Ericsson (Publ) Methods and apparatus for spreading and despreading information signals in code division multiple access communications systems
US6771674B1 (en) * 1998-12-28 2004-08-03 3Com Corporation Method and system for forward error correction based on parallel streams
US6944160B1 (en) * 2000-09-15 2005-09-13 Lucent Technologies Inc. Method and apparatus for multiplexing voice over ATM or IP data communication channels

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5349A (en) * 1847-10-30 Washing-machine
CA1230949A (en) 1984-06-29 1987-12-29 Nicholas Tsiakas Signal multiplexing circuit
JPS6155455A (en) * 1984-08-24 1986-03-19 Toyota Motor Corp Control method at idle operation time of automatic speed changer for vehicle
US4686614A (en) * 1986-04-15 1987-08-11 Zenith Electronics Corporation Reduced EMI noise in switched-mode power supply
US5425051A (en) * 1992-11-09 1995-06-13 Norand Corporation Radio frequency communication network having adaptive parameters
US5148272A (en) * 1991-02-27 1992-09-15 Rca Thomson Licensing Corporation Apparatus for recombining prioritized video data
US5404362A (en) * 1991-12-04 1995-04-04 Meitner; Edmund Very low jitter clock recovery from serial audio data
US5392299A (en) * 1992-01-15 1995-02-21 E-Systems, Inc. Triple orthogonally interleaed error correction system
US5376969A (en) * 1993-11-15 1994-12-27 Rca Thomson Licensing Corporation Method and apparatus for conveying compressed video data over a noisy communication channel
KR0164827B1 (en) * 1995-03-31 1999-03-20 김광호 The program guide signal receiver
US6700958B2 (en) * 1995-04-10 2004-03-02 Starguide Digital Networks, Inc. Method and apparatus for transmitting coded audio signals through a transmission channel with limited bandwidth
JP3394119B2 (en) * 1995-10-17 2003-04-07 沖電気工業株式会社 Error correction encoding device, error correction decoding device, and communication system
US7003796B1 (en) * 1995-11-22 2006-02-21 Samsung Information Systems America Method and apparatus for recovering data stream clock
US5848146A (en) * 1996-05-10 1998-12-08 Rane Corporation Audio system for conferencing/presentation room
US5978379A (en) * 1997-01-23 1999-11-02 Gadzoox Networks, Inc. Fiber channel learning bridge, learning half bridge, and protocol
US5844948A (en) * 1997-02-10 1998-12-01 Lsi Logic Corporation System and method for digital tracking and compensation of frequency offset error in a satellite receiver
US6275507B1 (en) 1997-09-26 2001-08-14 International Business Machines Corporation Transport demultiplexor for an MPEG-2 compliant data stream
US6356567B2 (en) * 1997-09-26 2002-03-12 International Business Machines Corporation Embedded clock recovery and difference filtering for an MPEG-2 compliant transport stream
US6373954B1 (en) * 1997-10-14 2002-04-16 Cirrus Logic, Inc. Single-chip audio circuitry, method, and systems using the same
JPH11127138A (en) * 1997-10-24 1999-05-11 Sony Corp Error correction coding method, device therefor, and data transmission method
JPH11196072A (en) * 1997-12-30 1999-07-21 Sony Corp Error correction encoding method and device and data transmission method
US6345126B1 (en) * 1998-01-29 2002-02-05 Xerox Corporation Method for transmitting data using an embedded bit stream produced in a hierarchical table-lookup vector quantizer
US6405338B1 (en) * 1998-02-11 2002-06-11 Lucent Technologies Inc. Unequal error protection for perceptual audio coders
US6154206A (en) * 1998-05-06 2000-11-28 Sony Corporation Of Japan Method and apparatus for distributed conditional access control on a serial communication network
US6317462B1 (en) * 1998-10-22 2001-11-13 Lucent Technologies Inc. Method and apparatus for transmitting MPEG video over the internet
US6490705B1 (en) * 1998-10-22 2002-12-03 Lucent Technologies Inc. Method and apparatus for receiving MPEG video over the internet
US6223324B1 (en) * 1999-01-05 2001-04-24 Agere Systems Guardian Corp. Multiple program unequal error protection for digital audio broadcasting and other applications
US7006642B1 (en) * 1999-06-04 2006-02-28 Roland Corporation Audio control apparatus and audio processing apparatus in a mixing system
US7200683B1 (en) * 1999-08-17 2007-04-03 Samsung Electronics, Co., Ltd. Device communication and control in a home network connected to an external network
JP2001136185A (en) * 1999-11-09 2001-05-18 Sony Corp Transmission method, transmission system and transmission controller
JP2001268700A (en) * 2000-03-17 2001-09-28 Fujitsu Ten Ltd Sound device
DE20005957U1 (en) * 2000-03-31 2000-08-31 Niehoff Kg Maschf Electrode device, especially for a tinning bath and the like.
US20020038461A1 (en) * 2000-04-19 2002-03-28 Gerard White Radio-frequency communications redundancy
US6658231B2 (en) * 2000-05-09 2003-12-02 Sony Corporation Receiver for user-demand information and entertainment system using wide area digital broadcast
US6778869B2 (en) * 2000-12-11 2004-08-17 Sony Corporation System and method for request, delivery and use of multimedia files for audiovisual entertainment in the home environment
US6630963B1 (en) * 2001-01-23 2003-10-07 Digeo, Inc. Synchronizing a video program from a television broadcast with a secondary audio program
US6920185B2 (en) * 2001-07-23 2005-07-19 Advent Networks, Inc Distributed block frequency converter
US7020210B2 (en) * 2001-10-23 2006-03-28 Broadcom Corporation Inter-device adaptable interfacing clock skewing
US7043671B2 (en) * 2002-01-16 2006-05-09 Aviom, Inc. System and method for transmitting audio or video data using multiple levels of protection
JP4240100B2 (en) * 2006-09-29 2009-03-18 ヤマハ株式会社 Mixing system and format conversion device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4864562A (en) * 1986-12-18 1989-09-05 Mitsubishi Denki Kabushiki Kaisha Sub-rate multi-media data transmission control system
US5130985A (en) * 1988-11-25 1992-07-14 Hitachi, Ltd. Speech packet communication system and method
US5414566A (en) * 1991-08-28 1995-05-09 Nippon Hoso Kyokai Apparatus and method for generating high speed dubbing signal
US6014694A (en) * 1997-06-26 2000-01-11 Citrix Systems, Inc. System for adaptive video/audio transport over a network
US6134243A (en) * 1998-01-15 2000-10-17 Apple Computer, Inc. Method and apparatus for media data transmission
US6502135B1 (en) * 1998-10-30 2002-12-31 Science Applications International Corporation Agile network protocol for secure communications with assured system availability
US6771674B1 (en) * 1998-12-28 2004-08-03 3Com Corporation Method and system for forward error correction based on parallel streams
US6532250B1 (en) * 1999-12-21 2003-03-11 Telefonaktiebolaget Lm Ericsson (Publ) Methods and apparatus for spreading and despreading information signals in code division multiple access communications systems
US6944160B1 (en) * 2000-09-15 2005-09-13 Lucent Technologies Inc. Method and apparatus for multiplexing voice over ATM or IP data communication channels

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7301966B2 (en) * 2002-01-16 2007-11-27 Avion, Inc. System and method for transmitting audio and video data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver
US20030161347A1 (en) * 2002-01-16 2003-08-28 Aviom, Inc. System and method for transmitting audio and video data over an asynchronous link that provides a synchronous recreation of the transmitter's data clock at a receiver
US8150918B1 (en) 2003-01-29 2012-04-03 Adobe Systems Incorporated Client controllable server-side playlists
US20050122958A1 (en) * 2003-12-05 2005-06-09 Shim Choon B. System and method for managing a VoIP network
US7450568B2 (en) * 2003-12-05 2008-11-11 Cisco Technology, Inc. System and method for managing a VolP network
US9071667B2 (en) 2009-08-17 2015-06-30 Adobe Systems Incorporated Media content streaming using stream message fragments
US9667682B2 (en) 2009-08-17 2017-05-30 Adobe Systems Incorporated Media content streaming using stream message fragments
US8166191B1 (en) * 2009-08-17 2012-04-24 Adobe Systems Incorporated Hint based media content streaming
US8412841B1 (en) 2009-08-17 2013-04-02 Adobe Systems Incorporated Media content streaming using stream message fragments
US9282382B2 (en) 2009-08-17 2016-03-08 Adobe Systems Incorporated Hint based media content streaming
US8837529B2 (en) * 2010-09-22 2014-09-16 Crestron Electronics Inc. Digital audio distribution
US20140334625A1 (en) * 2010-09-22 2014-11-13 Crestron Electronics, Inc. Digital Audio Distribution
US9301051B2 (en) * 2010-09-22 2016-03-29 Crestron Electronics Inc. Digital audio distribution
US20120070004A1 (en) * 2010-09-22 2012-03-22 Crestron Electronics, Inc. Digital Audio Distribution
US10972520B1 (en) * 2016-03-18 2021-04-06 Audio Fusion Systems, Inc. Monitor mixing system that distributes real-time multichannel audio over a wireless digital network
CN106788844A (en) * 2016-12-16 2017-05-31 深圳市声菲特科技技术有限公司 A kind of MCVF multichannel voice frequency synchronous transfer circuit
US10937434B2 (en) * 2018-05-17 2021-03-02 Mediatek Inc. Audio output monitoring for failure detection of warning sound playback

Also Published As

Publication number Publication date
US20060282748A1 (en) 2006-12-14
US20030167425A1 (en) 2003-09-04
US7523362B2 (en) 2009-04-21
US20030161354A1 (en) 2003-08-28
AU2003210505A1 (en) 2003-09-02
US20030165163A1 (en) 2003-09-04
US20030161347A1 (en) 2003-08-28
US7403828B2 (en) 2008-07-22
EP1953919A2 (en) 2008-08-06
EP1953919A3 (en) 2009-09-23
WO2003063465A2 (en) 2003-07-31
WO2003063465A3 (en) 2004-07-08
EP1476947A4 (en) 2006-04-12
JP2005516485A (en) 2005-06-02
EP1476947A2 (en) 2004-11-17
US7301966B2 (en) 2007-11-27
US20080310461A1 (en) 2008-12-18
US7043671B2 (en) 2006-05-09

Similar Documents

Publication Publication Date Title
US7043671B2 (en) System and method for transmitting audio or video data using multiple levels of protection
EP1502399B1 (en) Packet transmission system for streamed data with paralell clock transmission line
EP1523132B1 (en) Digital transmission of audio signals
US9237407B2 (en) High quality, controlled latency multi-channel wireless digital audio distribution system and methods
US5596647A (en) Integrated video and audio signal distribution system and method for use on commercial aircraft and other vehicles
EP1460794A2 (en) Synchronisation of data communication
JP4829569B2 (en) Data transmission
AU760909B2 (en) Method and apparatus of supporting an audio protocol in a network
JP2003516678A (en) System and method for transmitting data on a return path of a cable television system
JP2009512021A (en) System and method for transferring data
JP2010532606A (en) System and method for transmitting audio data
JP2006227594A (en) Passenger entertainment system for commercial aircraft and other vehicles
JP2006120122A (en) Data transmission
US7370263B1 (en) Hardware efficient CRC generator for high speed communication networks
JP3365909B2 (en) Digital signal multiplexer
CN117413465A (en) Wireless transmission and reception of packetized audio data incorporating forward error correction

Legal Events

Date Code Title Description
AS Assignment

Owner name: AVIOM, INC., PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CLEMENS, ROBERT P.;METCALF, THOMAS D.;REEL/FRAME:013664/0280

Effective date: 20021224

AS Assignment

Owner name: SQUARE 1 BANK, NORTH CAROLINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVIOM, INC.;REEL/FRAME:018002/0088

Effective date: 20050106

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION