WO1988002958A1

WO1988002958A1 - Control system

Info

Publication number: WO1988002958A1
Application number: PCT/AU1987/000349
Authority: WO
Inventors: David Burton
Original assignee: David Burton
Priority date: 1986-10-16
Filing date: 1987-10-16
Publication date: 1988-04-21
Also published as: AU604783B2; AU8109487A; JPH01501663A; EP0287619A1; KR880702018A

Abstract

A control system for the manipulation of sounds, when playing or recording said sounds, said system monitoring one or more inputs representative of the status of hardware transducers, and converting one or more of said inputs into digital input form, and storing said digital input in storage means (2, 3) associated with a time reference generated by a time reference means, (1) said system being adapted to recall and display said digital input on visual display means, (4) and allow manipulation of said digital input by direct interaction with said visual display or by remote interaction means, said manipulation optionally being a further input and/or an output to said hardware transducers.

Description

i .. 1 . ^{' '}

CONTROL SYSTEM The present invention relates to a control system and particularly an automated system for the sound engineer mixing sounds recorded on separate tracks or channels of a multi-track tape or other recording medium.

The combining or mixing of sound components in an ^; aurally balanced way can be achieved by manipulations such as switching each track (channel) on or off as required arid;

10 thereby minimizing noise from that channel, altering the ! volume of each track to achieve the desired balance, and optionally manipulating the sound through synthesizers, such as, for example mutes.

The most common apparatus used for this process is •_jc a console containing an array of potentiometers, known as faders, that alter the voltage applied to a voltage controlled amplifier and thus the sound volume from that amplifier, and also the voltage applied to synthesizers to alter the nature of the sound. 0 There is one main fader for each track of sound, and by switching the main fader into or out of the circuit one also has control of the presence of any track in the final mix. i

According to early forms of the¹ prior art, a 5 multi-track tape is replayed and re-recorded on a second tape, the presence, nature, and volume of any one or more individual tracks being altered during the replaying so that the changes form part of the second tape recording.

Disadvantages with this method of operation were 0 that it requires and uses a second or more tapes, and because change is made as at the same time as re-recording, there was a need to do the change correctly the first time. As it was difficult, if not impossible, to alter all the tracks requiring change in any single taping, it was ₅ necessary to continue with further re-recordings. It was a further disadvantage with this procedure that it was not easy to tell if the maximum amplification and/or maximum synthesized manipulation of any track had been reached or was near. Further, physical movement acro.ss the console to alter the faderscauses the engineer to move away from the central position required for best perception of stereo sound effect.

To try and overcome some of these disadvantages, further developments in the prior art have included the addition of motors to each fader so that the manipulation of any particular track could be seen and compared to the

10 maximum available gain for any fader.

This, however, has still had the disadvantage of requiring an engineer .to be responsible for overseeing the whole console and having to move away from central position. This system has also involved numerous tape ra-recordings. -,. Most recent developments in the prior art have utilised a hardware key pad (micro-processor■board) that allows an engineer to operate the console from a central position, the introduction of a memory noting the changes made in any track with respect to a clock reference (time

20 code) and recalling the changes made as required.

Disadvantages with this system still exist, however, in that the operator is restricted to the logic of the pre-programmed hardware key pad and is still not readily able to determine whether the maximum gain of a particular

25 fader has been reached or likely to be exceeded.

There is need for an operator to physically interact with the recording console. Further, the operator must still have high mixing skill levels even with these recent developments.

30 Towards overcoming the above disadvantages, there is provided according to the present invention, a control system for the manipulation of sounds, when playing or recording said sounds, said system monitoring one or more inputs representative of the status of hardware transducers, -,-. and converting one or more of said inputs into digital input form, and storing said digital input in storage means associated with a time- reference generated by time reference means, said system being adapted to recall and display said digital input on a visual display means, and allow manipulation of said digital input by direct interaction with said visual display means or by remote interaction means, said manipulation optionally being a further input and/or an output to said hardware transducers.

In a preferred embodiment of the invention there is provided in association with said digital input, input identifying means, said input indentifying means being

10 optionally recalled and displayed with the recall and display of the associated digital input.

The control system connects hardware transducers such as amplifiers, synthesizers and multitrack recorders to a programmable computer. The connection as such to a fader ₁₅ console is optional and not strictly necessary.

Inputs from the hardware transducers are representative of their working status, for example, the voltage levels of voltage controlled amplifiers as stated above. The inputs are monitored, by the computer of the _γ . control system scanning the inputs at a rate substantially faster than any change in hardware status whilst allowing for the storage of the hardware statuses. i i Conversion of the inputs into digital form is preferably via a bus structure. _?1- Storage of the input information is preferably in the memory of the computer on conventional floppy disc. The time reference means is preferably a clock oscillation generated and controlled by the computer, synchronizing the position of a manipulation of sound within ,₀ the overall musical piece.

The input identifying means comprises information preferably associated with a sequence of inputs, to identify those inputs as forming a particular passage or mix within a musical piece. Identification can preferably also include .,,. information on the musician or vocalist, the instrument( s) and any other indicia that assist in identifying the particular passage or track over earlier mix attempts. The visual display _;means is preferably a screen, said screen displaying input information preferably by graphical and/or colour means such that, when applicable, the maximum possible manipulation is also indicated. - The screen display is preferably designed to display the input information in conjunction with input identifying means, as described above, so that the user of the system has visually before him all the information required to adequately

10 control the mixing process.

Preferably in association with said display is an indication of time from the time reference means.

The direct interaction with said visual display means is preferably by the user touching the screen. The' _ις remote interaction means preferably includes a mouse, light pen or other key pad device to alter the visual display.

It can be seen from all of the above, that the invention has the advantages of providing a system which combines mass storage techniques and analog digital, digital ~₀ analog conversions, extensive processing power and screen graphics to emulate the complete recording process.

The use of computer processing gives the. further '. advantage of use of software menu type displays to assist in the use of the system through all the necessary stages in _₍. the sound mixing process or operation. A preferred embodiment of the invention will be described with reference to the accompanying figures:

Figure 1 is a physical layout of control system;

Figures 2a, 2b and 2c show alternative block » ₃₀ circuit diagrams describing more fully the inputs and electronic connections between main parts of the control system;

Figures 3 is a screen display interface with studio tape transport hardware. _3ς Figure 4 is a tabulation of standard steps in the production of a final mix. Referring to Figure 1, there is shown a processor 1 with storage facilities ^".2 and 3 for long term (archive) and fast access mass storage respectively, connected to the control system console 4.

Hardware transducer inputs, conversion into digital input and outputs of whatever nature are controlled by the processor 1 via the control system console which preferably is in the form of a flat T.V. type screen or screens displaying information in a manner shown by way of example in Figure 3. The screens are preferably of the touch control type and may contain a window function enabling different types of displays to be simultaneously shown on the console on any one screen.

Referring next to Figures 2(a), (b) and (c), the block diagrams depicted outline the connections between the main parts of the control system. It can be seen that the system operates through an external bus structure with, referring to Figure 2(a), studio inputs entering from a switch interface board and analog digital_analog board to the main central processing unit. The time code generator is also connected to the production studio and the external bus structure via an input/output port board. Following manipulations, outputs pass through an iriput/output port board and a lead interface board.

The use of the control system is preferably by way of command functions set up within a number of standard format type screen displays not shown.

The various operations associated with the sound mixing process include recording, playback, alteration, muting and focusing pn specific passages of music for appropriate manipulation. These operations have been given command function names in the control system such as write, read, update, solo write, mute, with enter and leave commands for moving through each function together with a execute and clear command function. i - 6 - ^{' '} ^• These command functions enable easy operation of the control system assisted by a help function and menu displays which direct the user,when the need arises.

The use of the command functions is further described with reference to Figure 4 which shows a typical sequence of functions for operating the system in creating a: mix.

In operation, a sequence of sounds, such as music, j is recorded with respect to a time code. Any changes to the sound made by the sound engineer is inputted into the control system against a time code reference being either real time or time with respect to the musical piece as a whole by storing the degree of change as a digital quantity against the time reference. This can be referred to as a first mix.

In the case of a fader adjustment, the change in voltage is stored and not the change in the sound of the music as has been the case in the prior art.

Playback of the sound will include the changes made *by the sound engineer as the processor monitors the information in its storage and repeats the changes occurring at each time point. j •

Accordingly, the- system provides 'the advantage of playback of the new mix without the need for any further recording of the sound on tape until the mix has been finished to the satisfaction of the sound e^'ngineer.

This first mix can be referred to as a mix file and subsequent manipulators will generate a new mix file as changes made by the sound engineer are stored. Old mix files are not discarded unless specifically ,deleted and pecific sounds such as solo pieces or specific time intervals of music can be manipulated and entered into the mix (ie. a master mix file) as required.

Each mix file can be given a title and the title stored on a menu for recall purposes. Updating the mix can be effected by executing commands such as (PLAY) (JOIN) (MIX) A (FROM) (time) (EXECUTE), or for example, (GO TO) (JOIN) (MIX) (AT) (CUE) (titTe such as solo) (EXECUTE). Refer again to Figure 5.

The cue function enables a specific point in a musical score to be reached by identifying that point as a cue or by a title rather than by a specific point in time. Referring to Figure 4, one of the screen displays

10 shows bar graphs, preferably in colour, representing • amplifier level information. Fader adjustments, grouping of various tracks and muting can all be executed by direct screen control of the bar graphs. Preferably the bar graphs will change colour as they each approach the maximum voltage

15 of the respective amplifiers so that a further visual cue is ■ provided to the sound engineer, monitoring the mix.

By using any form of cursor pointer device such as a mouse or by directly touching the screen any channel levels of the console may be adjusted. In the same manner .

20 channels may be grouped together to allow one or more channels to be adjusted for level with the one movement from the system operator.

This form oif interaction between the iscreen and the hardware may also be used to allow any channel to' be soloed, _2c muted, dynamics adjusted, equalisation of any channel to be adjusted and any adjustment effecting the processing of^' signals through the recording console.

With specific reference to the screen display of Figure 3, this display is typical of many of the screens and -.« represents "graphic" buttons which interface with hardware and directly control equipment positioned around the recording facility. With this screen the computer can control all the necessary functions on studio tape transports, while the other screens cover control of other c studio equipment.

By either directly touching the screen, or using the mouse to to point to the required control function, the operator of the system can directly access these functions. By inserting the computer into this control path the advantages of automating control are realised along with storing and recalling of complex control sequences and all with one action selection.

The modular nature of the control system provides the advantages of utilizing all hardware transducers in a studio environment and possibly upgrading their functioning by means of the programmable processor.

A further advantage of the system is the ability to effect maintenance by on-line modem interconnection to a remote maintenance team able to investigate and correct problems.

^*

Claims

THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS:

1. A control system f.or the manipulation of sounds, when pl^'aying or recording said sounds, said syste monitoring one or more inputs representative of the 'Status of hardware transducers, and converting one or 'more of said inputs into digital input form, and storing said digital input in storage means associated with a time reference generated by time reference means, said system being adapted to recall and display said digital input on a visual display means, and allow manipulation of said digital input by direct interation with said visual display means or by remote interaction means, said manipulation optionally being a further input, and/or an output to said hardware transducers.

2. A control system as claimed in claim 1 wherein input identifying means are provided in association with said digital input, said input identifying means being adapted to be recalled and displayed with the recall and display of the associated digital input.

3. A control system as claimed in claim 1 or claim 2 wherein said hardware transducers namely amplifiers, synthesizers and multitrack recorders are connected to^ a progra able computer.

4. A control system as claimed in any preceding claim wherein the connection is also made to a fader console.

5. A control system as claimed in any preceding claim wherein the inputs from the hardware transducers are representative of their working status, for example the voltage levels of voltage controlled amplifiers.

6. A control system as claimed in any preceding claim wherein the computer monitors the inputs at a rate substantially faster than any change in hardware status whilst allowing for storage of said hardware status.

7. A control system as claimed in any preceding claim wherein the time reference means is a clock oscillator generated and controlled by said computer synchronising the position of a manipulation of sound within the overall musical piece.

8. A control system as claimed in any preceding claim wherein the input identifying means includes information associated with a sequence of inputs to identify those inputs as forming a particular passage or mix within a musical piece.

9. A control system as claimed in any preceding claim wherein the visual display means is a screen, said screen displaying input information by graphical or colour means such that the maximum possible manipulation is indicated.