CA2250859A1 - Media editing system with improved effect management - Google Patents
Media editing system with improved effect management Download PDFInfo
- Publication number
- CA2250859A1 CA2250859A1 CA002250859A CA2250859A CA2250859A1 CA 2250859 A1 CA2250859 A1 CA 2250859A1 CA 002250859 A CA002250859 A CA 002250859A CA 2250859 A CA2250859 A CA 2250859A CA 2250859 A1 CA2250859 A1 CA 2250859A1
- Authority
- CA
- Canada
- Prior art keywords
- media
- composition
- media object
- user
- editing system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000001976 improved effect Effects 0.000 title description 2
- 239000000203 mixture Substances 0.000 claims abstract description 80
- 230000000694 effects Effects 0.000 claims abstract description 67
- 230000007704 transition Effects 0.000 claims abstract description 12
- 230000004044 response Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 22
- 230000003213 activating effect Effects 0.000 claims 2
- 241001416092 Buteo buteo Species 0.000 description 6
- 238000007726 management method Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 210000003254 palate Anatomy 0.000 description 4
- 238000013499 data model Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000011282 treatment Methods 0.000 description 2
- 235000000177 Indigofera tinctoria Nutrition 0.000 description 1
- AZFKQCNGMSSWDS-UHFFFAOYSA-N MCPA-thioethyl Chemical compound CCSC(=O)COC1=CC=C(Cl)C=C1C AZFKQCNGMSSWDS-UHFFFAOYSA-N 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 229940097275 indigo Drugs 0.000 description 1
- COHYTHOBJLSHDF-UHFFFAOYSA-N indigo powder Natural products N1C2=CC=CC=C2C(=O)C1=C1C(=O)C2=CC=CC=C2N1 COHYTHOBJLSHDF-UHFFFAOYSA-N 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/036—Insert-editing
Abstract
A media editing system that includes storage for a machine-readable composition made up of scenes separated by transitions. The system can identify to an effect generator a scene in the composition and receive a modified version back from the effect generator. It can read machine-readable information associated with the modified version, and automatically reinsert the modified version into the machine-readable composition in synchronism with the position in the composition that the scene occupied, based on the machinereadable information. The system can also associate versions of the scene with the scene and display to a user a list of identifiers of the versions in response to user command that references a portion of a timeline, and respond to a selection command from the user to select one of the versions to be a default version for the composition.
Description
CA 022~08~9 1998-10-01 2 PCT/US97/060~;2 MEDIA EDITING SYSTEM WIT~I IMPROVED EFFECT MANAGEMENT
FIELD OF THE INVENTION
This invention relates to media editing systems, and more particularly to non-linear, 5 computer-based motion picture editing systems.
BACKGROUND OF THE INVENTION
It is known to use non-linear, computer-based editing systems to edit motion picture media such as digitized video or film. Generally, motion picture media is first ~ligiti7.ed and 0 stored on the system as source media. The editor then uses the editing system, which can employ a timeline metaphor, to develop a composition made up of clips from the source media. These types of editing systems have greatly increased the efficiency of the editing process, and have allowed editors to concentrate on the creative rather than mechanical aspects of editing.
I s SUMMARY OF THE INVENTION
In one general aspect, the invention features a media editing system that includes storage for a machine-readable composition made up of scenes separated by transitions. The system can identify to an effect generator a scene in the composition and receive a modified version back from the effect generator. It can also read machine-readable information associated with the 20 modified version, and automatically reinsert the modified version into the machine-readable composition in synchronism with the position in the composition that the scene occupied, based on the machine-readable information.
In preferred embodiments, the system can find a match between the modified version and the scene in the machine-readable composition, and it can receive the modified version from a 25 network, such as a digital, packet-based, inter-city network. The system can also visually prompt the user before enabling automatic reinsertion, and the user can activate and deactivate this prompting. The system can receive, read, and reinsert a modified version into the machine-readable composition independent of user input, even while other portions of the editing system are responsive to user input. They system can also automatically pad the modified version if it 30 does not fully overlap the scene in the machine-readable composition. The system further includes v ersion management for associating the modified version with other alternate versions.
CA 022~08~9 1998-10-01 WO 97139452 rCT/US97/06052 According to another general aspect, the invention features a media editing system that includes storage for storing versions of a motion picture scene in a machine-readable composition. It can associate the versions of the scene with the scene and display to a user a list of identifiers of the versions in response to user comrnand that references a portion of a timeline.
The position of this portion of the timeline corresponds to the position of the scene in the composition. The system can also respond to a selection command from the user to select one of the versions to be a default version for the composition.
In preferred embodiments, the system can display the list at a position that is adjacent the portion of the timeline that corresponds to the position of the scene in the timeline. The system o can respond to actuation by the user, such as by a pointing device cursor, of an area whose position is associated with one of the identifiers in the list to select a version to be a default version for the composition.
According to a further general aspect, the invention features a media editing method that includes displaying a timeline for a composition, electronically storing a representation of alternate versions of a motion picture scene for which the composition is displayed, and associating the representation of the versions of the scene with the scene. The method also includes displaying to a user a list of identifiers of the versions of the scene in response to user actuation, such as by a pointing device cursor, of a portion of the timeline corresponding to the scene for which the composition is displayed.
Systems according to the invention can be advantageous in that they assist the user in tracking and organizing alternate versions of a scene. This benefit can be particularly important where multiple people are working on the same material, or where scenes are sent to remote locations for effect generation and rendering. By helping the user to track and manage versions of a scene, the user is freed up to focus more of his or her efforts on creative aspect of the editing 25 task. By providing for reconciliation of modified scenes without any user prompting, the user may also experience fewer interruptions in his or her work. Furthermore, aspects of the invention provide for a meaningful interface, which clearly and conveniently conveys information to the user about the alternate scenes available for a particular scene on a particular track.
CA 022~08~9 1998-10-01 BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram of a media editing system employing effect management according to one aspect of the invention;
s Fig. 2 is a view of the display of the media editing system of Fig. 2 showing its timeline and an alternate modified scene list for a scene presented in that timeline;
Fig. 3 is a data model diagram for use by the system of Fig. 1 to store an illustrative composition presented on the timeline of Fig. 2; and Fig. 4 is a flowchart illustrating operation of the system of Fig. 1.
DETAILI~I) DESCRIPTION
Referring to Fig. l, an illustrative media editing system 10 can include a media editing processing system 12, a display 14, and a user input device or devices 16. The user input devices may include a keyboard 20, a pointing device such as a mouse 22, and/or a special-purpose editing control (not shown). The display can be a cathode ray tube display (CRT) or liquid crystal display (LCD), or any other display device suitable for the media being edited.
The composition editing processing system 12 includes a user interface module 24responsive to the user input devices 16. This user interface communicates with an editing and display interface 26, which can in turn communicate with storage 30 and the display 14. The user interface includes drivers to interpret signals from the user input devices and includes facilities to provide visible controls to the user in the f'orm of menus, icons~ and the like. The editing and display interface responds to user input obtained through the user interface to assemble source media elements stored in source media storage 34 into a composition in composition storage 32. The editing of digitally stored media elements to form compositions which are to be displayed on a display is generally known, and will not be discussed further here.
The media editing processing system 12 further includes an effect reconciliation module - 36, an effect generator interface 38, one or more local effect generators 40, and a network interface 42, which are each also in communication with the user interface. The effect reconciliation module, effect generator interface, and local effect generator can each communicate with the storage 30, and the network interface 42 is operatively connected to a network 46. The network 46 can be a local area network (LAN), a wide area network (WAN), or any other network over which media data can be effectively conveyed. The effect generator CA 022~08~9 1998-10-01 ' WO 97/39452 PCT/US97/06052 interface communicates with the effect reconciliation module, the local effect generator, and the network interface.
Referring to Figs. l and 2, the user interface 24 of the media editing system 10 provides various controls to be displayed on the display 14 by the editing and display interface 26. These controls include an effect palate 52 including effect icons S 1, a title bar 54, and a menu bar 56.
Also included are a media display window 50 and a timeline 58. The timeline 58 can include a plurality of media tracks, such as a video track 62, a left audio track 64, and a right audio track 66. A variety of other types of tracks such as a time code track 68, an edge code track (not shown), or a subtitle track (not shown) can also be provided.
o The timeline represents a composition of a series of scenes 72, 74, 76 separated by transitions 73, 75. Each of the scenes is represented as a rectangular area bearing a title of the scene, and the transitions are represented by the lines or other shapes that lie between the scenes.
Track identifiers 70 are provided to the left of the timeline to identify the different tracks. In one example, the timeline includes a first scene 72 entitled "Man kicks tire," which is separated from a second scene 74 by a first transition 73. The second scene is entitled "Man falls down," and is separated from the third scene 76 by a second transition 75. The third scene is entitled "Buzzard w/cap~1 The user interface 24 is configured to allow the user to expand the timeline entry for each scene in each track, although it is contemplated that systems could be constructed that only allow 20 scenes in some of the tracks (e.g., only the video track) to be expanded. This expanded timeline area 60 is made up of one or more additional alternative scene entry areas 80, 82, 84, 86, and 88.
When the video track of the third illustrative scene 76 is expanded it exhibits the names of five alternate scenes in an alternate scene display area 60. The first alternate scene 80 is entitled "Buzzard w/cap 2:3 pulldown," the second alternate scene 82 is entitled "Buzzard wlcap ME
25 16.00 fps," and the third alternate scene 84 is entitled "Buzzard w/cap roto zero one." The fourth alternate scene 86 is entitled "Buzzard w/cap cc tint blue," and the fifth alternate scene 88 is entitled "Buzzard w/cap cc tint blueO2". As ~,vill be discussed in more detail below, each of these alternate scene designators represents a different version of the video tracl~ of the third scene 76.
The first alternate scene is a 2:3 pulldown version of the third scene, the second alternate scene is 30 a 16 frame per second motion effect version of the third scene, the third alternate scene is a "rotoscoped" version of the third scene (i.e., a version that is combined with another scene)~ the fourth alternate scene 86 is a blue tint version of the third scene, and the fifth alternate scene is a CA 022~08~9 1998-10-01 different blue tint version of the third scene. Preferably, the effects for these modified scenes are rendered, if the system is not capable of rendering them in real time. The displayed track area of the third scene 76, which has alternate scenes associated with it, has an alternate scene indicator 89 to indicate to the user that the alternate scenes exist. This indicator can be a downward-pointing triangle.
Referring to Figs. 1-3, the media editing system 10 can store compositions using an object oriented data model 100. This model includes a sequence object 101 for each track. Each sequence object is made up of an ordered series that can include source clip objects 102, 103, 105, 106, group objects 104, and/or transition objects (not shown). Each source clip object o includes a length parameter 110, a source identifier 112, a source track identifier 114, and a start time 116. A clip object's source identifier and track identifier identify the source in the media storage 34 of the scene corresponding to that object. For example, it can identify a clip from digitized film footage stored in the media storage. The length and start time specify how much of the clip is to be used for the scene, and where the scene is to begin within the source clip.
Where there are no alternate scenes, the first scene 72 can be represented by a first clip object 102, and the second scene 74 can be represented by a second clip object 103. No transition effect need be specified if the user only wants a simple cut between scenes. Where the third scene 76 has several alternatives, it can be represented by a group object 104. This group object has a component identifier which identifies further clip objects 105, 106. One of skill in 20 the art would be able to devise somewhat different data structures for keeping track of alternative versions within a timeline. The widely used Open Media Framework Interchange format (OMFI), which is available from Avid Technology, Inc. of Tewksbury, Massachusetts can be used to store compositions that include alternate scenes. Version 2.0 of this standard is herein incorporated by reference.
The media editing processing system 12 can include dedicated special purpose circuitry, and/or general purpose processing circuitry running special purpose software. It is also noted that the breakdown of elements can be different from that shown in Fig. l without altering the essential overall functioning of the system. In one embodiment, the editing system operates on a high perforrnance, 4-processor work station such as the "Onyx" or "Indigo II Impact"
30 workstations available from Silicon Graphics, Inc. of Mountain View, California. This workstation employs the well-known Unix operating system, which provides networking capabilities to the editing system.
CA 022~08~9 1998-10-01 In operation, referring to Figs. 1-4, once the user has a timeline representing a composition displayed on the display, and he or she is ready to add effects to scenes in the composition (step 200), the user can select an effect (step 202). To select an effect, the user can drag one of the effect icons 51 from the effect palate 52 onto one track of one of the scenes 72, s 74, 76 on the timeline 58. Alternatively, the user can drag the scene for the track to the out box 55, after which he or she will be prompted for an outgoing network address. Note that in one embodiment, the system can distinguish between selecting an effect in a manner that it will result in the creation of an alternative scene or selecting the effect in a manner that will result in replacement of the scene, by responding to different types of effect selection (e.g., shift or shift-lo option clicking).
When the user selects an effect using the effect palate 52, the effect generator interface 38provides identifying information for the selected scene to one of the local effect gener ators 40 (step 204). The user can then use the local effect generator to generate the effect (step 206).
Examples of effects include color corrections, masks, motion effects, frame painting, flips. flops, 5 resizing, among others.
When the user selects an effect via the out box 55, scene identifying information, and optionally the source media for the scene. are provided via the network 46 to a remote effect generation location 44 by the network interface 42. The effect is then generated at the remote location, which can be in the next room or in another city (step 206). The effect may be devised 20 and rendered at the remote location by a skilled editor. When he or she is done generating the effect, he or she returns the resulting modified scene via the network to the network interface 42.
Note that remote effect generation may take time, and that the user may chose to continue to perform other editing tasks in the interim (branch 205).
When the effect generator interface 38 receives the modified scene from either the local 25 effect generator 40 or the network interface 42, it checks for a match between the modified scene and the timeline (step 210). This may be done by comparing the source identifier 112, the source track identifier 114, and the start time 116 of the modified scene with similar identifying information for scenes in the timeline. and determining whether there is a scene in the timeline that matches the modified scene, at least to the extent that there is some overlap. If no match is 30 discovered, the modified scene can remain in a holding bin, or in the in box 53. If the match is only partial, the effect generator interface can automatically create a "padded" modified scene CA 022~08~9 1998-10-01 that fits within the slot for the third scene 76, but includes some blank fill or fill from the unmodified scene.
If the matching modified scene was obtained from a remote effect generator 44, ("no"
branch of step 211) and the media composing system is not in autoload mode ("no" branch of 5 step 212), the media editing system 10 plolllpts the user about whether he or she would like to reconcile the modified scene into the timeline (step 214). If the modified scene is from a local effect generator or autoload mode is on ("yes" branches of steps 211 or 212), reconciliation (step 216) begins without user prompting. If the user declines to reconcile modified scene, it can remain as an icon in the in box 53. Note that both the in box and the out box 55 can be displayed 0 in a list format, similar to the one used for the effects palate, and in this format the boxes can list incoming and outgoing scenes and information about them.
To reconcile a modified scene, the effect reconciliation module 36 automatically adds a new modified source clip object (e.g., 106) to the linked list of source clip components belonging to the media group object 104 in the data structure for the track that includes the unmodified 5 scene. The effect reconciliation module 36 includes version management facilities that update the data structure to include the new modified source clip ob~ect automatically, without user intervention. Note that the auto-relinking performed by the effect reconciliation module can take place while the user is performing other editing tasks. This feature is particularly useful with remotely generated effects, and it can be implemented by running a separate task for the effect 20 reconciliation.
Once the modif1ed scene has been reconciled into the timeline (step 216), the user can look at the alternate scenes (steps 218, 220), or he or she can select another effect or perform other editing functions (branch 217). If the user chooses to browse through the alternative scenes, he or she can click on the desired track of the scene (or double-click, or otherwise actuate 25 the desired track, its alternate indicator triangle, or another area associated with the track for that scene) (step 218). In response, the user interface presents him or her with the alternative scene display area 60 (step 220), which presents the user with a listing of alternate treatments of the scene (a "treatment collection"). This area can remain open only so long as the button of the mouse 22 is held down (a "drag'- operation), or it can stay open until a second click of the mouse 30 (a "toggle" operation), although other behaviors are also possible. With the area open, the user can use the mouse or otherwise select one of the alternative scenes 80, 82, 84, 86, 88 to be used as the default scene in the timeline. The selected default scene is indicated by a default icon 90.
CA 022~08~9 1998-10-01 Once a default scene has been selected, the default scene will be presented when the composition represented by the timeline is played, stepped through, or otherwise viewed, or when an edit decision list (EDL) is generated. Normally, the most recently added version of a scene becomes the default version, but the user can manually select an earlier one.
The automatic management of scene versions and intuitive interface can significantly enhance productivity, particularly in large projects or projects involving significant numbers of effects. An editor can work on a large composition that includes many scenes that will each require different effects, while effects specialists work on the effects themselves. The effects specialists can then add modified versions of the scene to the editor's timeline, without requiring o him or her to track which scenes have been updated, and even without any interruption in the editor' s work. And if the scenes are sent over a network, the editor can chose particularly well-suited effects specialists for the different scenes from a variety of remote locations. If a scene requires a succession of sophisticated effects, the editor can begin working with the base scene (e.g., a stop-frame ~nim~ted model), then work with intermediate versions (e.g., a wire frame outline based on the model), and finish with a final version (e.g., ray-traced computer graphics based on the wire frame outline). In working on the project, the editor has the sense that the project is moving along, but is not caught up in the tedium of manually tracking the various effects.
The present invention has now been described in connection with a number of specific 20 embodiments thereof. However, numerous modifications which are contemplated as falling within the scope of the present invention should now be apparent to those skilled in the art.
Therefore, it is intended that the scope of the present invention be limited only by the scope of the claims appended hereto.
What is claimed is:
FIELD OF THE INVENTION
This invention relates to media editing systems, and more particularly to non-linear, 5 computer-based motion picture editing systems.
BACKGROUND OF THE INVENTION
It is known to use non-linear, computer-based editing systems to edit motion picture media such as digitized video or film. Generally, motion picture media is first ~ligiti7.ed and 0 stored on the system as source media. The editor then uses the editing system, which can employ a timeline metaphor, to develop a composition made up of clips from the source media. These types of editing systems have greatly increased the efficiency of the editing process, and have allowed editors to concentrate on the creative rather than mechanical aspects of editing.
I s SUMMARY OF THE INVENTION
In one general aspect, the invention features a media editing system that includes storage for a machine-readable composition made up of scenes separated by transitions. The system can identify to an effect generator a scene in the composition and receive a modified version back from the effect generator. It can also read machine-readable information associated with the 20 modified version, and automatically reinsert the modified version into the machine-readable composition in synchronism with the position in the composition that the scene occupied, based on the machine-readable information.
In preferred embodiments, the system can find a match between the modified version and the scene in the machine-readable composition, and it can receive the modified version from a 25 network, such as a digital, packet-based, inter-city network. The system can also visually prompt the user before enabling automatic reinsertion, and the user can activate and deactivate this prompting. The system can receive, read, and reinsert a modified version into the machine-readable composition independent of user input, even while other portions of the editing system are responsive to user input. They system can also automatically pad the modified version if it 30 does not fully overlap the scene in the machine-readable composition. The system further includes v ersion management for associating the modified version with other alternate versions.
CA 022~08~9 1998-10-01 WO 97139452 rCT/US97/06052 According to another general aspect, the invention features a media editing system that includes storage for storing versions of a motion picture scene in a machine-readable composition. It can associate the versions of the scene with the scene and display to a user a list of identifiers of the versions in response to user comrnand that references a portion of a timeline.
The position of this portion of the timeline corresponds to the position of the scene in the composition. The system can also respond to a selection command from the user to select one of the versions to be a default version for the composition.
In preferred embodiments, the system can display the list at a position that is adjacent the portion of the timeline that corresponds to the position of the scene in the timeline. The system o can respond to actuation by the user, such as by a pointing device cursor, of an area whose position is associated with one of the identifiers in the list to select a version to be a default version for the composition.
According to a further general aspect, the invention features a media editing method that includes displaying a timeline for a composition, electronically storing a representation of alternate versions of a motion picture scene for which the composition is displayed, and associating the representation of the versions of the scene with the scene. The method also includes displaying to a user a list of identifiers of the versions of the scene in response to user actuation, such as by a pointing device cursor, of a portion of the timeline corresponding to the scene for which the composition is displayed.
Systems according to the invention can be advantageous in that they assist the user in tracking and organizing alternate versions of a scene. This benefit can be particularly important where multiple people are working on the same material, or where scenes are sent to remote locations for effect generation and rendering. By helping the user to track and manage versions of a scene, the user is freed up to focus more of his or her efforts on creative aspect of the editing 25 task. By providing for reconciliation of modified scenes without any user prompting, the user may also experience fewer interruptions in his or her work. Furthermore, aspects of the invention provide for a meaningful interface, which clearly and conveniently conveys information to the user about the alternate scenes available for a particular scene on a particular track.
CA 022~08~9 1998-10-01 BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram of a media editing system employing effect management according to one aspect of the invention;
s Fig. 2 is a view of the display of the media editing system of Fig. 2 showing its timeline and an alternate modified scene list for a scene presented in that timeline;
Fig. 3 is a data model diagram for use by the system of Fig. 1 to store an illustrative composition presented on the timeline of Fig. 2; and Fig. 4 is a flowchart illustrating operation of the system of Fig. 1.
DETAILI~I) DESCRIPTION
Referring to Fig. l, an illustrative media editing system 10 can include a media editing processing system 12, a display 14, and a user input device or devices 16. The user input devices may include a keyboard 20, a pointing device such as a mouse 22, and/or a special-purpose editing control (not shown). The display can be a cathode ray tube display (CRT) or liquid crystal display (LCD), or any other display device suitable for the media being edited.
The composition editing processing system 12 includes a user interface module 24responsive to the user input devices 16. This user interface communicates with an editing and display interface 26, which can in turn communicate with storage 30 and the display 14. The user interface includes drivers to interpret signals from the user input devices and includes facilities to provide visible controls to the user in the f'orm of menus, icons~ and the like. The editing and display interface responds to user input obtained through the user interface to assemble source media elements stored in source media storage 34 into a composition in composition storage 32. The editing of digitally stored media elements to form compositions which are to be displayed on a display is generally known, and will not be discussed further here.
The media editing processing system 12 further includes an effect reconciliation module - 36, an effect generator interface 38, one or more local effect generators 40, and a network interface 42, which are each also in communication with the user interface. The effect reconciliation module, effect generator interface, and local effect generator can each communicate with the storage 30, and the network interface 42 is operatively connected to a network 46. The network 46 can be a local area network (LAN), a wide area network (WAN), or any other network over which media data can be effectively conveyed. The effect generator CA 022~08~9 1998-10-01 ' WO 97/39452 PCT/US97/06052 interface communicates with the effect reconciliation module, the local effect generator, and the network interface.
Referring to Figs. l and 2, the user interface 24 of the media editing system 10 provides various controls to be displayed on the display 14 by the editing and display interface 26. These controls include an effect palate 52 including effect icons S 1, a title bar 54, and a menu bar 56.
Also included are a media display window 50 and a timeline 58. The timeline 58 can include a plurality of media tracks, such as a video track 62, a left audio track 64, and a right audio track 66. A variety of other types of tracks such as a time code track 68, an edge code track (not shown), or a subtitle track (not shown) can also be provided.
o The timeline represents a composition of a series of scenes 72, 74, 76 separated by transitions 73, 75. Each of the scenes is represented as a rectangular area bearing a title of the scene, and the transitions are represented by the lines or other shapes that lie between the scenes.
Track identifiers 70 are provided to the left of the timeline to identify the different tracks. In one example, the timeline includes a first scene 72 entitled "Man kicks tire," which is separated from a second scene 74 by a first transition 73. The second scene is entitled "Man falls down," and is separated from the third scene 76 by a second transition 75. The third scene is entitled "Buzzard w/cap~1 The user interface 24 is configured to allow the user to expand the timeline entry for each scene in each track, although it is contemplated that systems could be constructed that only allow 20 scenes in some of the tracks (e.g., only the video track) to be expanded. This expanded timeline area 60 is made up of one or more additional alternative scene entry areas 80, 82, 84, 86, and 88.
When the video track of the third illustrative scene 76 is expanded it exhibits the names of five alternate scenes in an alternate scene display area 60. The first alternate scene 80 is entitled "Buzzard w/cap 2:3 pulldown," the second alternate scene 82 is entitled "Buzzard wlcap ME
25 16.00 fps," and the third alternate scene 84 is entitled "Buzzard w/cap roto zero one." The fourth alternate scene 86 is entitled "Buzzard w/cap cc tint blue," and the fifth alternate scene 88 is entitled "Buzzard w/cap cc tint blueO2". As ~,vill be discussed in more detail below, each of these alternate scene designators represents a different version of the video tracl~ of the third scene 76.
The first alternate scene is a 2:3 pulldown version of the third scene, the second alternate scene is 30 a 16 frame per second motion effect version of the third scene, the third alternate scene is a "rotoscoped" version of the third scene (i.e., a version that is combined with another scene)~ the fourth alternate scene 86 is a blue tint version of the third scene, and the fifth alternate scene is a CA 022~08~9 1998-10-01 different blue tint version of the third scene. Preferably, the effects for these modified scenes are rendered, if the system is not capable of rendering them in real time. The displayed track area of the third scene 76, which has alternate scenes associated with it, has an alternate scene indicator 89 to indicate to the user that the alternate scenes exist. This indicator can be a downward-pointing triangle.
Referring to Figs. 1-3, the media editing system 10 can store compositions using an object oriented data model 100. This model includes a sequence object 101 for each track. Each sequence object is made up of an ordered series that can include source clip objects 102, 103, 105, 106, group objects 104, and/or transition objects (not shown). Each source clip object o includes a length parameter 110, a source identifier 112, a source track identifier 114, and a start time 116. A clip object's source identifier and track identifier identify the source in the media storage 34 of the scene corresponding to that object. For example, it can identify a clip from digitized film footage stored in the media storage. The length and start time specify how much of the clip is to be used for the scene, and where the scene is to begin within the source clip.
Where there are no alternate scenes, the first scene 72 can be represented by a first clip object 102, and the second scene 74 can be represented by a second clip object 103. No transition effect need be specified if the user only wants a simple cut between scenes. Where the third scene 76 has several alternatives, it can be represented by a group object 104. This group object has a component identifier which identifies further clip objects 105, 106. One of skill in 20 the art would be able to devise somewhat different data structures for keeping track of alternative versions within a timeline. The widely used Open Media Framework Interchange format (OMFI), which is available from Avid Technology, Inc. of Tewksbury, Massachusetts can be used to store compositions that include alternate scenes. Version 2.0 of this standard is herein incorporated by reference.
The media editing processing system 12 can include dedicated special purpose circuitry, and/or general purpose processing circuitry running special purpose software. It is also noted that the breakdown of elements can be different from that shown in Fig. l without altering the essential overall functioning of the system. In one embodiment, the editing system operates on a high perforrnance, 4-processor work station such as the "Onyx" or "Indigo II Impact"
30 workstations available from Silicon Graphics, Inc. of Mountain View, California. This workstation employs the well-known Unix operating system, which provides networking capabilities to the editing system.
CA 022~08~9 1998-10-01 In operation, referring to Figs. 1-4, once the user has a timeline representing a composition displayed on the display, and he or she is ready to add effects to scenes in the composition (step 200), the user can select an effect (step 202). To select an effect, the user can drag one of the effect icons 51 from the effect palate 52 onto one track of one of the scenes 72, s 74, 76 on the timeline 58. Alternatively, the user can drag the scene for the track to the out box 55, after which he or she will be prompted for an outgoing network address. Note that in one embodiment, the system can distinguish between selecting an effect in a manner that it will result in the creation of an alternative scene or selecting the effect in a manner that will result in replacement of the scene, by responding to different types of effect selection (e.g., shift or shift-lo option clicking).
When the user selects an effect using the effect palate 52, the effect generator interface 38provides identifying information for the selected scene to one of the local effect gener ators 40 (step 204). The user can then use the local effect generator to generate the effect (step 206).
Examples of effects include color corrections, masks, motion effects, frame painting, flips. flops, 5 resizing, among others.
When the user selects an effect via the out box 55, scene identifying information, and optionally the source media for the scene. are provided via the network 46 to a remote effect generation location 44 by the network interface 42. The effect is then generated at the remote location, which can be in the next room or in another city (step 206). The effect may be devised 20 and rendered at the remote location by a skilled editor. When he or she is done generating the effect, he or she returns the resulting modified scene via the network to the network interface 42.
Note that remote effect generation may take time, and that the user may chose to continue to perform other editing tasks in the interim (branch 205).
When the effect generator interface 38 receives the modified scene from either the local 25 effect generator 40 or the network interface 42, it checks for a match between the modified scene and the timeline (step 210). This may be done by comparing the source identifier 112, the source track identifier 114, and the start time 116 of the modified scene with similar identifying information for scenes in the timeline. and determining whether there is a scene in the timeline that matches the modified scene, at least to the extent that there is some overlap. If no match is 30 discovered, the modified scene can remain in a holding bin, or in the in box 53. If the match is only partial, the effect generator interface can automatically create a "padded" modified scene CA 022~08~9 1998-10-01 that fits within the slot for the third scene 76, but includes some blank fill or fill from the unmodified scene.
If the matching modified scene was obtained from a remote effect generator 44, ("no"
branch of step 211) and the media composing system is not in autoload mode ("no" branch of 5 step 212), the media editing system 10 plolllpts the user about whether he or she would like to reconcile the modified scene into the timeline (step 214). If the modified scene is from a local effect generator or autoload mode is on ("yes" branches of steps 211 or 212), reconciliation (step 216) begins without user prompting. If the user declines to reconcile modified scene, it can remain as an icon in the in box 53. Note that both the in box and the out box 55 can be displayed 0 in a list format, similar to the one used for the effects palate, and in this format the boxes can list incoming and outgoing scenes and information about them.
To reconcile a modified scene, the effect reconciliation module 36 automatically adds a new modified source clip object (e.g., 106) to the linked list of source clip components belonging to the media group object 104 in the data structure for the track that includes the unmodified 5 scene. The effect reconciliation module 36 includes version management facilities that update the data structure to include the new modified source clip ob~ect automatically, without user intervention. Note that the auto-relinking performed by the effect reconciliation module can take place while the user is performing other editing tasks. This feature is particularly useful with remotely generated effects, and it can be implemented by running a separate task for the effect 20 reconciliation.
Once the modif1ed scene has been reconciled into the timeline (step 216), the user can look at the alternate scenes (steps 218, 220), or he or she can select another effect or perform other editing functions (branch 217). If the user chooses to browse through the alternative scenes, he or she can click on the desired track of the scene (or double-click, or otherwise actuate 25 the desired track, its alternate indicator triangle, or another area associated with the track for that scene) (step 218). In response, the user interface presents him or her with the alternative scene display area 60 (step 220), which presents the user with a listing of alternate treatments of the scene (a "treatment collection"). This area can remain open only so long as the button of the mouse 22 is held down (a "drag'- operation), or it can stay open until a second click of the mouse 30 (a "toggle" operation), although other behaviors are also possible. With the area open, the user can use the mouse or otherwise select one of the alternative scenes 80, 82, 84, 86, 88 to be used as the default scene in the timeline. The selected default scene is indicated by a default icon 90.
CA 022~08~9 1998-10-01 Once a default scene has been selected, the default scene will be presented when the composition represented by the timeline is played, stepped through, or otherwise viewed, or when an edit decision list (EDL) is generated. Normally, the most recently added version of a scene becomes the default version, but the user can manually select an earlier one.
The automatic management of scene versions and intuitive interface can significantly enhance productivity, particularly in large projects or projects involving significant numbers of effects. An editor can work on a large composition that includes many scenes that will each require different effects, while effects specialists work on the effects themselves. The effects specialists can then add modified versions of the scene to the editor's timeline, without requiring o him or her to track which scenes have been updated, and even without any interruption in the editor' s work. And if the scenes are sent over a network, the editor can chose particularly well-suited effects specialists for the different scenes from a variety of remote locations. If a scene requires a succession of sophisticated effects, the editor can begin working with the base scene (e.g., a stop-frame ~nim~ted model), then work with intermediate versions (e.g., a wire frame outline based on the model), and finish with a final version (e.g., ray-traced computer graphics based on the wire frame outline). In working on the project, the editor has the sense that the project is moving along, but is not caught up in the tedium of manually tracking the various effects.
The present invention has now been described in connection with a number of specific 20 embodiments thereof. However, numerous modifications which are contemplated as falling within the scope of the present invention should now be apparent to those skilled in the art.
Therefore, it is intended that the scope of the present invention be limited only by the scope of the claims appended hereto.
What is claimed is:
Claims (50)
1. A media editing system, comprising:
storage for storing a machine-readable composition made up of a plurality of media objects located at a plurality of positions in the composition, means for receiving a modified version of one of the media objects in the composition from an effect generator and a machine-readable identifier associated with the modified version of the one of the media objects, effect reconciliation means responsive to the means for receiving, for reading the machine-readable identifier and for finding a match between the modified version of the one of the media objects and the one of the media objects in the composition based on the machine-readable identifier and an identifier corresponding to the one of the media objects, and means for automatically inserting, the modified version of the one of the media objects into the machine-readable composition in synchronism with one of the positions in the composition that the one of the media objects occupied in the composition.
storage for storing a machine-readable composition made up of a plurality of media objects located at a plurality of positions in the composition, means for receiving a modified version of one of the media objects in the composition from an effect generator and a machine-readable identifier associated with the modified version of the one of the media objects, effect reconciliation means responsive to the means for receiving, for reading the machine-readable identifier and for finding a match between the modified version of the one of the media objects and the one of the media objects in the composition based on the machine-readable identifier and an identifier corresponding to the one of the media objects, and means for automatically inserting, the modified version of the one of the media objects into the machine-readable composition in synchronism with one of the positions in the composition that the one of the media objects occupied in the composition.
2. The media editing system of claim 1 further including means responsive to thestorage and to user input for identifying to the effect generator the one of the media objects in the composition stored in the storage.
3. The media editing system of claim 1 wherein the means for receiving a modified version is operatively connected to a network.
4. The media editing system of claim 1 wherein the means for receiving a modified version is operatively connected to a digital, packet-based, inter-city network.
5. The media editing system of claim 1 wherein the means for receiving includes prompting means for visually prompting and responding to the user before enabling the means for automatically inserting to insert the modified version of the one of the media objects in the machine-readable composition.
6. The media editing system of claim 5 wherein the prompting means include user-activated mode selection means responsive to a user command for activating and deactivating the prompting means.
7. The media editing system of claim 1 wherein the means for receiving, the means for reading, and the means for automatically inserting are operable to receive, read, and insert a modified version of the one of the objects into the machine-readable composition independent of user input.
8. The media editing system of claim 7 wherein the means for receiving, the means for reading, and the means for automatically inserting are operable to receive, read, and insert a modified version of the one of the media objects into a composition while other portions of the editing system are responsive to user input.
9. The media editing system of claim 1 wherein the means for automatically inserting includes means for finding a match between the modified version of the one of the media objects and the one of the media objects in the machine-readable composition, and means for automatically padding the modified version of the one of the media objects if the modified version of the one of the media objects does not fully overlap the one of the media objects in the machine-readable composition.
10. The media editing system of claim 1 wherein the means for automatically inserting includes version management means for associating the modified version of the one of the media objects with other alternate versions of the one of the media objects in the machine-readable composition.
11. The media editing system of claim 10 further including, alternate media object display means for displaying user-readable identifiers of the alternate versions of the one of the media objects in the machine-readable composition, including the modified version of the one of the media objects.
12. The media editing system of claim 11 wherein the alternate media object display means are operative to display the identifiers to the user in a display area that is adjacent to a timeline that displays information about the composition.
13. The media editing system of claim 10 wherein the alternate media object display means are responsive to user actuation of a portion of timeline that displays information about the composition on a display that is responsive to the media editing system, and wherein the portion of the timeline is at a position in the timeline that corresponds to the one of the positions in the composition that the one of the media objects in the machine-readable composition occupies
14. The media editing system of claim 13 wherein the alternate media object display means are operative to display the identifiers to the user in a display area that is adjacent to the portion of the timeline.
15. The media editing system of claim 1 wherein the one of the media objects is one of a plurality of motion picture scenes located at a plurality of positions in the composition, and wherein the scenes are separated by transitions in the composition.
16. A media editing system, comprising:
storage for storing a plurality of versions of a media object in a machine-readable composition, version management means for associating the versions of the media object with the media object, means for displaying to a user a list of identifiers of the versions of the media object in response to user command that references a portion of a timeline, wherein the position of the portion of the timeline corresponds to a position of the media object in the composition, and selection means responsive to a selection command from the user to select one of the plurality of versions to be a default version of the media object for composition.
storage for storing a plurality of versions of a media object in a machine-readable composition, version management means for associating the versions of the media object with the media object, means for displaying to a user a list of identifiers of the versions of the media object in response to user command that references a portion of a timeline, wherein the position of the portion of the timeline corresponds to a position of the media object in the composition, and selection means responsive to a selection command from the user to select one of the plurality of versions to be a default version of the media object for composition.
17. The media editing system of claim 16 wherein the means for displaying is operative to display to the user the list at a position that is adjacent the position of the portion of the timeline that corresponds to the position of the media object in the timeline.
18. The media editing system of claim 16 wherein the means for displaying is responsive to user actuation of the portion of the timeline that corresponds to the media object in the composition as the user command.
19. The media editing system of claim 18 wherein the means for displaying is responsive to user actuation, by a pointing device cursor, or the portion of the timeline that corresponds to the position of the media object in the composition as the user command, and wherein the selection means are operative to respond to actuation by the user, by a pointing device cursor, of an area whose position is associated with one of the identifiers in the list of identifiers as the selection command from the user to select one of the plurality of versions to be a default version of the media object for the composition.
20. The media editing system of claim 16 wherein the selection means are operative to respond to user actuation of an area whose position is associated with one of the identifiers in the list of identifiers as the selection command from the user to select one of the plurality of versions to be a default version of the media object for the composition.
21. The media editing system of claim 16 further including means for automatically receiving and storing a further version of the media object, and wherein the version management means are for automatically associating the further version of the media object with the media object.
22. The media editing system of claim 21 wherein the means for automatically receiving is responsive to receive the futher version of the media object from a network.
23. The media editing system of claim 22 wherein the means for receiving a modified version is operatively connected to a digital, packet-based, inter-city network.
24. The media editing system of claim 21 wherein the means for receiving includes prompting means for visually prompting and responding to the user before enabling, the version management means to associate the further version of the media object in the machine-readable composition.
25. The media editing system of claim 24 wherein the prompting means include user-activated mode selection means responsive to a user command for activating and deactivating the prompting means.
26. The media editing system of claim 21 wherein the version management means are operable to receive and insert a modified media object into the machine-readable composition independent of user input.
27. The media editing system of claim 21 wherein the version management means are operable to receive and insert a modified media object into the machine-readable composition while other portions of the editing system are responsive to user input.
28. The media editing system of claim 16 wherein the version management means include means for finding a match between a modified media object and the media object in the machine-readable composition, and means for automatically padding the modified media object if the modified media object does not fully overlap the one media object in the machine-readable composition.
29. The media editing system of claim 16 wherein the media objects are motion picture scenes located at a plurality of positions in the composition, and wherein the scenes are separated by transitions in the composition.
30. A media editing method, comprising:
displaying on a display a timeline for a composition made up of a plurality of media objects, electronically storing a representation of each of a plurality of alternate versions of one of the media objects for which a composition is displayed in the step of displaying, associating the representation of each of the versions of the one of the media objects stored in the step of storing with the one of the media objects for which the composition is displayed in the step of displaying, and displaying to a user a list of identifiers of the versions of the one of the media objects stored in the step of storing in response to user actuation of a portion of the timeline corresponding to the one of the media objects for which the composition is displayed in the step of displaying.
displaying on a display a timeline for a composition made up of a plurality of media objects, electronically storing a representation of each of a plurality of alternate versions of one of the media objects for which a composition is displayed in the step of displaying, associating the representation of each of the versions of the one of the media objects stored in the step of storing with the one of the media objects for which the composition is displayed in the step of displaying, and displaying to a user a list of identifiers of the versions of the one of the media objects stored in the step of storing in response to user actuation of a portion of the timeline corresponding to the one of the media objects for which the composition is displayed in the step of displaying.
31. The method of claim 30 further including the step of automatically receiving and storing a further version of the one of the media objects, and automatically associating the further version of the one of the media objects with the one of the media objects.
32. The method of claim 31 wherein the step of receiving receives the further version from a network.
33. The method of claim 31 wherein the step of receiving receives the further version from a location in or proximate another city via a network.
34. The method of claim 31 further including a step of prompting the user before the step of automatically associating.
35. The method of claim 34 further including the steps of enabling and disabling the step of prompting in response to user input.
36. The method of claim 30 further including the step of automatically padding the further version of the one of the media object if it does not fully overlap the one of the media objects.
37. The method of claim 30 further including the step of responding to a user selection command associated with one of the displayed identifiers to select one of the versions as a default version of the one of the media objects in the composition.
38. The method of claim 37 wherein the steps of displaying and the step of responding to a user selection command are responsive to a pointing device.
39. The media editing system of claim 30 wherein the media objects are motion picture scenes located at a plurality of positions in the composition, and wherein the scenes are separated by transitions in the composition.
40. A media editing method, comprising:
locally storing a first media object having a first position in a composition of media objects, the step of storing a first media object including storing a first digital source identifier for the first media object, receiving from a remote location a second media object including a second digital source identifier that corresponds to the first digital source identifier, after the step of receiving from a remote location a second media object, automatically matching the first and second media objects based on the first and second digital source identifiers, and inserting the second media object into the composition at a position that is based on the step of matching the first and second media objects.
locally storing a first media object having a first position in a composition of media objects, the step of storing a first media object including storing a first digital source identifier for the first media object, receiving from a remote location a second media object including a second digital source identifier that corresponds to the first digital source identifier, after the step of receiving from a remote location a second media object, automatically matching the first and second media objects based on the first and second digital source identifiers, and inserting the second media object into the composition at a position that is based on the step of matching the first and second media objects.
41. The media editing method of claim 39 further including the steps of:
locally storing a third media object having a third position in the composition, the step of storing a third media object including storing a third digital source identifier for the third media object, receiving from a remote location a fourth media object including a fourth digital source identifier that corresponds to the first digital source identifier, after the step of receiving from a remote location a second media object, automatically matching the third and fourth media objects based on the third and fourth digital source identifiers, and inserting the fourth media object into the composition at a position that is based on the step at matching the third and fourth media objects.
locally storing a third media object having a third position in the composition, the step of storing a third media object including storing a third digital source identifier for the third media object, receiving from a remote location a fourth media object including a fourth digital source identifier that corresponds to the first digital source identifier, after the step of receiving from a remote location a second media object, automatically matching the third and fourth media objects based on the third and fourth digital source identifiers, and inserting the fourth media object into the composition at a position that is based on the step at matching the third and fourth media objects.
42. The media editing method of claim 40 wherein the step of receiving a fourth media object takes place after the step of receiving a second media object and before the step of inserting the second media object.
43. The media editing method of claim 40 wherein the step of automatically matching the first and second media objects includes a step of comparing the first digital source identifier with both the second and fourth digital source identifiers in order to match the first digital source identifier with a matching one of the second and fourth identifiers.
44. The media editing method of claim 40 further including the step of temporarily locally storing the first media object after the step of receiving a first media object and before the step of inserting the first media object.
45. The media editing method of claim 40 further including a step of prompting a user after the step of receiving the second media object and before the step of inserting the second media object.
46. The media editing method of claim 45 further including a step of disabling further steps of prompting.
47. The media editing method of claim 40 wherein the step of receiving the second media object receives the second media object in an in box from a packet-switched inter-city digital network.
48. The media editing method of claim 40 further including the step of sending the first media object to a remote effect generator before the step of receiving the second media object, and wherein the step of receiving the second media object receives a modified version of the first media object from the remote effect generator.
49. The media editing method of claim 40 wherein the step of inserting the second media object inserts the second media object as a second version of the first media object.
50. The media editing system of claim 40 wherein the media object is one of a plurality of motion picture scenes located at a plurality of positions in the composition, and wherein the scenes are separated by transitions in the composition.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/631,323 US6161115A (en) | 1996-04-12 | 1996-04-12 | Media editing system with improved effect management |
| US08/631,323 | 1996-04-12 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2250859A1 true CA2250859A1 (en) | 1997-10-23 |
Family
ID=24530715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002250859A Abandoned CA2250859A1 (en) | 1996-04-12 | 1997-04-11 | Media editing system with improved effect management |
Country Status (7)
| Country | Link |
|---|---|
| US (3) | US6161115A (en) |
| EP (2) | EP1026687A1 (en) |
| JP (1) | JP3980062B2 (en) |
| AU (1) | AU2664897A (en) |
| CA (1) | CA2250859A1 (en) |
| DE (1) | DE69701566T2 (en) |
| WO (1) | WO1997039452A1 (en) |
Families Citing this family (73)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6340978B1 (en) * | 1997-01-31 | 2002-01-22 | Making Everlasting Memories, Ltd. | Method and apparatus for recording and presenting life stories |
| US7657835B2 (en) * | 1997-01-31 | 2010-02-02 | Making Everlasting Memories, L.L.C. | Method and system for creating a commemorative presentation |
| US6243725B1 (en) * | 1997-05-21 | 2001-06-05 | Premier International, Ltd. | List building system |
| JP3276596B2 (en) | 1997-11-04 | 2002-04-22 | 松下電器産業株式会社 | Video editing device |
| JP3997026B2 (en) * | 1999-01-29 | 2007-10-24 | キヤノン株式会社 | Form editing method and apparatus, and storage medium storing computer-readable program |
| US6571255B1 (en) * | 1999-04-16 | 2003-05-27 | Robert Gonsalves | Modification of media with common attributes on a digital nonlinear editing system |
| WO2001037553A1 (en) * | 1999-11-15 | 2001-05-25 | Copan, Inc. | System and method for improving digital video utilizing genetic image evolution |
| DE60139527D1 (en) * | 2000-01-26 | 2009-09-24 | Sony Corp | INFORMATION PROCESSING DEVICE, METHOD AND PROGRAM MEMORY |
| US7085995B2 (en) * | 2000-01-26 | 2006-08-01 | Sony Corporation | Information processing apparatus and processing method and program storage medium |
| US6774919B2 (en) * | 2000-12-06 | 2004-08-10 | Microsoft Corporation | Interface and related methods for reducing source accesses in a development system |
| US6961943B2 (en) * | 2000-12-06 | 2005-11-01 | Microsoft Corporation | Multimedia processing system parsing multimedia content from a single source to minimize instances of source files |
| US7447754B2 (en) * | 2000-12-06 | 2008-11-04 | Microsoft Corporation | Methods and systems for processing multi-media editing projects |
| US6983466B2 (en) * | 2000-12-06 | 2006-01-03 | Microsoft Corporation | Multimedia project processing systems and multimedia project processing matrix systems |
| US6768499B2 (en) | 2000-12-06 | 2004-07-27 | Microsoft Corporation | Methods and systems for processing media content |
| US7114162B2 (en) | 2000-12-06 | 2006-09-26 | Microsoft Corporation | System and methods for generating and managing filter strings in a filter graph |
| US6912717B2 (en) * | 2000-12-06 | 2005-06-28 | Microsoft Corporation | Methods and systems for implementing dynamic properties on objects that support only static properties |
| US7103677B2 (en) | 2000-12-06 | 2006-09-05 | Microsoft Corporation | Methods and systems for efficiently processing compressed and uncompressed media content |
| US7114161B2 (en) * | 2000-12-06 | 2006-09-26 | Microsoft Corporation | System and related methods for reducing memory requirements of a media processing system |
| US7287226B2 (en) | 2000-12-06 | 2007-10-23 | Microsoft Corporation | Methods and systems for effecting video transitions represented by bitmaps |
| US6882891B2 (en) * | 2000-12-06 | 2005-04-19 | Microsoft Corporation | Methods and systems for mixing digital audio signals |
| US6834390B2 (en) | 2000-12-06 | 2004-12-21 | Microsoft Corporation | System and related interfaces supporting the processing of media content |
| US6954581B2 (en) * | 2000-12-06 | 2005-10-11 | Microsoft Corporation | Methods and systems for managing multiple inputs and methods and systems for processing media content |
| US6959438B2 (en) * | 2000-12-06 | 2005-10-25 | Microsoft Corporation | Interface and related methods for dynamically generating a filter graph in a development system |
| US20020108115A1 (en) * | 2000-12-11 | 2002-08-08 | The Associated Press | News and other information delivery system and method |
| US20020188859A1 (en) * | 2001-06-07 | 2002-12-12 | Dollens James Terry | DNA intrusion detection method |
| US20030046060A1 (en) * | 2001-09-04 | 2003-03-06 | Juergen Roeck | Rule-based document composing |
| US7432940B2 (en) | 2001-10-12 | 2008-10-07 | Canon Kabushiki Kaisha | Interactive animation of sprites in a video production |
| US20030233621A1 (en) * | 2002-06-13 | 2003-12-18 | International Business Machines Corporation | Editor for smart version control |
| US20050132293A1 (en) * | 2003-12-10 | 2005-06-16 | Magix Ag | System and method of multimedia content editing |
| US8732221B2 (en) * | 2003-12-10 | 2014-05-20 | Magix Software Gmbh | System and method of multimedia content editing |
| US20050234838A1 (en) * | 2004-04-14 | 2005-10-20 | Manousos Nicholas H | Method and apparatus for providing in place editing within static documents |
| US7739306B2 (en) * | 2004-04-14 | 2010-06-15 | Verisign, Inc. | Method and apparatus for creating, assembling, and organizing compound media objects |
| US8250034B2 (en) * | 2004-04-14 | 2012-08-21 | Verisign, Inc. | Method and apparatus to provide visual editing |
| US20050276573A1 (en) * | 2004-05-28 | 2005-12-15 | Abbate Jeffrey A | Method and apparatus to edit a media file |
| GB0418152D0 (en) * | 2004-08-13 | 2004-09-15 | Rpptv Ltd | Remote program production |
| WO2006089433A1 (en) * | 2005-02-28 | 2006-08-31 | James Monro Productions Inc. | Method and apparatus for editing media |
| US20070162855A1 (en) * | 2006-01-06 | 2007-07-12 | Kelly Hawk | Movie authoring |
| US20070162857A1 (en) * | 2006-01-06 | 2007-07-12 | Ralf Weber | Automated multimedia authoring |
| US7800615B2 (en) * | 2006-01-25 | 2010-09-21 | Autodesk, Inc. | Universal timelines for coordinated productions |
| US7495667B2 (en) * | 2006-02-24 | 2009-02-24 | Michael Bruggeman | Post production integration platform |
| US20090207998A1 (en) * | 2008-01-07 | 2009-08-20 | Angus Wall | Determining unique material identifier numbers using checksum values |
| US8463109B2 (en) | 2008-01-07 | 2013-06-11 | Black Mariah, Inc. | Editing digital film |
| US8522144B2 (en) * | 2009-04-30 | 2013-08-27 | Apple Inc. | Media editing application with candidate clip management |
| US8881013B2 (en) | 2009-04-30 | 2014-11-04 | Apple Inc. | Tool for tracking versions of media sections in a composite presentation |
| US8549404B2 (en) * | 2009-04-30 | 2013-10-01 | Apple Inc. | Auditioning tools for a media editing application |
| US8555169B2 (en) * | 2009-04-30 | 2013-10-08 | Apple Inc. | Media clip auditioning used to evaluate uncommitted media content |
| US8701007B2 (en) * | 2009-04-30 | 2014-04-15 | Apple Inc. | Edit visualizer for modifying and evaluating uncommitted media content |
| US8533598B2 (en) * | 2009-04-30 | 2013-09-10 | Apple Inc. | Media editing with a segmented timeline |
| US9032299B2 (en) * | 2009-04-30 | 2015-05-12 | Apple Inc. | Tool for grouping media clips for a media editing application |
| US9564173B2 (en) * | 2009-04-30 | 2017-02-07 | Apple Inc. | Media editing application for auditioning different types of media clips |
| US20100299621A1 (en) * | 2009-05-20 | 2010-11-25 | Making Everlasting Memories, L.L.C. | System and Method for Extracting a Plurality of Images from a Single Scan |
| US8327268B2 (en) * | 2009-11-10 | 2012-12-04 | Magix Ag | System and method for dynamic visual presentation of digital audio content |
| US20110161166A1 (en) * | 2009-12-30 | 2011-06-30 | Mindrum G Scott | System and method for capturing, processing, and presenting information |
| US8631047B2 (en) | 2010-06-15 | 2014-01-14 | Apple Inc. | Editing 3D video |
| US8819557B2 (en) | 2010-07-15 | 2014-08-26 | Apple Inc. | Media-editing application with a free-form space for organizing or compositing media clips |
| US10324605B2 (en) | 2011-02-16 | 2019-06-18 | Apple Inc. | Media-editing application with novel editing tools |
| US10095367B1 (en) * | 2010-10-15 | 2018-10-09 | Tivo Solutions Inc. | Time-based metadata management system for digital media |
| US9099161B2 (en) | 2011-01-28 | 2015-08-04 | Apple Inc. | Media-editing application with multiple resolution modes |
| US8839110B2 (en) | 2011-02-16 | 2014-09-16 | Apple Inc. | Rate conform operation for a media-editing application |
| US20120210219A1 (en) | 2011-02-16 | 2012-08-16 | Giovanni Agnoli | Keywords and dynamic folder structures |
| US9997196B2 (en) | 2011-02-16 | 2018-06-12 | Apple Inc. | Retiming media presentations |
| US9412414B2 (en) | 2011-02-16 | 2016-08-09 | Apple Inc. | Spatial conform operation for a media-editing application |
| US11747972B2 (en) | 2011-02-16 | 2023-09-05 | Apple Inc. | Media-editing application with novel editing tools |
| US20130073960A1 (en) | 2011-09-20 | 2013-03-21 | Aaron M. Eppolito | Audio meters and parameter controls |
| US9536564B2 (en) | 2011-09-20 | 2017-01-03 | Apple Inc. | Role-facilitated editing operations |
| US20130124999A1 (en) | 2011-11-14 | 2013-05-16 | Giovanni Agnoli | Reference clips in a media-editing application |
| US10496250B2 (en) | 2011-12-19 | 2019-12-03 | Bellevue Investments Gmbh & Co, Kgaa | System and method for implementing an intelligent automatic music jam session |
| US9477674B2 (en) * | 2014-02-20 | 2016-10-25 | Avid Technology, Inc. | Merging and splitting of media composition files |
| US10817583B2 (en) * | 2015-02-20 | 2020-10-27 | Disney Enterprises, Inc. | Systems and methods for non-linear content creation |
| US11665312B1 (en) * | 2018-12-27 | 2023-05-30 | Snap Inc. | Video reformatting recommendation |
| US10887542B1 (en) | 2018-12-27 | 2021-01-05 | Snap Inc. | Video reformatting system |
| US20200296462A1 (en) | 2019-03-11 | 2020-09-17 | Wci One, Llc | Media content presentation |
| US11881233B2 (en) * | 2021-04-08 | 2024-01-23 | Rovi Guides, Inc. | Methods and systems for generating meme content |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4689683B1 (en) | 1986-03-18 | 1996-02-27 | Edward Efron | Computerized studio for motion picture film and television production |
| JP2629802B2 (en) | 1988-04-16 | 1997-07-16 | ソニー株式会社 | News program broadcasting system |
| US5051845A (en) * | 1989-04-27 | 1991-09-24 | Gardner Larry J | Closed-loop post production process |
| US5227863A (en) | 1989-11-14 | 1993-07-13 | Intelligent Resources Integrated Systems, Inc. | Programmable digital video processing system |
| US5307456A (en) | 1990-12-04 | 1994-04-26 | Sony Electronics, Inc. | Integrated multi-media production and authoring system |
| US5404316A (en) | 1992-08-03 | 1995-04-04 | Spectra Group Ltd., Inc. | Desktop digital video processing system |
| US6005560A (en) * | 1992-10-01 | 1999-12-21 | Quark, Inc. | Multi-media project management and control system |
| US5574898A (en) * | 1993-01-08 | 1996-11-12 | Atria Software, Inc. | Dynamic software version auditor which monitors a process to provide a list of objects that are accessed |
| US5649200A (en) * | 1993-01-08 | 1997-07-15 | Atria Software, Inc. | Dynamic rule-based version control system |
| US5339393A (en) * | 1993-04-15 | 1994-08-16 | Sony Electronics, Inc. | Graphical user interface for displaying available source material for editing |
| EP1414043B1 (en) * | 1994-03-16 | 2008-01-02 | Sony Corporation | Image editing system |
| JPH08115312A (en) * | 1994-10-14 | 1996-05-07 | Fuji Xerox Co Ltd | Multimedia document reproducing device, multimedia document editing device, and multimedia document editing and reproducing device |
| US5659793A (en) * | 1994-12-22 | 1997-08-19 | Bell Atlantic Video Services, Inc. | Authoring tools for multimedia application development and network delivery |
| US5684963A (en) * | 1995-03-20 | 1997-11-04 | Discreet Logic, Inc. | System and method for distributing video from a plurality of video providers |
| US5819004A (en) * | 1995-05-08 | 1998-10-06 | Kabushiki Kaisha Toshiba | Method and system for a user to manually alter the quality of previously encoded video frames |
| US5907837A (en) * | 1995-07-17 | 1999-05-25 | Microsoft Corporation | Information retrieval system in an on-line network including separate content and layout of published titles |
| US5781188A (en) * | 1996-06-27 | 1998-07-14 | Softimage | Indicating activeness of clips and applying effects to clips and tracks in a timeline of a multimedia work |
-
1996
- 1996-04-12 US US08/631,323 patent/US6161115A/en not_active Expired - Lifetime
-
1997
- 1997-04-11 EP EP00101415A patent/EP1026687A1/en not_active Ceased
- 1997-04-11 CA CA002250859A patent/CA2250859A1/en not_active Abandoned
- 1997-04-11 EP EP97918575A patent/EP0892976B1/en not_active Expired - Lifetime
- 1997-04-11 AU AU26648/97A patent/AU2664897A/en not_active Abandoned
- 1997-04-11 JP JP53723897A patent/JP3980062B2/en not_active Expired - Fee Related
- 1997-04-11 WO PCT/US1997/006052 patent/WO1997039452A1/en active IP Right Grant
- 1997-04-11 DE DE69701566T patent/DE69701566T2/en not_active Expired - Lifetime
-
2000
- 2000-11-13 US US09/711,468 patent/US6544293B1/en not_active Expired - Fee Related
-
2003
- 2003-03-11 US US10/386,155 patent/US20040078761A1/en not_active Abandoned
Also Published As
| Publication number | Publication date |
|---|---|
| DE69701566T2 (en) | 2000-11-09 |
| EP1026687A1 (en) | 2000-08-09 |
| WO1997039452A1 (en) | 1997-10-23 |
| US6161115A (en) | 2000-12-12 |
| AU2664897A (en) | 1997-11-07 |
| DE69701566D1 (en) | 2000-05-04 |
| JP2001501350A (en) | 2001-01-30 |
| US6544293B1 (en) | 2003-04-08 |
| EP0892976A1 (en) | 1999-01-27 |
| JP3980062B2 (en) | 2007-09-19 |
| US20040078761A1 (en) | 2004-04-22 |
| EP0892976B1 (en) | 2000-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6544293B1 (en) | Media editing system with improved effect management | |
| US6400378B1 (en) | Home movie maker | |
| EP0915469B1 (en) | Digital video editing method and system | |
| US6204840B1 (en) | Non-timeline, non-linear digital multimedia composition method and system | |
| US6078005A (en) | Apparatus for editing and reproducing visual events along musical events | |
| US8280224B2 (en) | Information recording apparatus and information recording method | |
| EP0625783B1 (en) | Method and apparatus for displaying available source material for editing | |
| US6928613B1 (en) | Organization, selection, and application of video effects according to zones | |
| JP3433746B2 (en) | Computer and editing processing method | |
| US20040034869A1 (en) | Method and system for display and manipulation of thematic segmentation in the analysis and presentation of film and video | |
| JPH11205736A (en) | Moving image editing device | |
| CA2563359A1 (en) | Editing system for audiovisual works and corresponding text for television news | |
| US6879769B1 (en) | Device for processing recorded information and storage medium storing program for same | |
| US11721365B2 (en) | Video editing or media management system | |
| WO2021022324A1 (en) | Video editing system, method and user interface | |
| JP2000516012A (en) | Graphical user interface for motion video planning / editing system for computer | |
| US7694225B1 (en) | Method and apparatus for producing a packaged presentation | |
| US20020199204A1 (en) | Generation of a description in a markup language of a structure of a multimedia content | |
| JP3411184B2 (en) | Video editing system | |
| KR100322294B1 (en) | Method for recording and modifying menu | |
| Costello | Non-Linear Editing | |
| JP4101258B2 (en) | Image editing method, image editing apparatus, and medium storing program for causing computer to execute image editing processing operation | |
| JPH05216608A (en) | Scenario display device | |
| JPH11250050A (en) | Display preparing method, computer-readable recording medium recording program for preparing display, display preparing device and presentation editing software generating method | |
| Phillips | Crossing the Line: Bridging Traditional and Digital Post Production Processes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued |