US6072935A - System and method for improving video recorder performance in a search mode - Google Patents

System and method for improving video recorder performance in a search mode Download PDF

Info

Publication number
US6072935A
US6072935A US08/734,712 US73471296A US6072935A US 6072935 A US6072935 A US 6072935A US 73471296 A US73471296 A US 73471296A US 6072935 A US6072935 A US 6072935A
Authority
US
United States
Prior art keywords
display
images
defining
sequences
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US08/734,712
Inventor
Peter H. N. De With
Stephanus J. J. Nijssen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
US Philips Corp
Original Assignee
US Philips Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by US Philips Corp filed Critical US Philips Corp
Priority to US08/734,712 priority Critical patent/US6072935A/en
Priority to US09/442,958 priority patent/US6167191A/en
Priority to US09/575,974 priority patent/US6339671B1/en
Application granted granted Critical
Publication of US6072935A publication Critical patent/US6072935A/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B15/00Driving, starting or stopping record carriers of filamentary or web form; Driving both such record carriers and heads; Guiding such record carriers or containers therefor; Control thereof; Control of operating function
    • G11B15/18Driving; Starting; Stopping; Arrangements for control or regulation thereof
    • G11B15/1808Driving of both record carrier and head
    • G11B15/1875Driving of both record carrier and head adaptations for special effects or editing
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/12Formatting, e.g. arrangement of data block or words on the record carriers
    • G11B20/1201Formatting, e.g. arrangement of data block or words on the record carriers on tapes
    • G11B20/1202Formatting, e.g. arrangement of data block or words on the record carriers on tapes with longitudinal tracks only
    • G11B20/1204Formatting, e.g. arrangement of data block or words on the record carriers on tapes with longitudinal tracks only for continuous data, e.g. digitised analog information signals, pulse code modulated [PCM] data
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/12Formatting, e.g. arrangement of data block or words on the record carriers
    • G11B20/1201Formatting, e.g. arrangement of data block or words on the record carriers on tapes
    • G11B20/1207Formatting, e.g. arrangement of data block or words on the record carriers on tapes with transverse tracks only
    • G11B20/1208Formatting, e.g. arrangement of data block or words on the record carriers on tapes with transverse tracks only for continuous data, e.g. digitised analog information signals, pulse code modulated [PCM] data
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/005Reproducing at a different information rate from the information rate of recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/783Adaptations for reproducing at a rate different from the recording rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/93Regeneration of the television signal or of selected parts thereof
    • H04N5/937Regeneration of the television signal or of selected parts thereof by assembling picture element blocks in an intermediate store
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H04N9/8047Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/90Tape-like record carriers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/7824Television signal recording using magnetic recording on tape with rotating magnetic heads
    • H04N5/7826Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape
    • H04N5/78263Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape for recording on tracks inclined relative to the direction of movement of the tape
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/7824Television signal recording using magnetic recording on tape with rotating magnetic heads
    • H04N5/7826Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape
    • H04N5/78263Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape for recording on tracks inclined relative to the direction of movement of the tape
    • H04N5/78266Television signal recording using magnetic recording on tape with rotating magnetic heads involving helical scanning of the magnetic tape for recording on tracks inclined relative to the direction of movement of the tape using more than one track for the recording of one television field or frame, i.e. segmented recording

Definitions

  • the present invention applies to video recorders and, specifically, to video recorders operative with playback at the recording speed and at least one other speed.
  • the present invention is a method of recording data defining a plurality of images on substantially parallel tracks of a recording medium at a recording speed, for playback at said recording speed and at least one additional speed. It comprises the steps of generating a plurality of basic segments for each of said images in response to received image data, each of said basic segments defining an incremental part of an image extending in a first direction and in a second direction transverse to said first direction.
  • the basic segments are recorded on the tracks as a plurality of sub-sequences each defining a first contiguous part of the image exceeding said incremental part in area. Sequentially recorded sub-sequences in turn define second contiguous parts of the image, greater than the first contiguous parts. All sub-sequences on one track together defining a third contiguous part of the image exceeding in area said second contiguous part constitute a sequence.
  • the present invention also constitutes a method for generating display signals for display of an image. Bursts of data (macro-segments) are read from a recording medium at a selected speed exceeding the recording speed of the data.
  • the recording medium has a plurality of tracks each having at least part of one of a plurality of sequential images recorded thereon.
  • Each of the bursts of data comprises data defining a contiguous area of one of the images, while a plurality of bursts varying in number in correspondence to the ratio of the selected speed to the recording speed defines all parts of an image.
  • the data of the read-out bursts is stored in a memory until the plurality of bursts has been received, and then read from the memory in a sequence and at a rate suitable for display, thereby creating the display signals.
  • the present invention further constitutes a recording medium having a plurality of tracks, a plurality of images being recorded on the tracks, each of said tracks having a data sequence defining a first contiguous area of one of the images, said sequence comprising a plurality of sequentially recorded sub-sequences each defining a second contiguous area smaller than that first contiguous area, each of said sub-sequences comprising a plurality of sequentially recorded basic segments each defining a third area of said image, the plurality of third areas together constituting one of the second areas.
  • the present invention also constitutes an apparatus for recording video signals defining a plurality of images on a plurality of tracks of a recording medium for replay at the recording speed and at least one higher speed.
  • Coding means are provided for encoding said video signals into basic segments each basic segment defining an incremental area of one of said images.
  • Memory means store a plurality of said basic segments, addressing means reading out a plurality of sub-sequences, each comprising basic segments defining contiguous parts of said image, from said memory means in a predetermined order, thereby furnishing read-out sub-sequences.
  • Recording means record the read-out sub-sequences on tracks of the recording medium.
  • the present invention also constitutes an apparatus for furnishing display signals in response to macro-segments of data read from a recording medium at a speed different from the recording speed. It comprises means for storing the macro-segments together constituting an image, and means for reading out the stored data in a sequence and at a rate suitable for application to display means.
  • FIG. 1a is a schematic diagram showing track pairs and head pairs in azimuth recording
  • FIG. 1b is a diagram showing the variation of signal-to-noise ratio with head position in FIG. 1a;
  • FIG. 2 is a diagram illustrating the head vs. track movement at a plurality of speeds exceeding the recording speed
  • FIG. 3 is a diagram illustrating a problem which arises for an unacceptable ratio of playback speed to recording speed
  • FIG. 4 is a schematic diagram illustrating head vs. track movement at an acceptable speed higher than the recording speed
  • FIG. 5a illustrates the composition of a basic segment
  • FIG. 5b shows an image divided into macro-segments and basic segments
  • FIG. 5c is a schematic diagram illustrating tape tracks having the segments of FIG. 5b recorded thereon;
  • FIG. 6 illustrates macro-segment bursts recoverable at 2.5 times the recording speed according to the system and method of the present invention
  • FIG. 7 illustrates the corresponding reconstructed image
  • FIG. 8 is a block diagram of the recording and playback system according to the present invention.
  • the problem to be solved by the present invention is to furnish a video recorder/playback system and method which yields the best possible images for playback at the recording speed as well as at higher speeds, during, for example, a search mode.
  • the solution to this problem in accordance with the present invention will be analyzed based on a preferred embodiment in which azimuth recording is used, i.e., the information is recorded on neighboring tracks with opposite azimuth. This is illustrated in FIG. 1a where the two neighboring tracks are denoted by a and b, respectively, and information is recorded and read from the track pairs by a head pair A, B.
  • the gap in head A is so oriented that it can only read information from the a track, while head B can read information only from the b track.
  • the width of the head is equal to the width of the track and that there are 6 tracks, i.e. 3 track pairs, per frame. The track pairs are numbered 1, 2, 3 etc. in FIG. 1a.
  • the head pair AB will, during recording, and during playback at the recording speed, travel along the tracks so that the highest signal-to-noise ratio is always obtained.
  • the heads will not travel parallel to the tracks, but will take the paths illustrated in FIG. 1a by two solid lines, one for head B and one for head A. These paths involve the crossing of tracks and, therefore, a variation of the signal-to-noise ratio furnished by the heads as a function of position. This variation is illustrated in FIG. 1b with a solid line for head A and a dashed line for head B.
  • SNR amplitude plotted in FIG. 1b
  • the direction of head motion as a function of the multiple of the recording speed at which playback occurs is shown in FIG. 2.
  • the head pair is preferably not in its recording or normal playback position at the start, but is located so that the center of head A coincides with 5 the edge of the track, i.e., in a position where the SNR is just sufficient to start data recovery.
  • This change in relative position of head to tape takes place automatically, simultaneously with selection of a search mode by the user, and minimizes track crossings. With this positioning, no track crossings occur at twice the recording speed, one crossing occurs at 3 times the recording speed, etc.
  • the macro-segments derived from sequential tracks are to be stored in memory, and subsequently read-out from memory for application to a video display system to recreate a whole image.
  • search higher-than-recording
  • only part of the information recorded on each track can be read out at such higher-than-recording (search) speeds. Therefore, even after all tracks associated with a given frame of the video signal have been scanned, some parts of the image (indicated by blank track portions in tracks 1-6 of frame n) are still missing.
  • the corresponding parts of subsequently received frames, recorded on subsequent tracks are to be used to fill in the missing parts. As is illustrated in FIG.
  • data is recorded on the tape in such a way that each of the above-mentioned macro-segments defines a horizontally and/or vertically contiguous part of the image, each part being as square as possible.
  • the recording is also such that a macro-segment, i.e., data defining a contiguous image portion, is read out from each track at different quick-search speeds, the only difference being that the higher the quick-search speeds, the smaller the amount of data within a macro-segment and, therefore, the larger the number of macro-segments per displayed frame. Readout from storage for display purposes proceeds in the normal line-by-line scanning pattern. This recording scheme will now be discussed in greater detail with reference to FIGS. 5 and 6.
  • each basic segment contains sixty discrete cosine transform (DCT) encoded blocks of 8 ⁇ 8 pixels, all the blocks inside of the segment being adjacent blocks in the image.
  • Each basic segment contains luminance blocks, Y, associated with 4 block lines and 10 block columns, as well as the corresponding chrominance blocks (UV).
  • DCT discrete cosine transform
  • Y luminance blocks
  • UV chrominance blocks
  • the exact structure of the basic segments with respect to the number of pixels and the type of coding is not important to the present invention. Even a single block could be used.
  • the blocks can be encoded in a variable or fixed word-length format. The latter is used for convenience in the preferred embodiment.
  • variable word-length coding the block-length will tend to average out: alternatively, the number of bits per basic segment, or per sequence or sub-sequence can be fixed. A wide variety of embodiments will be readily apparent to one skilled in the art. However, a contiguous area of the image to be displayed is always represented in each basic segment.
  • the illustrated rectangle represents one frame of a received video signal.
  • the word "frame” as used herein can also include a field, since a field can be considered as a frame with lower resolution.
  • the image represented in the frame is first divided into three horizontal sections A, B, C. Each of these sections contains fifty-four basic segments. Reference to FIG. 5c shows that the fifty-four basic segments associated with each of the horizontal sections are recorded on respective track pairs, i.e., constitute a "sequence" as defined herein.
  • the order in which recording takes place is indicated by the numbering of the basic segments in FIG. 5b, i.e., it is carried out in a column-by-column basis, each column containing 6 vertically adjacent basic segments, constituting a "sub-sequence".
  • one-ninth of the frame constitutes a macro-segment at playback at two and a half times the recording speed.
  • one-ninth of the track namely, columns of six vertically adjacent basic segments, constitute a macro-segment, etc.
  • Playback speeds at which a non-integral number of basic segments per macro-segment would be required would not result in optimum picture quality. For example, at five times the recording speed, one-eighth of a track or one-eighth of fifty-four basic segments would constitute a macro-segment. This playback speed should preferably not be chosen even if it meets the N/p requirement specified above.
  • sequential frames are indicated by "fr 1", “fr 2", etc.
  • the track pairs associated with each frame namely, 1, 2 and 3.
  • the track areas from which usable information is read out when the playback speed is two and a half times the recording speed are indicated by horizontal lines and are numbered in the order of read-out.
  • FIG. 7 shows how the data read out from the indicated track areas is put together in memory to constitute the image.
  • Track area 1 of FIG. 6, for example, contains information corresponding to the left-most image portion of track a of FIG. 5b and, thus, the corresponding part of the image in FIG. 7.
  • the right-most portion of track 2 is read out, resulting in the filling in of the image portion labelled 2 in FIG. 7.
  • No portion of the third track of frame 1 can be read-out, the next available macro-segment being the middle portion of the first track of frame 2, which results in the addition of the image portion marked 3 in FIG. 7.
  • the readout continues until the middle area of track 2 of frame 5 is read-out. This completes the image by furnishing data required to reconstruct its central part.
  • FIG. 8 One embodiment of apparatus required to carry out the present invention is illustrated in FIG. 8.
  • a video camera 20 is provided.
  • the output of video camera 20 is applied to an analog-digital converter 22.
  • the digitized information at the output of analog-digital (A/D) converter 22 is stored in a memory 24 to allow formation of the 8 ⁇ 8 pixel blocks by use of address control AC.
  • the blocks are encoded by a discrete cosine transform (DCT) in a transform stage 26 as shown, e.g., in Europen Patent Application EP 0 286 184 filed Jun. 4, 1988 and published Dec. 10, 1988 corresponding to U.S. Pat. No. 4,881,192. Other codes could be used. In any event, data compression takes place.
  • DCT discrete cosine transform
  • the addresses and amplitudes constituting the DCT blocks are again stored, (M2, which may be part of M1) to allow readout as basic segments in the order required for recording the desired sub-sequences illustrated in FIGS. 5b and 5c on a tape 30 by a recording head 32.
  • the data on the tape is read out by a read head 34.
  • the speed at which the readout takes place is controlled by a speed control SC.
  • the data is applied to a third memory 36 in the consecutive order of basic segments indicated in FIGS. 5b and 5c. If the readout is at other than the recording speed, namely, at a higher search speed selected to assure that all image-bearing parts of the tape will be read, the data will be received in memory 36 as macro-segments shown in FIGS. 6 and 7.
  • the data is applied to a stage 38 to perform the inverse discrete cosine transformation.
  • the output of stage 38 is applied, possibly via a memory 40, to digital-to-analog (D/A) converter 42.
  • the output of D/A 42 is stored in a display memory 44, which is a full frame memory, the contents of which are displayed line-by-line on a display 46.

Abstract

A method and apparatus wherein video images are recorded on a plurality of tracks of a tape such that, for playback in a search mode at a speed higher than the recording speed, the displayed image will consist of a plurality of contiguous parts, some of the parts being read out from tracks each having a different frame recorded thereon.

Description

This is a continuation of application Ser. No. 08/581,882, filed Jan. 2, 1996, abandoned, which is a continuation of application Ser. No. 08/204,904. Filed Mar. 2, 1994, abandoned, which is a continuation of application Ser. No. 07/865,525, filed Apr. 9, 1992, abandoned.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention applies to video recorders and, specifically, to video recorders operative with playback at the recording speed and at least one other speed.
2. Description of the Related Art
The problem of creating adequate pictures or images from a video recording played back at the recording speed, and one or more higher speeds in a search mode has been addressed before. It is discussed in a publication entitled "Introduction to the 4:2:2 Digital Video Tape Recorder" by Stephen Gregory of the Sony Broadcasting Company, published by Pentech Press, London, 1988. Chapter 7 teaches a method of pixel-based shuffling for improving the robustness of the system and for recovering pictures in multispeed modes. Briefly, arrays are formed of pixels whose position has been scrambled. The position of the arrays is then scrambled, first within a field and subsequently over four consecutive fields.
This is a very complicated method and yields reasonable results at high speeds, but decreases the picture quality at the lower search speeds. Further, no data compression takes place.
SUMMARY OF THE INVENTION
It is an object of the present invention to furnish a method and system in which acceptable picture quality both at higher and lower search speeds is obtained, preferably in combination with data compression.
The present invention is a method of recording data defining a plurality of images on substantially parallel tracks of a recording medium at a recording speed, for playback at said recording speed and at least one additional speed. It comprises the steps of generating a plurality of basic segments for each of said images in response to received image data, each of said basic segments defining an incremental part of an image extending in a first direction and in a second direction transverse to said first direction.
The basic segments are recorded on the tracks as a plurality of sub-sequences each defining a first contiguous part of the image exceeding said incremental part in area. Sequentially recorded sub-sequences in turn define second contiguous parts of the image, greater than the first contiguous parts. All sub-sequences on one track together defining a third contiguous part of the image exceeding in area said second contiguous part constitute a sequence. The present invention also constitutes a method for generating display signals for display of an image. Bursts of data (macro-segments) are read from a recording medium at a selected speed exceeding the recording speed of the data. The recording medium has a plurality of tracks each having at least part of one of a plurality of sequential images recorded thereon. Each of the bursts of data comprises data defining a contiguous area of one of the images, while a plurality of bursts varying in number in correspondence to the ratio of the selected speed to the recording speed defines all parts of an image.
The data of the read-out bursts is stored in a memory until the plurality of bursts has been received, and then read from the memory in a sequence and at a rate suitable for display, thereby creating the display signals.
The present invention further constitutes a recording medium having a plurality of tracks, a plurality of images being recorded on the tracks, each of said tracks having a data sequence defining a first contiguous area of one of the images, said sequence comprising a plurality of sequentially recorded sub-sequences each defining a second contiguous area smaller than that first contiguous area, each of said sub-sequences comprising a plurality of sequentially recorded basic segments each defining a third area of said image, the plurality of third areas together constituting one of the second areas.
The present invention also constitutes an apparatus for recording video signals defining a plurality of images on a plurality of tracks of a recording medium for replay at the recording speed and at least one higher speed. Coding means are provided for encoding said video signals into basic segments each basic segment defining an incremental area of one of said images.
Memory means store a plurality of said basic segments, addressing means reading out a plurality of sub-sequences, each comprising basic segments defining contiguous parts of said image, from said memory means in a predetermined order, thereby furnishing read-out sub-sequences. Recording means record the read-out sub-sequences on tracks of the recording medium.
During playback at a speed exceeding the recording speed, only part of the data on each track will be read out. Of this, only a part will have a SNR sufficiently high for use in an error correcting code. This latter part is called a macro-segment herein.
The present invention also constitutes an apparatus for furnishing display signals in response to macro-segments of data read from a recording medium at a speed different from the recording speed. It comprises means for storing the macro-segments together constituting an image, and means for reading out the stored data in a sequence and at a rate suitable for application to display means.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention, its operation and further advantages thereof will be further clarified in the following description of preferred embodiments when taken in conjunction with the drawings, in which
FIG. 1a is a schematic diagram showing track pairs and head pairs in azimuth recording;
FIG. 1b is a diagram showing the variation of signal-to-noise ratio with head position in FIG. 1a;
FIG. 2 is a diagram illustrating the head vs. track movement at a plurality of speeds exceeding the recording speed;
FIG. 3 is a diagram illustrating a problem which arises for an unacceptable ratio of playback speed to recording speed;
FIG. 4 is a schematic diagram illustrating head vs. track movement at an acceptable speed higher than the recording speed;
FIG. 5a illustrates the composition of a basic segment;
FIG. 5b shows an image divided into macro-segments and basic segments;
FIG. 5c is a schematic diagram illustrating tape tracks having the segments of FIG. 5b recorded thereon;
FIG. 6 illustrates macro-segment bursts recoverable at 2.5 times the recording speed according to the system and method of the present invention;
FIG. 7 illustrates the corresponding reconstructed image; and
FIG. 8 is a block diagram of the recording and playback system according to the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
The problem to be solved by the present invention is to furnish a video recorder/playback system and method which yields the best possible images for playback at the recording speed as well as at higher speeds, during, for example, a search mode. The solution to this problem in accordance with the present invention will be analyzed based on a preferred embodiment in which azimuth recording is used, i.e., the information is recorded on neighboring tracks with opposite azimuth. This is illustrated in FIG. 1a where the two neighboring tracks are denoted by a and b, respectively, and information is recorded and read from the track pairs by a head pair A, B. As is well-known, the gap in head A is so oriented that it can only read information from the a track, while head B can read information only from the b track. In the preferred embodiment, it is also assumed that the width of the head is equal to the width of the track and that there are 6 tracks, i.e. 3 track pairs, per frame. The track pairs are numbered 1, 2, 3 etc. in FIG. 1a.
Again referring to FIG. 1a, the head pair AB will, during recording, and during playback at the recording speed, travel along the tracks so that the highest signal-to-noise ratio is always obtained. However, at a higher playback speed, the heads will not travel parallel to the tracks, but will take the paths illustrated in FIG. 1a by two solid lines, one for head B and one for head A. These paths involve the crossing of tracks and, therefore, a variation of the signal-to-noise ratio furnished by the heads as a function of position. This variation is illustrated in FIG. 1b with a solid line for head A and a dashed line for head B. For any particular application, there is a minimum value of the amplitude plotted in FIG. 1b (SNR) required to detect bits with an error rate that can be handled by the error correction coding system.
For a simplified model assuming perfect linear tracks and heads with an effective width equal to the track width, the direction of head motion as a function of the multiple of the recording speed at which playback occurs, is shown in FIG. 2. Also, as illustrated in FIG. 2, the head pair is preferably not in its recording or normal playback position at the start, but is located so that the center of head A coincides with 5 the edge of the track, i.e., in a position where the SNR is just sufficient to start data recovery. This change in relative position of head to tape takes place automatically, simultaneously with selection of a search mode by the user, and minimizes track crossings. With this positioning, no track crossings occur at twice the recording speed, one crossing occurs at 3 times the recording speed, etc. At a playback speed of p×v0, where p is the speed ratio and v0 the recording speed, each data burst is 1/(p-1) of a tracklength long. Since only a fraction f of a data burst can be used, the usable data part when track crossing is involved is f×1/(p-1) at a playback speed which is p times the recording speed. For f=1/2, the usable data is 1/[2(p-1)].
The macro-segments derived from sequential tracks are to be stored in memory, and subsequently read-out from memory for application to a video display system to recreate a whole image. As discussed above and illustrated in detail in FIGS. 3 and 4 for different playback speeds, only part of the information recorded on each track can be read out at such higher-than-recording (search) speeds. Therefore, even after all tracks associated with a given frame of the video signal have been scanned, some parts of the image (indicated by blank track portions in tracks 1-6 of frame n) are still missing. According to the invention, the corresponding parts of subsequently received frames, recorded on subsequent tracks, are to be used to fill in the missing parts. As is illustrated in FIG. 3, (for f=1), this cannot be accomplished when the playback speed is three times the recording speed. Only the first part of tracks 1 and 4 is read, while the middle part of tracks 2 and 5 and the last part of tracks 3 and 6 are read for all frames. The other parts of the tracks are never scanned. The reason for this is that p is an integral (sub)multiple of the number of tracks per frame: N/p=6/3=2. On the other hand, as illustrated in FIG. 4, at a playback speed which is five times the recording speed, all parts of each track will be read within five sequential frames. It is thus a requirement that any speed for quick search be such that neither N/P nor P/N is an integer.
According to the invention, data is recorded on the tape in such a way that each of the above-mentioned macro-segments defines a horizontally and/or vertically contiguous part of the image, each part being as square as possible. The recording is also such that a macro-segment, i.e., data defining a contiguous image portion, is read out from each track at different quick-search speeds, the only difference being that the higher the quick-search speeds, the smaller the amount of data within a macro-segment and, therefore, the larger the number of macro-segments per displayed frame. Readout from storage for display purposes proceeds in the normal line-by-line scanning pattern. This recording scheme will now be discussed in greater detail with reference to FIGS. 5 and 6.
Referring first to FIG. 5a, this illustrates the basic segments of which the image is constructed in a preferred embodiment. Each basic segment contains sixty discrete cosine transform (DCT) encoded blocks of 8×8 pixels, all the blocks inside of the segment being adjacent blocks in the image. Each basic segment contains luminance blocks, Y, associated with 4 block lines and 10 block columns, as well as the corresponding chrominance blocks (UV). The exact structure of the basic segments with respect to the number of pixels and the type of coding is not important to the present invention. Even a single block could be used. Also, the blocks can be encoded in a variable or fixed word-length format. The latter is used for convenience in the preferred embodiment. With variable word-length coding, the block-length will tend to average out: alternatively, the number of bits per basic segment, or per sequence or sub-sequence can be fixed. A wide variety of embodiments will be readily apparent to one skilled in the art. However, a contiguous area of the image to be displayed is always represented in each basic segment.
Referring now to FIG. 5b, the illustrated rectangle represents one frame of a received video signal. The word "frame" as used herein can also include a field, since a field can be considered as a frame with lower resolution. The image represented in the frame is first divided into three horizontal sections A, B, C. Each of these sections contains fifty-four basic segments. Reference to FIG. 5c shows that the fifty-four basic segments associated with each of the horizontal sections are recorded on respective track pairs, i.e., constitute a "sequence" as defined herein. The order in which recording takes place is indicated by the numbering of the basic segments in FIG. 5b, i.e., it is carried out in a column-by-column basis, each column containing 6 vertically adjacent basic segments, constituting a "sub-sequence".
Close examination of this type of block shuffling shows that, as discussed above, it yields macro-segments of adjacent blocks at a plurality of speeds exceeding the recording speed. Also, since the length of each basic segment exceeds its height, column-by-column recording results in macro-segments which are as square as possible.
As will be shown below with reference to FIGS. 6 and 7, one-third of a track and, therefore, for the given embodiment, one-ninth of the frame constitutes a macro-segment at playback at two and a half times the recording speed. At five and a half times the recording speed, one-ninth of the track, namely, columns of six vertically adjacent basic segments, constitute a macro-segment, etc. Playback speeds at which a non-integral number of basic segments per macro-segment would be required would not result in optimum picture quality. For example, at five times the recording speed, one-eighth of a track or one-eighth of fifty-four basic segments would constitute a macro-segment. This playback speed should preferably not be chosen even if it meets the N/p requirement specified above.
For a specific illustration of the reconstruction of the image from the macro-segments read from the tape at two and a half times the recording speed, reference is made to FIGS. 6 and 7. In FIG. 6, sequential frames are indicated by "fr 1", "fr 2", etc. Above the frame notation are the track pairs associated with each frame, namely, 1, 2 and 3. The track areas from which usable information is read out when the playback speed is two and a half times the recording speed, are indicated by horizontal lines and are numbered in the order of read-out.
FIG. 7 shows how the data read out from the indicated track areas is put together in memory to constitute the image. Track area 1 of FIG. 6, for example, contains information corresponding to the left-most image portion of track a of FIG. 5b and, thus, the corresponding part of the image in FIG. 7. Next, the right-most portion of track 2 is read out, resulting in the filling in of the image portion labelled 2 in FIG. 7. No portion of the third track of frame 1 can be read-out, the next available macro-segment being the middle portion of the first track of frame 2, which results in the addition of the image portion marked 3 in FIG. 7. The readout continues until the middle area of track 2 of frame 5 is read-out. This completes the image by furnishing data required to reconstruct its central part. While it is true that the parts of the image are not all derived from the same frame, this will make no difference if a still picture is concerned. If there is movement from frame to frame, the errors which are created are not visually too disturbing because the probability of motion occurring within a block which has both horizontal and vertical dimensions is quite high and the visually, particularly disturbing artefacts created by a constant error along a horizontal or vertical line extending all along the image are avoided.
One embodiment of apparatus required to carry out the present invention is illustrated in FIG. 8. For recording, a video camera 20 is provided. The output of video camera 20 is applied to an analog-digital converter 22. The digitized information at the output of analog-digital (A/D) converter 22 is stored in a memory 24 to allow formation of the 8×8 pixel blocks by use of address control AC. The blocks are encoded by a discrete cosine transform (DCT) in a transform stage 26 as shown, e.g., in Europen Patent Application EP 0 286 184 filed Jun. 4, 1988 and published Dec. 10, 1988 corresponding to U.S. Pat. No. 4,881,192. Other codes could be used. In any event, data compression takes place. The addresses and amplitudes constituting the DCT blocks are again stored, (M2, which may be part of M1) to allow readout as basic segments in the order required for recording the desired sub-sequences illustrated in FIGS. 5b and 5c on a tape 30 by a recording head 32.
For display, the data on the tape is read out by a read head 34. The speed at which the readout takes place is controlled by a speed control SC. When readout is taking place at the recording speed, the data is applied to a third memory 36 in the consecutive order of basic segments indicated in FIGS. 5b and 5c. If the readout is at other than the recording speed, namely, at a higher search speed selected to assure that all image-bearing parts of the tape will be read, the data will be received in memory 36 as macro-segments shown in FIGS. 6 and 7. The data is applied to a stage 38 to perform the inverse discrete cosine transformation. The output of stage 38 is applied, possibly via a memory 40, to digital-to-analog (D/A) converter 42. The output of D/A 42 is stored in a display memory 44, which is a full frame memory, the contents of which are displayed line-by-line on a display 46.
It should be noted that in above description, many items, such as modulators required before recording, demodulators required after readout, etc., have been omitted for the sake of clarity. Other components, such as the DCT coding stage, could be omitted or another type substituted. Memories can be combined or possibly omitted (e.g., memory 40). Basic segments may contain data from more than one frame, etc.
Thus, the present invention has been disclosed in a preferred embodiment, but other embodiments will readily occur to one skilled in the art and are intended to be encompassed in the following claims.

Claims (14)

We claim:
1. A method for recording digital data defining, on display, a plurality of images, on substantially parallel oblique tracks of a longitudinal record carrier at a recording speed, said method comprising the steps:
(a) generating blocks of coded data, each block including a plurality of pixels defining, on display, a rectangular area of one of said plurality of images;
(b) combining a plurality of blocks to form basic segments, each of said basic segments defining, on display, an incremental area of said one of said plurality of images; and
(c) recording sequences of said basic segments on respective tracks, each sequence being a plurality of sub-sequences of basic segments, each sub-sequence defining, on display, a first contiguous part of said one of said plurality of images consisting of a plurality of said incremental areas lined up along a first axis, all of the sub-sequences on a track together defining, on display, a second contiguous part composed of first contiguous parts of said one of said plurality of images lined up along a second axis orthogonal to the first axis.
2. A method as claimed in claim 1, wherein said recording is azimuth recording, and wherein in said step of recording, said sequences are recorded on track pairs.
3. A method as claimed in claim 2, wherein data defining, on display, each of said plurality of images is recorded on a plurality N of track pairs, each of said sequences having data defining, on display, 1/N of said image.
4. A method as claimed in claim 3, wherein N=3.
5. A method as claimed in claim 1, wherein each of said basic segments defines, on display, an area having a longer length along said second axis than along said first axis perpendicular to said second axis; and wherein said sub-sequences extend along said first axis.
6. A method as claimed in claim 5, wherein said second axis is in a horizontal direction and said first axis is in a vertical direction, and wherein said sub-sequences comprise columns of basic segments having data defining, on display, vertically adjacent image elements.
7. Method for generating display signals for display of an image in response to digital data read from a longitudinal record carrier having a plurality of oblique tracks, digital data for creating a plurality of images having been recorded on said tracks, each of said tracks having a sequence defining, on display, a first contiguous area of one of said plurality of images recorded thereon, said sequence comprising a plurality of sub-sequences each defining, on display, a second contiguous area of said one of said plurality of images, the second contiguous areas being lined up along a first axis, each of said sub-sequences comprising a plurality of basic segments each defining, on display, an incremental area of said one of said plurality of images, the incremental areas being lined up along a second axis orthogonal to said first axis, each basic segment consisting of blocks of coded data including a plurality of pixels defining, on display, a rectangular area of said one of said plurality of images, at a selected speed exceeding the recording speed, said method comprising the steps:
reading out portions of data from the tracks, each portion of data representing sequentially recorded sub-sequences defining, on display, a third contiguous area of one said plurality of images, said third contiguous area being greater than said first contiguous areas, all of the sub-sequences on a track together defining, on display, said second contiguous areas of said one of said plurality of images;
storing said portions of data in a read-out memory until sub-sequences defining, on display, a whole image have been stored; and
reading out image-defining data from said read-out memory in a sequence and at a rate suitable for display, thereby creating said display signals.
8. A method as claimed in claim 7, further comprising the step:
decoding said digital data before creating said display signals.
9. A method as claimed in claim 8, wherein the digital data forming each of the plurality of images on said longitudinal record carrier was recorded on a plurality N of said tracks, and in said method, said selected speed is a multiple p of said recording speed, and wherein p/N is not an integer.
10. Apparatus for recording digital data defining, on display, a plurality of images on substantially parallel oblique tracks of a longitudinal record carrier at a recording speed, said apparatus comprising:
(a) means for generating blocks of coded data, each block including a plurality of pixels defining, on display, a rectangular area of one of said plurality of images;
(b) means for combining a plurality of blocks to form basic segments, each of said basic segments defining, on display, an incremental area of said one of said plurality of images; and
(c) means for recording sequences of said basic segments on respective tracks, each sequence being a plurality of sub-sequences of basic segments, each sub-sequence defining, on display, a first contiguous part of said one of said plurality of images consisting of a plurality of said incremental areas lined up along a first axis, all of the sub-sequences on a track together defining, on display, a second contiguous part composed of first contiguous parts of said one of said plurality of images lined up along a second axis orthogonal to the first axis.
11. Apparatus as claimed in claim 10, wherein said means tor recording records the digital data forming each of said plurality of images on a plurality N of said tracks, and wherein a sequence of data, together defining, on display, a contiguous fraction 1/N of said image, is recorded on a track.
12. Apparatus as claimed in claim 11, wherein said sequence defines, on display, a rectangular image area extending over 1/N of the height of each of said plurality of images.
13. Apparatus for generating display signals for display of an image in response to digital data read from a longitudinal record carrier having a plurality of oblique tracks, digital data for creating a plurality of images having been recorded on said tracks, each of said tracks having a sequence defining, on display, a first contiguous area of one of said images recorded thereon, said sequence comprising a plurality of sub-sequences each defining, on display, a second contiguous area of said one of said images, the second contiguous areas being lined up along a first axis, each of said sub-sequences comprising a plurality of basic segments each defining, on display, an incremental area of said one of said images, the incremental areas being lined up along a second axis orthogonal to said first axis, each basic segment consisting of blocks of coded data including a plurality of pixels defining, on display, a rectangular area of said one of said plurality of images, at a selected speed exceeding the recording speed, said apparatus comprising:
reading means for reading out portions of data from the tracks, each of said portions of data representing sequentially recorded sub-sequences defining, on display, a third contiguous area of one of said plurality of images, said third contiguous area being greater than said first contiguous areas, all of the sub-sequences on a track together defining, on display, a second contiguous area of said one of said plurality of images;
storing means for storing said portions of data in a read-out memory until sub-sequences defining a whole image have been received; and
means for reading out image-defining data from said read-out memory in a sequence and at a rate suitable for display, thereby creating said display signals.
14. Apparatus as claimed in claim 13, wherein on said longitudinal record carrier, the digital data forming each of said images was recorded in a plurality N of said tracks, wherein in said apparatus, said selected speed is a multiple p of said recording speed, and wherein p/N is not an integer.
US08/734,712 1991-04-18 1996-10-21 System and method for improving video recorder performance in a search mode Expired - Fee Related US6072935A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US08/734,712 US6072935A (en) 1991-04-18 1996-10-21 System and method for improving video recorder performance in a search mode
US09/442,958 US6167191A (en) 1991-04-18 1999-11-18 System and method for improving video recorder performance in a search mode
US09/575,974 US6339671B1 (en) 1991-04-18 2000-05-23 System and method for improving video recorder performance in a search mode

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
EP91200919 1991-04-18
EP91200919 1991-04-18
US86552592A 1992-04-09 1992-04-09
US20490494A 1994-03-02 1994-03-02
US58188296A 1996-01-02 1996-01-02
US08/734,712 US6072935A (en) 1991-04-18 1996-10-21 System and method for improving video recorder performance in a search mode

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US53188296A Continuation 1991-04-18 1996-01-02
US58188296A Continuation 1991-04-18 1996-01-02

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US09/442,958 Continuation US6167191A (en) 1991-04-18 1999-11-18 System and method for improving video recorder performance in a search mode
US09/575,974 Division US6339671B1 (en) 1991-04-18 2000-05-23 System and method for improving video recorder performance in a search mode

Publications (1)

Publication Number Publication Date
US6072935A true US6072935A (en) 2000-06-06

Family

ID=8207617

Family Applications (3)

Application Number Title Priority Date Filing Date
US08/734,712 Expired - Fee Related US6072935A (en) 1991-04-18 1996-10-21 System and method for improving video recorder performance in a search mode
US09/442,958 Expired - Lifetime US6167191A (en) 1991-04-18 1999-11-18 System and method for improving video recorder performance in a search mode
US09/575,974 Expired - Lifetime US6339671B1 (en) 1991-04-18 2000-05-23 System and method for improving video recorder performance in a search mode

Family Applications After (2)

Application Number Title Priority Date Filing Date
US09/442,958 Expired - Lifetime US6167191A (en) 1991-04-18 1999-11-18 System and method for improving video recorder performance in a search mode
US09/575,974 Expired - Lifetime US6339671B1 (en) 1991-04-18 2000-05-23 System and method for improving video recorder performance in a search mode

Country Status (3)

Country Link
US (3) US6072935A (en)
JP (2) JP3162166B2 (en)
DE (1) DE69222801T2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6339671B1 (en) * 1991-04-18 2002-01-15 U.S. Philips Corporation System and method for improving video recorder performance in a search mode
US20040050272A1 (en) * 2001-03-22 2004-03-18 Heidelberger Druckmaschinen Ag Method and device for driving a printing press
US20040070594A1 (en) * 1997-07-12 2004-04-15 Burke Trevor John Method and apparatus for programme generation and classification
US20050039177A1 (en) * 1997-07-12 2005-02-17 Trevor Burke Technology Limited Method and apparatus for programme generation and presentation
US20050144652A1 (en) * 1997-07-12 2005-06-30 Burke Trevor J. Method and apparatus for generating a programme
US20050204294A1 (en) * 2004-03-10 2005-09-15 Trevor Burke Technology Limited Distribution of video data
US20050289151A1 (en) * 2002-10-31 2005-12-29 Trevor Burker Technology Limited Method and apparatus for programme generation and classification

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3318699B2 (en) * 1994-10-31 2002-08-26 ソニー株式会社 Digital signal receiving system
KR100370249B1 (en) * 2000-08-19 2003-01-29 엘지전자 주식회사 A system for video skimming using shot segmentation information

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4809118A (en) * 1978-07-19 1989-02-28 Nippon Hoso Kyokai PCM helical-scan magnetic record/playback systems
US4881192A (en) * 1987-04-10 1989-11-14 U.S. Philips Corporation One-dimensional linear picture transformer
US5130861A (en) * 1989-06-16 1992-07-14 Sony Corporation Method and apparatus for reproducing a digital video signal
US5136391A (en) * 1988-11-02 1992-08-04 Sanyo Electric Co., Ltd. Digital video tape recorder capable of accurate image reproduction during high speed tape motion
US5175631A (en) * 1990-08-13 1992-12-29 Matsushita Electric Industrial Co., Ltd. Apparatus for recording and reproducing a digital video signal in the form of order-rearranged and coded data

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69222801T2 (en) * 1991-04-18 1998-04-02 Koninkl Philips Electronics Nv System and method for improving the search mode in a video recorder

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4809118A (en) * 1978-07-19 1989-02-28 Nippon Hoso Kyokai PCM helical-scan magnetic record/playback systems
US4881192A (en) * 1987-04-10 1989-11-14 U.S. Philips Corporation One-dimensional linear picture transformer
US5136391A (en) * 1988-11-02 1992-08-04 Sanyo Electric Co., Ltd. Digital video tape recorder capable of accurate image reproduction during high speed tape motion
US5130861A (en) * 1989-06-16 1992-07-14 Sony Corporation Method and apparatus for reproducing a digital video signal
US5175631A (en) * 1990-08-13 1992-12-29 Matsushita Electric Industrial Co., Ltd. Apparatus for recording and reproducing a digital video signal in the form of order-rearranged and coded data

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6339671B1 (en) * 1991-04-18 2002-01-15 U.S. Philips Corporation System and method for improving video recorder performance in a search mode
US20040070594A1 (en) * 1997-07-12 2004-04-15 Burke Trevor John Method and apparatus for programme generation and classification
US20050039177A1 (en) * 1997-07-12 2005-02-17 Trevor Burke Technology Limited Method and apparatus for programme generation and presentation
US20050144652A1 (en) * 1997-07-12 2005-06-30 Burke Trevor J. Method and apparatus for generating a programme
US20040050272A1 (en) * 2001-03-22 2004-03-18 Heidelberger Druckmaschinen Ag Method and device for driving a printing press
US6796239B2 (en) * 2001-03-22 2004-09-28 Heidelberger Druckmaschinen Ag Method and device for driving a printing press
US6810809B2 (en) * 2001-03-22 2004-11-02 Heidelberger Druckmaschinen Ag Method and device for driving a printing press
US20050289151A1 (en) * 2002-10-31 2005-12-29 Trevor Burker Technology Limited Method and apparatus for programme generation and classification
US20050204294A1 (en) * 2004-03-10 2005-09-15 Trevor Burke Technology Limited Distribution of video data
US7882436B2 (en) 2004-03-10 2011-02-01 Trevor Burke Technology Limited Distribution of video data

Also Published As

Publication number Publication date
JP3162166B2 (en) 2001-04-25
DE69222801T2 (en) 1998-04-02
JP3355182B2 (en) 2002-12-09
DE69222801D1 (en) 1997-11-27
US6339671B1 (en) 2002-01-15
JPH05183871A (en) 1993-07-23
JP2001218167A (en) 2001-08-10
US6167191A (en) 2000-12-26

Similar Documents

Publication Publication Date Title
EP0509594B1 (en) System and method for improving video recorder performance in a search mode
KR900007470B1 (en) The method of recording video signal and apparatus for video signal
KR950003638B1 (en) Error detection/correction code decording system
KR940005204B1 (en) Video data recording and reproducing method
US6072935A (en) System and method for improving video recorder performance in a search mode
US5432613A (en) Image data processing apparatus and method for processing image data
JPH02121584A (en) Video signal recorder
US5583651A (en) Method of and system for transmitting and receiving digitally encoded video images
KR930018556A (en) Digital recording and playback device for video signals
US4554597A (en) Memory utilization control system for compressed digital picture data transmission system
JPH05274841A (en) Information recording device
US4633329A (en) Information signal recording medium and reproducing apparatus therefor
US4587558A (en) Address signal generating circuit for a memory circuit
US5045955A (en) Digital data recording and reproducing apparatus for recording and producing an image on and from a video tape through matrix conversion
JP2505807B2 (en) Digital signal recorder
KR100250235B1 (en) Data recording method
US5208677A (en) Video signal reproducing apparatus
JP3207739B2 (en) Image playback device
KR960005399B1 (en) Video recorder providing for slant track recording
US5519547A (en) Magnetic recording and reproducing apparatus recording and reproducing plural types of data signals at different data rates
JP3106479B2 (en) Digital component signal recording apparatus and recording method
JPH0321988B2 (en)
JPH0783275B2 (en) Error correction code decoding device
JP3496885B2 (en) Digital video signal recording device
JPS63308770A (en) Digital signal recordor

Legal Events

Date Code Title Description
FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20120606