WO1994028527A1 - Image storage system for vehicle identification - Google Patents

Image storage system for vehicle identification Download PDF

Info

Publication number
WO1994028527A1
WO1994028527A1 PCT/AU1994/000260 AU9400260W WO9428527A1 WO 1994028527 A1 WO1994028527 A1 WO 1994028527A1 AU 9400260 W AU9400260 W AU 9400260W WO 9428527 A1 WO9428527 A1 WO 9428527A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
sensor
data representing
pin
signal
Prior art date
Application number
PCT/AU1994/000260
Other languages
French (fr)
Inventor
Roy William Lock
John Stanley Dods
Original Assignee
Locktronic Systems Pty. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Locktronic Systems Pty. Ltd. filed Critical Locktronic Systems Pty. Ltd.
Priority to CA002163424A priority Critical patent/CA2163424C/en
Priority to AT94916083T priority patent/ATE189551T1/en
Priority to AU67890/94A priority patent/AU694731B2/en
Priority to DK94916083T priority patent/DK0700559T3/en
Priority to EP94916083A priority patent/EP0700559B1/en
Priority to JP50000995A priority patent/JP3410470B2/en
Priority to DE69422918T priority patent/DE69422918T2/en
Publication of WO1994028527A1 publication Critical patent/WO1994028527A1/en
Priority to HK98114195A priority patent/HK1013157A1/en
Priority to GR20000401040T priority patent/GR3033355T3/en

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/052Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed
    • G08G1/054Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed photographing overspeeding vehicles
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/04Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors

Definitions

  • the present invention relates to an image storage system.
  • the present invention relates to an image storage system suitable for use in connection with devices for detecting/recording overspeeding vehicles known generically as "speed cameras". Nevertheless, it is to be appreciated that it is not thereby limited to such applications.
  • Prior art devices used for detecting/recording vehicles which exceed speed limits are based on conventional photographic techniques using films coated with light sensitive emulsions which must be exposed, developed and stored in film or hard copy format. This is not only a costly procedure but creates bulky records in the form of rolls of exposed film which are cumbersome to store and handle. Because a typical roll of film may contain hundreds of traffic infringements or violations, access to a specific infringement or violation in such a roll of film is a time consuming exercise.
  • the image of a vehicle from which the license plate can be read and which shows the mandatory surrounding roadway and vehicles needs to have a relatively high resolution or definition.
  • the image typically needs to be made up of at least about 1.4 million picture elements or pixels, each able to represent one of about 64 shades of grey.
  • a file generated from such an image occupies over 1.4M Bytes of storage space.
  • state of the art file compression techniques can reduce this by up to 60% (570 K Bytes), the processing time involved reduces the overall operating speed considerably.
  • An object of the present invention is to provide an image storage system which at least alleviates the disadvantage of the prior art.
  • the system of the present invention may reduce the size of an uncompressed file or record by a factor of at least 10 or more, yet still provide similar resolution or definition in a relevant area or portion of the record.
  • the system of the present invention may achieve a reduction in file or record size by capturing two images of a vehicle to be recorded, each having a relatively low resolution.
  • One image may be captured using a relatively long focal length or telephoto lens.
  • the telephoto image of the vehicle may show relatively fine or detailed features such as a vehicle license plate, vehicle make and model and in some cases facial features of the occupants.
  • a further image may be captured using a relatively wide angle lens.
  • the wide angle image may show relatively coarse or less detailed features such as the infringing vehicle in relation to the surrounding roadway and other vehicles. The infringing vehicle may still be clearly recognizable in the wide angle image.
  • the two images may be captured via at least one image sensitive device or sensor such as a CCD (charge coupled device) array or vidicon tube.
  • the or each image sensor may have relatively low resolution or definiton. Nevertheless, higher resolution or definition image sensors may be used since it is always possible to reduce resolution or definition by discarding superfluous or unwanted image data prior to recording the data.
  • the or each image sensor may be capable of generating data representing an image containing at least about 50,000 picture elements or pixels, with each element or pixel being able to represent one of about 64 shades of grey.
  • a record or file generated from such data may occupy no more than about 50 KBytes of storage space.
  • the record or file representing two such images for each vehicle infringement may occupy about 100 K Bytes of storage space whilst still containing relevant infringement data. This is less than one tenth of the size of a comparable single picture system without compression techniques.
  • apparatus for use with an image storage system, said apparatus including at least one sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing at least relatively coarse features in said first image; means for applying a second image comprising an enlarged portion of said first image to said at least one sensor for generating second data representing at least relatively fine features in said first image, said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level, whereby reducing the quantity of said data for storage purposes.
  • an image storage system including: at least one image sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing at least relatively coarse features in said first image; means for applying a second image including an enlarged portion of said first image to said at least one sensor for generating second data representing at least relatively fine features in said first image; said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level; and means for storing said data.
  • the means for applying the first image may comprise a wide angle lens having a focal length of approximately 50mm.
  • the means for applying the second image may comprise a telephoto lens having a focal length of approximately 210 mm.
  • the two lenses may be associated with a single image sensor.
  • the image sensor may be fixed and the lenses may be movable or the lenses may be fixed and the sensor may be movable.
  • a single zoom lens eg. 50-210mm
  • each lens is associated with a respective image sensor.
  • the address lines of the respective image sensors may be driven in parallel via common driving circuits.
  • the apparatus may include a self contained board video camera. Two image sensors may be used with a single board video camera. The horizontal and vertical address lines of each image sensor may be driven in parallel via the board video camera.
  • the first and second images may be generated simultaneously or sequentially. Where the first and second images are generated sequentially, means such as a video switch or the like may be used to switch between the outputs of the respective image sensors.
  • the respective outputs may be processed in the usual way via the board video camera to provide a composite video or luminance signal at its output.
  • the composite video or luminance output signal may be connected to a frame grabber circuit.
  • the frame grabber circuit may include a memory.
  • the frame grabber circuit may also include an analog to digital converter.
  • the frame grabber circuit may be adapted to store one field (odd or even) from the composite video or luminance signal. Where the resolution of the composite or luminance video signal is greater than about 100,000 picture elements or pixels per frame (2 fields), the frame grabber circuit may be arranged to limit the quantity of data stored from each field such that the resolution of the stored field is limited to about 50,000 picture elements or pixels. This may ensure that the size or volume of the record or file for each field is of a manageable size.
  • the frame grabber circuit preferably is adapted to store the composite video signal in monochrome (luminance) to minimize the quantity of data stored from each field.
  • the frame grabber circuit may store a sample of the first and/or second image in color (luminance plus chrominance) .
  • the color sample may be taken from a relatively small relevant portion or area of the first and/or second image, such as a portion showing the color of an infringing vehicle, and this may be stored together with the monochrome image.
  • the portion or area from which the color was sampled may appear in true color against a monochrome background.
  • This technique may provide additional means of vehicle identification with minimum increase in image file size.
  • a change from monochrome to colour usually results in a threefold increase in file size with proportional decrease in overall operating speed.
  • the increase in file size is limited to the sampled area. Thus if the sampled area is 1% of the overall image area a 2% increase in overall file size can be expected.
  • the frame grabber circuit may transfer its data to any suitable storage medium such as a computer hard disk, static RAM or the like.
  • the data may be transferred to storage medium with other infringement related information such as details of location, user ID, speed zone together with infringing vehicle speed, distance, time and date etc.
  • the associated computer may be programmed to control operation of the apparatus of the present invention. Alternatively a dedicated microprocessor based controller may be used.
  • the apparatus may be triggered via any suitable speed/distance measuring device such as a radar based speed detector or preferably a laser based speed detector such as a model LTI 20-20 manufactured by Laser Technology Inc. of Englewood, Colorado USA.
  • the speed detecting/recording apparatus may be stationary relative to the roadway or it may be mounted in a moving patrol vehicle. Where the apparatus is mounted in a moving patrol vehicle means such as a summer device may be provided to determine absolute speed of a target vehicle from the relative speed of that vehicle and the patrol vehicle. The relative speed of the target vehicle may be determined by a speed detector mounted in the patrol vehicle. The speed of the patrol vehicle may be determined via a speedometer or tachometer in the patrol vehicle.
  • FIG. 1 shows a block diagram of a speed camera incorporating an image storage system according to one embodiment of the present invention
  • Fig. 2 shows a block diagram of the interface and logic control module
  • Fig. 3 shows a schematic diagram of one embodiment of the present invention
  • Fig. 4 shows a lens iris drive circuit associated with the embodiment of Fig. 3;
  • Fig. 5 shows a block diagram of a speed camera incorporating an imaging storage system according to a further embodiment of the present invention
  • Fig. 6 shows a flow chart of one form of operation program which is employed for controlling an image storage system
  • Fig. 7 shows a schematic diagram of a further embodiment of the present invention
  • Fig. 8 shows a schematic diagram of a logic module included in Fig. 7;
  • Fig. 9 shows a lens iris drive circuit associated with the embodiment of Fig. 7.
  • the system includes a wide angle lens 10 and associated CCD image sensor 11.
  • Lens 10 comprises a 50mm galvanometer type auto - iris device such as a COSMICAR type MCA5018APC.
  • Auto exposure interface 13 amplifies and buffers signals from sensor 11 and supplies them to the galvanometer type auto iris associated with lens 10.
  • the system includes a telephoto lens 14 and associated CCD image sensor 15.
  • the output (C) from image sensor 15 is connected to a second input of analog video switch 12 and to an automatic exposure interface 16. Since compact telephoto type auto-iris lenses are not readily available, this was developed by modifying a 210mm focal length compact zoom lens (Sigma type) designed for a
  • the lens preferably is suitable for use in the infrared region for night time operation.
  • the zoom lens may be fixed at maximum focal length and the iris detent spring and ball associated with the ring removed.
  • a ring gear may be fitted to the iris ring and the lens fitted to an adapter to allow mounting of CCD sensor 15.
  • the adapter may also include a mounting for a DC micro-servo motor (Minimotor SA type 1016) which may drive the lens iris ring via a small spur gear.
  • Interface 16 may be adapted to sample a horizontal scan line, from image sensor 15 eg. about half way down the image. This sample may be converted to a suitable level and applied to drive the auto iris servo motor associated with telephoto lens 14. This arrangement may provide closed loop feedback to automatically control exposure of image sensor 15.
  • the system includes a self contained video camera module 17 such as a TMC-7 series CCD board camera manufactured by PULNIX.
  • Video camera module 17 includes horizontal and vertical driving circuits for CCD sensors 11 and 15, timing and synch generators and a video amplifier for producing a composite video output signal (B) .
  • Camera module 17 may also include an auto iris control output for use with standard type auto iris lenses.
  • CCD sensors 11 and 15 are connected to the horizontal and vertical driving circuits on camera module 17 in parallel.
  • Video switch 12 is adapted to alternately connect the output (D) of sensor 11 or output (C) of sensor 15 to the CCD sensor input (E) of camera module 17 under control of interface and logic control module 18. The latter is described in more detail with reference to Fig. 2.
  • the composite video output signal (B) is connected to interface and logic control module 18 and to frame grabber 19 associated with an IBM compatible personal computer (PC) 20.
  • Frame grabber 19 may comprise a PC frame grabber card such as a FG 302 TV frame grabber PCB. Frame grabber 19 may occupy a single slot in PC 20. Its function is to digitize and store one field of a monochrome or color TV signal with (approximately) 256 x 256 pixel resolution (7 bits grey scale resolution per pixel) and to transfer the image data to the computer memory (RAM) in a sequence of DMA cycles.
  • a TV monitor output of the stored image is not provided on the FG 302. However images may be displayed on a monitor (eg. LCD) associated with PC 20.
  • the system is triggered via a trigger device 21 such as a laser based speed detector (eg. LTI 20-20) connected to PC 20 via an RS 232 port 22.
  • a trigger device 21 such as a laser based speed detector (eg. LTI 20-20) connected to PC 20 via an RS 232 port 22.
  • interface and logic control module 18 comprises a synch separator 23 such as an LM 1881.
  • Synch separator 23 receives at its input a composite video signal (B) from camera module 17 and provides at its output an odd/even field signal having a falling edge at the end of an odd field and a rising edge at the end of an even field. The odd/even field signal is connected to one input of RS bistable latch 24.
  • Synch separator 23 also provides at its output a vertical synch pulse (K) to auto exposure interface 16.
  • a control signal (A) to latch 24 is provided from RS 232 port 22 of PC 20.
  • the Q and Q outputs of latch 24 are adapted to control the position of analog video switch 12 which alternately switches the signal (C) from sensor 15 or the signal (D) from sensor 11 to the CCD input (E) of camera module 17.
  • control signal (A) from PC 20 is connected to one input of latch 41A and B (4011) via diode D3 and resistor Rl.
  • Control signal (A) switches latch 41A and B causing a change in output signals (H and J) to video multiplexer switch IC6A and C (4066).
  • This causes the input signal (E) to camera module 17 to change from, say, output (D) from wide angle sensor 11 to output (C) from telephoto sensor 15.
  • Lines (C) , (D) and (E) are single lines. All other lines between sensors 11, 15 and camera module 17 are connected in parallel.
  • Control signal (A) also instructs frame grabber 19 to store the next odd field from composite input signal (B) .
  • PC 20 carries out a Direct Memory Access (DMA) transfer of image data from frame grabber 19 to Random Access Memory (RAM) .
  • DMA Direct Memory Access
  • a further control signal (A) returns video multiplexer switch IC 6A and C to its previous state causing the output (D) from wide angle sensor 11 to be connected to the input (E) to camera module 17.
  • Control signal (A) again instructs frame grabber 19 to store the next odd field.
  • Image data from wide angle sensor 11 is again transferred to RAM via DMA. Details of location, user ID and speed zone are entered into PC 20 during set-up and this data, together with the infringing vehicle speed, distance, time and date may be embedded into a single file with the two images of an infringing vehicle. This complete file, occupying about 102 KBytes is stored on the hard disk of PC 20.
  • Auto exposure interface 13 comprises a converter/driver made up of transistor Ml, resistors R7, R8, Rll and R13 and capacitors C6, C8 and C16.
  • An output (D) from wide angle sensor 11 is applied to the base of transistor Ml via capacitor C16 and resistor Rll.
  • the output (F) of the converter/driver is available at capacitor C8 and is applied to the auto iris drive of wide angle lens 10.
  • Night time operation may be enabled by a 2mS duration signal from monostable IC3A (4528) which is synchronized to the effective camera "shutter open" period via latch 41A and B.
  • This signal may be transmitted to a large array of infra-red diodes placed at a distance at which the speed detector or trigger (eg. LT1 20/20) is set to operate.
  • the speed detector or trigger eg. LT1 20/20
  • the infra-red filter normally fitted to the CCD camera may be removed.
  • the depth of field of the lenses preferably are arranged to produce well focused images in the range 60-100m.
  • the speed detector/trigger may be placed in automatic mode where a target vehicle distance falls within a defined window before a reading is taken. This distance may be chosen to be optimum for lens focus and infra-red illumination and may be adjustable.
  • frame grabber 19 stores a frame from output (C) from telephoto image sensor 15 before it stores a frame from output (D) from wide angle image sensor 11.
  • an output (C) from telephoto sensor 15 is routed via diode D6 to DC amplifier IC5 (LM108) .
  • the output from DC amplifier IC5 is applied to the input of sample and hold amplifier IC6 (LF 398) .
  • the command to sample is obtained from sample time monostable IC4B (4528) set to 52 ⁇ S (duration of one line).
  • Monostable IC4B is triggered via monostable IC4A (4528) approximately lOmS (duration of half a frame) after each vertical sync pulse provided by sync separator IC2 (LM1881) (refer Fig. 3).
  • the sample voltage is then proportional to the brightness of a single horizontal scan line approximately half way down a field. Samples representing lines or parts of lines elsewhere in a field may be chosen by changing the timing of monostables IC4A and/or IC4B.
  • the sample voltage is applied to servo amplifier IC7 (L272M) comprising dual power op amps which drive the auto iris servo associated with telephoto lens 14.
  • the iris servo is isolated from low out-of-range signals by means of microswitch SI, mounted on the lens body.
  • Steering diodes D4 and D5 provide individual direction control.
  • actuation of the trigger device eg. laser speed-gun
  • produces an output passes via interfaces 50, 51 to an associated computer (not shown) and is examined by an operation program (refer Fig. 6) stored in the computer.
  • the program examines the output of the trigger device and decides whether the data is valid according to criteria of the trigger device.
  • the program compares the captured speed of a target vehicle with a pre-set limit. If this has been exceeded a high state signal is sent from the computer to logic module 52 via interface 51.
  • Logic module 52 controls, inter alia, switching to camera module 57, outputs (CCD OUT) from CCD sensor 53 associated wide angle lens 54, and from CCD sensor 55 associated with telephoto lens 56, respectively.
  • the high state signal instructs logic module 52 to switch to camera module 57 the output from telephoto sensor 55.
  • the operation program then instructs the computer to store image data from telephoto sensor 55.
  • a low state signal is then sent from the computer to logic module 52.
  • the low state signal instructs logic module 52 to switch to camera module 57 the output from wide angle sensor 53.
  • the operation program then instructs the computer to store image data from wide angle sensor 53.
  • the image data is then transferred into memory, a unique file name is created and time, date, vehicle speed and distance are appended to the file which is then stored onto hard disk.
  • the computer is then ready to accept a new infringement.
  • Logic module 52 also controls an auto iris servo motor (not shown) associated with wide angle lens 54, and via drive signals applied to iris module 58, controls auto iris servo motor 59 associated with telephoto lens 56.
  • horizonal and vertical drive between camera module 57 and sensors 53, 55 (H & V drive) is shown as a single line, it represents 12 horizonal and vertical lines.
  • the electronic shutter speed of camera module 57 is fixed internally to 1/500 sec.
  • Camera module 57 provides both a composite color output and a Y/C (luminance/chrominance) output.
  • the luminance output is fed to a frame grabber associated with the computer via interface 51.
  • the luminance output is preferred since encoded color information substantially degrades a monochrome image.
  • the "Y" signal also contains all of the synchronizing signals necessary to drive various parts in the circuit.
  • a composite color signal is provided as an output to the system to assist in setting up and for continuous monitoring of the video signal if required. Images so produced appear as normal color video. As a violation or infringement is recorded, the output switches from the wide angle lens to the telephoto lens for two frames and then back again, providing a useful video tape back up if required.
  • a high level signal sent from the associated computer is routed to the circuit via port J7.
  • Possible voltage spikes are limited via zener diode Zl, while resistor Rl limits current flow into Zl and resistor R2 provides a DC current path to ground from input pin 4 of IC2 which comprises a programmable logic device (PLD) such as an EP910J.
  • PLD programmable logic device
  • FIG. 8 which shows the circuit embedded in PLD IC2, input pin 4 is applied to macrocell ICZ2 which has no function save to transmit identical signals from input to output. This signal is additionally routed via macrocell ICZ3 to output pin 11.
  • the output from pin 11 of IC2 is fed to the bases of NPN transistors Nl, N2 via resistors R18, R19 respectively, which serve to limit base current.
  • Relays R16, R17 form the collector loads for transistor Nl, N2 respectively while diodes D7, D8 clip any reverse voltage spikes caused by the inductance of relay coils associated with relays R16, R17.
  • Relays R16, R17 switch port J5 associated with the input to camera module 57 (Fig. 5), between port J4 associated with the output of telephoto CCD sensor 55, and port J6 associated with the output of wide angle CCD sensor 53.
  • Resistors R3 and R4 provide impedance matching for CCD sensors 55 and 53 respectively.
  • Relays R16, R17 each comprises a double pole relay to optimize isolation between signals from the wide angle and telephoto sensors 55, 53 respectively.
  • Capacitors C5 and C6 minimize cross talk between the outputs of the respective sensors while resistor R5 provides a suitable input impedance to camera module 57.
  • both transistors Nl, N2 are turned off, neither relay R16, R7 is energized and the output from wide angle sensor 53 is routed from port J6 through a normally closed contact associated with pin 4 of relay R17 across a moving contact set from pins 2 to 7 of relay R17 and out on pin 5 of relay R17 where it is routed to the input of camera module 57 via port J5.
  • Capacitor C6 has a negligible effect on the video signal.
  • Signals from telephoto sensor 55 are routed from port J4 via pin 3 to pin 2 of relay R16. Radiation of this signal is minimized via capacitor C6.
  • the computer outputs a signal via port J7 to change from telephoto sensor 55 to wide angle sensor 53, a high level signal is applied to the bases of transistors Nl, N2. This causes the collector currents so produced to energize both relays R16, R17.
  • the signal produced by telephoto sensor 55 is routed via port J4, then transferred from pin
  • the computer then instructs the frame grabber to freeze a frame taken via telephoto sensor 55. This is followed by a command to transfer the contents of this stored frame into memory. On completion of this action the computer issues a further signal via port J7 to change the signal path to the original route. Port J7 is pulled low by the computer allowing both transistors Nl, N2 to be turned off. Both relays R16, R17 are released. The signal from telephoto sensor 55 via port J4 is transferred from pin 3 of relay R16 to pin 2 disconnecting it from the input of camera module 57. The signal from wide angle sensor 53 is connected to pin 4 of relay R17 and via pin 2 to pin 7 then to pin 5 of relay R17 and to port J5.
  • the computer waits for the next odd field, then issues a further signal to the frame grabber to freeze the second image taken via wide angle sensor 53.
  • This image data is transferred into memory, a unique file name is created and time, date, vehicle speed and distance one appended to the file which is then stored onto hard disk.
  • the computer is then ready to accept a new infringement.
  • Automatic aperture control of the wide angle lens auto iris is provided by the signal from wide angle sensor 53 via port J6.
  • Capacitor Cl excludes unwanted lower frequencies from the signal while resistors R6, R7 form a voltage divider to suitably proportion the signal.
  • Capacitor C2 prevents dc interaction between the base of transistor Tl and the incoming signal.
  • Resistors R8, R9 provide a collector load and appropriate forward bias for transistor Tl.
  • the dc component of the amplified signal is filtered via capacitor C3 and the resulting signal is applied to drive the wide angle auto iris via port J2.
  • Electrolytic capacitor El provides decoupling of the power supply line.
  • Automatic aperture control of the auto iris associated with the telephoto lens is provided by means of a separate sampling circuit.
  • Composite video signals are fed to port J8 from camera module 57.
  • the composite video signals are applied to pin 2 of synch separator IC5 (LM 1881) via dc blocking capacitor CIO.
  • IC5 When provided with composite video signals, IC5 provides outputs of odd/even fields at pin 7, vertical synch at pin 3, horizontal synch at pin 15 and composite synch which is not used in this application.
  • Capacitor C9 and resistor R28 provide the correct time constant for the internal frame integrator of IC5.
  • a negative going vertical synch pulse from pin 3 of IC5 is applied to pin 3 of PLD IC2, while horizontal synch pulses from pin 5 of IC5 are applied to pin 19 of IC2.
  • input pin 3 is applied to pin 1 of two input NAND latch IC1A.
  • this high level is output from ICG for the 64 ⁇ S duration of horizontal line 159 via macrocell ICK2 to output pin 12 of IC2.
  • Counters ICB and ICC continue counting until a count of 255 is reached when the ripple-carry out (RCO) pin 15 of ICC goes high.
  • This signal is inverted via ICD and applied to pin 2 of IC1A which sets pin 3 low and prevents clock pulses from reaching counters ICB and ICC thus leaving the counters in this state.
  • This provides timing for a sample signal from a horizontal line approximately half way down the image. Referring to Fig. 7, this sample signal is outputted on pin 12 of IC2 via diode D6 to pin 2 of port Jl. Diode D6 prevents accidental voltages appearing at pin 2 of port Jl from destroying IC2. Resistor R15 provides some degree of static protection for pin 12 of IC2 when left disconnected for servicing.
  • the sample signal so generated is fed from pin 2 of port Jl to pin 8 of IC2 (LF 398), a sample and hold amplifier.
  • IC2 LF 398
  • sample and hold amplifier IC2 to take a sample of the voltage produced by telephoto sensor 55 which is a close approximation of the average light level across the entire 159th horizontal line.
  • the analog input to pin 3 of sample and hold amplifier IC2 is provided from telephoto sensor 55 via pin 3 of port Jl and is scaled to an appropriate level by a voltage divider comprising resistors R12, R13.
  • the same signal is applied to pin 3 of ICl (LF 398), a second sample and hold amplifier.
  • the logic input (pin 8) of sample and hold amplifier ICl is provided by PNP transistor Tl.
  • Transistor Tl forms an inverting amplifier which is gated on during the black level period by the 'horizontal sync' pulses decoded by IC5 of Fig. 7. These pulses are labelled 'burst* as they are intended to provide timing for the color burst of a composite video signal. However, they conveniently occur at black level when monochrome video is used.
  • Capacitor C7 blocks the dc component of the "horizontal synch”.
  • Resistor R19 holds transistor Tl in the 'off state except during the negative going "horizontal sync" pulses applied to the base which turn it on for the duration of each pulse.
  • Resistor R18 provides the collector load for transistor Tl. Positive going pulses appearing at the collector of Tl are applied to the logic input (pin 8) of ICl and provide a 'black level' reference at pin 5 of ICl.
  • Electrolytic capacitor E4 provides decoupling of the power supply line.
  • Capacitor C3 provides requisite storage for the black level sample, while capacitor C6 provides requisite storage of the 159th line of the CCD sensor output.
  • Suitable offset reference for ICl is provided by a voltage divider comprising resistors R9, RIO.
  • Output signals obtained at respective pins 5 of amplifiers ICl, IC2 are applied to the inputs of differential amplifier IC3 (LM108) .
  • the dc gain of IC3 is set by resistors R4, R5, R3 and Rll. Frequency compensation is provided by capacitor Cl while frequency response is limited to an extremely low level by capacitor C2. Further, limiting and smoothing of the signal is provided by resistor R6 and electrolytic capacitor El.
  • IC4 (L272M) contains two operational amplifiers and because of its output drive capability is used as a driver for the telephoto lens iris servo-motor.
  • the error signal provided by IC3 is fed to one inverting input (pin 8) of IC4 via resistor R31.
  • Resistors R31, R14 control the dc gain of this driver amplifier.
  • Resistor R7, trimpot PI and resistor R8 form a voltage divider with an adjustable operating point. Trimpot PI is used to set a reference signal which is associated with the appropriate light level reaching telephoto sensor 55.
  • Electrolytic capacitor E7 stabilizes the reference signal against minor noise and spikes. This reference signal is applied to a non-inverting input (pin 7) of one amplifier of IC .
  • the second amplifier of IC4 is used to provide a high current, voltage centre point allowing bi-directional operation of the telephoto iris DC servo motor connected via port Jll.
  • a reference voltage for this second amplifier is provided at pin 6 of IC4 from a voltage divider comprising resistors R16, R17 with unwanted noise being filtered by electrolytic capacitor E6.
  • a small amount of positive feedback is applied to the system via resistor R26.
  • the error drive signal is applied to the telephoto iris drive motor connected between pins 1 and 3 of IC4 via diode D6.
  • Diodes D6, D7 are included to prevent stalling of the servo motor when maximum aperture is reached. When this happens, the contacts of limit switch J12 open and current can only flow in the direction necessary to close the aperture.
  • limit switch J12 During normal operation the contacts of limit switch J12 are closed and diodes D6, D7 are in parallel and allow bi-directional operation of the iris servo motor. It was found unnecessary to include a second limit switch at maximum lens aperture as maximum light levels do not reach this point. Capacitor C4 and resistor R15 prevent spurious oscillations in this section of the circuit.
  • Flash synchronization is provided by means of a 2mS synch pulse generated for each picture by the system.
  • a negative going spike the duration of which is equal to the total transfer time of gates ICZ2 and ICZ will be formed at the output (pin 3) of XOR gate ICY.
  • Input pin 5 is connected to odd/even field pin 7 of
  • IC5 in Fig. 7 and goes high at the beginning of an odd field. With pin 1 of ICU normally high, pin 3 must be low. At the beginning of the next odd field (which is the only time the frame grabber can be instructed to store an image) the odd/even field signal at pin 2 of ICU produces a negative going spike at the output (pin 3) of ICX, the duration of which is equal to the transfer time of gates
  • ICV and ICW This spike coincides with the start of an image to be captured and is applied to pin 1 of ICK.
  • This action sets pin 3 of ICK high, allowing 'horizontal synch' pulses through gate ICJ to clock counters ICLl and ICL2.
  • the binary outputs of these counters are decoded by ICM at a count of 31. This number of 64 ⁇ S pulses produces a period of 1984 ⁇ S.
  • the output of ICM goes low when 31 is decoded. This low going signal is applied to input pin 2 of ICK.
  • This action sets output pin 3 low stopping further 'horizontal synch' pulses from clocking the counters.
  • the positive going edge on the input of ICN generates a negative going spike at the output of ICQ which is applied to the "clear" inputs of counters ICLl and ICL2, resetting these counters to zero.
  • the duration of the "strobe" signal at ICK pin 3 is approximately 2mS and is output at gate ICK3 and output pin 9.
  • the strobe signal at pin 9 of IC2 goes high for approximately 2mS and is applied to the base of NPN transistor T via resistor R14.
  • Transistor T is configured as an emitter follower with load provided via resistor R27. This buffered signal is taken from the emitter load and outputted at port J9.
  • IC regulator LI (LM2948) is configured as a 10 volt regulator. A 12 volt supply is applied to input pin 1 with some smoothing carried out by electrolytic capacitor E7. Diode D2 minimizes damage by reverse voltage at the input. Resistors RIO, Rll form a reference voltage for regulator LI, while electrolytic capacitor E3 minimizes noise and ensures stability of this signal. Electrolytic capacitor E2 provides further filtering of the regulated 10 volt supply. Diode Dl protects regulator LI from residual charge on capacitor E2 destroying LI should the 12 volt input be shorted to ground. IC regulator L2 (LM317) is configured as a 5 volt regulator. A 12 volt supply is applied to input pin 3. The reference voltage is set by voltage divider resistors R12, R13 while electrolytic capacitor E4 minimizes noise and ensures stability of regulator L2. Electrolytic capacitor E5 provides further filtering of the voltage supply.
  • Electrolytic capacitors E6 and El perform bypass functions and are sited appropriately to prevent current drawn by active circuit elements from generating disturbances on the supply rails.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Warehouses Or Storage Devices (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Television Signal Processing For Recording (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

An image storage system suitable for use with devices for detecting/recording overspeeding vehicles. The system includes at least one image sensor (11, 15, 53, 55) for generating data representing an image applied to the sensor. The system includes means for applying a first image (10, 54) to the sensor (11, 53) for generating first data representing at least relatively coarse features in the first image, and means for applying a second image (14, 56) including an enlarged portion of the first image to the sensor (15, 55) for generating second data representing at least relatively fine features in the first image. The second data representing relatively fine features has a set level of definition. The first data representing relatively coarse features has a level of definition which is below the set level. The quantity of data is thereby reduced for storage purposes. A data storage system including a frame grabber (19) and digital computer (20) having a hard disk is also disclosed.

Description

IMAGESTORAGESYSTEMFORVEHICLEIDENTIFICATION
The present invention relates to an image storage system. In particular the present invention relates to an image storage system suitable for use in connection with devices for detecting/recording overspeeding vehicles known generically as "speed cameras". Nevertheless, it is to be appreciated that it is not thereby limited to such applications. Prior art devices used for detecting/recording vehicles which exceed speed limits are based on conventional photographic techniques using films coated with light sensitive emulsions which must be exposed, developed and stored in film or hard copy format. This is not only a costly procedure but creates bulky records in the form of rolls of exposed film which are cumbersome to store and handle. Because a typical roll of film may contain hundreds of traffic infringements or violations, access to a specific infringement or violation in such a roll of film is a time consuming exercise.
Using conventional techniques, the image of a vehicle from which the license plate can be read and which shows the mandatory surrounding roadway and vehicles needs to have a relatively high resolution or definition. To achieve such definition or resolution the image typically needs to be made up of at least about 1.4 million picture elements or pixels, each able to represent one of about 64 shades of grey. A file generated from such an image occupies over 1.4M Bytes of storage space. Although state of the art file compression techniques can reduce this by up to 60% (570 K Bytes), the processing time involved reduces the overall operating speed considerably.
An object of the present invention is to provide an image storage system which at least alleviates the disadvantage of the prior art.
The system of the present invention may reduce the size of an uncompressed file or record by a factor of at least 10 or more, yet still provide similar resolution or definition in a relevant area or portion of the record. The system of the present invention may achieve a reduction in file or record size by capturing two images of a vehicle to be recorded, each having a relatively low resolution. One image may be captured using a relatively long focal length or telephoto lens. The telephoto image of the vehicle may show relatively fine or detailed features such as a vehicle license plate, vehicle make and model and in some cases facial features of the occupants. A further image may be captured using a relatively wide angle lens. The wide angle image may show relatively coarse or less detailed features such as the infringing vehicle in relation to the surrounding roadway and other vehicles. The infringing vehicle may still be clearly recognizable in the wide angle image.
The two images may be captured via at least one image sensitive device or sensor such as a CCD (charge coupled device) array or vidicon tube. The or each image sensor may have relatively low resolution or definiton. Nevertheless, higher resolution or definition image sensors may be used since it is always possible to reduce resolution or definition by discarding superfluous or unwanted image data prior to recording the data.
In one form, the or each image sensor may be capable of generating data representing an image containing at least about 50,000 picture elements or pixels, with each element or pixel being able to represent one of about 64 shades of grey. A record or file generated from such data may occupy no more than about 50 KBytes of storage space. The record or file representing two such images for each vehicle infringement may occupy about 100 K Bytes of storage space whilst still containing relevant infringement data. This is less than one tenth of the size of a comparable single picture system without compression techniques.
It is to be appreciated that no matter what is the final resolution or definition of an image required to be stored, the principles of the present invention may be applied to provide considerable savings in record or file size and operating speed over prior art approaches.
According to one aspect of the present invention there is provided apparatus for use with an image storage system, said apparatus including at least one sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing at least relatively coarse features in said first image; means for applying a second image comprising an enlarged portion of said first image to said at least one sensor for generating second data representing at least relatively fine features in said first image, said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level, whereby reducing the quantity of said data for storage purposes. According to a further aspect of the present invention there is provided an image storage system including: at least one image sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing at least relatively coarse features in said first image; means for applying a second image including an enlarged portion of said first image to said at least one sensor for generating second data representing at least relatively fine features in said first image; said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level; and means for storing said data.
The means for applying the first image may comprise a wide angle lens having a focal length of approximately 50mm. The means for applying the second image may comprise a telephoto lens having a focal length of approximately 210 mm. The two lenses may be associated with a single image sensor. The image sensor may be fixed and the lenses may be movable or the lenses may be fixed and the sensor may be movable. Alternatively, a single zoom lens (eg. 50-210mm) may be used in place of the two lenses. Preferably each lens is associated with a respective image sensor. The address lines of the respective image sensors may be driven in parallel via common driving circuits. In one form the apparatus may include a self contained board video camera. Two image sensors may be used with a single board video camera. The horizontal and vertical address lines of each image sensor may be driven in parallel via the board video camera.
The first and second images may be generated simultaneously or sequentially. Where the first and second images are generated sequentially, means such as a video switch or the like may be used to switch between the outputs of the respective image sensors.
The respective outputs may be processed in the usual way via the board video camera to provide a composite video or luminance signal at its output. The composite video or luminance output signal may be connected to a frame grabber circuit. The frame grabber circuit may include a memory. The frame grabber circuit may also include an analog to digital converter. The frame grabber circuit may be adapted to store one field (odd or even) from the composite video or luminance signal. Where the resolution of the composite or luminance video signal is greater than about 100,000 picture elements or pixels per frame (2 fields), the frame grabber circuit may be arranged to limit the quantity of data stored from each field such that the resolution of the stored field is limited to about 50,000 picture elements or pixels. This may ensure that the size or volume of the record or file for each field is of a manageable size. The frame grabber circuit preferably is adapted to store the composite video signal in monochrome (luminance) to minimize the quantity of data stored from each field.
According to a further feature of the present invention the frame grabber circuit may store a sample of the first and/or second image in color (luminance plus chrominance) . The color sample may be taken from a relatively small relevant portion or area of the first and/or second image, such as a portion showing the color of an infringing vehicle, and this may be stored together with the monochrome image. When the image is reviewed the portion or area from which the color was sampled may appear in true color against a monochrome background. This technique may provide additional means of vehicle identification with minimum increase in image file size. A change from monochrome to colour usually results in a threefold increase in file size with proportional decrease in overall operating speed. However the increase in file size is limited to the sampled area. Thus if the sampled area is 1% of the overall image area a 2% increase in overall file size can be expected.
The frame grabber circuit may transfer its data to any suitable storage medium such as a computer hard disk, static RAM or the like. The data may be transferred to storage medium with other infringement related information such as details of location, user ID, speed zone together with infringing vehicle speed, distance, time and date etc.
The associated computer may be programmed to control operation of the apparatus of the present invention. Alternatively a dedicated microprocessor based controller may be used. The apparatus may be triggered via any suitable speed/distance measuring device such as a radar based speed detector or preferably a laser based speed detector such as a model LTI 20-20 manufactured by Laser Technology Inc. of Englewood, Colorado USA.
The speed detecting/recording apparatus may be stationary relative to the roadway or it may be mounted in a moving patrol vehicle. Where the apparatus is mounted in a moving patrol vehicle means such as a summer device may be provided to determine absolute speed of a target vehicle from the relative speed of that vehicle and the patrol vehicle. The relative speed of the target vehicle may be determined by a speed detector mounted in the patrol vehicle. The speed of the patrol vehicle may be determined via a speedometer or tachometer in the patrol vehicle.
Preferred embodiments of the present invention will now be described with reference to the accompanying drawings wherein:- Fig. 1 shows a block diagram of a speed camera incorporating an image storage system according to one embodiment of the present invention;
Fig. 2 shows a block diagram of the interface and logic control module; Fig. 3 shows a schematic diagram of one embodiment of the present invention;
Fig. 4 shows a lens iris drive circuit associated with the embodiment of Fig. 3;
Fig. 5 shows a block diagram of a speed camera incorporating an imaging storage system according to a further embodiment of the present invention;
Fig. 6 shows a flow chart of one form of operation program which is employed for controlling an image storage system; Fig. 7 shows a schematic diagram of a further embodiment of the present invention;
Fig. 8 shows a schematic diagram of a logic module included in Fig. 7; and
Fig. 9 shows a lens iris drive circuit associated with the embodiment of Fig. 7.
Referring to Fig. 1 the system includes a wide angle lens 10 and associated CCD image sensor 11. The output
(D) of image sensor 11 is connected to a first input of analog video switch 12 and to an automatic exposure interface 13 associated with wide angle lens 10. Lens 10 comprises a 50mm galvanometer type auto - iris device such as a COSMICAR type MCA5018APC. Auto exposure interface 13 amplifies and buffers signals from sensor 11 and supplies them to the galvanometer type auto iris associated with lens 10.
The system includes a telephoto lens 14 and associated CCD image sensor 15. The output (C) from image sensor 15 is connected to a second input of analog video switch 12 and to an automatic exposure interface 16. Since compact telephoto type auto-iris lenses are not readily available, this was developed by modifying a 210mm focal length compact zoom lens (Sigma type) designed for a
35mm SLR camera. The lens preferably is suitable for use in the infrared region for night time operation. The zoom lens may be fixed at maximum focal length and the iris detent spring and ball associated with the ring removed. A ring gear may be fitted to the iris ring and the lens fitted to an adapter to allow mounting of CCD sensor 15. The adapter may also include a mounting for a DC micro-servo motor (Minimotor SA type 1016) which may drive the lens iris ring via a small spur gear.
Interface 16 may be adapted to sample a horizontal scan line, from image sensor 15 eg. about half way down the image. This sample may be converted to a suitable level and applied to drive the auto iris servo motor associated with telephoto lens 14. This arrangement may provide closed loop feedback to automatically control exposure of image sensor 15.
The system includes a self contained video camera module 17 such as a TMC-7 series CCD board camera manufactured by PULNIX. Video camera module 17 includes horizontal and vertical driving circuits for CCD sensors 11 and 15, timing and synch generators and a video amplifier for producing a composite video output signal (B) . Camera module 17 may also include an auto iris control output for use with standard type auto iris lenses. CCD sensors 11 and 15 are connected to the horizontal and vertical driving circuits on camera module 17 in parallel. Video switch 12 is adapted to alternately connect the output (D) of sensor 11 or output (C) of sensor 15 to the CCD sensor input (E) of camera module 17 under control of interface and logic control module 18. The latter is described in more detail with reference to Fig. 2. The composite video output signal (B) is connected to interface and logic control module 18 and to frame grabber 19 associated with an IBM compatible personal computer (PC) 20. Frame grabber 19 may comprise a PC frame grabber card such as a FG 302 TV frame grabber PCB. Frame grabber 19 may occupy a single slot in PC 20. Its function is to digitize and store one field of a monochrome or color TV signal with (approximately) 256 x 256 pixel resolution (7 bits grey scale resolution per pixel) and to transfer the image data to the computer memory (RAM) in a sequence of DMA cycles. A TV monitor output of the stored image is not provided on the FG 302. However images may be displayed on a monitor (eg. LCD) associated with PC 20.
The system is triggered via a trigger device 21 such as a laser based speed detector (eg. LTI 20-20) connected to PC 20 via an RS 232 port 22.
Referring to Fig. 2, interface and logic control module 18 comprises a synch separator 23 such as an LM 1881. Synch separator 23 receives at its input a composite video signal (B) from camera module 17 and provides at its output an odd/even field signal having a falling edge at the end of an odd field and a rising edge at the end of an even field. The odd/even field signal is connected to one input of RS bistable latch 24. Synch separator 23 also provides at its output a vertical synch pulse (K) to auto exposure interface 16. A control signal (A) to latch 24 is provided from RS 232 port 22 of PC 20. The Q and Q outputs of latch 24 are adapted to control the position of analog video switch 12 which alternately switches the signal (C) from sensor 15 or the signal (D) from sensor 11 to the CCD input (E) of camera module 17.
Referring to Fig. 3, the control signal (A) from PC 20 is connected to one input of latch 41A and B (4011) via diode D3 and resistor Rl. Control signal (A) switches latch 41A and B causing a change in output signals (H and J) to video multiplexer switch IC6A and C (4066). This causes the input signal (E) to camera module 17 to change from, say, output (D) from wide angle sensor 11 to output (C) from telephoto sensor 15. Lines (C) , (D) and (E) are single lines. All other lines between sensors 11, 15 and camera module 17 are connected in parallel. Control signal (A) also instructs frame grabber 19 to store the next odd field from composite input signal (B) . Following this, PC 20 carries out a Direct Memory Access (DMA) transfer of image data from frame grabber 19 to Random Access Memory (RAM) .
A further control signal (A) returns video multiplexer switch IC 6A and C to its previous state causing the output (D) from wide angle sensor 11 to be connected to the input (E) to camera module 17. Control signal (A) again instructs frame grabber 19 to store the next odd field. Image data from wide angle sensor 11 is again transferred to RAM via DMA. Details of location, user ID and speed zone are entered into PC 20 during set-up and this data, together with the infringing vehicle speed, distance, time and date may be embedded into a single file with the two images of an infringing vehicle. This complete file, occupying about 102 KBytes is stored on the hard disk of PC 20. Auto exposure interface 13 comprises a converter/driver made up of transistor Ml, resistors R7, R8, Rll and R13 and capacitors C6, C8 and C16. An output (D) from wide angle sensor 11 is applied to the base of transistor Ml via capacitor C16 and resistor Rll. The output (F) of the converter/driver is available at capacitor C8 and is applied to the auto iris drive of wide angle lens 10.
Night time operation may be enabled by a 2mS duration signal from monostable IC3A (4528) which is synchronized to the effective camera "shutter open" period via latch 41A and B. This signal may be transmitted to a large array of infra-red diodes placed at a distance at which the speed detector or trigger (eg. LT1 20/20) is set to operate. By this means an infringing vehicle may always be in an optimum flash illumination zone and focus. The infra-red filter normally fitted to the CCD camera may be removed. For day time operation the depth of field of the lenses preferably are arranged to produce well focused images in the range 60-100m. For night time operation, the speed detector/trigger may be placed in automatic mode where a target vehicle distance falls within a defined window before a reading is taken. This distance may be chosen to be optimum for lens focus and infra-red illumination and may be adjustable. For night time operation at least, it is preferable that frame grabber 19 stores a frame from output (C) from telephoto image sensor 15 before it stores a frame from output (D) from wide angle image sensor 11.
Referring to Fig. 4 an output (C) from telephoto sensor 15 is routed via diode D6 to DC amplifier IC5 (LM108) . The output from DC amplifier IC5 is applied to the input of sample and hold amplifier IC6 (LF 398) . The command to sample is obtained from sample time monostable IC4B (4528) set to 52μS (duration of one line). Monostable IC4B is triggered via monostable IC4A (4528) approximately lOmS (duration of half a frame) after each vertical sync pulse provided by sync separator IC2 (LM1881) (refer Fig. 3). The sample voltage is then proportional to the brightness of a single horizontal scan line approximately half way down a field. Samples representing lines or parts of lines elsewhere in a field may be chosen by changing the timing of monostables IC4A and/or IC4B.
The sample voltage is applied to servo amplifier IC7 (L272M) comprising dual power op amps which drive the auto iris servo associated with telephoto lens 14. The iris servo is isolated from low out-of-range signals by means of microswitch SI, mounted on the lens body. Steering diodes D4 and D5 provide individual direction control. Referring to Figs. 5 and 6, actuation of the trigger device (eg. laser speed-gun) produces an output which passes via interfaces 50, 51 to an associated computer (not shown) and is examined by an operation program (refer Fig. 6) stored in the computer. The program examines the output of the trigger device and decides whether the data is valid according to criteria of the trigger device. If so, the program compares the captured speed of a target vehicle with a pre-set limit. If this has been exceeded a high state signal is sent from the computer to logic module 52 via interface 51. Logic module 52 controls, inter alia, switching to camera module 57, outputs (CCD OUT) from CCD sensor 53 associated wide angle lens 54, and from CCD sensor 55 associated with telephoto lens 56, respectively. The high state signal instructs logic module 52 to switch to camera module 57 the output from telephoto sensor 55. The operation program then instructs the computer to store image data from telephoto sensor 55.
A low state signal is then sent from the computer to logic module 52. The low state signal instructs logic module 52 to switch to camera module 57 the output from wide angle sensor 53. The operation program then instructs the computer to store image data from wide angle sensor 53. The image data is then transferred into memory, a unique file name is created and time, date, vehicle speed and distance are appended to the file which is then stored onto hard disk. The computer is then ready to accept a new infringement.
Logic module 52 also controls an auto iris servo motor (not shown) associated with wide angle lens 54, and via drive signals applied to iris module 58, controls auto iris servo motor 59 associated with telephoto lens 56.
Although the horizonal and vertical drive between camera module 57 and sensors 53, 55 (H & V drive) is shown as a single line, it represents 12 horizonal and vertical lines. The electronic shutter speed of camera module 57 is fixed internally to 1/500 sec. Camera module 57 provides both a composite color output and a Y/C (luminance/chrominance) output. The luminance output is fed to a frame grabber associated with the computer via interface 51. The luminance output is preferred since encoded color information substantially degrades a monochrome image. The "Y" signal also contains all of the synchronizing signals necessary to drive various parts in the circuit. A composite color signal is provided as an output to the system to assist in setting up and for continuous monitoring of the video signal if required. Images so produced appear as normal color video. As a violation or infringement is recorded, the output switches from the wide angle lens to the telephoto lens for two frames and then back again, providing a useful video tape back up if required.
Referring to Fig. 7, a high level signal sent from the associated computer is routed to the circuit via port J7. Possible voltage spikes are limited via zener diode Zl, while resistor Rl limits current flow into Zl and resistor R2 provides a DC current path to ground from input pin 4 of IC2 which comprises a programmable logic device (PLD) such as an EP910J. Referring to Fig. 8 which shows the circuit embedded in PLD IC2, input pin 4 is applied to macrocell ICZ2 which has no function save to transmit identical signals from input to output. This signal is additionally routed via macrocell ICZ3 to output pin 11.
Referring again to Fig. 7, the output from pin 11 of IC2 is fed to the bases of NPN transistors Nl, N2 via resistors R18, R19 respectively, which serve to limit base current. Relays R16, R17 form the collector loads for transistor Nl, N2 respectively while diodes D7, D8 clip any reverse voltage spikes caused by the inductance of relay coils associated with relays R16, R17.
Relays R16, R17 switch port J5 associated with the input to camera module 57 (Fig. 5), between port J4 associated with the output of telephoto CCD sensor 55, and port J6 associated with the output of wide angle CCD sensor 53. Resistors R3 and R4 provide impedance matching for CCD sensors 55 and 53 respectively. Relays R16, R17 each comprises a double pole relay to optimize isolation between signals from the wide angle and telephoto sensors 55, 53 respectively. Capacitors C5 and C6 minimize cross talk between the outputs of the respective sensors while resistor R5 provides a suitable input impedance to camera module 57. Initially with a low state signal being sent via port J7 from the computer, both transistors Nl, N2 are turned off, neither relay R16, R7 is energized and the output from wide angle sensor 53 is routed from port J6 through a normally closed contact associated with pin 4 of relay R17 across a moving contact set from pins 2 to 7 of relay R17 and out on pin 5 of relay R17 where it is routed to the input of camera module 57 via port J5. Capacitor C6 has a negligible effect on the video signal.
Signals from telephoto sensor 55 are routed from port J4 via pin 3 to pin 2 of relay R16. Radiation of this signal is minimized via capacitor C6. When the computer outputs a signal via port J7 to change from telephoto sensor 55 to wide angle sensor 53, a high level signal is applied to the bases of transistors Nl, N2. This causes the collector currents so produced to energize both relays R16, R17. The signal produced by telephoto sensor 55 is routed via port J4, then transferred from pin
3 of relay R16 via pins 2 and 7 to pin 6 which is connected to the input of camera module 57 via port J5. Wide angle sensor 53 is disconnected via pin 4 of relay
R17 and radiation of this signal is minimized by capacitor
C6.
The computer then instructs the frame grabber to freeze a frame taken via telephoto sensor 55. This is followed by a command to transfer the contents of this stored frame into memory. On completion of this action the computer issues a further signal via port J7 to change the signal path to the original route. Port J7 is pulled low by the computer allowing both transistors Nl, N2 to be turned off. Both relays R16, R17 are released. The signal from telephoto sensor 55 via port J4 is transferred from pin 3 of relay R16 to pin 2 disconnecting it from the input of camera module 57. The signal from wide angle sensor 53 is connected to pin 4 of relay R17 and via pin 2 to pin 7 then to pin 5 of relay R17 and to port J5.
The computer waits for the next odd field, then issues a further signal to the frame grabber to freeze the second image taken via wide angle sensor 53. This image data is transferred into memory, a unique file name is created and time, date, vehicle speed and distance one appended to the file which is then stored onto hard disk. The computer is then ready to accept a new infringement.
Automatic aperture control of the wide angle lens auto iris is provided by the signal from wide angle sensor 53 via port J6. Capacitor Cl excludes unwanted lower frequencies from the signal while resistors R6, R7 form a voltage divider to suitably proportion the signal. Capacitor C2 prevents dc interaction between the base of transistor Tl and the incoming signal. Resistors R8, R9 provide a collector load and appropriate forward bias for transistor Tl. The dc component of the amplified signal is filtered via capacitor C3 and the resulting signal is applied to drive the wide angle auto iris via port J2. Electrolytic capacitor El provides decoupling of the power supply line. Automatic aperture control of the auto iris associated with the telephoto lens is provided by means of a separate sampling circuit. Composite video signals are fed to port J8 from camera module 57. The composite video signals are applied to pin 2 of synch separator IC5 (LM 1881) via dc blocking capacitor CIO. When provided with composite video signals, IC5 provides outputs of odd/even fields at pin 7, vertical synch at pin 3, horizontal synch at pin 15 and composite synch which is not used in this application. Capacitor C9 and resistor R28 provide the correct time constant for the internal frame integrator of IC5. A negative going vertical synch pulse from pin 3 of IC5 is applied to pin 3 of PLD IC2, while horizontal synch pulses from pin 5 of IC5 are applied to pin 19 of IC2. Referring to Fig. 8, input pin 3 is applied to pin 1 of two input NAND latch IC1A. This sets output pin 3 of latch IC1A high allowing horizontal synch pulses from pin 5 of IC5 to clock binary counters ICB and ICC via input pin 19 and gate ICH. When a binary count of 159 is decoded by ICE, ICF and ICG, this high level is output from ICG for the 64μS duration of horizontal line 159 via macrocell ICK2 to output pin 12 of IC2. Counters ICB and ICC continue counting until a count of 255 is reached when the ripple-carry out (RCO) pin 15 of ICC goes high. This signal is inverted via ICD and applied to pin 2 of IC1A which sets pin 3 low and prevents clock pulses from reaching counters ICB and ICC thus leaving the counters in this state. This provides timing for a sample signal from a horizontal line approximately half way down the image. Referring to Fig. 7, this sample signal is outputted on pin 12 of IC2 via diode D6 to pin 2 of port Jl. Diode D6 prevents accidental voltages appearing at pin 2 of port Jl from destroying IC2. Resistor R15 provides some degree of static protection for pin 12 of IC2 when left disconnected for servicing.
Referring to Fig. 9, the sample signal so generated is fed from pin 2 of port Jl to pin 8 of IC2 (LF 398), a sample and hold amplifier. This allows sample and hold amplifier IC2 to take a sample of the voltage produced by telephoto sensor 55 which is a close approximation of the average light level across the entire 159th horizontal line. The analog input to pin 3 of sample and hold amplifier IC2 is provided from telephoto sensor 55 via pin 3 of port Jl and is scaled to an appropriate level by a voltage divider comprising resistors R12, R13. The same signal is applied to pin 3 of ICl (LF 398), a second sample and hold amplifier. The logic input (pin 8) of sample and hold amplifier ICl is provided by PNP transistor Tl. Transistor Tl forms an inverting amplifier which is gated on during the black level period by the 'horizontal sync' pulses decoded by IC5 of Fig. 7. These pulses are labelled 'burst* as they are intended to provide timing for the color burst of a composite video signal. However, they conveniently occur at black level when monochrome video is used. Capacitor C7 blocks the dc component of the "horizontal synch". Resistor R19 holds transistor Tl in the 'off state except during the negative going "horizontal sync" pulses applied to the base which turn it on for the duration of each pulse. Resistor R18 provides the collector load for transistor Tl. Positive going pulses appearing at the collector of Tl are applied to the logic input (pin 8) of ICl and provide a 'black level' reference at pin 5 of ICl.
Electrolytic capacitor E4 provides decoupling of the power supply line. Capacitor C3 provides requisite storage for the black level sample, while capacitor C6 provides requisite storage of the 159th line of the CCD sensor output. Suitable offset reference for ICl is provided by a voltage divider comprising resistors R9, RIO. Output signals obtained at respective pins 5 of amplifiers ICl, IC2 are applied to the inputs of differential amplifier IC3 (LM108) . The dc gain of IC3 is set by resistors R4, R5, R3 and Rll. Frequency compensation is provided by capacitor Cl while frequency response is limited to an extremely low level by capacitor C2. Further, limiting and smoothing of the signal is provided by resistor R6 and electrolytic capacitor El.
IC4 (L272M) contains two operational amplifiers and because of its output drive capability is used as a driver for the telephoto lens iris servo-motor. The error signal provided by IC3 is fed to one inverting input (pin 8) of IC4 via resistor R31. Resistors R31, R14 control the dc gain of this driver amplifier. Resistor R7, trimpot PI and resistor R8 form a voltage divider with an adjustable operating point. Trimpot PI is used to set a reference signal which is associated with the appropriate light level reaching telephoto sensor 55. Electrolytic capacitor E7 stabilizes the reference signal against minor noise and spikes. This reference signal is applied to a non-inverting input (pin 7) of one amplifier of IC .
The second amplifier of IC4 is used to provide a high current, voltage centre point allowing bi-directional operation of the telephoto iris DC servo motor connected via port Jll. A reference voltage for this second amplifier is provided at pin 6 of IC4 from a voltage divider comprising resistors R16, R17 with unwanted noise being filtered by electrolytic capacitor E6. A small amount of positive feedback is applied to the system via resistor R26. The error drive signal is applied to the telephoto iris drive motor connected between pins 1 and 3 of IC4 via diode D6. Diodes D6, D7 are included to prevent stalling of the servo motor when maximum aperture is reached. When this happens, the contacts of limit switch J12 open and current can only flow in the direction necessary to close the aperture. During normal operation the contacts of limit switch J12 are closed and diodes D6, D7 are in parallel and allow bi-directional operation of the iris servo motor. It was found unnecessary to include a second limit switch at maximum lens aperture as maximum light levels do not reach this point. Capacitor C4 and resistor R15 prevent spurious oscillations in this section of the circuit.
Flash synchronization is provided by means of a 2mS synch pulse generated for each picture by the system. Referring to Fig. 8, it may be seen that for every edge applied at input pin 4, a negative going spike, the duration of which is equal to the total transfer time of gates ICZ2 and ICZ will be formed at the output (pin 3) of XOR gate ICY. Input pin 5 is connected to odd/even field pin 7 of
IC5 in Fig. 7 and goes high at the beginning of an odd field. With pin 1 of ICU normally high, pin 3 must be low. At the beginning of the next odd field (which is the only time the frame grabber can be instructed to store an image) the odd/even field signal at pin 2 of ICU produces a negative going spike at the output (pin 3) of ICX, the duration of which is equal to the transfer time of gates
ICV and ICW. This spike coincides with the start of an image to be captured and is applied to pin 1 of ICK. This action sets pin 3 of ICK high, allowing 'horizontal synch' pulses through gate ICJ to clock counters ICLl and ICL2. The binary outputs of these counters are decoded by ICM at a count of 31. This number of 64μS pulses produces a period of 1984μS. The output of ICM goes low when 31 is decoded. This low going signal is applied to input pin 2 of ICK. This action sets output pin 3 low stopping further 'horizontal synch' pulses from clocking the counters. The positive going edge on the input of ICN generates a negative going spike at the output of ICQ which is applied to the "clear" inputs of counters ICLl and ICL2, resetting these counters to zero. The duration of the "strobe" signal at ICK pin 3 is approximately 2mS and is output at gate ICK3 and output pin 9.
Referring to Fig. 7, the strobe signal at pin 9 of IC2 (labelled 2MS) goes high for approximately 2mS and is applied to the base of NPN transistor T via resistor R14. Transistor T is configured as an emitter follower with load provided via resistor R27. This buffered signal is taken from the emitter load and outputted at port J9.
Power to the circuit is provided via IC regulators LI and L2 shown in Fig. 7. IC regulator LI (LM2948) is configured as a 10 volt regulator. A 12 volt supply is applied to input pin 1 with some smoothing carried out by electrolytic capacitor E7. Diode D2 minimizes damage by reverse voltage at the input. Resistors RIO, Rll form a reference voltage for regulator LI, while electrolytic capacitor E3 minimizes noise and ensures stability of this signal. Electrolytic capacitor E2 provides further filtering of the regulated 10 volt supply. Diode Dl protects regulator LI from residual charge on capacitor E2 destroying LI should the 12 volt input be shorted to ground. IC regulator L2 (LM317) is configured as a 5 volt regulator. A 12 volt supply is applied to input pin 3. The reference voltage is set by voltage divider resistors R12, R13 while electrolytic capacitor E4 minimizes noise and ensures stability of regulator L2. Electrolytic capacitor E5 provides further filtering of the voltage supply.
Electrolytic capacitors E6 and El perform bypass functions and are sited appropriately to prevent current drawn by active circuit elements from generating disturbances on the supply rails.
Finally, it is to be understood that various alterations, modifications and/or additions may be introduced into the constructions and arrangements of parts previously described without departing from the spirit or ambit of the invention.

Claims

1. Apparatus suitable for use with an image storage system, said apparatus including: at least one image sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing at least relatively coarse features in said first image; means for applying a second image including an enlarged portion of said first image to said at least one sensor for generating second data representing at least relatively fine features in said first image; said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level, whereby reducing the quantity of said data for storage purposes.
2. Apparatus according to Claim 1 wherein said at least one image sensor includes a charge coupled device (CCD) array.
3. Apparatus according to claim 1 or 2 wherein said means for applying said first image includes a wide angle lens and said means for applying said second image includes a telephoto lens.
4. Apparatus according to any one of the preceding claims and including processing means for controlling operation of said apparatus.
5. Apparatus according to claim 4 wherein said processing means includes a digital computer having storage means for storing said data.
6. Apparatus according to claim 4 or 5 wherein said processing means includes a frame grabber for freezing said data.
7. Apparatus according to claim 5 or 6 wherein said apparatus is adapted for recording overspeeding vehicles.
8. An image storage system including: at least one image sensor for generating data representing an image applied to said sensor; means for applying a first image to said at least one sensor for generating first data representing at least relatively coarse features in said first image; means for applying a second image including an enlarged portion of said first image to said at least one sensor for generating second data representing at least relatively fine features in said first image; said second data representing said relatively fine features with a set level of definition and said first data representing said relatively coarse features with a level of definition which is below said set level; and means for storing said data.
9. A system according to claim 8 wherein said at least one image sensor includes a charge coupled device (CCD) array.
10. A system according to claim 8 or 9 wherein said means for applying said first image includes a wide angle lens and said means for applying said second image includes a telephoto lens.
11. A system according to any one of claims 8-10 including processing means for controlling operation of said system.
12. Apparatus for recording overspeeding vehicles including an image storage system according to any one of claims 8-11.
13. Apparatus according to claim 12 wherein said apparatus is operable in response to a speed detector.
14. Apparatus substantially as herein described with reference to Figs. 1-4 or Figs. 5-9 of the accompanying drawings.
PCT/AU1994/000260 1993-05-24 1994-05-23 Image storage system for vehicle identification WO1994028527A1 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
CA002163424A CA2163424C (en) 1993-05-24 1994-05-23 Image storage system for vehicle identification
AT94916083T ATE189551T1 (en) 1993-05-24 1994-05-23 IMAGE STORAGE SYSTEM FOR VEHICLE IDENTIFICATION
AU67890/94A AU694731B2 (en) 1993-05-24 1994-05-23 Imaging apparatus and storage system for vehicle identification
DK94916083T DK0700559T3 (en) 1993-05-24 1994-05-23 Vehicle Identification Image Storage System
EP94916083A EP0700559B1 (en) 1993-05-24 1994-05-23 Image storage system for vehicle identification
JP50000995A JP3410470B2 (en) 1993-05-24 1994-05-23 Image storage system for vehicle identification
DE69422918T DE69422918T2 (en) 1993-05-24 1994-05-23 IMAGE STORAGE SYSTEM FOR VEHICLE IDENTIFICATION
HK98114195A HK1013157A1 (en) 1993-05-24 1998-12-21 Image storage system for vehicle identification
GR20000401040T GR3033355T3 (en) 1993-05-24 2000-05-02 Image storage system for vehicle identification

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AUPL894493 1993-05-24
AUPL8944 1993-05-24

Publications (1)

Publication Number Publication Date
WO1994028527A1 true WO1994028527A1 (en) 1994-12-08

Family

ID=3776911

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU1994/000260 WO1994028527A1 (en) 1993-05-24 1994-05-23 Image storage system for vehicle identification

Country Status (10)

Country Link
EP (1) EP0700559B1 (en)
JP (1) JP3410470B2 (en)
AT (1) ATE189551T1 (en)
DE (1) DE69422918T2 (en)
DK (1) DK0700559T3 (en)
ES (1) ES2144521T3 (en)
GR (1) GR3033355T3 (en)
HK (1) HK1013157A1 (en)
PT (1) PT700559E (en)
WO (1) WO1994028527A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0886844A1 (en) * 1996-03-04 1998-12-30 Laser Technology, Inc. A speed detection and image capture system for moving vehicles
FR2797081A1 (en) * 1999-07-29 2001-02-02 Positive Speeding vehicle image recording method, for identifying e.g. car and driver, provides trigger signals for two flashes of different intensities and timing so that clear pictures of both driver and registration plate are taken
EP1109134A2 (en) * 1999-12-17 2001-06-20 ROBOT FOTO UND ELECTRONIC GmbH Information location by data compression
EP1301895A2 (en) * 2000-05-24 2003-04-16 Redflex Traffic Systems, Inc. Automated traffic violation monitoring and reporting system
US6573929B1 (en) 1998-11-23 2003-06-03 Nestor, Inc. Traffic light violation prediction and recording system
US6731332B1 (en) 1998-01-29 2004-05-04 Matsushita Electric Industrial Co., Ltd. Image processing apparatus
US6760061B1 (en) 1997-04-14 2004-07-06 Nestor Traffic Systems, Inc. Traffic sensor
US7821422B2 (en) 2003-08-18 2010-10-26 Light Vision Systems, Inc. Traffic light signal system using radar-based target detection and tracking
US7986339B2 (en) 2003-06-12 2011-07-26 Redflex Traffic Systems Pty Ltd Automated traffic violation monitoring and reporting system with combined video and still-image data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0132795A2 (en) * 1983-07-29 1985-02-13 Polaroid Corporation Method and apparatus for image processing with field portions
EP0152355A2 (en) * 1984-02-14 1985-08-21 Nippon Telegraph And Telephone Corporation Image information retrieval/display apparatus
DE3535588A1 (en) * 1985-10-05 1987-04-09 Robot Foto Electr Kg Method and device for photographic detection of highly luminous or reflecting parts of a field of vision to be photographed
GB2266398A (en) * 1992-04-16 1993-10-27 Traffic Technology Limited Vehicle monitoring apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0132795A2 (en) * 1983-07-29 1985-02-13 Polaroid Corporation Method and apparatus for image processing with field portions
EP0152355A2 (en) * 1984-02-14 1985-08-21 Nippon Telegraph And Telephone Corporation Image information retrieval/display apparatus
DE3535588A1 (en) * 1985-10-05 1987-04-09 Robot Foto Electr Kg Method and device for photographic detection of highly luminous or reflecting parts of a field of vision to be photographed
GB2266398A (en) * 1992-04-16 1993-10-27 Traffic Technology Limited Vehicle monitoring apparatus

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN, P1623, page 145; & JP,A,05 151 386 (ISHIKAWAJIMA HARIMA HEAVY IND CO LTD (1)), 18 June 1993. *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0886844A1 (en) * 1996-03-04 1998-12-30 Laser Technology, Inc. A speed detection and image capture system for moving vehicles
EP0886844A4 (en) * 1996-03-04 1999-06-09 Laser Technology Inc A speed detection and image capture system for moving vehicles
US6760061B1 (en) 1997-04-14 2004-07-06 Nestor Traffic Systems, Inc. Traffic sensor
US6731332B1 (en) 1998-01-29 2004-05-04 Matsushita Electric Industrial Co., Ltd. Image processing apparatus
US6573929B1 (en) 1998-11-23 2003-06-03 Nestor, Inc. Traffic light violation prediction and recording system
US6647361B1 (en) 1998-11-23 2003-11-11 Nestor, Inc. Non-violation event filtering for a traffic light violation detection system
US6950789B2 (en) 1998-11-23 2005-09-27 Nestor, Inc. Traffic violation detection at an intersection employing a virtual violation line
FR2797081A1 (en) * 1999-07-29 2001-02-02 Positive Speeding vehicle image recording method, for identifying e.g. car and driver, provides trigger signals for two flashes of different intensities and timing so that clear pictures of both driver and registration plate are taken
EP1109134A3 (en) * 1999-12-17 2003-03-19 ROBOT FOTO UND ELECTRONIC GmbH Information location by data compression
EP1109134A2 (en) * 1999-12-17 2001-06-20 ROBOT FOTO UND ELECTRONIC GmbH Information location by data compression
EP1301895A2 (en) * 2000-05-24 2003-04-16 Redflex Traffic Systems, Inc. Automated traffic violation monitoring and reporting system
EP1301895A4 (en) * 2000-05-24 2004-09-29 Redflex Traffic Systems Inc Automated traffic violation monitoring and reporting system
US7986339B2 (en) 2003-06-12 2011-07-26 Redflex Traffic Systems Pty Ltd Automated traffic violation monitoring and reporting system with combined video and still-image data
US7821422B2 (en) 2003-08-18 2010-10-26 Light Vision Systems, Inc. Traffic light signal system using radar-based target detection and tracking

Also Published As

Publication number Publication date
PT700559E (en) 2000-07-31
EP0700559A4 (en) 1997-01-02
ES2144521T3 (en) 2000-06-16
EP0700559A1 (en) 1996-03-13
GR3033355T3 (en) 2000-09-29
JPH08510349A (en) 1996-10-29
JP3410470B2 (en) 2003-05-26
DK0700559T3 (en) 2000-07-24
ATE189551T1 (en) 2000-02-15
DE69422918T2 (en) 2000-10-12
EP0700559B1 (en) 2000-02-02
HK1013157A1 (en) 1999-08-13
DE69422918D1 (en) 2000-03-09

Similar Documents

Publication Publication Date Title
US5938717A (en) Speed detection and image capture system for moving vehicles
US6650765B1 (en) System for simultaneously imaging vehicles and their license plates
US7986248B2 (en) Image recording apparatus and method
US20060269105A1 (en) Methods, Apparatus and Products for Image Capture
WO1993021617A1 (en) Vehicle monitoring apparatus
EP0700559B1 (en) Image storage system for vehicle identification
JP2006190198A (en) Portable vehicle number recognizing device and vehicle number recognizing method using the same
US5936668A (en) Color image display device
EP0243977B1 (en) Still image pickup camera
KR100825669B1 (en) Cross Road Integrating Administration System
CA2163424C (en) Image storage system for vehicle identification
AU694731B2 (en) Imaging apparatus and storage system for vehicle identification
NL9300671A (en) Method and device for electronically recording an event, for example a traffic violation.
JP2646754B2 (en) Automatic parking violation warning device
JP2002109589A (en) Parking lot control device
JP3230998B2 (en) Mobile imaging device
KR970049930A (en) Vehicle Identification Image Processing System and Its Operation Method
JPH1145394A (en) Signal neglect automatic control device
JPS6246920B2 (en)
KR100403762B1 (en) apparatus for photograping and measuring speed
JPH0329099A (en) Automatic monitor system for illegal parking
KR20000061294A (en) Traffic Violation Enforcement System
JP2663924B2 (en) Vehicle license plate reader
KR0174148B1 (en) Moving laser automatic video speed measuring device
JPH07152992A (en) Unlawful vehicle detecting device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AT AU BB BG BR BY CA CH CN CZ DE DK ES FI GB GE HU JP KG KP KR KZ LK LU LV MD MG MN MW NL NO NZ PL PT RO RU SD SE SI SK TJ TT UA US UZ VN

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2163424

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 1995 549754

Country of ref document: US

Date of ref document: 19951124

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 266396

Country of ref document: NZ

WWE Wipo information: entry into national phase

Ref document number: 1994916083

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1994916083

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWG Wipo information: grant in national office

Ref document number: 1994916083

Country of ref document: EP