CA1298107C - Image correction processing method - Google Patents

Image correction processing method

Info

Publication number
CA1298107C
CA1298107C CA000469063A CA469063A CA1298107C CA 1298107 C CA1298107 C CA 1298107C CA 000469063 A CA000469063 A CA 000469063A CA 469063 A CA469063 A CA 469063A CA 1298107 C CA1298107 C CA 1298107C
Authority
CA
Canada
Prior art keywords
image
scanning
coordinate system
point
coordinate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CA000469063A
Other languages
French (fr)
Inventor
Youichi Seto
Koichi Homma
Fuminobu Komura
Hideo Ota
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Application granted granted Critical
Publication of CA1298107C publication Critical patent/CA1298107C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • G01C11/025Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures by scanning the object

Abstract

Abstract:
The present invention relates to distortion models consisting of two forward and backward reciprocating planes that let a corrected image correspond to an uncorrected image for each scanning direction. The models are constituted to let an uncorrected satellite image, scanned by a reciprocating scanning sensor, with scanning overlap or scanning underlap correspond to a corrected image after distortion correction by means of a continuous mapping function on a 1:1 basis. It is determined whether each point on the corrected image is a point on an over-lapping scan or on an underlapping scan or on a normal scan from the existence of a real point on the distortion models.

Description

-~2~

Imaqe correction p_ocessing method _ This invention relates to an image correction processing method for a satellite image displaying geometric distortion, and more particularly to a correction processing method for the image obtained by an optical sensor known as a Thematic Mapper (TM) mounted on the Landsat 4 Satellite.
The scanning error resulting from orbit and attitude fluctuations in the conventional satellite image is within the error allowance of a model. As a result, correcting scanning error has not been taken into consideration because the scanning i5 unidirectional scanning as typified by multispectral scanning (MSS). The resulting resolution is as low as 2.7X when compared with a TM sensor.
Therefore, the prior art technique included a problem in that, in a model, i.e. a mapping function which gives a correspondence between a corrected image and an uncorrected image~ the mapping function is discontinued at the positions where a scanning error exists. As a result, the image cannot be expressed at the error positions.
The present invention is directed to providing a correction processing method which can easily distinguish scanning distortion caused by overlap or underlap between points on the satellite image read by a reciprocating scanning sensor.
3~;

~981()7 To accomplish the object described above, the present invention constitutes two models, reciprocating two-plane distortion models, in which the corrected image corresponds to the uncorrected image.for the scanning directions, and which carries out processing in such a manner that if no real point is found on either of the two models for a point on the corrected image, the point is judged to be on an underlapping scan.
If a real point is found on both models, the point is judged to be on an overlapping scan. Finally, if a real point is found on only one of the two models, the point is judged to be on a normal scan.
In accordance with one aspect of the invention there is provided a satellite image geometric correction processing method for use in an image correction system for correcting distortion in an image produced by displaying received data resulting from reciprocatiny scanning of an image detecting device mounted on a satellite, comprising the steps of:
establishing a first coordinate system for a corrected image;
allocating data signals representing received image data to s0cond and third coordinate systems to provide uncorrected images for the forward and backward scanning directions of said image detecting device, respectively: locating the respective coordinate points of the received image data in said second and third coordinate systems which correspond to the points of said first coordinate system; determining for each point of said first coordinate system whether or not the corresponding points of said second and third coordinate systems exist on a scanning region in the respective coordinate system; determining the intensity of image data at a point of said first coordinate system through interpolation by assuming that the point exists on an underlapping scanning region when the corresponding coordinate point of said second and third coordinate system does not exist on a scanning region of either of said second and third coordinate system;

~298~
; 2a and visually producing the corrected image data in said first coordinate system on the basis of the determined intensity of each point therein.
The present invention will be described in detail hereinbelow with the aid of the accompanying drawings in which^
Figure 1 shows a conventional model representing a corrected image function and an uncorrected image function;
Figure 2 shows the Landsat 4 Satellite schematically;
Figure 3 shows a two plane distortion model system with a double mapping function schematically; and Figure 4 shows a flow chart for correction processing of the Landsat 4 Satellite TM image in accordance with the corresponding two-plane distortion model system.

~L~

983L0~

With reference to Figs~ 1 and 2, one must first consider the reason why conventional distortion correction systems cannot judge and correct scanning error distortion, overlappîng scan 1 and underlapping scan 2 shown in Figure 1. Figure 2 shows the outline of the Landsat 4 Satellite TM sensor. An oscillating scanning mirror 8 reciprocally scans the ground surface in a direction corresponding to that indicated by arrows 9, to take photographs of the ground surfaceO The image obtained by photographing the ground surface exhibits differences ~etween forward scanning 6 and backward scanning 7 due to the attitude fluctuation of the scanning mirror and satellite as represented by the corrected image 4 in Figure 1. The following processes (1) through (3) are carried out in order to correct the received image.
(1) The mapping function y representing geometric correspondence from the received uncorrected image 3 to the corrected image 4 is determined. The mapping function y is determined from data such as the orbit attitude data of the satellite, the scanning angle, and the like.
(2) A representative point on the corrected image such as a point (xi, Yi) on the received image corres-ponding to the normal grid point (ui, vi), for example, is obtained by repeated calculation of convergence of the mapping unction y (primarily because the inverse mapping function~ 1 cannot be determined), and the points corres-ponding to those other than ~he representative point are interpolated to approximate the inverse mapping function y -1 (3) The corresponding point (x, y) of the corrected picture element poisition (u, v) is obtained with the approximate inverse mapping function~ 1, and the surrounding received image data is interpolated to obtain a corrected image intensity value, because its position does not generally correspond to the picture element position on the received image.
., ~2~1~3 3L~'7 If the mapping function y is continuous, the distortion correction processing described above can approximate the inverse mapping functiony with an arbitrary level of accuracy by increasing the density of the representative point on the output image; hence, it does not present any problem When the received image 3 has an overlapping scan l or an underlapping scan 2, however, the mapping funtion y is a many-to-one or a zero-to-one relation and approximation with the continuous function is impossible.
Hereinafter, one embodiment of the present invention will be described with reference to the reciprocating two-plane distortion model of the Landsat 4 Satellite by referring to Figures 3 and 4.
The mapping function y representing the correspondence between the corrected image 4 and the uncorrected image 3 is the function that uses the attitude angle ~(t) of the satellite, the position ~(t) and the scanning angle ~tt) as its variables. Mapping ~(x,y) from the uncorrected image coordinates x - y to the corrected image coordinates u ~ v can be expressed by the following formula. Here, t represents the time, and is a function of the uncorrected image coordinates x - y as t = ttX, y):
(u, v) = y[~(t), ~(t), ~(t)] ....~ (l) The present invention is practiced with the following [A] and [B].
[~: Introduction of double mapping functionsy ll and y Mapping ~ from the corrected image coordinates system u - v to the uncorrected image coordinates system x ~ y is not l:l mapping on the TM image for the following reasons (l) and (2).
(l) There is a region Ql' scanning overlap region, on the corrected i~age where mapping is a one-to-many relation.
; (2) There is a region Q2~ the scanning underlap region, on the corrected image where no corresponding point exists on the uncorrected image coordinate system x - y.

~z~

Therefore, the present invention considers the two coordinates systems xl - Yl and x2 - Y2 to be the uncorrected image coordinates 3.
These two coordinates are the following (a) and (b) as shown in Figure 3:
(a) The coordinates system xl - Yl formed by alternately coupling forward scanning data regions 6 and imaginary forward scanning data regions lo; and (b) The coordinates system x2 - Y2 formed by alternately coupling backward scanning data regions 7 and imaginary backward scanning data regions 17.
The two coordinates systems define two mappings y 1l and y21 corresponding to xl - Yl and x2 - Y2, respectively. When carrying out imaginary forward (backward) scanniny, mapping is obtained by proceeding as if scanning were made in practice forward (or backward) scanning with forward (or backward) scanning characteristics.
Therefore, mappingsy 1l and~ 21 are continuous, 1:1 mapping functions.
The following can be judged from the relation between four kinds of points a, b, c, d on the corrected image 4 and the corresponding points al, bl, cl, dl, a2~ 2~ 2 2 uncorrected image:
(i) The points al, a2, corresponding to the point a on the scanning overlap region Ql' exist in the practical image data regions 6, 7 on the uncorrected image 3; and (ii) The points cl, c2 corresponding to the point c on the scanning underlap region ~2 exist in the imaginary image data regions 16, 17 on the uncorrected image 2.
[B] Introduction of the reciprocating two plane distortion model correction system:
Figure 4 shows the flow of the reciprocating two-plane distortion model correction process.
Step 18: The coordinates (u~ v) on the corrected image 4 are determinedO

~ ~ ~9~7 Step 19: The corresponding points (xl, Y~ x2, Y2) on the uncorrected image 3 are determined from the point (u, v) on the corrected image 4 by mapping~ 1l (u, v) and mapping ~ 21 (u, v). The satellite parameter data 20 are used when determining the mapping y 1l and ~21.
Step 20: Data such as the satellite position, the attitude, the scanning angle of the sensor, and the like are calculated.
Step 21: It is determined whether or not the corres-ponding point (xl, Yl) exists on a real scan. If it does step 22 is followed, and if not, step 23 is followed.
Step 22: It i9 determined whether or not the corres-ponding point (x2, Y2 exists on the real scanO If it does step 24 is followed and if not, step 25 is followed.
Step 23: It is determined whether or not corresponding point (x2, Y2) exists on the real scan. If so, step 26 is followed and if not, step 27 is followed.
Step 2~: Interpolation is made assuming that the point exists on an overlapping scan.
Step 25: Interpolation is made assuming that the point exists on a normal scan of the coordinates expressed by yll ~
Step 26: Interpolation is made assuming that the point exists on a nor~al scan of the coordinates expressed by Step 27: Interpolation is made assuming that the ~oint exists on an underlapping scan.
After the procedures described above have been carried out for all the points (u, v) on the corrected image, geometric distortion taking the scanning error into consideration can be corrected~
The present invention is particularly effective for detecting scanning error when correcting a satellite image having geometric distortion such as scanning overlap or underlap resulting from reciprocating scanning.

Claims (4)

1. A satellite image geometric correction processing method for use in an image correction system for correcting distortion in an image produced by displaying received data resulting from reciprocating scanning of an image detecting device mounted on a satellite, comprising the steps of:
establishing a first coordinate system for a corrected image;
allocating data signals representing received image data to second and third coordinate systems to provide uncorrected images for the forward and backward scanning directions of said image detecting device, respectively;
locating the respective coordinate points of the received image data in said second and third coordinate systems which correspond to the points of said first coordinate system;
determining for each point of said first coordinate system whether or not the corresponding points of said second and third coordinate systems exist on a scanning region in the respective coordinate system;
determining the intensity of image data at a point of said first coordinate system through interpolation by assuming that the point exists on an underlapping scanning region when the corresponding coordinate point of said second and third coordinate system does not exist on a scanning region of either of said second and third coordinate system, and visually producing the corrected image data in said first coordinate system on the basis of the determined intensity of each point therein.
2. A satellite image geometric correction processing method according to claim 1, which further comprises a step of determining the intensity of image data at a point of said first coordinate system through interpolation by assuming that the point exists on an overlapping scanning region when the corresponding coordinate points of said second and third coordinate systems exist on a scanning region of both of these coordinate systems.
3. A satellite image geometric correction processing method according to claim 2, wherein said second coordinate system is formed by alternate forward scanning data regions and imaginary forward scanning data regions and said third coordinate system is formed by alternate backward scanning data regions and imaginary backward scanning data regions.
4. A satellite image geometric correction processing method according to claim 1, wherein said second coordinate system is formed by alternate forward scanning data regions and imaginary forward scanning data regions and said third coordinate system is formed by alternate backward scanning data regions and imaginary backward scanning data regions.
CA000469063A 1983-12-02 1984-11-30 Image correction processing method Expired - Lifetime CA1298107C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP58226857A JPS60120473A (en) 1983-12-02 1983-12-02 Correcting and processing system of satellite picture
JP226857/1983 1983-12-02

Publications (1)

Publication Number Publication Date
CA1298107C true CA1298107C (en) 1992-03-31

Family

ID=16851653

Family Applications (1)

Application Number Title Priority Date Filing Date
CA000469063A Expired - Lifetime CA1298107C (en) 1983-12-02 1984-11-30 Image correction processing method

Country Status (4)

Country Link
US (1) US4695964A (en)
JP (1) JPS60120473A (en)
CA (1) CA1298107C (en)
FR (1) FR2556159B1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5165016A (en) * 1985-10-07 1992-11-17 Casio Computer Co., Ltd. Image data output apparatus with display range designation means
GB2188205B (en) * 1986-03-20 1990-01-04 Rank Xerox Ltd Imaging apparatus
JP2653443B2 (en) * 1987-09-18 1997-09-17 株式会社東芝 Gamma camera sensitivity correction device
US4989086A (en) * 1988-06-02 1991-01-29 Westinghouse Electric Corp. Ultra wide field-of-regard multispectral imaging radiometer
JPH0648844B2 (en) * 1990-04-18 1994-06-22 大日本スクリーン製造株式会社 Image reader
US5323334A (en) * 1992-12-04 1994-06-21 Hughes Aircraft Company Sensor system having nonuniformity suppression with image preservation
US5278402A (en) * 1993-06-09 1994-01-11 Litton Systems Real-scene dispersion sensor detecting two wavelengths and determining time delay
US5798923A (en) * 1995-10-18 1998-08-25 Intergraph Corporation Optimal projection design and analysis
US6249289B1 (en) * 1996-11-27 2001-06-19 Silicon Graphics, Inc. Multi-purpose high resolution distortion correction
CN100346633C (en) * 2001-07-12 2007-10-31 杜莱布斯公司 Method and system for correcting chromatic aberrations of a colour image produced by an optical system
US6810153B2 (en) * 2002-03-20 2004-10-26 Hitachi Software Global Technology, Ltd. Method for orthocorrecting satellite-acquired image

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3560642A (en) * 1967-10-13 1971-02-02 Us Navy Television satellite system
JPS508883B1 (en) * 1970-06-18 1975-04-08
US3676581A (en) * 1971-02-01 1972-07-11 Us Navy Optical scanning spacecraft system
US3716669A (en) * 1971-05-14 1973-02-13 Japan Eng Dev Co Mapping rectifier for generating polarstereographic maps from satellite scan signals
US3952151A (en) * 1973-08-13 1976-04-20 Trw Inc. Method and apparatus for stabilized reproduction of remotely-sensed images
US4245254A (en) * 1978-08-30 1981-01-13 Westinghouse Electric Corp. Image motion compensator
US4313678A (en) * 1979-09-24 1982-02-02 The United States Of America As Represented By The Secretary Of The Interior Automated satellite mapping system (MAPSAT)
JPS5784058U (en) * 1980-11-04 1982-05-24

Also Published As

Publication number Publication date
FR2556159B1 (en) 1988-09-16
JPS60120473A (en) 1985-06-27
JPH0563835B2 (en) 1993-09-13
FR2556159A1 (en) 1985-06-07
US4695964A (en) 1987-09-22

Similar Documents

Publication Publication Date Title
CA1298107C (en) Image correction processing method
US6373518B1 (en) Image correction apparatus for stereo camera
US7313289B2 (en) Image processing method and apparatus and computer-readable storage medium using improved distortion correction
Wu Adaptive split-and-merge segmentation based on piecewise least-square approximation
US6385334B1 (en) System and method for adjusting stereo camera
US6078701A (en) Method and apparatus for performing local to global multiframe alignment to construct mosaic images
CN110830781B (en) Automatic projected image correction method and system based on binocular vision
CA1223060A (en) Image distortion correction system for electro-optic sensors
JPH07334679A (en) Area extracting device
CA1220543A (en) Image correction processing method
CN108592884B (en) A kind of general linear array satellite core line image generating method
US5422962A (en) Method and apparatus for extracting line segments from an image of an object
Maas Automatic DEM generation by multi-image feature based matching
EP0472455B1 (en) Reproduction of image pattern data
US6256035B1 (en) Image processing method and apparatus
Wiemker Registration of airborne scanner imagery using akima local quintic polynomial interpolation
CN112665528A (en) Correction method for laser scanning three-dimensional imaging
Castellani et al. Efficient on-line mosaicing from 3D acoustical images
JP2003346144A (en) Method and system for extracting outline of building
Hebert SMARTY: Point-based range processing for autonomous driving
JPS58189781A (en) Pattern recognizer
US20020159654A1 (en) Method for processing an image of a concrete construction
JPH10340337A (en) Correction method for inclination, extension and contraction of image data of drawing with drawing frame line graphic
Lopez-Abadia et al. Vision-guided mobile robot navigation
JP2621810B2 (en) Figure detection method and apparatus

Legal Events

Date Code Title Description
MKEX Expiry