US20030090586A1 - Method for exploring viewpoint and focal length of camera - Google Patents

Method for exploring viewpoint and focal length of camera Download PDF

Info

Publication number
US20030090586A1
US20030090586A1 US09/981,942 US98194201A US2003090586A1 US 20030090586 A1 US20030090586 A1 US 20030090586A1 US 98194201 A US98194201 A US 98194201A US 2003090586 A1 US2003090586 A1 US 2003090586A1
Authority
US
United States
Prior art keywords
camera
lens
calibration target
projection
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/981,942
Other versions
US6985183B2 (en
Inventor
Gwo-Jen Jan
Chuang-Jan Chang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Appro Technology Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2001280904A priority Critical patent/JP3624288B2/en
Application filed by Individual filed Critical Individual
Priority to US09/981,942 priority patent/US6985183B2/en
Assigned to APPRO TECHNOLOGY INC. reassignment APPRO TECHNOLOGY INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHANG, CHUANG-JAN, JAN, GWO-JEN
Publication of US20030090586A1 publication Critical patent/US20030090586A1/en
Application granted granted Critical
Publication of US6985183B2 publication Critical patent/US6985183B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation

Definitions

  • the present invention relates to a method for processing and showing digital images. More specifically, the invention is a method for restoring distortive images to normal ones by means of finding out the viewpoint and focal length of a lens in a camera.
  • the imaging principle of cameras described by general optical theory is mostly built on hypotheses of a rectilinear projection model.
  • a camera with a similar kind of lens usually can get image pictures close to normal reality.
  • the field of view (FOV) is small.
  • FOV of standard lenses is around 45 degrees to 55 degrees. It enables some devices that need a broad FOV, like surveillance or endoscopes etc., to use wide-angle lens or fisheye lens (FEL) in order to capture pictures with a big FOV with every single shot.
  • FOV field of view
  • the FEL is used to capture extremely wide-angled images.
  • a fisheye lens camera FELC
  • FELC fisheye lens camera
  • the level of accuracy of the calibration method attained determines what fields the FELC can be applied. For instance, if the surveillance systems only need to see where people or things are, they can tolerate a partial distortion in images.
  • the purpose is taking pictures for virtual reality (VR), it is also acceptable that images “look like” normal ones.
  • VR virtual reality
  • our purpose involves 3-D image metering, such as stereoscopic or autonomous robotic vision, it is difficult to obtain accurate 3-D positions of images from reality in situations that some cubical optical parameters of the FEL are unknown.
  • FIG. 1A and FIG. 1B wherein FIG. 1B is a cubical projection of FIG. 1A, it is assumed that the image plane 1 is an ellipse (or a circle), and the intersection point 13 of its major axis 11 and minor axis 12 is exactly the image center (the point C on both the figures). In addition, it is also assumed that the FOV taken by the FEL is exactly 180 degrees.
  • the periphery of the imaged area has a zenithal angle of ⁇ /2
  • the one on the distortion center 13 has an angle of 0, and the others are determined by the relative location between the point C 13 and the periphery.
  • the point A in FIG. 1A corresponds to the point A′ in FIG. 1B.
  • the method of calibration described above is simple and needs no calibration target to assist. Nevertheless, its premises are not really correct.
  • the center point 13 on the obtained picture perhaps is not the real image center.
  • the periphery of an image taken by the FEL is usually blurred, so it is difficult to correctly decide where the imaged boundary exactly lies. Accordingly, the fidelity of the calibrated image is not verifiable. Obviously, this image-based model of analysis cannot be used appropriately in the domain of 3-D metering.
  • TeleBobotic International Inc. has disclosed several technologies regarding the FEL, such as the U.S. Pat. Nos. 5,185,667, 5,313,306, 5,359,363 and 5,384,588. Overall, the contents of the technologies are described as following: a hemispheric FOV is shot by a FELC without moving or rotating the camera, utilizing a dedicated electronic circuit controlled by a computer to digitally transfer the original distortive images into normal perspective ones and show them in a display. The technologies are indicated to apply in the fields of orientation, surveillance, endoscopes, remote control, etc.
  • IH the distance from an imaged point to the optic axis of a lens (also called the image height)
  • the effective focal length of the FEL
  • the incident angle in the focal plane, being named the zenithal angle if the optical axis is upward as shown in FIG. 1B.
  • the stereographic projection is the best, but the equidistant form is a normally given type that is easier to produce. Therefore, most of the current calibration methods have a postulation that almost all projection modes of the FEL are equidistant projection. Basically, it is not certain.
  • the FEL is treated as no “real viewpoint”. However, if the corresponding projection mode can be classified and the focal length can be discovered, it can not only calibrate distortion but also be applied in the field of 3-D metering and in the quality control or the specification verification of the deployed products.
  • Another object of this invention is to explore the viewpoint (also termed the front nodal point in the traditional optically modeling) and the effective focal length of the fisheye lens camera (FELC) so as to employ it in the field of 3-D application.
  • viewpoint also termed the front nodal point in the traditional optically modeling
  • FELC effective focal length of the fisheye lens camera
  • a further object of this invention is to provide a method for parameterizing or verifying the optical characteristic of a FEL or related devices to control the quality of products before deploying.
  • the present invention provides a method for exploring the viewpoint and the focal length of the FELC.
  • both the centers of the test pattern and the corresponding image are connected to locate the optic axis of the FEL. Thereafter, a pinpoint will be searched out along the optic axis to enable the image height and the corresponding physical zenithal angle fit in with a specific projection model.
  • the projection model could be one of an equidistant projection, a stereographic projection or an orthographic projection, being the well-known projection modes of the FEL. Accordingly, the located pinpoint will be the viewpoint of the FELC and then the effective focal length will be acquired through the obtained projective formula.
  • the present invention has the ability to find out the viewpoint, the effective focal length and its inherent projection model. Therefore, it can not only calibrate distortion and find out the projection mechanism but can also be applied in the quality verification of products and, further, in setting up a versatile 3-D metering applications with a larger view angle.
  • FIG. 1A and FIG. 1B show a schematic view of a related-art calibration method for a FEL's image
  • FIG. 2 shows a schematic view of an optical path about locating the optic axis of the FEL in the invention
  • FIG. 3A through FIG. 3D show a schematic view of four embodiments of the test pattern in the calibration target
  • FIG. 4 shows a schematic view of an optical path to point out the viewpoint and the effective focal length with a sampling of the equidistant projection
  • FIG. 5 shows an approaching curve while the invention is practically tested for seeking the viewpoint
  • FIG. 6 shows another embodiment of the calibration target which can do with a visual angle greater than 180 degrees.
  • the distortive phenomenon has the following characteristics: the distortion is axially symmetric in viewing space and center symmetric in the imaged plane. These are well-known to those skilled in the art.
  • the present invention first takes advantage of the characteristics to locate the optic axis of the FEL. With the reference to the optic axis then, further find out the viewpoint of the FEL and figure out the focal length by a dedicated projection mode.
  • a calibration target 22 should be used to practice the method of the invention.
  • the calibration target 22 provides at least one flat plane. In locating the optic axis, there is at least one geometric figure on the flat plane of the calibration target 22 . If there are plural ones, they must be homocentric and symmetric, like the concentric circles shown in FIG. 2, totally called test pattern 220 . While the calibration is proceeding, the calibration target 22 is put in the field of view (FOV) of the fisheye lens camera (FELC). At this moment the test pattern 220 forms a corresponding image 230 on an image plane 23 behind the FEL 24 .
  • FOV field of view
  • FELC fisheye lens camera
  • the image 230 will be similar to the concentric circles although it is also distorted. Hence, the position of the calibration target 22 is adjusted until the image 230 is exactly composed of concentric circles. Then both the centers of the test pattern 220 and the image 230 are connected to locate the optic axis 21 of the FEL 24 .
  • test pattern 220 There are many kinds of the test pattern 220 which can be employed in the invention, not only the concentric circles shown in FIG. 3A. It will be a better embodiment for the test pattern 220 to be composed of homocentric and symmetric figures. In addition to the concentric circles, the concentric rectangles shown in FIG. 3B, the concentric triangles shown in FIG. 3C or the concentric hexagons shown in FIG. 3D are all applicable in the invention. Even the combination of any number of circles, rectangles, triangles and polygons will be a possible embodiment of the test pattern 220 in the invention. Considering the barrel distortion of the image 230 , in addition to circles, it is necessary to set up featured coordinates on the angles of the figures, such as rectangles or triangles, to be the references during calibration.
  • the viewpoint if there is one must be a certain point on the optic axis 21 based on the optics theory, and it is frequently inside the FEL 24 . It means that the possible range of the viewpoint is limited substantially. Hence, every point on the optic axis 21 is tested one by one through trial and error to find out the viewpoint of the FEL 24 .
  • the method of testing also utilizes the test pattern 220 on the calibration target 22 .
  • the zenithal angle ⁇ i which is the extent between the incident rays of sight and the optic axis 21
  • the distance IH i also called the image height
  • the utilized test pattern 220 is a planar graph of twenty concentric circles, each separated by a constant five-mm radial distance around a central blob.
  • the coordinate system of FIG. 4 is declared as setting the origin at the perpendicular intersection point of the center of the calibration target 22 and the optic axis 21 .
  • the viewpoint must be on the optic axis, being denoted as (0,0,z), where z is a real number.
  • the distance between the viewpoint and the calibration target 22 is D
  • setting the radius of each concentric circle is r i , each corresponding to an image height IH i .
  • the object distance D can be fixed at the minimum of e i (z) if there is only one.
  • z is the distant of a free point on the optic axis 21 from the test target 220 toward the FEL 24 .
  • the viewpoint is located at where the ⁇ (z) is minimum or zero.
  • ⁇ i (D) IH i (D)/ ⁇ i (D).
  • the ⁇ (D), the ⁇ i (D) and the ⁇ are equal to the inherent focal length of the FEL if there is no error in measurement, and D value is inferred accurately.
  • FIG. 5 which shows some matching profiles while searching for D value along the located optical axis of a tested FELC that is composed of a board camera (Type BV-7112, by Appro Tech. Co., Taiwan) installing a fisheye lens having the focal length of 1.78 mm and 170 degrees diagonal angle of view (Type DW9813, by Daiwon Optical Co., Korea).
  • the solid line in the figure is the profiles of the matching errors respecting an unknown offset from the test target 22 .
  • the inferred objective distance is 14.7 mm.
  • the invention further moves the calibration target 22 separately forward 5 times each with increasing offset of 5 mm to proceed the same tests.
  • the sibling offsets must be a constant of 5.0 mm.
  • the measured data demonstrates that the deviation in each test isn't proportional increasing when the objective distance is changed. For instance, the relative deviation of last column is 0.2 mm (i.e. 25.0 mm to 24.8 mm) and the one in column 4 is 0.3 mm (i.e. 15.0 mm to 14.7 mm). Therefore, these errors could be interpreted as a random process in the experiments.
  • the linearity of the objective offsets proves the uniqueness of the viewpoint.
  • the projective formula is based to derive the focal lengths. These values are shown on row 3.
  • the height of the CCD cell in the camera is based to absolutely scale the ⁇ (D) accordingly.
  • the values of the ( ⁇ (D) ⁇ (D)) are close and each a (D) is pretty small.
  • Image calibration of the FELC will be extremely easy when the viewpoint and focal length of the FELC are disclosed.
  • the imaging is modally analytical and the barrel deformation is a natural phenomenon.
  • the projective mechanism can be read as having a specific property that the incident rays doesn't refract on the viewpoint (or the perspective point on the focal plane) but on the surface of a hemisphere defined by the effective focal length.
  • a FEL normally owns a hemispherical FOV. It is impossible to reach such wide view angle under the planar calibration target 22 described above.
  • the embolism can also provide the extension. Referring to FIG. 6, it will be done by vertically extending a cylindrical surface 22 a from the periphery of the flat plane to turn the calibration target 22 into a hollow and one-side-open shape like a cubical cylinder or a generally axis-symmetrical physical extension.
  • FIG. 6 being denoted as an azimuthal cut, the cylinder's bottom is drawn a center-referred concentric schema as pre-describing for posing the camera in distance D.
  • the surrounding surface 22 a with D offset from the planar target 22 reaches the horizon of the FEL. Then, as on FIG. 6, the object point 222 on the side of the viewpoint 241 has a view angle of 180 degrees, and the corresponding image point 232 is exactly on the boundary of 180 degrees of the image.
  • This extension can service lens with a view angle larger than 180 degrees.
  • the invention has the ability to find out the viewpoint and the focal length of the camera, 3-D metering (also stereoscope) can be truly realized by two sets of FELC.
  • the method of triangularly cubical posing it is well known to those skilled in the art, hence it is not necessary to having a detailed description here.
  • the invention has the excellent ability of rapidly getting the incident angle on the focal plane from the “so-called” distortive image height by the inherent native projection formula.
  • the invention can reduce tons of processing steps in comparison to the methods in related art by approaching from the rectilinear projective model, which uses a nonlinear polynomial function to calibrate the obtained image height to fit in with the rectilinear projection, then through the inverse-tangent function of the effective focal length to derive the incident angle. Because the incident angle is a necessary step for 3-D metering; the invention has an absolutely advantageous superiority in modeling the kind of severe distortion mechanism such as the FEL by its inherent projection model.
  • 3-D metering can be truly realized by the invention and the objective incident angle can be got by an easier speedy way.
  • the calibration method is simple and low-cost. It is suitable to parameterize or verify the camera with a FEL or any kind of nonlinear projection mechanism.

Abstract

The present invention is a method for exploring the viewpoint and focal length of a fisheye lens camera (FELC). It employs the characteristic of the central symmetry of the distortion of the fisheye lens (FEL) to set its optic axis by means of a calibration target with a plurality of symmetrically homocentric figures. Once the optic axis is fixed, further disclose the viewpoint (VP) of the FELC along the optic axis through a trail-and-error procedure and calculate its effective focal length and classify it to the primitive projection mode. Because the invention is capable of finding out both the internal and external parameters of the FELC and the calibration method is easy, low-cost, suitable to any projection model, and has greater sensitivity corresponding to an increasing in image distortion, the distortive images can be transformed easily to normal ones which fit in with a central perspective mechanism. Furthermore, the invention is also practicable and excellent in its applications in the fields of quality identification of the FEL and wide-view 3-D metering.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of Invention [0001]
  • The present invention relates to a method for processing and showing digital images. More specifically, the invention is a method for restoring distortive images to normal ones by means of finding out the viewpoint and focal length of a lens in a camera. [0002]
  • 2. Related Art [0003]
  • The imaging principle of cameras described by general optical theory is mostly built on hypotheses of a rectilinear projection model. A camera with a similar kind of lens usually can get image pictures close to normal reality. But there is a drawback—the field of view (FOV) is small. For instance, the FOV of standard lenses is around 45 degrees to 55 degrees. It enables some devices that need a broad FOV, like surveillance or endoscopes etc., to use wide-angle lens or fisheye lens (FEL) in order to capture pictures with a big FOV with every single shot. [0004]
  • The FEL is used to capture extremely wide-angled images. Usually, a fisheye lens camera (FELC) can take 180 degrees or more without moving or rotating the camera itself. Coming with the increase of the angle of view, there is also a severe problem of distortion in the captured images. Thus, it is necessary to come out with a calibration method in order to obtain images that are close to reality. The level of accuracy of the calibration method attained determines what fields the FELC can be applied. For instance, if the surveillance systems only need to see where people or things are, they can tolerate a partial distortion in images. If the purpose is taking pictures for virtual reality (VR), it is also acceptable that images “look like” normal ones. However, if our purpose involves 3-D image metering, such as stereoscopic or autonomous robotic vision, it is difficult to obtain accurate 3-D positions of images from reality in situations that some cubical optical parameters of the FEL are unknown. [0005]
  • However, for customers, the kind of lens that has the advantages of wide-angled views and showing image in clarity as well as the capability of metering accurately will be very competitive and attractive. Moreover, with the excellent characteristic of a nearly infinite view depth, it is a point that other kinds of lenses are scarcely comparable to the fisheye lens. If the imaged distortion isn't counted, the fisheye lens is superior to other kinds of lenses. Thus, for expanding the applied fields, how to calibrate the distortive images of the FEL is vitally important. [0006]
  • Currently, there are many calibration methods have been advanced. R. Y. Tasi [1987] (Tsai, “A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV camera and lenses”, IEEE Journal of Robotics and Automation, Vol. RA-3, No 4, August, 1987, pp 323-344) employs five non-coplanar points of known absolute coordinates in viewing space and transfers them by a rotation matrix and a translation matrix to gain the viewpoint and the focal length of a normal lens. The result from Tasi's model is pretty accurate. But its demonstration also is based on the hypothesis of rectilinear projection; it will involve a large error under a severely nonlinear projection system like the FEL. For the purposes of calibrating the FEL, Tasi's model seems not to be a common choice. Thereafter, there is a simple calibration method aimed at the FEL. With reference to FIG. 1A and FIG. 1B, wherein FIG. 1B is a cubical projection of FIG. 1A, it is assumed that the [0007] image plane 1 is an ellipse (or a circle), and the intersection point 13 of its major axis 11 and minor axis 12 is exactly the image center (the point C on both the figures). In addition, it is also assumed that the FOV taken by the FEL is exactly 180 degrees. On the premised basis, it is deduced that the periphery of the imaged area has a zenithal angle of π/2, the one on the distortion center 13 has an angle of 0, and the others are determined by the relative location between the point C 13 and the periphery. For example, the point A in FIG. 1A corresponds to the point A′ in FIG. 1B. The method of calibration described above is simple and needs no calibration target to assist. Nevertheless, its premises are not really correct. First, the center point 13 on the obtained picture perhaps is not the real image center. Next, the periphery of an image taken by the FEL is usually blurred, so it is difficult to correctly decide where the imaged boundary exactly lies. Accordingly, the fidelity of the calibrated image is not verifiable. Obviously, this image-based model of analysis cannot be used appropriately in the domain of 3-D metering.
  • With regard to the patents, TeleBobotic International Inc. has disclosed several technologies regarding the FEL, such as the U.S. Pat. Nos. 5,185,667, 5,313,306, 5,359,363 and 5,384,588. Overall, the contents of the technologies are described as following: a hemispheric FOV is shot by a FELC without moving or rotating the camera, utilizing a dedicated electronic circuit controlled by a computer to digitally transfer the original distortive images into normal perspective ones and show them in a display. The technologies are indicated to apply in the fields of orientation, surveillance, endoscopes, remote control, etc. Subsequently, according to TeleBobotic's disclosure, Interactive Pictures Corporation further brought up a serial of new inventions, such as the U.S. Pat. Nos. 5,764,276, 5,877,801, 5,903,319, 5,990,941, 6,002,430, 6,147,709 and 6,201,574 B1. But no matter whichever above all employs a same projection mode to calibrate images. They do not really find out the viewpoint and the focal length the parameters of the FEL, and consider that the same projection mechanism shown in FIG. 1A and FIG. 1B, the equidistant projection (EDP) model. Within the indistinct situations of the exact optical projective mechanism, the present technologies are only for extending and restoring original images but not improve on accuracy. Applications in the field of 3-D image metering would still be restricted. [0008]
  • In the projective models, besides the EDP there are other FEL projection modes known to those skilled in the art—stereographic projection and orthographic projection (often called an equisolid angle projection). Their respective formulas are presented separately as following: [0009]
  • 1. Equidistant projection: IH=ƒθ[0010]
  • 2. Stereographic projection: IH=2ƒ×tan(θ/2) [0011]
  • 3. Orthographic projection: IH=ƒ×sin θ[0012]
  • where, [0013]
  • IH: the distance from an imaged point to the optic axis of a lens (also called the image height) [0014]
  • ƒ: the effective focal length of the FEL [0015]
  • θ: the incident angle in the focal plane, being named the zenithal angle if the optical axis is upward as shown in FIG. 1B. [0016]
  • Theoretically, the stereographic projection is the best, but the equidistant form is a normally given type that is easier to produce. Therefore, most of the current calibration methods have a postulation that almost all projection modes of the FEL are equidistant projection. Basically, it is not certain. [0017]
  • On the other hand, although lenses are usually designed in a specific projective mechanism, after being made it is difficult to verify whether they match the desired specification or not. Furthermore, when the FEL is installed into a real system (such as a camera), its optical parameters such as the effective focal length and the imaged visual angle probably vary accordingly. For this reason, if a simple and common technology is developed, which can verify the optical characteristics of the fabricated devices being produced, to provide a guarantee of quality for the product during sale, it would greatly raise the value. [0018]
  • It is a standpoint to those skilled in the art of the rectilinear projection; the FEL is treated as no “real viewpoint”. However, if the corresponding projection mode can be classified and the focal length can be discovered, it can not only calibrate distortion but also be applied in the field of 3-D metering and in the quality control or the specification verification of the deployed products. [0019]
  • SUMMARY OF THE INVENTION
  • In view of the foregoing, it is an object of this invention to provide an essentially solving method for modeling a severe non-linear projection mechanism such as a fisheye lens (FEL) based on appraising the inherent projection model of the lens. [0020]
  • Another object of this invention is to explore the viewpoint (also termed the front nodal point in the traditional optically modeling) and the effective focal length of the fisheye lens camera (FELC) so as to employ it in the field of 3-D application. [0021]
  • A further object of this invention is to provide a method for parameterizing or verifying the optical characteristic of a FEL or related devices to control the quality of products before deploying. [0022]
  • Pursuant to the above objects, the present invention provides a method for exploring the viewpoint and the focal length of the FELC. First, put a calibration target with a specific test pattern in the field of view (FOV) of the FELC. Adjust the position of the calibration target (or of the FELC) to make its corresponding image have a geometric figure according to some predicted features. At this moment, both the centers of the test pattern and the corresponding image are connected to locate the optic axis of the FEL. Thereafter, a pinpoint will be searched out along the optic axis to enable the image height and the corresponding physical zenithal angle fit in with a specific projection model. The projection model could be one of an equidistant projection, a stereographic projection or an orthographic projection, being the well-known projection modes of the FEL. Accordingly, the located pinpoint will be the viewpoint of the FELC and then the effective focal length will be acquired through the obtained projective formula. The present invention has the ability to find out the viewpoint, the effective focal length and its inherent projection model. Therefore, it can not only calibrate distortion and find out the projection mechanism but can also be applied in the quality verification of products and, further, in setting up a versatile 3-D metering applications with a larger view angle. [0023]
  • Further scope of applicability of the present invention will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art from this detailed description.[0024]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention will become more fully understood from the detailed description given herein below illustration only, and thus are not limitative of the present invention, and wherein: [0025]
  • FIG. 1A and FIG. 1B show a schematic view of a related-art calibration method for a FEL's image; [0026]
  • FIG. 2 shows a schematic view of an optical path about locating the optic axis of the FEL in the invention; [0027]
  • FIG. 3A through FIG. 3D show a schematic view of four embodiments of the test pattern in the calibration target; [0028]
  • FIG. 4 shows a schematic view of an optical path to point out the viewpoint and the effective focal length with a sampling of the equidistant projection; [0029]
  • FIG. 5 shows an approaching curve while the invention is practically tested for seeking the viewpoint; and [0030]
  • FIG. 6 shows another embodiment of the calibration target which can do with a visual angle greater than 180 degrees.[0031]
  • In the various drawings, the same references relate to the same elements. [0032]
  • DETAILED DESCRIPTION OF THE INVENTION
  • There is severe deformation in images projected from an axis-symmetrical nonlinear-distortive lens such as the fisheye lens (FEL). Nevertheless, the distortive phenomenon has the following characteristics: the distortion is axially symmetric in viewing space and center symmetric in the imaged plane. These are well-known to those skilled in the art. The present invention first takes advantage of the characteristics to locate the optic axis of the FEL. With the reference to the optic axis then, further find out the viewpoint of the FEL and figure out the focal length by a dedicated projection mode. [0033]
  • Referring to FIG. 2, a [0034] calibration target 22 should be used to practice the method of the invention. The calibration target 22 provides at least one flat plane. In locating the optic axis, there is at least one geometric figure on the flat plane of the calibration target 22. If there are plural ones, they must be homocentric and symmetric, like the concentric circles shown in FIG. 2, totally called test pattern 220. While the calibration is proceeding, the calibration target 22 is put in the field of view (FOV) of the fisheye lens camera (FELC). At this moment the test pattern 220 forms a corresponding image 230 on an image plane 23 behind the FEL 24. According to the characteristics of axial symmetric and center symmetric distortion, if and only if the test pattern 220 is paralleled with the image plane 23 and the optic axis 21 of the FEL 24 passes through their centers, the image 230 will be similar to the concentric circles although it is also distorted. Hence, the position of the calibration target 22 is adjusted until the image 230 is exactly composed of concentric circles. Then both the centers of the test pattern 220 and the image 230 are connected to locate the optic axis 21 of the FEL 24.
  • There are many kinds of the [0035] test pattern 220 which can be employed in the invention, not only the concentric circles shown in FIG. 3A. It will be a better embodiment for the test pattern 220 to be composed of homocentric and symmetric figures. In addition to the concentric circles, the concentric rectangles shown in FIG. 3B, the concentric triangles shown in FIG. 3C or the concentric hexagons shown in FIG. 3D are all applicable in the invention. Even the combination of any number of circles, rectangles, triangles and polygons will be a possible embodiment of the test pattern 220 in the invention. Considering the barrel distortion of the image 230, in addition to circles, it is necessary to set up featured coordinates on the angles of the figures, such as rectangles or triangles, to be the references during calibration.
  • Referring to FIG. 4, after the [0036] optic axis 21 of the FEL 24 being showed up, the viewpoint if there is one must be a certain point on the optic axis 21 based on the optics theory, and it is frequently inside the FEL 24. It means that the possible range of the viewpoint is limited substantially. Hence, every point on the optic axis 21 is tested one by one through trial and error to find out the viewpoint of the FEL 24. The method of testing also utilizes the test pattern 220 on the calibration target 22. Taking an equidistant projection mode as an example, if a pinpoint 241 on the optic axis 21 is determined as being the viewpoint, the zenithal angle θi, which is the extent between the incident rays of sight and the optic axis 21, and the distance IHi (also called the image height), which is the distance from the image point 231 corresponded with the object point 221 to the optic axis 21 (also the center of the image), are measurable. Having the data of θi and IHi of each concentric circle can further get ƒi value by θi dividing IHi While the projective behavior of the camera totally fits in with the equidistant projection model, the ƒi value is a constant.
  • When the invention is put into practice, the utilized [0037] test pattern 220 is a planar graph of twenty concentric circles, each separated by a constant five-mm radial distance around a central blob. For descriptive purposes, the coordinate system of FIG. 4 is declared as setting the origin at the perpendicular intersection point of the center of the calibration target 22 and the optic axis 21. Thus, the viewpoint must be on the optic axis, being denoted as (0,0,z), where z is a real number. Supposed the distance between the viewpoint and the calibration target 22 is D, and setting the radius of each concentric circle is ri, each corresponding to an image height IHi. Since both IHi and θi are functions of D, the equidistant projection can be rearranged as IHi(D)=ƒθi(D), where i=1˜20. Taking IH20(D)=ƒθ20(D) as reference, the relationship with each another radius is given by:
  • IH i(D)/IH 20(D)−θi(D)/θ20(D)=0
  • If (0, 0, D) is replaced by a free point on the [0038] optic axis 21, an error relationship is given by:
  • e i(z)=IH i(D)/IH 20(D)−θi(z)/θ20(z)
  • According to the relationship, the object distance D can be fixed at the minimum of e[0039] i(z) if there is only one.
  • However, the relationship described above is just a result of picking up two concentric circles. In order to cover the overall effective FOV of the camera and consider that there is a respective nonlinear radial extension of imaging circles so that the effective imaged radius extended by each imaged contour is different, For the reasonable processing, a weight function is defined as w[0040] i(D)=(IHi(D)−IHi−1(D))/IH20(D), where IH0(D)=0, to deal fairly with each effect of the tracks on the image plane 23. Thus, the matching error profile along the optic axis 21 is: ɛ ( z ) = i = 1 20 abs ( e i ( z ) × w i ( D ) )
    Figure US20030090586A1-20030515-M00001
  • where z is the distant of a free point on the [0041] optic axis 21 from the test target 220 toward the FEL 24. The viewpoint is located at where the ε(z) is minimum or zero. To obtain the focal length f, the measured IHi(D) and the respective θi(D) are based to get: f ( D ) = i = 1 20 f i ( D ) × w i ( D )
    Figure US20030090586A1-20030515-M00002
  • where ƒ[0042] i(D)=IHi(D)/θi(D). In the optical modeling, the ƒ(D), the ƒi(D) and the ƒ are equal to the inherent focal length of the FEL if there is no error in measurement, and D value is inferred accurately. Putting in practice, by the descriptive statistic to analyze the standard deviation of ƒi(D) can evaluate the accuracy of the projection model. Namely, the following equation can be as an index to qualify the fitness with the equidistant projection model: σ ( D ) = ( i = 1 20 ( f i ( D ) - f ( D ) ) 2 ) / ( 20 - 1 )
    Figure US20030090586A1-20030515-M00003
  • Referring to FIG. 5, which shows some matching profiles while searching for D value along the located optical axis of a tested FELC that is composed of a board camera (Type BV-7112, by Appro Tech. Co., Taiwan) installing a fisheye lens having the focal length of 1.78 mm and 170 degrees diagonal angle of view (Type DW9813, by Daiwon Optical Co., Korea). The solid line in the figure is the profiles of the matching errors respecting an unknown offset from the [0043] test target 22. After processing, the inferred objective distance is 14.7 mm. Referring to the obtained location (i.e. DD=0 mm), the invention further moves the calibration target 22 separately forward 5 times each with increasing offset of 5 mm to proceed the same tests. Their respective error profiles are the dashed traces in the figure. These curves reveal very obvious minimums under the six testing to locate the viewpoints or the objective distances Respectively, the manipulated parameters and results obtained from the six tests are shown in Table 1.
    TABLE 1
    the parameters and results of tests in the invention
    DD 0.0 5.0 10.0 15.0 20.0 25
    D 14.7 19.6 25.2 30.0 35.3 39.5
    f(D) 1.805 1.788 1.827 1.796 1.798 1.784
    σ (D) 0.005 0.002 0.0091 0.0058 0.0062 0.0052
  • Looking at the data in Table 1, wherever the [0044] calibration target 22 is located in the six separated relative locations denoted as DD shown on row 1; the objective distances inferred by the minimum errors profiles are denoted as D, being shown on the 2nd row. In the model of this invention, the sibling offsets must be a constant of 5.0 mm. The measured data demonstrates that the deviation in each test isn't proportional increasing when the objective distance is changed. For instance, the relative deviation of last column is 0.2 mm (i.e. 25.0 mm to 24.8 mm) and the one in column 4 is 0.3 mm (i.e. 15.0 mm to 14.7 mm). Therefore, these errors could be interpreted as a random process in the experiments. Further, the linearity of the objective offsets proves the uniqueness of the viewpoint. After located the viewpoint, the projective formula is based to derive the focal lengths. These values are shown on row 3. Note, the height of the CCD cell in the camera is based to absolutely scale the ƒ(D) accordingly. The values of the (ƒ(D)±σ(D)) are close and each a (D) is pretty small. These measured data and the parameterized values reveal that the method of the invention has an excellent accuracy and precision.
  • Image calibration of the FELC will be extremely easy when the viewpoint and focal length of the FELC are disclosed. To the usual art, there is no constant focal length if the image of a FEL is interpreted in the way of a rectilinear projection. Nevertheless, if examined alternatively, the imaging is modally analytical and the barrel deformation is a natural phenomenon. Referring to FIG. 4 again and taking the same example of an equidistant projection, the projective mechanism can be read as having a specific property that the incident rays doesn't refract on the viewpoint (or the perspective point on the focal plane) but on the surface of a hemisphere defined by the effective focal length. It means that the imaged [0045] point 231, which is mapped from the point 221 on the test target 22, defines a zenithal angle θi on the rays of sight in the viewed hemispheres, directly shines upon on the spherical surface 25 with the radius of the effective focal length in other hemisphere, and the length of the corresponding arc is exactly the height of the image point 231 on the image plane 23. Therefore, when the viewpoint and the focal length of the FELC are fixed, based on θ=IH/ƒ, the zenithal angle θ of each image point 231 is accordingly obtained, and put it into the formula of IH′=ƒ×tan θ to get the corrected IH′ of the image point 231′. Similar arguments are directly adapted to the FEL of other projective models, except that the corresponding objectively imaged lengths are scaled by their respective projective formulae.
  • This invention is also capable of examining or classifying the projective model of a FELC. If the various projective formulae are applied to derive the respected viewpoints and the focal lengths at the relative different objective offset, the consistent of the obtained values in parameterizing the test camera will enable the distinguishing process. Therefore, the method of exploring the viewpoint and the focal length in the invention is applied not only in the camera whose lens fits in with an equidistant projection, but also the ones with a stereographic projection (IH[0046] i=2ƒ×tan(θi/2)) or an orthographic projection (IHi=ƒ×sin θi); Further, to the one with a specific nonlinear projective model. Accordingly, the invention has ability to classify or verify the inherent projection model of the cameras. As to the camera applied in the invention, it could be a CCD camera, a CMOS camera, a digital camera or a traditional camera with film.
  • A FEL normally owns a hemispherical FOV. It is impossible to reach such wide view angle under the [0047] planar calibration target 22 described above. As for solving the problem, the embolism can also provide the extension. Referring to FIG. 6, it will be done by vertically extending a cylindrical surface 22 a from the periphery of the flat plane to turn the calibration target 22 into a hollow and one-side-open shape like a cubical cylinder or a generally axis-symmetrical physical extension. FIG. 6 being denoted as an azimuthal cut, the cylinder's bottom is drawn a center-referred concentric schema as pre-describing for posing the camera in distance D. The surrounding surface 22 a with D offset from the planar target 22 reaches the horizon of the FEL. Then, as on FIG. 6, the object point 222 on the side of the viewpoint 241 has a view angle of 180 degrees, and the corresponding image point 232 is exactly on the boundary of 180 degrees of the image. This extension can service lens with a view angle larger than 180 degrees.
  • Because the invention has the ability to find out the viewpoint and the focal length of the camera, 3-D metering (also stereoscope) can be truly realized by two sets of FELC. As to the method of triangularly cubical posing, it is well known to those skilled in the art, hence it is not necessary to having a detailed description here. However, the invention has the excellent ability of rapidly getting the incident angle on the focal plane from the “so-called” distortive image height by the inherent native projection formula. It can reduce tons of processing steps in comparison to the methods in related art by approaching from the rectilinear projective model, which uses a nonlinear polynomial function to calibrate the obtained image height to fit in with the rectilinear projection, then through the inverse-tangent function of the effective focal length to derive the incident angle. Because the incident angle is a necessary step for 3-D metering; the invention has an absolutely advantageous superiority in modeling the kind of severe distortion mechanism such as the FEL by its inherent projection model. [0048]
  • Overall, the invention has the following advantages: [0049]
  • 1. The capability of finding out the viewpoint and the focal length of the lens in the camera, so the distortive images can be recovered to normal ones within a central perspective mechanism. [0050]
  • 2. The inherent projection model of the lens can be classified and ensured. [0051]
  • 3. 3-D metering can be truly realized by the invention and the objective incident angle can be got by an easier speedy way. [0052]
  • 4. The calibration method is simple and low-cost. It is suitable to parameterize or verify the camera with a FEL or any kind of nonlinear projection mechanism. [0053]
  • The invention being thus described, it will be obvious that the same technique may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims. [0054]

Claims (21)

What is claimed is:
1. A method for exploring viewpoint and focal length of camera that has an axis-symmetrical nonlinear-distortive lens, the method comprises:
providing a calibration target with a test pattern composed of at least one geometric figure;
aiming the center of the test pattern at an optic axis of a lens in the camera; and
searching a pinpoint along the optic axis to enable at least one image height on an image plane which is related to the geometric figure and the corresponding zenithal angle between the incident rays of light and the optic axis both fit in with a projection model.
2. The method according to claim 1, wherein the geometric figure is selected from the group comprising a circle, a rectangle, a triangle and a polygon.
3. The method according to claim 1, wherein there is a plurality of the geometric figures composed of concentric circles, concentric rectangles, concentric triangles or concentric polygons.
4. The method according to claim 1, wherein the optic axis is further located by the steps comprise:
placing the calibration target in the field of view of the camera to let the test pattern form a corresponding image on the image plane; and
changing the position of the calibration target to make the image similar to the test pattern, then connecting both the centers of the calibration target and the image to locate the optic axis.
5. The method according to claim 1, wherein the lens in the camera is a fisheye lens.
6. The method according to claim 1, wherein the lens is a nonlinear lens with a given projection model.
7. The method according to claim 1, wherein the projection model is selected from the group comprising an equidistant projection, an orthographic projection and a stereographic projection.
8. The method according to claim 1, wherein the pinpoint is the viewpoint of the lens in the camera.
9. The method according to claim 1, wherein the calibration target has at least one flat plane to provide the test pattern.
10. The method according to claim 8, wherein the periphery of the flat plane further vertically extends a surface to turn the calibration target into a hollow and one-side-open shape.
11. The method according to claim 1, wherein the camera is selected from the group comprising a CCD camera, a CMOS camera, a digital camera and a traditional camera with film.
12. A method for exploring viewpoint and focal length of camera that has an axis-symmetrical nonlinear-distortive lens, the method comprises:
providing a calibration target with a test pattern composed of at least one geometric figure;
placing the calibration target in the field of view of the camera to let the test pattern form a corresponding image on an image plane;
changing the position of the calibration target to make the image similar to the test pattern, then connecting both the centers of the calibration target and the image to locate an optic axis; and
searching a pinpoint along the optic axis to enable at least one image height on the image plane which is related to the geometric figure and the corresponding zenithal angle between the incident rays of light and the optic axis both fit in with a projection model.
13. The method according to claim 12, wherein the geometric figure is selected from the group comprising a circle, a rectangle, a square, a triangle and a polygon.
14. The method according to claim 12, wherein there is a plurality of the geometric figures composed of concentric circles, concentric rectangles, concentric triangle or concentric polygons.
15. The method according to claim 12, wherein the lens in the camera is a fisheye lens.
16. The method according to claim 12, wherein the lens is a nonlinear lens with a given projection model.
17. The method according to claim 12, wherein the projection model is selected from the group comprising an equidistant projection, an orthographic projection and a stereographic projection.
18. The method according to claim 12, wherein the pinpoint is the viewpoint of the lens in the camera.
19. The method according to claim 12, wherein the calibration target has at least one flat plane to provide the test pattern.
20. The method according to claim 12, wherein the periphery of the flat plane further vertically extends a surrounding surface to turn the calibration target into a hollow and one-side-open shape.
21. The method according to claim 12, wherein the camera is selected from the group comprising a CCD camera, a CMOS camera, a digital camera and a traditional camera with film.
US09/981,942 2001-09-17 2001-10-19 Method for exploring viewpoint and focal length of camera Expired - Fee Related US6985183B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2001280904A JP3624288B2 (en) 2001-09-17 2001-09-17 Store management system
US09/981,942 US6985183B2 (en) 2001-09-17 2001-10-19 Method for exploring viewpoint and focal length of camera

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2001280904A JP3624288B2 (en) 2001-09-17 2001-09-17 Store management system
US09/981,942 US6985183B2 (en) 2001-09-17 2001-10-19 Method for exploring viewpoint and focal length of camera

Publications (2)

Publication Number Publication Date
US20030090586A1 true US20030090586A1 (en) 2003-05-15
US6985183B2 US6985183B2 (en) 2006-01-10

Family

ID=27624602

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/981,942 Expired - Fee Related US6985183B2 (en) 2001-09-17 2001-10-19 Method for exploring viewpoint and focal length of camera

Country Status (2)

Country Link
US (1) US6985183B2 (en)
JP (1) JP3624288B2 (en)

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004015976A2 (en) * 2002-07-26 2004-02-19 Appro Technology Inc. Method for presenting fisheye-camera images
WO2004092825A1 (en) * 2003-04-18 2004-10-28 Appro Technology Inc. Method for exploring optical parameters of camera
WO2004092826A1 (en) * 2003-04-18 2004-10-28 Appro Technology Inc. Method and system for obtaining optical parameters of camera
US20050105822A1 (en) * 2003-11-18 2005-05-19 Yoshinori Narita Variable distortion aberration image pickup device
US20080143838A1 (en) * 2006-12-14 2008-06-19 Sateesha Nadabar Method and apparatus for calibrating a mark verifier
US20110018964A1 (en) * 2007-09-21 2011-01-27 The Trustees Of Columbia University In The City Of New York Systems and methods for panoramic imaging
US7963448B2 (en) 2004-12-22 2011-06-21 Cognex Technology And Investment Corporation Hand held machine vision method and apparatus
US8027802B1 (en) * 2006-06-29 2011-09-27 Cognex Corporation Method and apparatus for verifying two dimensional mark quality
CN103852243A (en) * 2012-12-06 2014-06-11 义晶科技股份有限公司 Method for detecting optical center of wide-angle lens and optical center detecting device
CN105511092A (en) * 2014-10-11 2016-04-20 深圳超多维光电子有限公司 Correction device of stereo display device
US9552506B1 (en) 2004-12-23 2017-01-24 Cognex Technology And Investment Llc Method and apparatus for industrial identification mark verification
CN109451302A (en) * 2018-12-07 2019-03-08 昆山丘钛微电子科技有限公司 A kind of camera module test method, device, electronic equipment and medium
US10349047B2 (en) * 2015-09-08 2019-07-09 Lg Innotek Co., Ltd. Device for testing angle of view of camera
US10592715B2 (en) 2007-11-13 2020-03-17 Cognex Corporation System and method for reading patterns using multiple image frames
US10614519B2 (en) 2007-12-14 2020-04-07 Consumerinfo.Com, Inc. Card registry systems and methods
US10621657B2 (en) 2008-11-05 2020-04-14 Consumerinfo.Com, Inc. Systems and methods of credit information reporting
US10628448B1 (en) 2013-11-20 2020-04-21 Consumerinfo.Com, Inc. Systems and user interfaces for dynamic access of multiple remote databases and synchronization of data based on user rules
US10642999B2 (en) 2011-09-16 2020-05-05 Consumerinfo.Com, Inc. Systems and methods of identity protection and management
US10671749B2 (en) 2018-09-05 2020-06-02 Consumerinfo.Com, Inc. Authenticated access and aggregation database platform
US10685398B1 (en) 2013-04-23 2020-06-16 Consumerinfo.Com, Inc. Presenting credit score information
US10798197B2 (en) 2011-07-08 2020-10-06 Consumerinfo.Com, Inc. Lifescore
US20210044754A1 (en) * 2019-08-08 2021-02-11 Karl Storz Se & Co Kg Observation Device and Method of Operating an Observation Device
US10929925B1 (en) 2013-03-14 2021-02-23 Consumerlnfo.com, Inc. System and methods for credit dispute processing, resolution, and reporting
US10963959B2 (en) 2012-11-30 2021-03-30 Consumerinfo. Com, Inc. Presentation of credit score factors
US10986263B2 (en) * 2018-05-21 2021-04-20 Mitutoyo Corporation Calibration method of variable focal length lens and variable focal length lens device
US11012491B1 (en) 2012-11-12 2021-05-18 ConsumerInfor.com, Inc. Aggregating user web browsing data
US11113759B1 (en) 2013-03-14 2021-09-07 Consumerinfo.Com, Inc. Account vulnerability alerts
US11157872B2 (en) 2008-06-26 2021-10-26 Experian Marketing Solutions, Llc Systems and methods for providing an integrated identifier
CN113643381A (en) * 2021-08-17 2021-11-12 安徽农业大学 Calibration method of variable-focus liquid lens
US11200620B2 (en) 2011-10-13 2021-12-14 Consumerinfo.Com, Inc. Debt services candidate locator
US11238656B1 (en) 2019-02-22 2022-02-01 Consumerinfo.Com, Inc. System and method for an augmented reality experience via an artificial intelligence bot
US20220031149A1 (en) * 2004-05-18 2022-02-03 Boston Scientific Scimed, Inc. Serialization of single-use endoscopes
US11315179B1 (en) 2018-11-16 2022-04-26 Consumerinfo.Com, Inc. Methods and apparatuses for customized card recommendations
US11356430B1 (en) 2012-05-07 2022-06-07 Consumerinfo.Com, Inc. Storage and maintenance of personal data
US11941065B1 (en) 2019-09-13 2024-03-26 Experian Information Solutions, Inc. Single identifier platform for storing entity data

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002216136A (en) * 2001-01-23 2002-08-02 Sony Corp Distance calculating method and imaging system
KR100386090B1 (en) * 2001-04-02 2003-06-02 한국과학기술원 Camera calibration system and method using planar concentric circles
US20040199052A1 (en) 2003-04-01 2004-10-07 Scimed Life Systems, Inc. Endoscopic imaging system
US7578786B2 (en) * 2003-04-01 2009-08-25 Boston Scientific Scimed, Inc. Video endoscope
US20050245789A1 (en) * 2003-04-01 2005-11-03 Boston Scientific Scimed, Inc. Fluid manifold for endoscope system
US8118732B2 (en) 2003-04-01 2012-02-21 Boston Scientific Scimed, Inc. Force feedback control system for video endoscope
US7591783B2 (en) * 2003-04-01 2009-09-22 Boston Scientific Scimed, Inc. Articulation joint for video endoscope
JP2005037117A (en) * 2003-06-23 2005-02-10 Daikin Ind Ltd Indoor machine for air conditioner
JP2005164219A (en) * 2003-11-14 2005-06-23 Mitsubishi Electric Corp Air conditioning equipment and signal transmission method
JP5138021B2 (en) * 2003-11-14 2013-02-06 三菱電機株式会社 Air conditioner and signal transmission method
ES2374380T3 (en) 2004-03-09 2012-02-16 Mitsubishi Denki Kabushiki Kaisha AIR CONDITIONING EQUIPMENT.
KR100870805B1 (en) * 2004-03-09 2008-11-27 미쓰비시덴키 가부시키가이샤 Air conditioner
CA2581124A1 (en) * 2004-09-30 2006-04-13 Boston Scientific Scimed, Inc. Adapter for use with digital imaging medical device
US7479106B2 (en) 2004-09-30 2009-01-20 Boston Scientific Scimed, Inc. Automated control of irrigation and aspiration in a single-use endoscope
US8083671B2 (en) 2004-09-30 2011-12-27 Boston Scientific Scimed, Inc. Fluid delivery system for use with an endoscope
JP2006308150A (en) * 2005-04-27 2006-11-09 Hitachi Ltd Air conditioner system
US8202265B2 (en) 2006-04-20 2012-06-19 Boston Scientific Scimed, Inc. Multiple lumen assembly for use in endoscopes or other medical devices
US7955255B2 (en) * 2006-04-20 2011-06-07 Boston Scientific Scimed, Inc. Imaging assembly with transparent distal cap
KR20080053834A (en) * 2006-12-11 2008-06-16 현대자동차주식회사 A distortion correction method for a vehicle's rear camera
CA2818696C (en) * 2010-12-31 2020-07-28 Nest Labs, Inc. Flexible functionality partitioning within intelligent-thermostat-controlled hvac systems
US8837847B2 (en) * 2012-07-17 2014-09-16 Adobe Systems Incorporated Determining focal lengths of photographs
CA2819956C (en) 2013-07-02 2022-07-12 Guy Martin High accuracy camera modelling and calibration method
WO2016125270A1 (en) * 2015-02-04 2016-08-11 三菱電機株式会社 Air-conditioning system
JP6890876B2 (en) * 2016-02-10 2021-06-18 三菱電機株式会社 Controls, control systems and programs
JP6727007B2 (en) * 2016-04-08 2020-07-22 三菱電機株式会社 Air conditioning management system and air conditioner
CN108931357B (en) * 2017-05-22 2020-10-23 宁波舜宇车载光学技术有限公司 Test target and corresponding lens MTF detection system and method

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3574464A (en) * 1965-05-10 1971-04-13 Bradford Howland Camera test equipment and method
US5185667A (en) * 1991-05-13 1993-02-09 Telerobotics International, Inc. Omniview motionless camera orientation system
US5313306A (en) * 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5359363A (en) * 1991-05-13 1994-10-25 Telerobotics International, Inc. Omniview motionless camera surveillance system
US5384588A (en) * 1991-05-13 1995-01-24 Telerobotics International, Inc. System for omindirectional image viewing at a remote location without the transmission of control signals to select viewing parameters
US5764276A (en) * 1991-05-13 1998-06-09 Interactive Pictures Corporation Method and apparatus for providing perceived video viewing experiences using still images
US5903319A (en) * 1991-05-13 1999-05-11 Interactive Pictures Corporation Method for eliminating temporal and spacial distortion from interlaced video signals
US5990941A (en) * 1991-05-13 1999-11-23 Interactive Pictures Corporation Method and apparatus for the interactive display of any portion of a spherical image
US6002430A (en) * 1994-01-31 1999-12-14 Interactive Pictures Corporation Method and apparatus for simultaneous capture of a spherical image
US6147709A (en) * 1997-04-07 2000-11-14 Interactive Pictures Corporation Method and apparatus for inserting a high resolution image into a low resolution interactive image to produce a realistic immersive experience
US6201574B1 (en) * 1991-05-13 2001-03-13 Interactive Pictures Corporation Motionless camera orientation system distortion correcting sensing element
US6574376B1 (en) * 1999-02-12 2003-06-03 Advanet Incorporation Arithmetic unit for image transformation and monitoring system
US20040046888A1 (en) * 2002-07-26 2004-03-11 Gwo-Jen Jan Method for presenting fisheye-camera images
US20040095470A1 (en) * 2002-11-19 2004-05-20 Tecu Kirk S. Electronic imaging device resolution enhancement
US6754400B2 (en) * 2001-02-06 2004-06-22 Richard Wilson, Jr. System and method for creation, processing and visualization of omni-directional images
US6833843B2 (en) * 2001-12-03 2004-12-21 Tempest Microsystems Panoramic imaging and display system with canonical magnifier

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4048511B2 (en) * 1998-03-13 2008-02-20 富士通株式会社 Fisheye lens camera device and image distortion correction method thereof

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3574464A (en) * 1965-05-10 1971-04-13 Bradford Howland Camera test equipment and method
US5990941A (en) * 1991-05-13 1999-11-23 Interactive Pictures Corporation Method and apparatus for the interactive display of any portion of a spherical image
US5764276A (en) * 1991-05-13 1998-06-09 Interactive Pictures Corporation Method and apparatus for providing perceived video viewing experiences using still images
US5185667A (en) * 1991-05-13 1993-02-09 Telerobotics International, Inc. Omniview motionless camera orientation system
US5384588A (en) * 1991-05-13 1995-01-24 Telerobotics International, Inc. System for omindirectional image viewing at a remote location without the transmission of control signals to select viewing parameters
US5313306A (en) * 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5877801A (en) * 1991-05-13 1999-03-02 Interactive Pictures Corporation System for omnidirectional image viewing at a remote location without the transmission of control signals to select viewing parameters
US5903319A (en) * 1991-05-13 1999-05-11 Interactive Pictures Corporation Method for eliminating temporal and spacial distortion from interlaced video signals
US6201574B1 (en) * 1991-05-13 2001-03-13 Interactive Pictures Corporation Motionless camera orientation system distortion correcting sensing element
US5359363A (en) * 1991-05-13 1994-10-25 Telerobotics International, Inc. Omniview motionless camera surveillance system
US6002430A (en) * 1994-01-31 1999-12-14 Interactive Pictures Corporation Method and apparatus for simultaneous capture of a spherical image
US6795113B1 (en) * 1995-06-23 2004-09-21 Ipix Corporation Method and apparatus for the interactive display of any portion of a spherical image
US6147709A (en) * 1997-04-07 2000-11-14 Interactive Pictures Corporation Method and apparatus for inserting a high resolution image into a low resolution interactive image to produce a realistic immersive experience
US6574376B1 (en) * 1999-02-12 2003-06-03 Advanet Incorporation Arithmetic unit for image transformation and monitoring system
US6754400B2 (en) * 2001-02-06 2004-06-22 Richard Wilson, Jr. System and method for creation, processing and visualization of omni-directional images
US6833843B2 (en) * 2001-12-03 2004-12-21 Tempest Microsystems Panoramic imaging and display system with canonical magnifier
US20040046888A1 (en) * 2002-07-26 2004-03-11 Gwo-Jen Jan Method for presenting fisheye-camera images
US20040095470A1 (en) * 2002-11-19 2004-05-20 Tecu Kirk S. Electronic imaging device resolution enhancement

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004015976A2 (en) * 2002-07-26 2004-02-19 Appro Technology Inc. Method for presenting fisheye-camera images
WO2004015976A3 (en) * 2002-07-26 2004-07-01 Appro Technology Inc Method for presenting fisheye-camera images
WO2004092825A1 (en) * 2003-04-18 2004-10-28 Appro Technology Inc. Method for exploring optical parameters of camera
WO2004092826A1 (en) * 2003-04-18 2004-10-28 Appro Technology Inc. Method and system for obtaining optical parameters of camera
US20050105822A1 (en) * 2003-11-18 2005-05-19 Yoshinori Narita Variable distortion aberration image pickup device
US20220031149A1 (en) * 2004-05-18 2022-02-03 Boston Scientific Scimed, Inc. Serialization of single-use endoscopes
US7963448B2 (en) 2004-12-22 2011-06-21 Cognex Technology And Investment Corporation Hand held machine vision method and apparatus
US9798910B2 (en) 2004-12-22 2017-10-24 Cognex Corporation Mobile hand held machine vision method and apparatus using data from multiple images to perform processes
US10061946B2 (en) 2004-12-23 2018-08-28 Cognex Technology And Investment Llc Method and apparatus for industrial identification mark verification
US9552506B1 (en) 2004-12-23 2017-01-24 Cognex Technology And Investment Llc Method and apparatus for industrial identification mark verification
US9465962B2 (en) 2006-06-29 2016-10-11 Cognex Corporation Method and apparatus for verifying two dimensional mark quality
US8027802B1 (en) * 2006-06-29 2011-09-27 Cognex Corporation Method and apparatus for verifying two dimensional mark quality
US20080143838A1 (en) * 2006-12-14 2008-06-19 Sateesha Nadabar Method and apparatus for calibrating a mark verifier
US8169478B2 (en) 2006-12-14 2012-05-01 Cognex Corporation Method and apparatus for calibrating a mark verifier
US20110211039A1 (en) * 2007-09-21 2011-09-01 Gurunandan Krishnan Systems And Methods For Panoramic Imaging
US8817066B2 (en) 2007-09-21 2014-08-26 The Trustees Of Columbia University In The City Of New York Systems and methods for panoramic imaging
US8767037B2 (en) * 2007-09-21 2014-07-01 The Trustees Of Columbia University In The City Of New York Systems and methods for panoramic imaging
US20110018964A1 (en) * 2007-09-21 2011-01-27 The Trustees Of Columbia University In The City Of New York Systems and methods for panoramic imaging
US10592715B2 (en) 2007-11-13 2020-03-17 Cognex Corporation System and method for reading patterns using multiple image frames
US10878499B2 (en) 2007-12-14 2020-12-29 Consumerinfo.Com, Inc. Card registry systems and methods
US10614519B2 (en) 2007-12-14 2020-04-07 Consumerinfo.Com, Inc. Card registry systems and methods
US11379916B1 (en) 2007-12-14 2022-07-05 Consumerinfo.Com, Inc. Card registry systems and methods
US11769112B2 (en) 2008-06-26 2023-09-26 Experian Marketing Solutions, Llc Systems and methods for providing an integrated identifier
US11157872B2 (en) 2008-06-26 2021-10-26 Experian Marketing Solutions, Llc Systems and methods for providing an integrated identifier
US10621657B2 (en) 2008-11-05 2020-04-14 Consumerinfo.Com, Inc. Systems and methods of credit information reporting
US11665253B1 (en) 2011-07-08 2023-05-30 Consumerinfo.Com, Inc. LifeScore
US10798197B2 (en) 2011-07-08 2020-10-06 Consumerinfo.Com, Inc. Lifescore
US10642999B2 (en) 2011-09-16 2020-05-05 Consumerinfo.Com, Inc. Systems and methods of identity protection and management
US11790112B1 (en) 2011-09-16 2023-10-17 Consumerinfo.Com, Inc. Systems and methods of identity protection and management
US11087022B2 (en) 2011-09-16 2021-08-10 Consumerinfo.Com, Inc. Systems and methods of identity protection and management
US11200620B2 (en) 2011-10-13 2021-12-14 Consumerinfo.Com, Inc. Debt services candidate locator
US11356430B1 (en) 2012-05-07 2022-06-07 Consumerinfo.Com, Inc. Storage and maintenance of personal data
US11012491B1 (en) 2012-11-12 2021-05-18 ConsumerInfor.com, Inc. Aggregating user web browsing data
US11863310B1 (en) 2012-11-12 2024-01-02 Consumerinfo.Com, Inc. Aggregating user web browsing data
US11308551B1 (en) 2012-11-30 2022-04-19 Consumerinfo.Com, Inc. Credit data analysis
US11651426B1 (en) 2012-11-30 2023-05-16 Consumerlnfo.com, Inc. Credit score goals and alerts systems and methods
US10963959B2 (en) 2012-11-30 2021-03-30 Consumerinfo. Com, Inc. Presentation of credit score factors
CN103852243A (en) * 2012-12-06 2014-06-11 义晶科技股份有限公司 Method for detecting optical center of wide-angle lens and optical center detecting device
US11113759B1 (en) 2013-03-14 2021-09-07 Consumerinfo.Com, Inc. Account vulnerability alerts
US10929925B1 (en) 2013-03-14 2021-02-23 Consumerlnfo.com, Inc. System and methods for credit dispute processing, resolution, and reporting
US11514519B1 (en) 2013-03-14 2022-11-29 Consumerinfo.Com, Inc. System and methods for credit dispute processing, resolution, and reporting
US11769200B1 (en) 2013-03-14 2023-09-26 Consumerinfo.Com, Inc. Account vulnerability alerts
US10685398B1 (en) 2013-04-23 2020-06-16 Consumerinfo.Com, Inc. Presenting credit score information
US11461364B1 (en) 2013-11-20 2022-10-04 Consumerinfo.Com, Inc. Systems and user interfaces for dynamic access of multiple remote databases and synchronization of data based on user rules
US10628448B1 (en) 2013-11-20 2020-04-21 Consumerinfo.Com, Inc. Systems and user interfaces for dynamic access of multiple remote databases and synchronization of data based on user rules
CN105511092A (en) * 2014-10-11 2016-04-20 深圳超多维光电子有限公司 Correction device of stereo display device
US10715797B2 (en) * 2015-09-08 2020-07-14 Lg Innotek Co., Ltd. Device for testing angle of view of camera
US20190281283A1 (en) * 2015-09-08 2019-09-12 Lg Innotek Co., Ltd. Device for testing angle of view of camera
US10349047B2 (en) * 2015-09-08 2019-07-09 Lg Innotek Co., Ltd. Device for testing angle of view of camera
US10986263B2 (en) * 2018-05-21 2021-04-20 Mitutoyo Corporation Calibration method of variable focal length lens and variable focal length lens device
US10671749B2 (en) 2018-09-05 2020-06-02 Consumerinfo.Com, Inc. Authenticated access and aggregation database platform
US11265324B2 (en) 2018-09-05 2022-03-01 Consumerinfo.Com, Inc. User permissions for access to secure data at third-party
US11399029B2 (en) 2018-09-05 2022-07-26 Consumerinfo.Com, Inc. Database platform for realtime updating of user data from third party sources
US10880313B2 (en) 2018-09-05 2020-12-29 Consumerinfo.Com, Inc. Database platform for realtime updating of user data from third party sources
US11315179B1 (en) 2018-11-16 2022-04-26 Consumerinfo.Com, Inc. Methods and apparatuses for customized card recommendations
CN109451302A (en) * 2018-12-07 2019-03-08 昆山丘钛微电子科技有限公司 A kind of camera module test method, device, electronic equipment and medium
US11238656B1 (en) 2019-02-22 2022-02-01 Consumerinfo.Com, Inc. System and method for an augmented reality experience via an artificial intelligence bot
US11842454B1 (en) 2019-02-22 2023-12-12 Consumerinfo.Com, Inc. System and method for an augmented reality experience via an artificial intelligence bot
US20210044754A1 (en) * 2019-08-08 2021-02-11 Karl Storz Se & Co Kg Observation Device and Method of Operating an Observation Device
US11941065B1 (en) 2019-09-13 2024-03-26 Experian Information Solutions, Inc. Single identifier platform for storing entity data
CN113643381A (en) * 2021-08-17 2021-11-12 安徽农业大学 Calibration method of variable-focus liquid lens

Also Published As

Publication number Publication date
JP2003090586A (en) 2003-03-28
US6985183B2 (en) 2006-01-10
JP3624288B2 (en) 2005-03-02

Similar Documents

Publication Publication Date Title
US6985183B2 (en) Method for exploring viewpoint and focal length of camera
Luhmann et al. Sensor modelling and camera calibration for close-range photogrammetry
CN105701827B (en) The parametric joint scaling method and device of Visible Light Camera and infrared camera
US7751651B2 (en) Processing architecture for automatic image registration
Habib et al. Automatic calibration of low-cost digital cameras
CN109859272B (en) Automatic focusing binocular camera calibration method and device
US8619248B2 (en) System and method for calibrating ultra wide-angle lenses
Zhang et al. A robust and rapid camera calibration method by one captured image
US7042508B2 (en) Method for presenting fisheye-camera images
Lim et al. Virtual stereovision system: new understanding on single-lens stereovision using a biprism
Liu et al. Calibration method based on the image of the absolute quadratic curve
Zhao et al. Metric calibration of unfocused plenoptic cameras for three-dimensional shape measurement
JP3704494B2 (en) How to check camera viewpoint and focal length
Toschi et al. Improving automated 3D reconstruction methods via vision metrology
Gorevoy et al. Optimization of a geometrical calibration procedure for stereoscopic endoscopy systems
Alturki et al. Camera principal point estimation from vanishing points
Castanheiro et al. Modeling Hyperhemispherical Points and Calibrating a Dual-Fish-Eye System for Close-Range Applications
Zhang et al. Rectifying projective distortion in 4d light field
CN115797459B (en) Binocular vision system ranging method with arbitrary focal length combination
Wierzbicki Calibration low-cost cameras with wide-angle lenses for measurements
Ibrahim et al. Circular Calibration of Depth Extraction in Stereo Configuration
Chen et al. Improved blur circle detection method for geometric calibration of multifocus light field cameras
US20220327727A1 (en) Method And System For The Calibration Of An Object Reconstruction Device
Li Feature Based Calibration of a Network of Kinect Sensors
Srestasathiern et al. A novel camera calibration method for fish-eye lenses using line features

Legal Events

Date Code Title Description
AS Assignment

Owner name: APPRO TECHNOLOGY INC., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JAN, GWO-JEN;CHANG, CHUANG-JAN;REEL/FRAME:012270/0619

Effective date: 20010831

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20100110