US20150057533A1 - Optical scanning device - Google Patents

Optical scanning device Download PDF

Info

Publication number
US20150057533A1
US20150057533A1 US14/538,994 US201414538994A US2015057533A1 US 20150057533 A1 US20150057533 A1 US 20150057533A1 US 201414538994 A US201414538994 A US 201414538994A US 2015057533 A1 US2015057533 A1 US 2015057533A1
Authority
US
United States
Prior art keywords
scanned object
laser
laser light
probe
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/538,994
Inventor
Harris Bergman
Scott Cahall
Giorgos Hatzilias
Karol Hatzilias
David G. Stites
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
United Sciences LLC
Original Assignee
United Sciences LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by United Sciences LLC filed Critical United Sciences LLC
Priority to US14/538,994 priority Critical patent/US20150057533A1/en
Publication of US20150057533A1 publication Critical patent/US20150057533A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1077Measuring of profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00011Operational features of endoscopes characterised by signal transmission
    • A61B1/00016Operational features of endoscopes characterised by signal transmission using wireless means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00043Operational features of endoscopes provided with output arrangements
    • A61B1/00045Display arrangement
    • A61B1/00052Display arrangement positioned at proximal end of the endoscope body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0661Endoscope light sources
    • A61B1/0684Endoscope light sources using light emitting diodes [LED]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/07Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements using light-conductive means, e.g. optical fibres
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/227Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for ears, i.e. otoscopes
    • A61B19/5244
    • A61B19/54
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062Arrangements for scanning
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062Arrangements for scanning
    • A61B5/0064Body surface scanning
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1079Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • A61B2019/5257
    • A61B2019/5445
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2055Optical tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2055Optical tracking systems
    • A61B2034/2057Details of tracking cameras
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361Image-producing devices, e.g. surgical cameras
    • A61B2090/3614Image-producing devices, e.g. surgical cameras using optical fibre
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364Correlation of different images or relation of image positions in respect to the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3937Visible markers
    • A61B2090/3945Active visible markers, e.g. light emitting diodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/555Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes

Definitions

  • the present invention relates to determine the shape of surfaces of soft tissue, and more specifically, to determining such shapes using optical technology.
  • body surfaces including surfaces defining body orifices, such as the size of shape of an ear canal, throat, mouth, or nostrils of a patient.
  • surgery may be guided by knowing such shapes or medical devices fashioned to have a custom fit for such shapes.
  • a device for scanning a body orifice of a body includes a light source and a wide angle lens wherein the light from the light source is projected in a pattern distal to the wide angle lens.
  • an embodiment of the present invention includes a method of determining geometry of a body orifice.
  • the method includes projecting, with a light source, a pattern of light to a location in a coordinate system. At least a partial lateral portion of the pattern of light illuminates a surface of the body orifice. A position of the lateral portion in the coordinate system is determined using a camera with a focal surface, wherein the focal surface includes the location.
  • FIG. 1 is a schematic of a device of one embodiment of the present invention
  • FIG. 2 is a schematic of a probe of another embodiment of the present invention.
  • FIGS. 3A-3E are various views of a distal tip of the probe of FIG. 2 ;
  • FIG. 4 is an exploded view of the probe of FIG. 2 ;
  • FIG. 5 is a schematic of another embodiment of the present invention using a beam splitter in the forward field-of-view of the wide angle lens;
  • FIG. 6 is an image of a skin target illuminated by a laser light pattern for calibration
  • FIG. 7 is a cross-section of a thickness of a lateral portion of the laser light pattern of FIG. 6 showing an intensity distribution across the thickness;
  • FIG. 8 is a target used for calibration of the probe of FIG. 2 ;
  • FIG. 9 is a simulated image of the target of FIG. 8 captured using a wide angle lens of the probe of FIG. 2 ;
  • FIG. 10 is a schematic of the mathematics and geometry used by a processor to detect a radial distance or position of the lateral portions of the laser light pattern intersecting a measured surface;
  • FIG. 11 is a three-dimensional shape of a portion of an ear canal reconstructed by a computer shown in FIG. 1 ;
  • FIG. 12 is a perspective view of ear anatomy used in a method for measuring a geometry of an ear saddle of another embodiment of the present invention.
  • FIG. 13 is a schematic of a computer system of another embodiment of the present invention for optically determining surface geometries.
  • embodiments of the present invention include a device 10 for scanning a body orifice or surface including a light source 12 and a wide angle lens 14 .
  • the light from the light source is projected in a pattern 16 distal or adjacent to the wide angle lens 14 .
  • the pattern 16 is within a focal surface 18 of the wide angle lens 14 .
  • the pattern 16 intersects a surface of the body orifice, such as an ear canal, and defines a partial lateral portion 20 of the pattern extending along the surface.
  • a processor 26 is configured to receive an image of the lateral portion 20 from the wide angle lens 14 and determine a position of the lateral portion in a coordinate system using a known focal surface of the wide angle lens 14 .
  • known refers to known approximately within normal tolerances fit to achieve the desired resolution.
  • the known focal surface has some thickness and variation to it that corresponds to the result of normal manufacturing tolerances.
  • the device may further include a handheld probe 34 , an optical hardware assembly 66 , a tracking system 28 and a computer 68 .
  • the optical hardware assembly 66 can be contained within the body of the handheld probe 34 .
  • the body 30 of the patient defines any of a plurality of orifices or body surfaces that can be investigated by embodiments of the present invention for medical purposes.
  • Body markers 38 or fiducials adorn the portion of the body 30 defining the surface or orifice of interest.
  • a head band 72 extends around the head near the ear canal 70 and supports a plurality of retro-reflective spheres.
  • ear canal 70 which has a small diameter (approximately 6 mm).
  • the ear canal optionally has and at least one bend along its length.
  • the probe 34 includes a handle 74 , a cable 76 , a probe shaft 40 , and a plurality of probe markers 38 .
  • the cable 76 includes a light conductor 42 and a plurality of image conductors 44 and connects the probe 34 to the optical hardware assembly 66 .
  • the image conductors may conduct the optical images, such as through a fiber optic line, or through communicating an electrical signal containing the image data.
  • the term “conductor” therefore is used in its broadest sense herein to include conducting of any signal, analog or digital, power or information or data.
  • a conductor may also represent wireless communication such as by an RF signal.
  • the optical hardware assembly includes a fiberscope body, the light source 12 and a camera.
  • the fiberscope body is connected via one of the image conductors 44 to the probe 34 .
  • the camera is connected to the fiberscope body and receives images therefrom for navigation of the probe 34 within the body orifice.
  • the light source in this case a laser light source, connects to the probe 34 via the light conductor 42 .
  • the tracking system 28 includes a pair of cameras 78 spaced apart and pointed toward the probe markers 36 and the body marker 38 .
  • the tracking system 28 may be an integrated system that is configured to track and report the position of objects within its coordinate system, or one marker relative to another, using on-board hardware and software.
  • the processing functions may be distributed, such as within the computer system 68 of the embodiment illustrated in FIG. 1 .
  • the computer system 68 is connected to the optical hardware assembly 66 and the tracking system 28 .
  • the processor 26 Within the computer is the processor 26 and additional components described in more detail in FIG. 13 .
  • the computer system is configured to receive data from the probe 34 , including data on the lateral portions 20 of the light pattern 16 intersecting surfaces of the body orifice, and data from the tracking system 28 , including position data of the probe 34 and the wearer's body relative to a coordinate system.
  • the computer's processor 26 is configured to use the data to determine a three-dimensional shape of the body surfaces, such as the shape of the ear canal 70 , for use in building customized hearing aids.
  • the probe 34 is shown in greater schematic detail and includes the probe markers 36 in the form of a plurality of retro-reflective tracking spheres within the field of view of the cameras 78 of the tracking system 28 .
  • the probe markers 36 are used and the probe comprises three or more such probe markers.
  • three spheres are the minimum needed to lock down all 6 degrees of freedom.
  • Emitting from a distal end of the probe is the light pattern 16 (in this case a planar surface, but it could also be a cone of light, or a beam or some other surface shape) extending through the transparent side walls 58 of a cap 56 and forming one or more lateral portions 20 as it intersects the inner surfaces of the ear canal 70 .
  • the probe 34 is advantageously sized to move within the ear canal 70 to capture several shapes that are communicated to the computer system 68 for assembly into the three-dimensional shape 32 .
  • FIGS. 3A , 3 B, 3 C, 3 D, and 3 F are even more detailed views of the distal end of the probe 34 .
  • the probe can optionally comprise one or more of the light conductor 42 , the image conductors 44 , the cap 56 , a reflector 48 , a mask 50 , a cone mirror 52 and a fiber scope 54 .
  • the distal end of the probe 34 is shown in cross section with the wide angle lens 14 positioned proximal to ends of the fiber scope 54 and light conductor 42 carrying the laser light.
  • the wide angle lens defines a field of view 46 as shown by the dotted lines. Extending back proximally from the lens is one of the image conductors 44 configured to carry the images or data on the partial lateral portion(s) 20 .
  • the field of view of the illustrated embodiment is a full 150 degrees wherein the light pattern 16 may extend laterally out at right angles to the optical axis of the wide angle lens. Angles up to 180 degrees are possible but wider angles can be increasingly difficult to minimize distortion.
  • the light conductor 42 and the distal end of the fiber scope 54 which includes a conductor(s) (such as a fiber optic bundle) for diffuse light and return conductor(s) for returning navigation images.
  • a conductor(s) such as a fiber optic bundle
  • the mirror 52 At the distal most tip of the light source 12 is positioned the mirror 52 having a conical shape and configured to redirect the laser light into the pattern 16 . If the conical shape is more or less than a 45 degree angle with respect to the axis of the laser light, the shape of the pattern 16 a conical surface. At 45 degrees, the shape is the planar surface 60 shown in FIG. 2 .
  • the mask 50 is a planar sheet with a pair of holes, as shown in FIG. 3D , and is preferably constructed of a transparent material to block reflections from the redirected laser light back to the wide angle lens 14 that may not be representative of the surface being detected and measured.
  • the holes allow for passage of the light conductor 42 transmitting the laser light to the cone mirror 52 and the image conductor 44 for the fiber scope 54 .
  • the transparent side walls 58 and the cap 56 are configured to enclose and protect the distal portions of the probe 34 but at the same time allow passage of the laser light pattern 16 , diffuse navigation light from the fiber scope 54 and the images resulting and returning therefrom.
  • the cap 56 may be, but does not need to be, transparent for the fiberscope.
  • an opening in the cap 56 may allow passage and/or viewing by the fiberscope.
  • the returned partial lateral portion 20 may only be a “C shape” that leaves out a portion blocked from visibility by the light conductor 42 and image conductor 44 .
  • FIG. 4 shows an exploded view of a probe 34 of another embodiment of the present invention with the outer shaft 40 removed to better illustrate the function of the optical components.
  • the cap 56 is assembled to the transparent side walls 58 which are formed by a short section of transparent cylindrical tube.
  • the mirror 52 which is mounted in a mirror tube and affixed to the end of laser light conductor 42 .
  • the laser light conductor 42 may also include a collimator function to generate a collimated beam for redirection into the pattern 16 by the cone mirror 52 .
  • the fiberscope 54 has its distal end near the cone mirror 52 and extends proximally in a path adjacent to the light conductor 42 within the shaft 40 . Both the fiber scope 54 and the light conductor 52 bend around a CCD camera chip 80 and into the body of the probe 34 to pass through the cable 76 to the computer system 68 .
  • the wide angle lens 14 and its image conductor 44 extend back from the cylindrical window 58 in a generally parallel relationship to the conductors 42 , 44 .
  • the relative positioning of the optical components of the wide angle lens 14 is maintained in part by use of a pair of spacers 82 .
  • the wide angle lens 14 is a plurality of optical lens elements that include the image conductor 14 returning the image of the lateral portions 20 to the CCD camera chip 80 mounted in the body of the probe as shown in FIG. 4 .
  • a focusing screw 84 that when turned adjusts the focus of the wide angle lens 14 , thereby changing the position of its focal surface for improved accuracy within different body orifices and for compensating for manufacturing tolerances and for improved accuracy within a variety of orifices.
  • Proximal to the focusing screw 84 is the CCD camera chip that receives the images of the lateral portions 20 and converts those images into pixel data for return to the computer 68 for processing.
  • wide angle lens means any lens configured for a relatively wide field of view that will work in tortuous openings such as the ear canal 70 .
  • a 63 degree angle results in a lens-focal surface offset about equal to the maximum diameter of the ear canal that can be scanned with a centered probe 34 .
  • the focal surface of a 60 degree lens (a fairly standard sized wide angle lens) is equal to the diameter, resulting in a forward focal surface of about 6 mm, which is short enough to survive the second bend in an ear canal which is at about a 6 mm diameter. Therefore, for the purpose of ear canals, wide angle lenses are 60 degrees or greater.
  • the device 10 may not need a fiber scope 54 and instead the wide angle lens 14 is used for the forward field of view.
  • a beam splitter diverts the center of the wide angle lens field to a second camera that is focused further in front of the probe 34 and is configured to image the forward (nonlaser-lit) view.
  • a diffuse light source may be provided to illuminate ahead of the probe 34 .
  • a skin target is shown with partial lateral portions 20 of the pattern 16 projected thereon for the purpose of determining how the laser pattern 16 will project upon skin and its location be marked.
  • a perpendicular section of one of the lateral portions shows that the light intensity (y-axis) varies in a bell-curve shape with the thickness (x-axis) of the section.
  • the partial lateral portion 20 may include an edge 22 of the light pattern 16 or a ridge 24 of the light pattern. These landmarks may be used to determine the position of the lateral portion 20 in the coordinate system.
  • one of the aforementioned landmarks could be found (such as by a ridge detecting function of the processor 26 ) or an inside edge of the lateral portion or an outside edge of the lateral portion. Or, an average of the inside and outside portions may be used.
  • An advantage of the present invention is that the wide angle lens 14 can view relatively proximate lateral portions of the body surface with high precision due to overlap of its focal surface with the pattern 16 of laser light.
  • the term “focal surface” as used herein refers to a thickness within a range of focus of the wide angle lens 14 that is capable of achieving a certain base line resolution, such as being able to discern a 50 micrometer feature or smaller. For example, lateral positioning of the pattern 16 within the focal surface allows one pixel to be equivalent to about 50 micrometers.
  • the focal surface itself has a bell curve distribution of resolution that allows variations in overlap or thickness of the focal surface and the width of the lateral portion 20 which, as shown above, has its own curved distribution across its thickness.
  • the wide angle lens 14 should have a reasonably low distortion threshold to meet the resolution goals.
  • Most wide angle lenses can be as high as ⁇ 80 percent or ⁇ 60 percent distortion that would need to be compensated by improved accuracy in other areas such as placement of the focal surface and lateral portion 20 . Therefore, there is no set threshold although collectively the various components are preferably tuned to allow a 50 micrometer or better resolution for lateral distances from the optical axis of the wide angle lens 14 .
  • the inventors have found that a distortion of better than ⁇ 40 percent works well with preferred fields of view mentioned herein for ear canal applications.
  • the tracker or tracking system 28 is configured to determine a position of the probe 34 in the coordinate system and the body 30 of the patient in the coordinate system.
  • the processor 26 is configured to use this information to determine the position of the probe 34 and its measurements relative to the body 30 .
  • the tracking system 28 may include elements of a commercially available tracking system such as the POLARIS SPECTRA from NDI of Waterloo, Ontario, Canada.
  • the system is a two camera system to allow three-dimensional position determination of objects in its field of view including the patient and the probe 34 through the probe markers 36 and the body markers 38 .
  • the probe 34 and its laser pattern 16 are calibrated using a target placed in the field of view.
  • the laser pattern 16 and the optics, including the wide angle lens 14 are perfect and that the probe 34 is rigid. This enables referencing of the laser pattern 16 directed to the coordinate system.
  • the target includes a checkerboard 86 connected to a pair of optical markers 88 carefully aligned with the z-axis of the probe 34 .
  • the relative location of 86 with respect to 88 is known by performing photogrammetry on the calibration object.
  • the probe 34 is placed so that the projected laser pattern 16 is co-planar (to within tolerance) with the calibration grid (to within tolerance). This may be aided by a hole in the target that allows passage of the probe 34 . Positioning is established when the laser light pattern 16 smears across the surface of the target 86 .
  • a tracking session is performed with the tracker 28 to establish the position of the checkerboard with the markers 88 and the position of the probe with the probe markers 36 . Then, while maintaining the relative relationship of the probe 34 and the checkerboard 86 , a lamp or light is shined on the checkerboard 86 and an image of it is collected through the wide angle lens 14 .
  • the direction of the y-axis and z-axis relative to the tracker 28 is also noted to avoid axial direction errors.
  • Calibration may also include non-planar light patterns wherein a checkerboard is exposed to the light pattern in several different orientations. The intersection of the light pattern lateral portion with the checkerboard lines allows a reconstruction of the shape of the non-planar light pattern with respect to the wide-angle lens. Using a target similar to that illustrated in FIG. 8 , it is possible to relate the reconstructed shape of the pattern into the coordinate system of the handheld.
  • FIG. 9 shows the simulation of the calibration image.
  • the distance from the optical markers 88 to each of the corners of the checkerboard 86 and the laser pattern 16 is coincident with the corners of grid points on the checkerboards.
  • the three dimensional position of the laser hitting the surface may be interpolating to determine the nearest grid point of the checkerboard 86 . This information is then used fix the laser pattern within the coordinate system.
  • the device 10 includes a processor 26 that's connected in communication with the wide angle lens 14 and is configured to perform several functions including: determining a position of the lateral portion 20 in the coordinate system, determining the position of the lateral portion 20 using a known focal surface, determining the position of a plurality of the lateral portions 20 in the coordinate system and a corresponding location of the coordinate system relative to the body 30 , and combining the lateral portions 20 together into a three-dimensional shape 32 of a body orifice (such as an ear canal) using the positions and the corresponding locations.
  • a processor 26 that's connected in communication with the wide angle lens 14 and is configured to perform several functions including: determining a position of the lateral portion 20 in the coordinate system, determining the position of the lateral portion 20 using a known focal surface, determining the position of a plurality of the lateral portions 20 in the coordinate system and a corresponding location of the coordinate system relative to the body 30 , and combining the lateral portions 20 together into a three-dimensional shape 32 of
  • FIG. 10 schematically shows an embodiment for calculation of the radial distance of the lateral portion 20 from the optical axis of the probe 34 as implemented by the processor 26 .
  • the position can be determined by triangulation, as shown in equations 1-7.
  • a coordinate system for the scanner is oriented so that its Z axis is centered and fixed as the central axis of a scanning probe, looking end-on into the probe, here also referred to as the imaging axis.
  • the ratio of the distance R from the imaging axis of a laser-illuminated point to the distance S between the laser plane and the lens is equal to that of the distance h from the center of the image sensor to the distance S′ between the image sensor surface and the lens.
  • Magnification M is the ratio of S′ and S.
  • the image sensor may be implemented in complementary-symmetry metallic-oxide-semiconductor (‘CMOS’) sensor, as a charge-coupled device (‘CCD’), or with other sensing technology as may occur to those of skill in the art.
  • CMOS complementary-symmetry metallic-oxide-semiconductor
  • CCD charge-coupled device
  • a CMOS sensor can be operated in a snapshot readout mode or with a rolling shutter when the scan along the Z-axis is incremented or stepped synchronously to effect a readout of a complete frame. Similar incrementing or stepping may be used for a CCD operated with interlacing scans of image frames.
  • FIG. 11 shows an exemplary three-dimensional shape 32 of an ear canal 92 constructed from a plurality of the lateral portions assembled using the processor 26 .
  • the device 10 may be used to measure anatomical features well-suited to facilitate creation of a hearing aid. These features include a saddle 90 , ear canal 92 and concha bowl 94 .
  • the ear canal 92 and concha bowl 94 are scanned as described above and the probe 34 is rotated so the laser pattern 16 falls upon the surface of the outside of the tragus 96 .
  • the scan moves up the pinna 98 until the saddle point 100 is reached and the scan progresses 10 to 15 mm beyond the saddle point 100 .
  • This data is transmitted to the processor 26 , along with the orifice data, to construct the three-dimensional shape 32 used to custom build the hearing aid.
  • FIG. 13 a schematic diagram of a central server 500 , or similar network entity such as the computer 68 shown in FIG. 1 , configured to implement a system for measuring body surfaces according to one embodiment of the invention, is provided.
  • the designation “central” merely serves to describe the common functionality the server provides for multiple clients or other computing devices and does not require or infer any centralized positioning of the server relative to other computing devices.
  • the central server 500 may include a processor 510 (such as the processor 26 ) that communicates with other elements within the central server 500 via a system interface or bus 545 . Also included in the central server 500 may be a display device/input device 520 for receiving and displaying data.
  • This display device/input device 520 may be, for example, a keyboard or pointing device that is used in combination with a monitor, or the CCD 80 or the tracker 28 shown in FIGS. 1 and 4 .
  • the central server 500 may further include memory 505 , which may include both read only memory (ROM) 535 and random access memory (RAM) 530 .
  • the server's ROM 535 may be used to store a basic input/output system 540 (BIOS), containing the basic routines that help to transfer information across the one or more networks.
  • BIOS basic input/output system
  • the central server 500 may include at least one storage device 515 , such as a hard disk drive, a floppy disk drive, a CD Rom drive, or optical disk drive, for storing information on various computer-readable media, such as a hard disk, a removable magnetic disk, or a CD-ROM disk.
  • each of these storage devices 515 may be connected to the system bus 545 by an appropriate interface.
  • the storage devices 515 and their associated computer-readable media may provide nonvolatile storage for a central server. It is important to note that the computer-readable media described above could be replaced by any other type of computer-readable media known in the art. Such media include, for example, magnetic cassettes, flash memory cards and digital video disks.
  • a number of program modules may be stored by the various storage devices and within RAM 530 .
  • Such program modules may include an operating system 550 and a plurality of one or more (N) modules 560 .
  • the modules 560 may control certain aspects of the operation of the central server 500 , with the assistance of the processor 510 and the operating system 550 .
  • the modules may perform the functions described above and illustrated by the figures and other materials disclosed herein.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • Advantages of the embodiments of the invention described herein include the relatively short distance (3 mm, 2 mm, 1 mm or less) of the pattern 16 and focal surface 18 extending past the probe 34 that allow it to image laterally in orifices with tortuous geometry, such as ear canals with a small diameter and where it is useful to scan 3 mm past a bend and also to image larger diameter ear canals and spaces without having to take multiple passes over that section of the canal.
  • the low distortion of the wide angle lens 14 leads to high resolution when the laser pattern 16 is coincident with the focal surface 18 . This allows the resolution of 50 micrometers for a single pixel when other prior art systems have neighboring pixels a millimeter or more apart.
  • Advantages particular to the creation of hearing aids include a solution that allows directly scanning of the ear instead of making a silicone mold. Quality, performance and fit are improved while reducing cost and increasing speed of production by capturing the shape and size of the ear canal for submission directly to the hearing aid manufacturer.
  • Other medical applications include endoscopic surgery, dental impressions and the aforementioned industrial applications, such as inspection of various pipes, channels, tubing or other openings.
  • a camera may be any kind of image sensor.
  • the embodiment was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.

Abstract

A device for scanning a body orifice or surface including a light source and a wide angle lens. The light from the light source is projected in a pattern distal or adjacent to the wide angle lens. Preferably, the pattern is within a focal surface of the wide angle lens. The pattern intersects a surface of the body orifice, such as an ear canal, and defines a partial lateral portion of the pattern extending along the surface. A processor is configured to receive an image of the lateral portion from the wide angle lens and determine a position of the lateral portion in a coordinate system using a known focal surface of the wide angle lens. Multiple lateral portions are reconstructed by the processor to build a three-dimensional shape. This three-dimensional shape may be used for purposes such as diagnostic, navigation, or custom-fitting of medical devices, such as hearing aids.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation application of and claims priority from U.S. patent application Ser. No. 13/417,767, filed on Mar. 12, 2012, which claims the benefit and priority of U.S. Provisional Patent Application No. 61/466,863, filed Mar. 23, 2011.
  • BACKGROUND
  • The present invention relates to determine the shape of surfaces of soft tissue, and more specifically, to determining such shapes using optical technology.
  • Hearing aids, hearing protection, and custom head phones often require silicone impressions to be made of a patient's ear canal. Audiologists pour the silicone material into an ear, wait for it to harden then manufacturers use the resulting silicone impression to create a custom fitting in-ear device. The process is slow, expensive, inconsistent, and unpleasant for the patient, and can even be dangerous.
  • Also, there are a range of other medical needs that benefit from determining the shape of body surfaces, including surfaces defining body orifices, such as the size of shape of an ear canal, throat, mouth, or nostrils of a patient. For example, surgery may be guided by knowing such shapes or medical devices fashioned to have a custom fit for such shapes.
  • There is a need, therefore, for improvements in the determination of body surface shapes, including the shapes and sizes of surfaces associated with body orifices.
  • SUMMARY
  • According to one embodiment of the present invention, a device for scanning a body orifice of a body includes a light source and a wide angle lens wherein the light from the light source is projected in a pattern distal to the wide angle lens.
  • In another embodiment, an embodiment of the present invention includes a method of determining geometry of a body orifice. The method includes projecting, with a light source, a pattern of light to a location in a coordinate system. At least a partial lateral portion of the pattern of light illuminates a surface of the body orifice. A position of the lateral portion in the coordinate system is determined using a camera with a focal surface, wherein the focal surface includes the location.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a schematic of a device of one embodiment of the present invention;
  • FIG. 2 is a schematic of a probe of another embodiment of the present invention;
  • FIGS. 3A-3E are various views of a distal tip of the probe of FIG. 2;
  • FIG. 4 is an exploded view of the probe of FIG. 2;
  • FIG. 5 is a schematic of another embodiment of the present invention using a beam splitter in the forward field-of-view of the wide angle lens;
  • FIG. 6 is an image of a skin target illuminated by a laser light pattern for calibration;
  • FIG. 7 is a cross-section of a thickness of a lateral portion of the laser light pattern of FIG. 6 showing an intensity distribution across the thickness;
  • FIG. 8 is a target used for calibration of the probe of FIG. 2;
  • FIG. 9 is a simulated image of the target of FIG. 8 captured using a wide angle lens of the probe of FIG. 2;
  • FIG. 10 is a schematic of the mathematics and geometry used by a processor to detect a radial distance or position of the lateral portions of the laser light pattern intersecting a measured surface;
  • FIG. 11 is a three-dimensional shape of a portion of an ear canal reconstructed by a computer shown in FIG. 1;
  • FIG. 12 is a perspective view of ear anatomy used in a method for measuring a geometry of an ear saddle of another embodiment of the present invention; and
  • FIG. 13 is a schematic of a computer system of another embodiment of the present invention for optically determining surface geometries.
  • DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
  • With reference now to FIGS. 1-4, embodiments of the present invention include a device 10 for scanning a body orifice or surface including a light source 12 and a wide angle lens 14. The light from the light source is projected in a pattern 16 distal or adjacent to the wide angle lens 14. Preferably, the pattern 16 is within a focal surface 18 of the wide angle lens 14. The pattern 16 intersects a surface of the body orifice, such as an ear canal, and defines a partial lateral portion 20 of the pattern extending along the surface. A processor 26 is configured to receive an image of the lateral portion 20 from the wide angle lens 14 and determine a position of the lateral portion in a coordinate system using a known focal surface of the wide angle lens 14.
  • The term “known” as used herein refers to known approximately within normal tolerances fit to achieve the desired resolution. Thus, the known focal surface has some thickness and variation to it that corresponds to the result of normal manufacturing tolerances.
  • The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
  • The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The embodiment was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
  • Referring again to FIGS. 1 and 2, a body 30 of the patient being examined with the device 10. The device may further include a handheld probe 34, an optical hardware assembly 66, a tracking system 28 and a computer 68.
  • Notably, some or all of the elements of the optical hardware assembly 66, including the light sources for the laser and/or the fiberscope, the tracking system 28 and the computer 68 can be contained within the body of the handheld probe 34.
  • The body 30 of the patient defines any of a plurality of orifices or body surfaces that can be investigated by embodiments of the present invention for medical purposes. Body markers 38 or fiducials adorn the portion of the body 30 defining the surface or orifice of interest. For example, a head band 72 extends around the head near the ear canal 70 and supports a plurality of retro-reflective spheres.
  • It should also be noted that non-medical uses are possible, such as measuring of tortuous openings or surfaces in an industrial setting. However, embodiments of the present invention are particularly well-suited to measure surfaces of an ear canal 70 which has a small diameter (approximately 6 mm). The ear canal optionally has and at least one bend along its length.
  • The probe 34 includes a handle 74, a cable 76, a probe shaft 40, and a plurality of probe markers 38. The cable 76 includes a light conductor 42 and a plurality of image conductors 44 and connects the probe 34 to the optical hardware assembly 66. The image conductors may conduct the optical images, such as through a fiber optic line, or through communicating an electrical signal containing the image data. The term “conductor” therefore is used in its broadest sense herein to include conducting of any signal, analog or digital, power or information or data. A conductor may also represent wireless communication such as by an RF signal.
  • The optical hardware assembly includes a fiberscope body, the light source 12 and a camera. The fiberscope body is connected via one of the image conductors 44 to the probe 34. The camera is connected to the fiberscope body and receives images therefrom for navigation of the probe 34 within the body orifice. Similarly, the light source, in this case a laser light source, connects to the probe 34 via the light conductor 42.
  • The tracking system 28 includes a pair of cameras 78 spaced apart and pointed toward the probe markers 36 and the body marker 38. Optionally, there are at least three probe markers. The tracking system 28 may be an integrated system that is configured to track and report the position of objects within its coordinate system, or one marker relative to another, using on-board hardware and software. Or, the processing functions may be distributed, such as within the computer system 68 of the embodiment illustrated in FIG. 1.
  • The computer system 68 is connected to the optical hardware assembly 66 and the tracking system 28. Within the computer is the processor 26 and additional components described in more detail in FIG. 13. Generally, the computer system is configured to receive data from the probe 34, including data on the lateral portions 20 of the light pattern 16 intersecting surfaces of the body orifice, and data from the tracking system 28, including position data of the probe 34 and the wearer's body relative to a coordinate system. And, the computer's processor 26 is configured to use the data to determine a three-dimensional shape of the body surfaces, such as the shape of the ear canal 70, for use in building customized hearing aids.
  • Referring to FIG. 2, the probe 34 is shown in greater schematic detail and includes the probe markers 36 in the form of a plurality of retro-reflective tracking spheres within the field of view of the cameras 78 of the tracking system 28. As described above, optionally, three or more probe markers 36 are used and the probe comprises three or more such probe markers. Generally, absent other assumptions or information, three spheres are the minimum needed to lock down all 6 degrees of freedom. Emitting from a distal end of the probe is the light pattern 16 (in this case a planar surface, but it could also be a cone of light, or a beam or some other surface shape) extending through the transparent side walls 58 of a cap 56 and forming one or more lateral portions 20 as it intersects the inner surfaces of the ear canal 70. The probe 34 is advantageously sized to move within the ear canal 70 to capture several shapes that are communicated to the computer system 68 for assembly into the three-dimensional shape 32.
  • FIGS. 3A, 3B, 3C, 3D, and 3F are even more detailed views of the distal end of the probe 34. The probe can optionally comprise one or more of the light conductor 42, the image conductors 44, the cap 56, a reflector 48, a mask 50, a cone mirror 52 and a fiber scope 54.
  • Referring to FIG. 3A, the distal end of the probe 34 is shown in cross section with the wide angle lens 14 positioned proximal to ends of the fiber scope 54 and light conductor 42 carrying the laser light. The wide angle lens defines a field of view 46 as shown by the dotted lines. Extending back proximally from the lens is one of the image conductors 44 configured to carry the images or data on the partial lateral portion(s) 20. Notably, the field of view of the illustrated embodiment is a full 150 degrees wherein the light pattern 16 may extend laterally out at right angles to the optical axis of the wide angle lens. Angles up to 180 degrees are possible but wider angles can be increasingly difficult to minimize distortion.
  • Extending under and past the wide angle lens 14 are the light conductor 42 and the distal end of the fiber scope 54 which includes a conductor(s) (such as a fiber optic bundle) for diffuse light and return conductor(s) for returning navigation images. At the distal most tip of the light source 12 is positioned the mirror 52 having a conical shape and configured to redirect the laser light into the pattern 16. If the conical shape is more or less than a 45 degree angle with respect to the axis of the laser light, the shape of the pattern 16 a conical surface. At 45 degrees, the shape is the planar surface 60 shown in FIG. 2.
  • The mask 50 is a planar sheet with a pair of holes, as shown in FIG. 3D, and is preferably constructed of a transparent material to block reflections from the redirected laser light back to the wide angle lens 14 that may not be representative of the surface being detected and measured. The holes allow for passage of the light conductor 42 transmitting the laser light to the cone mirror 52 and the image conductor 44 for the fiber scope 54.
  • The transparent side walls 58 and the cap 56 are configured to enclose and protect the distal portions of the probe 34 but at the same time allow passage of the laser light pattern 16, diffuse navigation light from the fiber scope 54 and the images resulting and returning therefrom. The cap 56 may be, but does not need to be, transparent for the fiberscope. Optionally, as shown in FIG. 3, an opening in the cap 56 may allow passage and/or viewing by the fiberscope.
  • Because the light conductor 42 and the image conductor extend distal to the wide angle lens 14, the images of the projected pattern 16 of light as it strikes a surface are not completely detected and returned through the full 360 degree field. Instead, in a roughly cylindrical opening such as the ear canal, the returned partial lateral portion 20 may only be a “C shape” that leaves out a portion blocked from visibility by the light conductor 42 and image conductor 44.
  • FIG. 4 shows an exploded view of a probe 34 of another embodiment of the present invention with the outer shaft 40 removed to better illustrate the function of the optical components. Starting distally, the cap 56 is assembled to the transparent side walls 58 which are formed by a short section of transparent cylindrical tube. Also distal is the mirror 52 which is mounted in a mirror tube and affixed to the end of laser light conductor 42. The laser light conductor 42 may also include a collimator function to generate a collimated beam for redirection into the pattern 16 by the cone mirror 52.
  • The fiberscope 54 has its distal end near the cone mirror 52 and extends proximally in a path adjacent to the light conductor 42 within the shaft 40. Both the fiber scope 54 and the light conductor 52 bend around a CCD camera chip 80 and into the body of the probe 34 to pass through the cable 76 to the computer system 68.
  • Also within the shaft 40 of the probe 34, the wide angle lens 14 and its image conductor 44 extend back from the cylindrical window 58 in a generally parallel relationship to the conductors 42, 44. The relative positioning of the optical components of the wide angle lens 14 is maintained in part by use of a pair of spacers 82. The wide angle lens 14 is a plurality of optical lens elements that include the image conductor 14 returning the image of the lateral portions 20 to the CCD camera chip 80 mounted in the body of the probe as shown in FIG. 4.
  • Supporting the wide angle lens 14 is a focusing screw 84 that when turned adjusts the focus of the wide angle lens 14, thereby changing the position of its focal surface for improved accuracy within different body orifices and for compensating for manufacturing tolerances and for improved accuracy within a variety of orifices. Proximal to the focusing screw 84 is the CCD camera chip that receives the images of the lateral portions 20 and converts those images into pixel data for return to the computer 68 for processing.
  • The term “wide angle lens” as used herein means any lens configured for a relatively wide field of view that will work in tortuous openings such as the ear canal 70. For example, for an ear canal, a 63 degree angle results in a lens-focal surface offset about equal to the maximum diameter of the ear canal that can be scanned with a centered probe 34. Notably, the focal surface of a 60 degree lens (a fairly standard sized wide angle lens) is equal to the diameter, resulting in a forward focal surface of about 6 mm, which is short enough to survive the second bend in an ear canal which is at about a 6 mm diameter. Therefore, for the purpose of ear canals, wide angle lenses are 60 degrees or greater. Other increments that work even better are 90 degrees with its 2:1 ratio allowing a forward focal surface distance of about 3 mm, allowing the probe 34 to be fairly short. Lenses that are greater than 90 degrees are possible as are lenses that include complex optical elements with sideways only views and no forward field of view.
  • In another embodiment, illustrated FIG. 5, the device 10 may not need a fiber scope 54 and instead the wide angle lens 14 is used for the forward field of view. A beam splitter diverts the center of the wide angle lens field to a second camera that is focused further in front of the probe 34 and is configured to image the forward (nonlaser-lit) view. A diffuse light source may be provided to illuminate ahead of the probe 34.
  • Referring to FIG. 6, a skin target is shown with partial lateral portions 20 of the pattern 16 projected thereon for the purpose of determining how the laser pattern 16 will project upon skin and its location be marked. A perpendicular section of one of the lateral portions, as shown in FIG. 7, shows that the light intensity (y-axis) varies in a bell-curve shape with the thickness (x-axis) of the section. Thus, the partial lateral portion 20 may include an edge 22 of the light pattern 16 or a ridge 24 of the light pattern. These landmarks may be used to determine the position of the lateral portion 20 in the coordinate system. For example, one of the aforementioned landmarks could be found (such as by a ridge detecting function of the processor 26) or an inside edge of the lateral portion or an outside edge of the lateral portion. Or, an average of the inside and outside portions may be used.
  • An advantage of the present invention is that the wide angle lens 14 can view relatively proximate lateral portions of the body surface with high precision due to overlap of its focal surface with the pattern 16 of laser light. The term “focal surface” as used herein refers to a thickness within a range of focus of the wide angle lens 14 that is capable of achieving a certain base line resolution, such as being able to discern a 50 micrometer feature or smaller. For example, lateral positioning of the pattern 16 within the focal surface allows one pixel to be equivalent to about 50 micrometers. The focal surface itself has a bell curve distribution of resolution that allows variations in overlap or thickness of the focal surface and the width of the lateral portion 20 which, as shown above, has its own curved distribution across its thickness.
  • Generally, the wide angle lens 14 should have a reasonably low distortion threshold to meet the resolution goals. Most wide angle lenses can be as high as −80 percent or −60 percent distortion that would need to be compensated by improved accuracy in other areas such as placement of the focal surface and lateral portion 20. Therefore, there is no set threshold although collectively the various components are preferably tuned to allow a 50 micrometer or better resolution for lateral distances from the optical axis of the wide angle lens 14. The inventors have found that a distortion of better than −40 percent works well with preferred fields of view mentioned herein for ear canal applications.
  • The tracker or tracking system 28 is configured to determine a position of the probe 34 in the coordinate system and the body 30 of the patient in the coordinate system. The processor 26 is configured to use this information to determine the position of the probe 34 and its measurements relative to the body 30. The tracking system 28 may include elements of a commercially available tracking system such as the POLARIS SPECTRA from NDI of Waterloo, Ontario, Canada. The system is a two camera system to allow three-dimensional position determination of objects in its field of view including the patient and the probe 34 through the probe markers 36 and the body markers 38.
  • Once the field of view is calibrated to establish the coordinate system the probe 34 and its laser pattern 16 are calibrated using a target placed in the field of view. For such calibration, it is assumed that the laser pattern 16 and the optics, including the wide angle lens 14, are perfect and that the probe 34 is rigid. This enables referencing of the laser pattern 16 directed to the coordinate system.
  • As shown in FIG. 8, for example, the target includes a checkerboard 86 connected to a pair of optical markers 88 carefully aligned with the z-axis of the probe 34. The relative location of 86 with respect to 88 is known by performing photogrammetry on the calibration object. In particular, the probe 34 is placed so that the projected laser pattern 16 is co-planar (to within tolerance) with the calibration grid (to within tolerance). This may be aided by a hole in the target that allows passage of the probe 34. Positioning is established when the laser light pattern 16 smears across the surface of the target 86.
  • With the checkerboard 86 in place, a tracking session is performed with the tracker 28 to establish the position of the checkerboard with the markers 88 and the position of the probe with the probe markers 36. Then, while maintaining the relative relationship of the probe 34 and the checkerboard 86, a lamp or light is shined on the checkerboard 86 and an image of it is collected through the wide angle lens 14. Preferably, the direction of the y-axis and z-axis relative to the tracker 28 is also noted to avoid axial direction errors.
  • Calibration may also include non-planar light patterns wherein a checkerboard is exposed to the light pattern in several different orientations. The intersection of the light pattern lateral portion with the checkerboard lines allows a reconstruction of the shape of the non-planar light pattern with respect to the wide-angle lens. Using a target similar to that illustrated in FIG. 8, it is possible to relate the reconstructed shape of the pattern into the coordinate system of the handheld.
  • FIG. 9 shows the simulation of the calibration image. The distance from the optical markers 88 to each of the corners of the checkerboard 86 and the laser pattern 16 is coincident with the corners of grid points on the checkerboards. Thus, the three dimensional position of the laser hitting the surface may be interpolating to determine the nearest grid point of the checkerboard 86. This information is then used fix the laser pattern within the coordinate system.
  • In another embodiment, the device 10 includes a processor 26 that's connected in communication with the wide angle lens 14 and is configured to perform several functions including: determining a position of the lateral portion 20 in the coordinate system, determining the position of the lateral portion 20 using a known focal surface, determining the position of a plurality of the lateral portions 20 in the coordinate system and a corresponding location of the coordinate system relative to the body 30, and combining the lateral portions 20 together into a three-dimensional shape 32 of a body orifice (such as an ear canal) using the positions and the corresponding locations.
  • FIG. 10 schematically shows an embodiment for calculation of the radial distance of the lateral portion 20 from the optical axis of the probe 34 as implemented by the processor 26. The position can be determined by triangulation, as shown in equations 1-7.
  • h S R S Equation 2 R = hS S Equation 3 y x = S S = M Equation 4 R = h M Equation 5 Δ R = Δ h M Equation 6 θ min = Tan - 1 ( R min S ) Equation 7 θ max = Tan - 1 ( R max S ) Equation 8
  • In the example of FIG. 10 and in equations 1-7, a coordinate system for the scanner is oriented so that its Z axis is centered and fixed as the central axis of a scanning probe, looking end-on into the probe, here also referred to as the imaging axis. In this example, therefore, the ratio of the distance R from the imaging axis of a laser-illuminated point to the distance S between the laser plane and the lens is equal to that of the distance h from the center of the image sensor to the distance S′ between the image sensor surface and the lens. Magnification M is the ratio of S′ and S. When the distances S and S′ between the lens and laser plane, and lens to image sensor are known, equations 1-7 can reconstruct the geometry of illuminated points in the coordinate system. These equations also denote that for a focal surface such as a plane, there is a 1:1 mapping of points in the coordinate system to pixel locations on the image sensor.
  • The image sensor may be implemented in complementary-symmetry metallic-oxide-semiconductor (‘CMOS’) sensor, as a charge-coupled device (‘CCD’), or with other sensing technology as may occur to those of skill in the art. A CMOS sensor can be operated in a snapshot readout mode or with a rolling shutter when the scan along the Z-axis is incremented or stepped synchronously to effect a readout of a complete frame. Similar incrementing or stepping may be used for a CCD operated with interlacing scans of image frames.
  • FIG. 11 shows an exemplary three-dimensional shape 32 of an ear canal 92 constructed from a plurality of the lateral portions assembled using the processor 26.
  • In another embodiment of the present invention, as shown in FIG. 12, the device 10 may be used to measure anatomical features well-suited to facilitate creation of a hearing aid. These features include a saddle 90, ear canal 92 and concha bowl 94. The ear canal 92 and concha bowl 94 are scanned as described above and the probe 34 is rotated so the laser pattern 16 falls upon the surface of the outside of the tragus 96. The scan moves up the pinna 98 until the saddle point 100 is reached and the scan progresses 10 to 15 mm beyond the saddle point 100. This data is transmitted to the processor 26, along with the orifice data, to construct the three-dimensional shape 32 used to custom build the hearing aid.
  • Referring now to FIG. 13, a schematic diagram of a central server 500, or similar network entity such as the computer 68 shown in FIG. 1, configured to implement a system for measuring body surfaces according to one embodiment of the invention, is provided. As used herein, the designation “central” merely serves to describe the common functionality the server provides for multiple clients or other computing devices and does not require or infer any centralized positioning of the server relative to other computing devices. As may be understood from FIG. 13, in this embodiment, the central server 500 may include a processor 510 (such as the processor 26) that communicates with other elements within the central server 500 via a system interface or bus 545. Also included in the central server 500 may be a display device/input device 520 for receiving and displaying data. This display device/input device 520 may be, for example, a keyboard or pointing device that is used in combination with a monitor, or the CCD 80 or the tracker 28 shown in FIGS. 1 and 4. The central server 500 may further include memory 505, which may include both read only memory (ROM) 535 and random access memory (RAM) 530. The server's ROM 535 may be used to store a basic input/output system 540 (BIOS), containing the basic routines that help to transfer information across the one or more networks.
  • In addition, the central server 500 may include at least one storage device 515, such as a hard disk drive, a floppy disk drive, a CD Rom drive, or optical disk drive, for storing information on various computer-readable media, such as a hard disk, a removable magnetic disk, or a CD-ROM disk. As will be appreciated by one of ordinary skill in the art, each of these storage devices 515 may be connected to the system bus 545 by an appropriate interface. The storage devices 515 and their associated computer-readable media may provide nonvolatile storage for a central server. It is important to note that the computer-readable media described above could be replaced by any other type of computer-readable media known in the art. Such media include, for example, magnetic cassettes, flash memory cards and digital video disks.
  • A number of program modules may be stored by the various storage devices and within RAM 530. Such program modules may include an operating system 550 and a plurality of one or more (N) modules 560. The modules 560 may control certain aspects of the operation of the central server 500, with the assistance of the processor 510 and the operating system 550. For example, the modules may perform the functions described above and illustrated by the figures and other materials disclosed herein.
  • The schematics, flowcharts, and block diagrams in the FIGS. 1-13 illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
  • Advantages of the embodiments of the invention described herein include the relatively short distance (3 mm, 2 mm, 1 mm or less) of the pattern 16 and focal surface 18 extending past the probe 34 that allow it to image laterally in orifices with tortuous geometry, such as ear canals with a small diameter and where it is useful to scan 3 mm past a bend and also to image larger diameter ear canals and spaces without having to take multiple passes over that section of the canal. Also, the low distortion of the wide angle lens 14 leads to high resolution when the laser pattern 16 is coincident with the focal surface 18. This allows the resolution of 50 micrometers for a single pixel when other prior art systems have neighboring pixels a millimeter or more apart.
  • Advantages particular to the creation of hearing aids include a solution that allows directly scanning of the ear instead of making a silicone mold. Quality, performance and fit are improved while reducing cost and increasing speed of production by capturing the shape and size of the ear canal for submission directly to the hearing aid manufacturer. Other medical applications include endoscopic surgery, dental impressions and the aforementioned industrial applications, such as inspection of various pipes, channels, tubing or other openings.
  • The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. For example, a camera may be any kind of image sensor. The embodiment was chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.

Claims (20)

What is claimed is:
1. Apparatus for scanning a three dimensional (‘3D’) object, the apparatus comprising:
a scanner body having mounted upon it a scanning probe, the scanning probe comprising a laser light source, a laser optical element, a source of non-laser video illumination, a wide-angle lens optically coupled to an image sensor, and an image sensor mounted within the scanner body and coupled for data communications to a data processor;
a plurality of tracking illumination sensors, the tracking illumination sensors sensing reflections of tracking illumination emitted from a tracking illumination emitter and reflected from tracking fiducials installed at positions that are fixed relative to the scanned object, the tracking illumination sensors also sensing reflections of tracking illumination emitted from the tracking illumination emitter and reflected from tracking targets installed at fixed positions on the scanner body; and
the data processor configured so that it functions by constructing, in dependence upon a sequence of images captured when a scanned object is illuminated by laser light and tracked positions of the scanner probe inferred from reflections of tracking illumination sensed by the tracking illumination sensors, a 3D image of the scanned object.
2. The apparatus of claim 1 further comprising a display screen coupled for data communications to the image sensor, the display screen displaying images of the scanned object.
3. The apparatus of claim 2 wherein the display screen displaying images of the scanned object further comprises the display screen displaying video images from the image sensor of the scanned object illuminated only by non-laser video illumination.
4. The apparatus of claim 2 wherein the display screen displaying images of the scanned object further comprises the display screen displaying the 3D image of the scanned object.
5. The apparatus of claim 1 further comprising a display screen coupled for data communications to the image sensor, the display screen displaying images of the scanned object, the display screen mounted on the scanner body.
6. The apparatus of claim 1 wherein the laser light source in the scanning probe comprises an optical fiber that conducts laser light to the scanning probe from a laser outside the probe.
7. The apparatus of claim 1 wherein:
the laser optical element comprises a conical laser-reflective optical element; and
the laser light source and the conical laser-reflecting optical element are configured so that the conical laser-reflecting optical element, when illuminated by the laser light source, projects a broken ring of laser light upon an interior surface of the ear when the ear probe is positioned in the ear.
8. The apparatus of claim 1 wherein:
the laser optical element comprises a laser optic lens; and
the laser light source and the laser optic lens are configured so that the laser optic lens, when illuminated by the laser light source, projects upon the object laser light from a front surface of the laser optic lens.
9. The apparatus of claim 1 wherein the wide angle lens has a sufficient depth of field so that an entire portion of a surface of the scanned object illuminated by laser light is in focus at the image sensor.
10. The apparatus of claim 1 wherein constructing a 3D image of the scanned object further comprises, for a sequence from the image sensor of 2D images of the scanned object taken when the scanned object is illuminated by laser light from the scanning probe:
detecting ridge points for each 2D image, the detecting further comprising identifying a set of brightest pixels for each 2D image, each set depicting a pattern of laser light reflected from a surface of the scanned object;
transforming, in dependence upon a predefined association between each pixel in the image sensor and corresponding points in scanner space, the ridge points to points in scanner space; and
transforming, in dependence upon a relationship between an origin of a coordinate system defining scanner space and an origin of another coordinate system defining object space, the points in scanner space to points in object space.
11. The apparatus of claim 1 wherein constructing the 3D image further comprises constructing the 3D image in dependence upon a sequence of images captured by the image sensor as the probe is moved relative to the scanned object.
12. The apparatus of claim 1 wherein the scanned object is an ear.
13. The apparatus of claim 1 wherein the scanned object is an interior portion of an ear.
14. The apparatus of claim 1 further comprising the scanning probe configured to extend into an orifice of a human body.
15. The apparatus of claim 1 wherein the laser light source comprises an optical fiber that extends further distally than the wide angle lens and into a field of view of the wide angle lens.
16. A method of determining a geometry of a three dimensional scanned object, the method comprising:
projecting, with a light source, a pattern of light to a location in a coordinate system, wherein at least a partial lateral portion of the pattern of light illuminates a surface of the scanned object; and
determining a position of the lateral portion in the coordinate system using an image sensor with a focal surface, the focal surface including the location.
17. The method of claim 16 further comprising:
moving the light source to illuminate different surfaces of the scanned object; and
repeating the projecting and determining steps for each of the different surfaces.
18. The method of claim 16 further comprising:
determining a position of a scanned object in the coordinate system; and
correlating positions of lateral portions of different surfaces of the scanned object with the position of the scanned object in the coordinate system; and
19. The method of claim 16 further comprising:
determining a position of a scanned object in the coordinate system;
correlating positions of lateral portions of different surfaces of the scanned object with the position of the scanned object in the coordinate system; and
assembling a three-dimensional shape using the correlated positions of the lateral portions.
20. The method of claim 16 wherein the scanned object is an ear.
US14/538,994 2011-03-23 2014-11-12 Optical scanning device Abandoned US20150057533A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/538,994 US20150057533A1 (en) 2011-03-23 2014-11-12 Optical scanning device

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201161466863P 2011-03-23 2011-03-23
US13/417,767 US8900126B2 (en) 2011-03-23 2012-03-12 Optical scanning device
US14/538,994 US20150057533A1 (en) 2011-03-23 2014-11-12 Optical scanning device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/417,767 Continuation US8900126B2 (en) 2011-03-23 2012-03-12 Optical scanning device

Publications (1)

Publication Number Publication Date
US20150057533A1 true US20150057533A1 (en) 2015-02-26

Family

ID=46880001

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/417,767 Expired - Fee Related US8900126B2 (en) 2011-03-23 2012-03-12 Optical scanning device
US14/538,994 Abandoned US20150057533A1 (en) 2011-03-23 2014-11-12 Optical scanning device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/417,767 Expired - Fee Related US8900126B2 (en) 2011-03-23 2012-03-12 Optical scanning device

Country Status (8)

Country Link
US (2) US8900126B2 (en)
EP (1) EP2710805A4 (en)
JP (1) JP2014524751A (en)
KR (1) KR20140067970A (en)
CN (1) CN103828360A (en)
AU (1) AU2012231140A1 (en)
CA (1) CA2844738A1 (en)
WO (1) WO2012129229A2 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE48214E1 (en) 2013-10-24 2020-09-15 Logitech Europe S.A Custom fit in-ear monitors utilizing a single piece driver module
US10869115B2 (en) 2018-01-03 2020-12-15 Logitech Europe S.A. Apparatus and method of forming a custom earpiece
US11375326B2 (en) 2014-05-30 2022-06-28 Logitech Canada, Inc. Customizable ear insert
US11425479B2 (en) 2020-05-26 2022-08-23 Logitech Europe S.A. In-ear audio device with interchangeable faceplate
DE102021120835A1 (en) 2021-08-10 2023-02-16 Smart Optics Sensortechnik Gmbh Method and system for acquiring 3D surface data of an object to be measured

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8900126B2 (en) 2011-03-23 2014-12-02 United Sciences, Llc Optical scanning device
US8900125B2 (en) 2012-03-12 2014-12-02 United Sciences, Llc Otoscanning with 3D modeling
WO2013188014A1 (en) * 2012-06-13 2013-12-19 Boston Scientific Scimed, Inc. Medical device visualization system
US20150038871A1 (en) * 2013-08-02 2015-02-05 United Sciences, Llc In-Ear Proprioceptive for Relieving Temporomandibular Joint-Related Symptoms
US20150038849A1 (en) * 2013-08-02 2015-02-05 United Sciences, Llc Methods for Reducing One or More Symptoms of Temporomandibular Joint Disorder
US20150039087A1 (en) * 2013-08-02 2015-02-05 United Sciences, Llc Method of Designing Custom Device for Alleviating Temporomandibular Joint-Related Symptoms
US20150035943A1 (en) * 2013-08-02 2015-02-05 United Sciences, Llc In-Ear Orthotic for Relieving Temporomandibular Joint-Related Symptoms
US20150098636A1 (en) * 2013-10-09 2015-04-09 United Sciences, Llc Integrated tracking with fiducial-based modeling
US20150097931A1 (en) * 2013-10-09 2015-04-09 United Sciences, Llc. Calibration of 3d scanning device
EP3133996A1 (en) * 2014-04-25 2017-03-01 Koninklijke Philips N.V. Catheter comprising two optical sensors
US20160051134A1 (en) * 2014-08-19 2016-02-25 United Sciences, Llc Guidance of three-dimensional scanning device
KR101638477B1 (en) 2014-09-19 2016-07-11 주식회사 고영테크놀러지 Optical tracking system and registration method for coordinate system in optical tracking system
US10621765B2 (en) * 2015-07-07 2020-04-14 Idex Asa Image reconstruction
US10861604B2 (en) * 2016-05-05 2020-12-08 Advinow, Inc. Systems and methods for automated medical diagnostics
ES2876155T3 (en) * 2016-07-13 2021-11-12 Dds Company Three-dimensional scanner and apparatus for processing artificial objects by using the same
US10097817B2 (en) * 2016-08-03 2018-10-09 MEGAFORCE COMPANY LlMlTED Double-image projection device projecting double images onto 3-dimensional ear canal model
US11026581B2 (en) * 2016-09-30 2021-06-08 Industrial Technology Research Institute Optical probe for detecting biological tissue
US11164679B2 (en) 2017-06-20 2021-11-02 Advinow, Inc. Systems and methods for intelligent patient interface exam station
US11348688B2 (en) 2018-03-06 2022-05-31 Advinow, Inc. Systems and methods for audio medical instrument patient measurements
CN108759668B (en) * 2018-05-31 2020-06-12 武汉中观自动化科技有限公司 Tracking type three-dimensional scanning method and system in vibration environment
US11647902B2 (en) * 2019-04-05 2023-05-16 University Of Utah Research Foundation Otoscope
US11712155B2 (en) 2019-06-20 2023-08-01 Cilag GmbH Intenational Fluorescence videostroboscopy of vocal cords
US11156748B2 (en) * 2019-09-18 2021-10-26 Lenovo (Singapore) Pte. Ltd. Omnidirectional structured light projection
WO2023150435A2 (en) * 2022-02-02 2023-08-10 The General Hospital Corporation An ultra-flexible miniature optical coherence tomography catheter and imaging method for endomicroscopy of the inner ear

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019274A1 (en) * 2001-06-27 2004-01-29 Vanderbilt University Method and apparatus for collecting and processing physical space data for use while performing image-guided surgery
US20050054900A1 (en) * 2003-07-21 2005-03-10 Vanderbilt University Ophthalmic orbital surgery apparatus and method and image-guided navigation system
US20050182295A1 (en) * 2003-12-12 2005-08-18 University Of Washington Catheterscope 3D guidance and interface system
US20050237581A1 (en) * 2004-04-21 2005-10-27 Knighton Mark S Hand held portable three dimensional scanner
US20110178765A1 (en) * 2010-01-20 2011-07-21 Faro Technologies, Inc. Multi-functional coordinate measurement machines
US20110230755A1 (en) * 2010-03-04 2011-09-22 Macfarlane Duncan Single camera motion measurement and monitoring for magnetic resonance applications
US20120057174A1 (en) * 2010-01-20 2012-03-08 Faro Technologies, Inc. Laser scanner or laser tracker having a projector

Family Cites Families (194)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4185918A (en) 1975-08-27 1980-01-29 Solid Photography Inc. Arrangement for sensing the characteristics of a surface and determining the position of points thereon
US4575805A (en) 1980-12-24 1986-03-11 Moermann Werner H Method and apparatus for the fabrication of custom-shaped implants
DK246082A (en) 1981-06-10 1982-12-11 Nat Res Dev TYMPANOMETRY DEVICE
US4396945A (en) 1981-08-19 1983-08-02 Solid Photography Inc. Method of sensing the position and orientation of elements in space
US4645348A (en) 1983-09-01 1987-02-24 Perceptron, Inc. Sensor-illumination system for use in three-dimensional measurement of objects and assemblies of objects
JPS6052710A (en) 1983-09-01 1985-03-26 Rikagaku Kenkyusho Distance detector
CH663466A5 (en) 1983-09-12 1987-12-15 Battelle Memorial Institute METHOD AND DEVICE FOR DETERMINING THE POSITION OF AN OBJECT IN RELATION TO A REFERENCE.
US4622967A (en) 1984-09-13 1986-11-18 Schachar Ronald A Auricular instrument
US4705401A (en) 1985-08-12 1987-11-10 Cyberware Laboratory Inc. Rapid three-dimensional surface digitizer
JPS63122421A (en) 1986-11-12 1988-05-26 株式会社東芝 Endoscope apparatus
US4774403A (en) 1987-03-30 1988-09-27 Harvey Industries, Inc. Triangulation-type position measuring device
US4986262A (en) 1987-03-31 1991-01-22 Kabushiki Kaisha Toshiba Measuring endoscope
JPH0796005B2 (en) 1987-10-27 1995-10-18 オリンパス光学工業株式会社 Endoscope device
FR2631697B1 (en) 1988-05-17 1991-07-26 Hispano Suiza Sa APPARATUS FOR OPTICAL CONTROL OF THE INTERNAL PROFILE OF A TUBE OR BORE
US5200819A (en) 1988-05-27 1993-04-06 The University Of Connecticut Multi-dimensional imaging system for endoscope
DK45889D0 (en) 1989-02-01 1989-02-01 Medicoteknisk Inst PROCEDURE FOR HEARING ADJUSTMENT
CH677570A5 (en) 1989-05-17 1991-05-31 Ascom Audiosys Ag
US5280378A (en) 1990-10-19 1994-01-18 I.L. Med, Inc. Cyclically scanned medical laser
US5487012A (en) 1990-12-21 1996-01-23 Topholm & Westermann Aps Method of preparing an otoplasty or adaptive earpiece individually matched to the shape of an auditory canal
US6675040B1 (en) 1991-01-28 2004-01-06 Sherwood Services Ag Optical object tracking system
US5294940A (en) 1991-02-06 1994-03-15 Dale A. Wennagel Pulsed laser optical display device
DE69232403T2 (en) 1991-08-06 2002-08-22 Canon Kk Three-dimensional model processing method and device
US5436655A (en) 1991-08-09 1995-07-25 Olympus Optical Co., Ltd. Endoscope apparatus for three dimensional measurement for scanning spot light to execute three dimensional measurement
US5218427A (en) 1991-09-06 1993-06-08 Koch Stephen K Ranging system for three-dimensional object digitizing
JP3347385B2 (en) 1992-03-27 2002-11-20 オリンパス光学工業株式会社 Endoscope image processing device
EP0646263B1 (en) 1993-04-20 2000-05-31 General Electric Company Computer graphic and live video system for enhancing visualisation of body structures during surgery
US5419312A (en) 1993-04-20 1995-05-30 Wildflower Communications, Inc. Multi-function endoscope apparatus
US5747789A (en) 1993-12-01 1998-05-05 Dynamics Imaging, Inc. Method for investigation of distribution of physiological components in human body tissues and apparatus for its realization
DK174851B1 (en) 1993-12-10 2003-12-22 Madsen Electronics As Oto-acoustic emission analyzer
US5605531A (en) 1994-04-08 1997-02-25 Tilane Corporation Apparatus for use with endoscopy and fluoroscopy for automatic switching between video modes
TW387560U (en) 1994-05-13 2000-04-11 Prec Optics Coroporation Viewing scope with image intensification
US5546189A (en) 1994-05-19 1996-08-13 View Engineering, Inc. Triangulation-based 3D imaging and processing method and system
US6028672A (en) 1996-09-30 2000-02-22 Zheng J. Geng High speed three dimensional imaging method
DE19535114B4 (en) 1994-09-21 2013-09-05 Hoya Corp. Endoscope system with fluorescence diagnosis
US5926388A (en) 1994-12-09 1999-07-20 Kimbrough; Thomas C. System and method for producing a three dimensional relief
US5825495A (en) 1995-02-27 1998-10-20 Lockheed Martin Corporation Bright field illumination system
US5658235A (en) 1995-03-31 1997-08-19 Medrx, Inc. Video otoscope and optical lens system therefor
US5702249A (en) 1995-05-19 1997-12-30 Cooper; David H. Modular intra-oral imaging system video camera
US5831601A (en) 1995-06-07 1998-11-03 Nview Corporation Stylus position sensing and digital camera with a digital micromirror device
JPH095048A (en) 1995-06-16 1997-01-10 Sony Corp Surface shape measuring apparatus
US5895927A (en) 1995-06-30 1999-04-20 The United States Of America As Represented By The Secretary Of The Air Force Electro-optic, noncontact, interior cross-sectional profiler
US5753931A (en) 1995-07-13 1998-05-19 Nike, Inc. Object imaging device and method using line striping
US5840017A (en) 1995-08-03 1998-11-24 Asahi Kogaku Kogyo Kabushiki Kaisha Endoscope system
JPH0961132A (en) 1995-08-28 1997-03-07 Olympus Optical Co Ltd Three-dimensional-shape measuring apparatus
JPH09189873A (en) 1995-11-09 1997-07-22 Toshiba Corp Method and device for scanning multi-beam
JP3435268B2 (en) 1995-11-09 2003-08-11 ペンタックス株式会社 Fluorescence observation endoscope device
US5714832A (en) 1996-03-15 1998-02-03 Hughes Electronics Miniature grating device
US5847832A (en) 1996-03-15 1998-12-08 Hughes Aircraft Company Moire topographic measurement
US6044170A (en) 1996-03-21 2000-03-28 Real-Time Geometry Corporation System and method for rapid shape digitizing and adaptive mesh generation
US6293911B1 (en) 1996-11-20 2001-09-25 Olympus Optical Co., Ltd. Fluorescent endoscope system enabling simultaneous normal light observation and fluorescence observation in infrared spectrum
US7179222B2 (en) 1996-11-20 2007-02-20 Olympus Corporation Fluorescent endoscope system enabling simultaneous achievement of normal light observation based on reflected light and fluorescence observation based on light with wavelengths in infrared spectrum
US5897494A (en) 1997-01-31 1999-04-27 The Board Of Trustees Of The University Of Arkansas Vibrometer
US6081612A (en) 1997-02-28 2000-06-27 Electro Optical Sciences Inc. Systems and methods for the multispectral imaging and characterization of skin tissue
US6393431B1 (en) 1997-04-04 2002-05-21 Welch Allyn, Inc. Compact imaging instrument system
US6069698A (en) 1997-08-28 2000-05-30 Olympus Optical Co., Ltd. Optical imaging apparatus which radiates a low coherence light beam onto a test object, receives optical information from light scattered by the object, and constructs therefrom a cross-sectional image of the object
US6217510B1 (en) 1997-10-02 2001-04-17 Olympus Optical Co., Ltd. Endoscopes and endoscope devices which image regular observation images and fluorescent images as well as which provide easier operation of treatment tools
US6179777B1 (en) 1997-11-27 2001-01-30 Asahi Kogaku Kogyo Kabushiki Kaisha Fluorescent diagnosing apparatus including optical path switching member
US5910845A (en) 1997-12-02 1999-06-08 Brown; Thomas Mattingly Peripheral viewing optical scanner for three dimensional surface measurement
US6377865B1 (en) 1998-02-11 2002-04-23 Raindrop Geomagic, Inc. Methods of generating three-dimensional digital models of objects by wrapping point cloud data points
US6292263B1 (en) 1998-02-18 2001-09-18 Minolta Co., Ltd. Three-dimensional measuring apparatus
FR2779517B1 (en) 1998-06-05 2000-08-18 Architecture Traitement D Imag METHOD AND DEVICE FOR OPTOELECTRIC ACQUISITION OF SHAPES BY AXIAL ILLUMINATION
US6110106A (en) 1998-06-24 2000-08-29 Biomax Technologies, Inc. Endoscopes and methods relating to direct viewing of a target tissue
FR2783330B1 (en) 1998-09-15 2002-06-14 Assist Publ Hopitaux De Paris DEVICE FOR OBSERVING THE INTERIOR OF A BODY PRODUCING AN IMPROVED OBSERVATION QUALITY
AU1517000A (en) 1998-10-26 2000-05-15 Visionary Medical, Inc. Portable data collection device
US7419467B2 (en) 1998-11-25 2008-09-02 M3 Electronics, Inc. Medical inspection device
US6626825B2 (en) 1998-11-25 2003-09-30 Jory Tsai Medical inspection device
US7137948B2 (en) 1998-11-25 2006-11-21 Jory Tsai Medical inspection device
US6186944B1 (en) 1998-11-25 2001-02-13 Jory Tsai Medical inspection device
US6361489B1 (en) 1998-11-25 2002-03-26 Jory Tsai Medical inspection device
DE60024059T2 (en) 1999-01-26 2006-07-20 Newton Laboratories, Inc., Woburn DEVICE FOR AUTOFLUORESCENT IMAGING FOR AN ENDOSCOPE
US8636648B2 (en) 1999-03-01 2014-01-28 West View Research, Llc Endoscopic smart probe
US6532299B1 (en) 2000-04-28 2003-03-11 Orametrix, Inc. System and method for mapping a surface
US7068825B2 (en) * 1999-03-08 2006-06-27 Orametrix, Inc. Scanning system and calibration method for capturing precise three-dimensional information of objects
US7110127B2 (en) * 1999-04-20 2006-09-19 Hewlett-Packard Development Company, L.P. Method and apparatus for product regionalization
US6902527B1 (en) 1999-05-18 2005-06-07 Olympus Corporation Endoscope system with charge multiplying imaging device and automatic gain control
US6753966B2 (en) 2000-03-10 2004-06-22 Textron Systems Corporation Optical probes and methods for spectral analysis
WO2001006924A1 (en) * 1999-07-23 2001-02-01 University Of Florida Ultrasonic guidance of target structures for medical procedures
US8239001B2 (en) 2003-10-17 2012-08-07 Medtronic Navigation, Inc. Method and apparatus for surgical navigation
US7366562B2 (en) 2003-10-17 2008-04-29 Medtronic Navigation, Inc. Method and apparatus for surgical navigation
US6383133B1 (en) 1999-11-09 2002-05-07 Dwight T. Jones Otoscope kit
DE10055725B4 (en) 1999-11-11 2007-12-27 Pentax Corp. Electronic endoscope system
US6450970B1 (en) 1999-11-16 2002-09-17 Ron Mahler Method and device for diagnosing an inflammatory process
US6603552B1 (en) 1999-12-22 2003-08-05 Xillix Technologies Corp. Portable system for detecting skin abnormalities based on characteristic autofluorescence
JP4433347B2 (en) 2000-01-17 2010-03-17 富士フイルム株式会社 Fluorescence imaging device
US6937348B2 (en) 2000-01-28 2005-08-30 Genex Technologies, Inc. Method and apparatus for generating structural pattern illumination
US6975898B2 (en) * 2000-06-19 2005-12-13 University Of Washington Medical imaging, diagnosis, and therapy using a scanning single optical fiber system
US6530882B1 (en) 2000-06-30 2003-03-11 Inner Vision Imaging, L.L.C. Endoscope having microscopic and macroscopic magnification
WO2002007587A2 (en) 2000-07-14 2002-01-31 Xillix Technologies Corporation Compact fluorescent endoscopy video system
US7625335B2 (en) * 2000-08-25 2009-12-01 3Shape Aps Method and apparatus for three-dimensional optical scanning of interior surfaces
US7050876B1 (en) 2000-10-06 2006-05-23 Phonak Ltd. Manufacturing methods and systems for rapid production of hearing-aid shells
EP1362218B1 (en) 2000-11-08 2012-05-02 Institut Straumann AG (dental) surface mapping and generation
DE10104483A1 (en) * 2001-01-31 2002-10-10 Forschungszentrum Fuer Medizin Device for 3D measurement of surfaces in especially organic hollow volumes has optical imaging channel(s), projection channel(s) in endoscope shaft, fed out of shaft laterally at distal end
US7835925B2 (en) 2001-02-20 2010-11-16 The Procter & Gamble Company System for improving the management of the health of an individual and related methods
US8032337B2 (en) 2001-03-02 2011-10-04 3Shape A/S Method for modeling customized earpieces
EP1246506A1 (en) 2001-03-26 2002-10-02 Widex A/S A CAD/CAM system for designing a hearing aid
EP1392164B1 (en) 2001-05-17 2012-07-25 Oticon A/S Method for obtaining geometrical data relating to the ear canal of the human body
EP1392155B1 (en) 2001-05-17 2012-09-05 Oticon A/S Method and apparatus for obtaining position data relating to a probe in the ear canal
WO2002091913A1 (en) 2001-05-17 2002-11-21 Oticon A/S Method and apparatus for obtaining geometrical data relating to a canal
US7421140B2 (en) 2001-11-21 2008-09-02 Shraga Rottem Method and system for enhancing the quality of device images
US7371218B2 (en) 2002-01-17 2008-05-13 Siemens Medical Solutions Usa, Inc. Immersive portable ultrasound system and method
US20030139673A1 (en) 2002-01-18 2003-07-24 Vivenzio Robert L. Illumination system
AU2002218934A1 (en) 2002-01-21 2002-03-26 Phonak Ag Method for the reconstruction of the geometry of the inner surface of a cavity
US20030210812A1 (en) * 2002-02-26 2003-11-13 Ali Khamene Apparatus and method for surgical navigation
US20030171655A1 (en) 2002-03-08 2003-09-11 Newman Richard W. Combination otoscope
EP1371939A1 (en) 2002-05-15 2003-12-17 Icos Vision Systems N.V. A device for measuring in three dimensions a topographical shape of an object
US20040186357A1 (en) 2002-08-20 2004-09-23 Welch Allyn, Inc. Diagnostic instrument workstation
US20040122787A1 (en) 2002-12-18 2004-06-24 Avinash Gopal B. Enhanced computer-assisted medical data processing system and method
US6918538B2 (en) 2002-12-18 2005-07-19 Symbol Technologies, Inc. Image scanning device having a system for determining distance to a target
US7490085B2 (en) 2002-12-18 2009-02-10 Ge Medical Systems Global Technology Company, Llc Computer-assisted data processing system and method incorporating automated learning
US7949385B2 (en) 2003-03-11 2011-05-24 Siemens Medical Solutions Usa, Inc. System and method for reconstruction of the human ear canal from optical coherence tomography scans
WO2004096008A2 (en) 2003-05-01 2004-11-11 Given Imaging Ltd. Panoramic field of view imaging device
SE0301718L (en) 2003-06-13 2005-02-11 Atos Medical Ab Method and device for determining body condition
US7311723B2 (en) 2003-07-11 2007-12-25 University Of Washington Scanning laser device and methods of use
US20050068544A1 (en) 2003-09-25 2005-03-31 Gunter Doemens Panoramic scanner
EP1709476A4 (en) 2003-09-26 2010-08-04 Tidal Photonics Inc Apparatus and methods relating to expanded dynamic range imaging endoscope systems
WO2005050156A2 (en) 2003-11-18 2005-06-02 Chameleon Medical Innovation Ltd. Measurement system and method for use in determining the patient's condition
US7937253B2 (en) 2004-03-05 2011-05-03 The Procter & Gamble Company Virtual prototyping system and method
US7162323B2 (en) 2004-04-05 2007-01-09 Hearing Aid Express, Inc. Decentralized method for manufacturing hearing aid devices
US7654997B2 (en) 2004-04-21 2010-02-02 Acclarent, Inc. Devices, systems and methods for diagnosing and treating sinusitus and other disorders of the ears, nose and/or throat
US20060063973A1 (en) 2004-04-21 2006-03-23 Acclarent, Inc. Methods and apparatus for treating disorders of the ear, nose and throat
JP2006006874A (en) * 2004-06-23 2006-01-12 Tadakazu Sakuragi Endoscope with liquid-crystal monitor for guiding tracheal tube
US8827899B2 (en) 2004-09-24 2014-09-09 Vivid Medical, Inc. Disposable endoscopic access device and portable display
US8858425B2 (en) 2004-09-24 2014-10-14 Vivid Medical, Inc. Disposable endoscope and portable display
US9033870B2 (en) 2004-09-24 2015-05-19 Vivid Medical, Inc. Pluggable vision module and portable display for endoscopy
US8556806B2 (en) 2004-09-24 2013-10-15 Vivid Medical, Inc. Wavelength multiplexing endoscope
US8602971B2 (en) 2004-09-24 2013-12-10 Vivid Medical. Inc. Opto-Electronic illumination and vision module for endoscopy
US8480566B2 (en) 2004-09-24 2013-07-09 Vivid Medical, Inc. Solid state illumination for endoscopy
US7961981B2 (en) 2004-11-24 2011-06-14 Phonak Ag Method of obtaining a three-dimensional image of the outer ear canal
US8109981B2 (en) 2005-01-25 2012-02-07 Valam Corporation Optical therapies and devices
US7611060B2 (en) 2005-03-11 2009-11-03 Hand Held Products, Inc. System and method to automatically focus an image reader
US20070001023A1 (en) * 2005-06-20 2007-01-04 Green Dennis E Air freshener
US7364306B2 (en) 2005-06-20 2008-04-29 Digital Display Innovations, Llc Field sequential light source modulation for a digital display system
US20090189972A1 (en) 2005-07-12 2009-07-30 Harris Michael D System and method for video medical examination and real time transmission to remote locations
US7448753B1 (en) 2005-07-19 2008-11-11 Chinnock Randal B Portable Digital Medical Camera for Capturing Images of the Retina or the External Auditory Canal, and Methods of Use
JP5114024B2 (en) 2005-08-31 2013-01-09 オリンパス株式会社 Optical imaging device
US20070156021A1 (en) * 2005-09-14 2007-07-05 Bradford Morse Remote imaging apparatus having an adaptive lens
US7802909B2 (en) 2005-09-20 2010-09-28 Noble Marketing, Inc. Multifunctional medical examination instrument
WO2007038330A2 (en) * 2005-09-22 2007-04-05 3M Innovative Properties Company Artifact mitigation in three-dimensional imaging
US8537203B2 (en) 2005-11-23 2013-09-17 University Of Washington Scanning beam with variable sequential framing using interrupted scanning resonance
DE102005059550A1 (en) 2005-12-13 2007-06-14 Siemens Ag Optical measuring device for measuring inner wall of e.g. ear channel, in animal, has rotatable reflector rotatable around rotary axis so that inner wall of cavity is scanned along line circulating rotary axis
AT502919B1 (en) * 2005-12-14 2010-11-15 Univ Innsbruck MEDICAL NAVIGATION SYSTEM
EP1969306A2 (en) 2006-01-06 2008-09-17 Phonak AG Method and system for reconstructing the three-dimensional shape of the surface of at least a portion of an ear canal and/or of a concha
CN101370429A (en) 2006-01-17 2009-02-18 成象诊断系统公司 Laser imaging apparatus with variable patient positioning
US8035637B2 (en) 2006-01-20 2011-10-11 3M Innovative Properties Company Three-dimensional scan recovery
US7813591B2 (en) 2006-01-20 2010-10-12 3M Innovative Properties Company Visual feedback of 3D scan parameters
US20080045799A1 (en) 2006-04-10 2008-02-21 Peter Whitehead Multipurpose diseased tissue detection devices, systems, and methods
US7955255B2 (en) 2006-04-20 2011-06-07 Boston Scientific Scimed, Inc. Imaging assembly with transparent distal cap
US20070270647A1 (en) 2006-05-19 2007-11-22 Ams Research Corporation Handle for Multifunction Endoscope
EP2086400A4 (en) 2006-07-17 2010-05-05 Signostics Pty Ltd Improved medical diagnostic device
US20080058629A1 (en) 2006-08-21 2008-03-06 University Of Washington Optical fiber scope with both non-resonant illumination and resonant collection/imaging for multiple modes of operation
US7440121B2 (en) 2006-09-20 2008-10-21 Lawrence Livermore National Security, Llc Optically measuring interior cavities
DE102006046925A1 (en) * 2006-09-28 2008-04-03 Jenlab Gmbh Method for laser endoscopy e.g. for medical work and for semiconductor processing, requires laser pulse for producing multi-photon processes as target ionization
US7553020B2 (en) 2006-09-29 2009-06-30 Welch Allyn, Inc. Medical diagnostic instrument with variable focus liquid lens
US20080146915A1 (en) 2006-10-19 2008-06-19 Mcmorrow Gerald Systems and methods for visualizing a cannula trajectory
DE102006054310A1 (en) 2006-11-17 2008-05-29 Siemens Ag Measuring a cavity by means of cylindrically symmetric triangulation
DE102007005388A1 (en) 2007-02-02 2008-08-07 Siemens Ag Refractive generation of a concentrically structured light beam, optical measuring device with refractive deflecting element
US7996068B2 (en) 2007-03-14 2011-08-09 The Board Of Trustees Of The Leland Stanford Junior University Surgical method and apparatus for identification of fluorescence
US7583872B2 (en) 2007-04-05 2009-09-01 University Of Washington Compact scanning fiber device
US8212884B2 (en) 2007-05-22 2012-07-03 University Of Washington Scanning beam device having different image acquisition modes
US20090021818A1 (en) * 2007-07-20 2009-01-22 Ethicon Endo-Surgery, Inc. Medical scanning assembly with variable image capture and display
EP2026102A1 (en) 2007-08-13 2009-02-18 Oticon A/S Method of and system for positioning first and second devices relative to each other
US7925333B2 (en) 2007-08-28 2011-04-12 Ethicon Endo-Surgery, Inc. Medical device including scanned beam unit with operational control features
US8705184B2 (en) 2007-11-12 2014-04-22 Cornell University Multi-path, multi-magnification, non-confocal fluorescence emission endoscopy apparatus and methods
US8811763B2 (en) 2007-12-06 2014-08-19 The United States Of America As Represented By The Secretary Of The Army Method and system for producing image frames using quantum properties
US8983580B2 (en) 2008-01-18 2015-03-17 The Board Of Trustees Of The University Of Illinois Low-coherence interferometry and optical coherence tomography for image-guided surgical treatment of solid tumors
US8228368B2 (en) 2008-04-26 2012-07-24 Intuitive Surgical Operations, Inc. Augmented stereoscopic visualization for a surgical robot using a captured fluorescence image and captured stereoscopic visible images
US20120057734A1 (en) 2008-07-23 2012-03-08 Asius Technologies, Llc Hearing Device System and Method
US8845526B2 (en) 2008-07-24 2014-09-30 Massachusetts Institute Of Technology Integrated otoscope and three dimensional scanning system
US9170199B2 (en) 2008-07-24 2015-10-27 Massachusetts Institute Of Technology Enhanced sensors in three dimensional scanning system
US9170200B2 (en) 2008-07-24 2015-10-27 Massachusetts Institute Of Technology Inflatable membrane with hazard mitigation
US9291565B2 (en) 2008-07-24 2016-03-22 Massachusetts Institute Of Technology Three dimensional scanning using membrane with optical features
US9140649B2 (en) 2008-07-24 2015-09-22 Massachusetts Institute Of Technology Inflatable membrane having non-uniform inflation characteristic
US8107086B2 (en) 2008-07-24 2012-01-31 Massachusetts Institute Of Technology Three-dimensional imaging using absorption
US8384916B2 (en) 2008-07-24 2013-02-26 Massachusetts Institute Of Technology Dynamic three-dimensional imaging of ear canals
WO2010033932A1 (en) 2008-09-22 2010-03-25 Earlens Corporation Transducer devices and methods for hearing
US20110009694A1 (en) * 2009-07-10 2011-01-13 Schultz Eric E Hand-held minimally dimensioned diagnostic device having integrated distal end visualization
US9746544B2 (en) 2008-12-03 2017-08-29 Analog Devices, Inc. Position measurement systems using position sensitive detectors
US7976474B2 (en) 2009-01-23 2011-07-12 Path Medical Gmbh Ear canal obstruction detecting acoustical stimulation ear probe
US9706282B2 (en) 2009-02-23 2017-07-11 Harman International Industries, Incorporated Earpiece system
DE102009014463A1 (en) 2009-03-23 2010-09-30 Siemens Medical Instruments Pte. Ltd. Apparatus and method for measuring the distance to the eardrum
CN102448398A (en) * 2009-06-01 2012-05-09 皇家飞利浦电子股份有限公司 Distance-based position tracking method and system
EP2442720B1 (en) * 2009-06-17 2016-08-24 3Shape A/S Focus scanning apparatus
US7995214B2 (en) 2009-07-28 2011-08-09 Siemens Medical Instruments Pte. Ltd. Apparatus and method for recording the shape of an ear section
US8206290B2 (en) 2009-10-08 2012-06-26 Apple Biomedical, Inc. Medical inspection device
US20110137118A1 (en) 2009-10-06 2011-06-09 Apple Biomedical, Inc. Medical inspection device
US20110102763A1 (en) 2009-10-30 2011-05-05 Microvision, Inc. Three Dimensional Imaging Device, System and Method
US8594757B2 (en) 2009-11-18 2013-11-26 The Board Of Trustees Of The University Of Illinois Apparatus for biomedical imaging
US11022433B2 (en) 2010-02-12 2021-06-01 Koninklijke Philips N.V. Laser enhanced reconstruction of 3D surface
EP3403568B1 (en) 2010-03-30 2023-11-01 3Shape A/S Scanning of cavities with restricted accessibility
TWI554243B (en) * 2011-01-21 2016-10-21 愛爾康研究有限公司 Combined surgical endoprobe for optical coherence tomography, illumination or photocoagulation
US8900126B2 (en) 2011-03-23 2014-12-02 United Sciences, Llc Optical scanning device
WO2012135823A1 (en) 2011-04-01 2012-10-04 Massachusetts Institute Of Technology High sensitivity temporal focusing widefield multiphoton endoscope capable of deep imaging
BR112014002053A2 (en) 2011-07-28 2017-02-21 Massachusetts Inst Technology camera setup for three-dimensional imaging of interior spaces
US8900125B2 (en) 2012-03-12 2014-12-02 United Sciences, Llc Otoscanning with 3D modeling

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040019274A1 (en) * 2001-06-27 2004-01-29 Vanderbilt University Method and apparatus for collecting and processing physical space data for use while performing image-guided surgery
US20050054900A1 (en) * 2003-07-21 2005-03-10 Vanderbilt University Ophthalmic orbital surgery apparatus and method and image-guided navigation system
US20050182295A1 (en) * 2003-12-12 2005-08-18 University Of Washington Catheterscope 3D guidance and interface system
US20050237581A1 (en) * 2004-04-21 2005-10-27 Knighton Mark S Hand held portable three dimensional scanner
US20110178765A1 (en) * 2010-01-20 2011-07-21 Faro Technologies, Inc. Multi-functional coordinate measurement machines
US20120057174A1 (en) * 2010-01-20 2012-03-08 Faro Technologies, Inc. Laser scanner or laser tracker having a projector
US20110230755A1 (en) * 2010-03-04 2011-09-22 Macfarlane Duncan Single camera motion measurement and monitoring for magnetic resonance applications

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE48214E1 (en) 2013-10-24 2020-09-15 Logitech Europe S.A Custom fit in-ear monitors utilizing a single piece driver module
USRE48424E1 (en) 2013-10-24 2021-02-02 Logitech Europe S.A Custom fit in-ear monitors utilizing a single piece driver module
US11375326B2 (en) 2014-05-30 2022-06-28 Logitech Canada, Inc. Customizable ear insert
US10869115B2 (en) 2018-01-03 2020-12-15 Logitech Europe S.A. Apparatus and method of forming a custom earpiece
US11425479B2 (en) 2020-05-26 2022-08-23 Logitech Europe S.A. In-ear audio device with interchangeable faceplate
DE102021120835A1 (en) 2021-08-10 2023-02-16 Smart Optics Sensortechnik Gmbh Method and system for acquiring 3D surface data of an object to be measured

Also Published As

Publication number Publication date
EP2710805A4 (en) 2015-05-13
JP2014524751A (en) 2014-09-25
AU2012231140A1 (en) 2013-10-31
KR20140067970A (en) 2014-06-05
WO2012129229A3 (en) 2014-05-01
WO2012129229A2 (en) 2012-09-27
US20120281071A1 (en) 2012-11-08
CA2844738A1 (en) 2012-09-27
CN103828360A (en) 2014-05-28
US8900126B2 (en) 2014-12-02
EP2710805A2 (en) 2014-03-26

Similar Documents

Publication Publication Date Title
US8900126B2 (en) Optical scanning device
US8900127B2 (en) Otoscanner with pressure sensor for compliance measurement
EP3403568B1 (en) Scanning of cavities with restricted accessibility
ES2327212T3 (en) PROCEDURE AND APPARATUS FOR A THREE-DIMENSIONAL OPTICAL SCANNING OF INTERIOR SURFACES.
US20150097931A1 (en) Calibration of 3d scanning device
US7995214B2 (en) Apparatus and method for recording the shape of an ear section
US20150097968A1 (en) Integrated calibration cradle
JPH02287311A (en) Endoscope device with measuring mechanism
JP2006325741A (en) Endoscope apparatus for measurement and program for endoscope
JP3446272B2 (en) Endoscope with measurement function
JP2017023562A (en) Three-dimensional shape measurement device, diagnostic system, and three-dimensional shape measurement method
JPH10323322A (en) Three-dimensional measurement endoscope device
JPH10239029A (en) Three-dimensional shape measuring device
Hasegawa et al. Electronic endoscope system for shape measurement
CN101984915B (en) Method and device for recording the form of an ear section
CN116327097B (en) Method and device for measuring size of tumor by endoscope
WO2022200350A1 (en) Ear profiling with oct

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION