CA1289788C - Operating microscope providing an image of an obscured object - Google Patents
Operating microscope providing an image of an obscured objectInfo
- Publication number
- CA1289788C CA1289788C CA000554551A CA554551A CA1289788C CA 1289788 C CA1289788 C CA 1289788C CA 000554551 A CA000554551 A CA 000554551A CA 554551 A CA554551 A CA 554551A CA 1289788 C CA1289788 C CA 1289788C
- Authority
- CA
- Canada
- Prior art keywords
- image
- microscope
- penetrating radiation
- visible
- radiation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/1006—Beam splitting or combining systems for splitting or combining different wavelengths
- G02B27/1013—Beam splitting or combining systems for splitting or combining different wavelengths for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/18—Arrangements with more than one light path, e.g. for comparing two specimens
- G02B21/20—Binocular arrangements
- G02B21/22—Stereoscopic arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/1066—Beam splitting or combining systems for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/12—Beam splitting or combining systems operating by refraction only
- G02B27/123—The splitting element being a lens or a system of lenses, including arrays and surfaces with refractive power
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/144—Beam splitting or combining systems operating by reflection only using partially transparent surfaces without spectral selectivity
Abstract
ABSTRACT OF THE DISCLOSURE
An improved microscope features real time generation of combined visible and converted images.
The converted image is of an object which is obscured by a layer of material which is opaque to visible light, but which is substantially transparent to non-visible pentrating radiation. In an operating microscope application, the invisible penetrating radiation may be radiation of wavelength greater than 620 nm, to which blood is transparent. The converted visible image made using the reflected pentrating radiation will show tissues underlying a layer of blood, which otherwise would obscure the tissues from being viewed by a surgeon. The converted and visible images are combined to generate a combined image which is more useful than would be the reflected penetrating radiation image alone. Image enhancement techniques may be employed to enhance the converted image.
An improved microscope features real time generation of combined visible and converted images.
The converted image is of an object which is obscured by a layer of material which is opaque to visible light, but which is substantially transparent to non-visible pentrating radiation. In an operating microscope application, the invisible penetrating radiation may be radiation of wavelength greater than 620 nm, to which blood is transparent. The converted visible image made using the reflected pentrating radiation will show tissues underlying a layer of blood, which otherwise would obscure the tissues from being viewed by a surgeon. The converted and visible images are combined to generate a combined image which is more useful than would be the reflected penetrating radiation image alone. Image enhancement techniques may be employed to enhance the converted image.
Description
1 ZP,~7~
OPERATING ~ICROSCOP~ PROYIDING AM
IMA OE OF AN OBSCUR~D OBJ~CT
BACKGROUND OF THE I~VENTION
1. Field of the Invention This invention relate~ ge~erally to operating microscopes, and more particularly, to operating microscopes used in microsurgery and other delicate operations.
OPERATING ~ICROSCOP~ PROYIDING AM
IMA OE OF AN OBSCUR~D OBJ~CT
BACKGROUND OF THE I~VENTION
1. Field of the Invention This invention relate~ ge~erally to operating microscopes, and more particularly, to operating microscopes used in microsurgery and other delicate operations.
2. Related Art Operating microscopes, according to which a surgeon is provided an enlarged view o~ the field of the surgery, are qenerally known in the art. See, for example, U.S. Patent No. 4,484,498 to Muller et al., which shows a binocular operatinq microscope according to which a number of dif~erent individuals can simultaneously view the field of surgery.
Optical operating microscope technology has generally been quiescent in racent years. This is in part due to the fact that inevitably during surgery a layer of blood obscures the object to be imaged. That is, the ultimate limitation on the surgeon's vision is the layer of blood overlying the tissues of interest.
Blood obscures the tissues to a degree depending on the amount of suction employed, how fast the blood seeps into the operating field, and so forth. Some amount of blood flow into the operating field is inevitable. In the case o~ particularly delicate surgery, ~uch as microsurgery on the eye, the nervous syst~m, and the like, blood in the operating field signi~icantly obscures the nervous and eye tissues, preventing tha ~ 7 ~ ~
surgeon frcm seeing the condition to be corrected by surgery.
Conventional operating microscopes cannot rPnder transparent the layer of blood which inevitably cover the tissues on which the surgery is to be performed ~9 that the surgeon can be provided an image o~ thP
underlying object.
U.S. Patent No. 3,74~,471 to Ro~s ~hows a "False Color Radiant Energy Detection Method and Apparatu~" in which visible and nonvisible radiation (that is, visible and, for example, infrared radiation) are simultaneously reflected from an object and are optically and electronically det~cted. ~he nonvisible re~lected radiation is converted into a false-colored visible image which is superimposed over the ordinary visible image, to produce a composite false-colored image highlighting portions of the object having a high degree of reflectivity in the nonvisible spectrum. Ross teaches that this apparatus may be of use in determining the relative health of pl~nt life. For example, heal~hy foliage reflects infrared radiation more completely than does unhealthy foliage. Ross does not teach any apparatus or method whereby an obscuring layer of material can be effectively removed from an image to reveal the underlying object.
U.S. Patent No. 4,596,930 to Steil et al. shows a charge-coupled imaginq device in which different groups of detectors which are sensitive to light energy at different wavelengths are arrqnged in a single array.
Howev~er, Steil et alO does not teach any means in which a layer of an obscuring material, such as blood~ can be effectively removed from a visi~le image, such as that of an operating field.
~ ~37~8 : -3-S~MMARY OF THE INVENTION
The present invention i~ o~ ?n operating micro~cope in which a real time composi~e image i provided of the visible operating field and of an underlying o~ect which is normally obscured by a layer of material opaque to visible radiation. More particularly, the microscope of the present invention comprises means for illuminating an object obscured by a layer OI a material which is opaque to vis;ble light with radiation consisting of visible light and l'penetrating radiation~
of a wavelength which penetrates the obscuring material. Where the obscuring material opaque to visib-l~ radiation is blood, penetrating radiation of a wavelength greater than about 620 nanometers i~
employed. Blood is significantly more transparent to radiation of a wavelength greater than 620 nm than to visible radiation. A detection and imaging system detects the penetrating radiation reflected from the object beneath the layer of blood, and convert~ the reflected penetrating radiation to provide a "converted" visible image. The converted image is thus a visible image of the object underlying the obscuring blood. The converted image provided by the detection and imaging system is then combined with a visible image of the operating field as ordinarily seen. The ~ombined images permit the surgeon to orient himself accurately, by reference ~o the visible image, while simultaneously viewing the ~onverted image o~ the object underneath the obscuring layer of blood.
-7~
In the preferred embodiment, the composite imagegeneration apparatus Df the present invention is confi8ured as a convenient after-market addition to a - highly popular pre-existing type of stereoscopic operating microscope. This allows such microscopes to be provided with the composite image generation capability according to the invention without a performance penalty in any other area. In a preferred embodiment, the pre-existing microscope to which composite image generation capability is added according to the present invention provides collimated optical ray paths at the point at which the composite image generation apparatus of the present invention is inserted; this fact allows the apparatus of the present invention to be inserted in the pre-existing microscope while altering the optical path of the microscope as little as possible.
Accordingly, the present invention provides a microscope for providing an image in the visible spectrum of an object obscured from direct view by a layer of material which is opaque to visible light, comprising: means for illuminating the object with radiation inciuding visible light and penetrating radiation~ wherein the layer of material obscuring the 7~
object is substantially transparent to said penetratin~
radiation; means for forming a visible image of the obscured ob~ect; means for detecting penetratin~
radiation reflected from the object obscured by the layer of material and for producing a penetrating radiation image; means for displaying a converted image of said object correspondinÆ to said penetrating radiation ima~e; and means for combining the visible image of the obscured object and the converted image to provide the image in the visible spectrum of the object.
Further, the present invention provides a method for providing an ima~e of an object obscured by a layer of a material whish is substantially opaque to visible light, comprising the steps of: illuminating the object with visible light and with penetrating radiation to which the layer of material is substantially transparent; forming a visible image of the obscured object using visible light reflected from the obscured object and the layer of material; detecting penetrating radiation having been reflected from said obJectj using said detected penetrating radiation to form a converted image of said object; and combining said visible and converted images to provide the image of the ob~ect.
7~.~
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be better understood if reference is made to the accompanying drawings, in which:
Figure 1 shows a graph of absorptance of hemoglobin versus wavelength of the illuminating radiation in nanometers;
Figure 2 shows a schematic diagram of the optical principles of a conventional binocular operating microscope; and ~igure 3 shows a schematic diagram of the optical principles of the operating microscope of Figure 2 having had the improved image formation apparatus according to the present invention added thereto.
D~SCRI~TION OF T~æ-lEg~FE~REDEH~oDI~oeHT~
As described above, in del~cate surgsry, particularly micro~urgery on the eyes, brain, spinal column, and the like, it i~ not pos~ible ~o remov~ all blood from the operating field. In addition ~o obscuration of the tissues by b~ood ~lowing ~rom damaged vessels, hlood in mall vessels or capillaries may render the tissues red or pink, masking normally vi3~ble cues in the target tissues. Thi~ ~s particularly true o~ tissues of the nervous system or well-vascularized tumors. In either case r the surgeon is ~requently reduced to operating by touch and ~eel. Clearly, this is not optimal, particularly in view of the fact that the surgeon's expertise will take considerable time to develop under these circumstances.
The present invention of an operating ~icroscope in which the obscuring layer of blood is rendered transparent in real time overcomes this problem.
More particularly, as is generally known, the human eye is sensitive to radiation of wavelengths in the range of about 380-650 nanometers (nm) wavelength. At ei~her end of this range, the eye's sensit~vity drops off relatively guickly. For example, I'red" is generally considered to extend ~rom 600-650 nm. However, the human eye i5 d~creasingly ~ensitive to images formed by radiation above about 620 nm. Therefore, if an ob~ect is illuminated with radiation of wavelengths greater than 620 nm, the typical eye is decreasingly capa~le of detecting its imaye, even though radiation ~rom 620-650 nm is sometimes termed part of the visible spectrum.
- ~. 2,P~7P,8 According to the present invention, an operating microscope is provided which presents a "combined" image to the surgeon's eyepiece. The combined image is a combination of a "visible" image (that iR, an image formed by reflected visible radiation ~n the 380-620 n~
range), and a "converted" image. The converted image iB
formed on a display device, and i~ a vi~ible image formed responsive to reflection of "penetrating radiation" in the non-visible range (that i~, less then about 380 nm or more than about 620 nm wavelength).
The combined image is of particular use because the converted image may be formed using reflected radiation of a wavelength to which a substance opaque to visible light is transparent. For example, hemoglobin, the main component of blood, is largely opaqus to visible light.
However, hemoglobin is relatively transparent to radiation of wavelength greater than about 620 nm. If an object obscured by a layer of blood is irradiated by penetrating radiation of wavelength greater than 620 nm, : 20 a "penetrating radiation image" of the object can be formed responsive to the reflected penetrating radiation; the penetrating radiation image can then be converted to a corre~ponding visible "converted" image of the obscured object.
When the visible and converted images are combined in real ~ime by the operating microscope of the present invention, the surgeon can use "clues" in ~he visible image of the operating ield to orient himself, and ¢an simultaneously use the superimposed converted image of the underlying object, for example, to see the actual condition to be remedied by the surgery. In this way, the surgeon will be provided with the correct understanding of the position of his surgical . .
~ ~p~
instruments with respect to the tissues upon which he is operating. By comparison, to have the converted image displayed, for example, on a separate video screen while viewing the visible image through the operating microscope would not provide the needed physical correlation between the converted and the visible images. Such an approach would not be as useful to the surgeon.
Radiation outside the ordinary visible spectrum may be used according to the invention to image objects underlying materials opaque in the visible spectrum, and ~o provide converted images which may be combined with the visible images to provide correlation therebetween.
It will be appreciated that the optics of the imaging system of the present invention may provide an effective limitation on the wavelengths of the "penetrating"
radiation, that is, on the radiation used to form the converted image. For example, th~ effective wavelength limits of the very popular Zeiss OPMI microscope are estimated to be about 360-2500 nm. Use of shorter wavelength ultraviolet radiation, perhaps down to 150-200 nm wavelength, might require use of quartz or magnesium fluoride optical elements. The sensors used to form the converted image will similarly have to be chosen in accordance with the wavelength of the penetrating radiation. Figure 1 shows, as mentioned, a plot of the relative absorptan~e of radiation by oxyhemoglobin tthat is, the pri~ary element of blood bearing oxygen) versus wavelength of the illuminating radiation in nanometers (nm). A~ can be seen, oxyhemoglobin shows several absorptance peaks in the blue (about 480 nm), greQn (about 545 nm) and yellow (about 578 nm) ranges, while its absorptance is relatively low in the red range (600-650 nm). This low absorbtance, of course, i5 why arterial blood appearz red. Deoxygenated hemoglobin has the ~ame red and infrared absorptance, but ~how~ only a single peak at about 550-560 nm, so that venous blood appears relatively blue. The relative absorptance o~ both t~pe~
of hemo~lobin drops rapidly to a value somewhat les~
than 0.05 at wavelengths gr~ater than about S20 nm.
However, as discussed above, at wavelength~ greater than about ~20 nm, the human eye responds very weakly if at all, such that it cannot effectively image thia longer wavelength radiation. Figure 1 thus show that hemoglobin, and hence blood, is effecti~ely more transparent to longer wavelength red light, which cannot be imaged by the eye, and to infrared radiation, than to visible radiation. Therefore, it i~ possible to irradiate an object obscured by a layer of blood with I'penetrating" radiation of wavelength greater than about 620 nm, and to form a "penetrating radiation" image of the reflected penetrating radiation. The penetrating radiation image can then be used to derive a corresponding "converted" image of the actual shape of the object underneath the layer of blood. The present invention exploits this fact.
Figure 2 shows a schematic diagram demonstrating the optical path of a typical operating microscope, in this case, the Zeiss "OPMI" binocular stereoscopic operating microscope. ~n object 10 in the operating field is covered by superficial blood vessels or capillaries or by an obscurlng layar 11 of material opaque to visibla radiation, such as blood. The operating field is imaged by a main objective 12 and a magnification changing unit 14. The imag is then 1 ~ ~J~ 7 ~ ~
passed through a binocular tube 16, and then via prisms 15 and 17 to parallel eye pieces 18. Such conventional microscopes are in common use in operating theater~.
It can be observed from Figure ~ that the light rays describing the optical path taken by the image of the obsurced object 10 are collimated between ~he magnification changer 14 and ths binocular tube 16.
While not necessarily critical to the present invention, this collimation makes it very convenient to provide the penetrating radiation imaging system of the present invention between the magni~ication changer 14 and binocular tube 16, and thereby to retrofit preexisting Zeiss OPMI microscopes with the penetrating radiation imaging systems of the present invention.
The fact that the Zeiss OPMI microscopes are manufactured in a modular fashion so as to be readily disassembled ~or modification permits the present invention to be conveniently provided in the form of a retrofit to such conventional microscopes. In addition, the inventors have found that the Zeiss OPMI micro~copes focus useful penetrating radiation as well as visible radiation, so that no modifications are needed to effectively gather penetrating radiation re~lected from the object and to provide it to the penetrating radiation imaging system 20 of the present invention.
Figure 3 is a schematic view of an embodiment of the apparatus of the present inventi~n as retrofit to the Zeiss OPMI microscope of Figure 2.
Referring now to Figure 3, the penetrating radiation imaging subsystem 20 of the present invention is interposed between the magnification changer 14 and the binocular tube 16. If needed, a source of the penetrating radiation 26 is provided. Penetrating radiation of a wavelength or of a range of wavelengths to which the obscuring layer 11 is tran~parent is reflected from the object 10 and collected by the main objective lens 12 exactly as i~ the vi~ible light.
Where the layer 11 to be penetrated is of blood, the penetrating radiation may be radiation o~ wavelength greater than 620 nm. The magni~ication changer 14 focuses the reflected penetrating radiati~n (forming the penetrating radiation image) in the same manner in which it focuses the visible light (forming the visible image~.
The penetrating radiation imaging system 20 of the present invention in the binocular embodiment shown has mirror image optical paths which are identical for both left-and right-eye optics. These optical paths begin with a pair of beamsplitters 22 which split the combined visible and penetrating radiation reflected images.
Each of the beamsplitters 22 provides a part of the combined visible and penetrati~g radiation image to a filter 24 and the remaining part to a beam combiner 3?.
Filters 24 then absorb the visible light of the part of the combined images provided to them and pass only the penetrating radiation image. Lenses 25 focus the penetrating radiation images on suitable sensors 28.
The sensors 28 may be so-called Newvicon video tubes, charge-coupled device (CCD) or metal oxide semiconductor (MOS~ image forming sensors, or other sensors sensitive to the wavelength of the penetrating radiation.
Multiple-element sensors, in which each elPment is sensitive to radiation of a different wavelength, could also be used. Image signals provided by sensors 28 drive display devices 30, which may be conventional cathode ray tube video displays or the equivalent.
'7F~
Display devices 30 produce the visible ~Iconverted~
images. These converted images are then focused by lenses 27 on beam com~iners 32, which combine the converted images, supplied by the displays 30 responsiYe to the signals provided by the ~ensors 28, with the visible images provided by beam ~plitters 22. The combined converted and visi~le images are then ~upplied to the surgeon Yia mirrors 15 and 17 at eyepiec~s 1~.
The Zeiss OPMI microscopes are stereoscopic, ~hat is, provide differing optical paths for ~he surgeon's right and left eyes. Provision of the dual optical paths i5 highly advantageous as it provides depth perceptisn. This advantage is retained according to the preferred embodiment of the present invention, as plural optical paths, each including penetrating radiation image formation and conversion elemPnts, are provided as discussed above.
As mentioned, the combination of the con~erted and visible images provided by the present invention has significant advantages. In particular, the surgeon is still provided with the visual clues with which he is most familiar, which are provided by the visible image, while simultaneously viewing the overlaid substantial additional detail provided by the converted imag~. In effect, the surgeon sees through the obscuring layer 11 of blood. In this way, the converted image is displayed to best advantage. By comparison, if the converted image were only provided on a video display or the like, separate from the visible image provided by the operating microscope, the surgeon would have substantial difficulty correlating the converted image with the visible image which he is accustomed to seeing.
According to the present invention, the correlation is 37~3 perfo~med automatically and in real time by pro~ision o~
the combined images.
Additional elements may be incorporat~d into ths microscope of the present invention, including real-time image processing device~ indic~ted generally by reference numeral 34. Conventional digital image processing can be used to enhance features of particular interest found in the penetrating radiation images for~ed by the sensors 28. Where appropriate, such image processing techniques are deemed to be within the scope o~ the present invention. Similarly, the provision of a video cassette recorder 36, for example to record the converted or combined images as a surgical operation proceeds, is within the scope of the present inv~ntion.
An optical camera (not shown3 may similarly be employed to record the combined or converted images.
Other modifications and variations on the present invention are similarly within its scope. For example, it would be posslble to have separate video images displayed and combined with respect to the penetrating radiation and visible images received from the magnification changer unit 14. In addition, the converted image can be formed by an array of phosphors (not shown). In the case of use of penetrating radiation of wavelength greater than 620 nm, phosphors could be employed which are excited by penetratinq radiation of this wavelength and which emit radiation in the visible spectrum. One could then co~bine an image of the phosphor array, for example, using a beam combiner 32 or the equivalsnt, with the Yisible image provided by ths optics o~ the Zeiss microscope. If phosphors or other sensors were used which were not ~P,~
sensitive to visible light, filters 24 could be dispensed with.
Other modifications and variations on the pr~ferr~d embodiment of the present invention are also within it~
scope. For example, one could ~orm a digital signal corresponding to the combined visible and penetrating radiation images received from the magnification changer 14. This signal can be digitally filtered to separate the p netrating radiation for subsequent image processing and enhancement as needed. The penetrating radiation might then be converted to visible wavelengths~ and combined with the digitized vi~ible portion of the signal to provide the combined Yisible and converted images. Similarly, the filters 24 might be ordinary optical ~ilter~ or be holographic; the beamsplitters 12 and beam combiners 32 may also be selected from a wide variety of suitable elements. A
filter (not shown) for the penetrating radiation could also be interposed prior to the eyepieces 18, to prevent the user ~rom eye damage caused by the penetrating radiation.
Furthermore, while the converted image i literally a "false-color" image, even if it is essentially a gray-scale image, it is also within the scope of the present invention to provide a true multi-color converted image, in which various colors of the displayed image correspond to differing wavelengths of the reflected penetrating radiation. Multiple-element displays, each element displaying a different portion of the visible spectrum, are also within the scope of the invention.
Similarly/ it will be appreciated that the present invention has applicability beyond the spPcific application shown and beyond the specific materials 7~
mentioned. The present invention could be used fsr inspection of goods during ~anufacture; for example, ~
manufacturing process in which the workpiece 10 i8 obscured by a material 11 which is opaque t~ visible light, preventing visual inspection of the underlying surfaces, but which is transpar~nt to radiation of other wavelengths, could be monitored by combination of a visible light image of the overall scene with ~
converted image made using radiation penetrating the obscuring material.
Therefore, while a preferred embodiment 9f the present invention has been shown and described, this should not be taken as a limitation on the invention but only as exemplary thereof. The invention is to be limited only by the following claims.
Optical operating microscope technology has generally been quiescent in racent years. This is in part due to the fact that inevitably during surgery a layer of blood obscures the object to be imaged. That is, the ultimate limitation on the surgeon's vision is the layer of blood overlying the tissues of interest.
Blood obscures the tissues to a degree depending on the amount of suction employed, how fast the blood seeps into the operating field, and so forth. Some amount of blood flow into the operating field is inevitable. In the case o~ particularly delicate surgery, ~uch as microsurgery on the eye, the nervous syst~m, and the like, blood in the operating field signi~icantly obscures the nervous and eye tissues, preventing tha ~ 7 ~ ~
surgeon frcm seeing the condition to be corrected by surgery.
Conventional operating microscopes cannot rPnder transparent the layer of blood which inevitably cover the tissues on which the surgery is to be performed ~9 that the surgeon can be provided an image o~ thP
underlying object.
U.S. Patent No. 3,74~,471 to Ro~s ~hows a "False Color Radiant Energy Detection Method and Apparatu~" in which visible and nonvisible radiation (that is, visible and, for example, infrared radiation) are simultaneously reflected from an object and are optically and electronically det~cted. ~he nonvisible re~lected radiation is converted into a false-colored visible image which is superimposed over the ordinary visible image, to produce a composite false-colored image highlighting portions of the object having a high degree of reflectivity in the nonvisible spectrum. Ross teaches that this apparatus may be of use in determining the relative health of pl~nt life. For example, heal~hy foliage reflects infrared radiation more completely than does unhealthy foliage. Ross does not teach any apparatus or method whereby an obscuring layer of material can be effectively removed from an image to reveal the underlying object.
U.S. Patent No. 4,596,930 to Steil et al. shows a charge-coupled imaginq device in which different groups of detectors which are sensitive to light energy at different wavelengths are arrqnged in a single array.
Howev~er, Steil et alO does not teach any means in which a layer of an obscuring material, such as blood~ can be effectively removed from a visi~le image, such as that of an operating field.
~ ~37~8 : -3-S~MMARY OF THE INVENTION
The present invention i~ o~ ?n operating micro~cope in which a real time composi~e image i provided of the visible operating field and of an underlying o~ect which is normally obscured by a layer of material opaque to visible radiation. More particularly, the microscope of the present invention comprises means for illuminating an object obscured by a layer OI a material which is opaque to vis;ble light with radiation consisting of visible light and l'penetrating radiation~
of a wavelength which penetrates the obscuring material. Where the obscuring material opaque to visib-l~ radiation is blood, penetrating radiation of a wavelength greater than about 620 nanometers i~
employed. Blood is significantly more transparent to radiation of a wavelength greater than 620 nm than to visible radiation. A detection and imaging system detects the penetrating radiation reflected from the object beneath the layer of blood, and convert~ the reflected penetrating radiation to provide a "converted" visible image. The converted image is thus a visible image of the object underlying the obscuring blood. The converted image provided by the detection and imaging system is then combined with a visible image of the operating field as ordinarily seen. The ~ombined images permit the surgeon to orient himself accurately, by reference ~o the visible image, while simultaneously viewing the ~onverted image o~ the object underneath the obscuring layer of blood.
-7~
In the preferred embodiment, the composite imagegeneration apparatus Df the present invention is confi8ured as a convenient after-market addition to a - highly popular pre-existing type of stereoscopic operating microscope. This allows such microscopes to be provided with the composite image generation capability according to the invention without a performance penalty in any other area. In a preferred embodiment, the pre-existing microscope to which composite image generation capability is added according to the present invention provides collimated optical ray paths at the point at which the composite image generation apparatus of the present invention is inserted; this fact allows the apparatus of the present invention to be inserted in the pre-existing microscope while altering the optical path of the microscope as little as possible.
Accordingly, the present invention provides a microscope for providing an image in the visible spectrum of an object obscured from direct view by a layer of material which is opaque to visible light, comprising: means for illuminating the object with radiation inciuding visible light and penetrating radiation~ wherein the layer of material obscuring the 7~
object is substantially transparent to said penetratin~
radiation; means for forming a visible image of the obscured ob~ect; means for detecting penetratin~
radiation reflected from the object obscured by the layer of material and for producing a penetrating radiation image; means for displaying a converted image of said object correspondinÆ to said penetrating radiation ima~e; and means for combining the visible image of the obscured object and the converted image to provide the image in the visible spectrum of the object.
Further, the present invention provides a method for providing an ima~e of an object obscured by a layer of a material whish is substantially opaque to visible light, comprising the steps of: illuminating the object with visible light and with penetrating radiation to which the layer of material is substantially transparent; forming a visible image of the obscured object using visible light reflected from the obscured object and the layer of material; detecting penetrating radiation having been reflected from said obJectj using said detected penetrating radiation to form a converted image of said object; and combining said visible and converted images to provide the image of the ob~ect.
7~.~
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be better understood if reference is made to the accompanying drawings, in which:
Figure 1 shows a graph of absorptance of hemoglobin versus wavelength of the illuminating radiation in nanometers;
Figure 2 shows a schematic diagram of the optical principles of a conventional binocular operating microscope; and ~igure 3 shows a schematic diagram of the optical principles of the operating microscope of Figure 2 having had the improved image formation apparatus according to the present invention added thereto.
D~SCRI~TION OF T~æ-lEg~FE~REDEH~oDI~oeHT~
As described above, in del~cate surgsry, particularly micro~urgery on the eyes, brain, spinal column, and the like, it i~ not pos~ible ~o remov~ all blood from the operating field. In addition ~o obscuration of the tissues by b~ood ~lowing ~rom damaged vessels, hlood in mall vessels or capillaries may render the tissues red or pink, masking normally vi3~ble cues in the target tissues. Thi~ ~s particularly true o~ tissues of the nervous system or well-vascularized tumors. In either case r the surgeon is ~requently reduced to operating by touch and ~eel. Clearly, this is not optimal, particularly in view of the fact that the surgeon's expertise will take considerable time to develop under these circumstances.
The present invention of an operating ~icroscope in which the obscuring layer of blood is rendered transparent in real time overcomes this problem.
More particularly, as is generally known, the human eye is sensitive to radiation of wavelengths in the range of about 380-650 nanometers (nm) wavelength. At ei~her end of this range, the eye's sensit~vity drops off relatively guickly. For example, I'red" is generally considered to extend ~rom 600-650 nm. However, the human eye i5 d~creasingly ~ensitive to images formed by radiation above about 620 nm. Therefore, if an ob~ect is illuminated with radiation of wavelengths greater than 620 nm, the typical eye is decreasingly capa~le of detecting its imaye, even though radiation ~rom 620-650 nm is sometimes termed part of the visible spectrum.
- ~. 2,P~7P,8 According to the present invention, an operating microscope is provided which presents a "combined" image to the surgeon's eyepiece. The combined image is a combination of a "visible" image (that iR, an image formed by reflected visible radiation ~n the 380-620 n~
range), and a "converted" image. The converted image iB
formed on a display device, and i~ a vi~ible image formed responsive to reflection of "penetrating radiation" in the non-visible range (that i~, less then about 380 nm or more than about 620 nm wavelength).
The combined image is of particular use because the converted image may be formed using reflected radiation of a wavelength to which a substance opaque to visible light is transparent. For example, hemoglobin, the main component of blood, is largely opaqus to visible light.
However, hemoglobin is relatively transparent to radiation of wavelength greater than about 620 nm. If an object obscured by a layer of blood is irradiated by penetrating radiation of wavelength greater than 620 nm, : 20 a "penetrating radiation image" of the object can be formed responsive to the reflected penetrating radiation; the penetrating radiation image can then be converted to a corre~ponding visible "converted" image of the obscured object.
When the visible and converted images are combined in real ~ime by the operating microscope of the present invention, the surgeon can use "clues" in ~he visible image of the operating ield to orient himself, and ¢an simultaneously use the superimposed converted image of the underlying object, for example, to see the actual condition to be remedied by the surgery. In this way, the surgeon will be provided with the correct understanding of the position of his surgical . .
~ ~p~
instruments with respect to the tissues upon which he is operating. By comparison, to have the converted image displayed, for example, on a separate video screen while viewing the visible image through the operating microscope would not provide the needed physical correlation between the converted and the visible images. Such an approach would not be as useful to the surgeon.
Radiation outside the ordinary visible spectrum may be used according to the invention to image objects underlying materials opaque in the visible spectrum, and ~o provide converted images which may be combined with the visible images to provide correlation therebetween.
It will be appreciated that the optics of the imaging system of the present invention may provide an effective limitation on the wavelengths of the "penetrating"
radiation, that is, on the radiation used to form the converted image. For example, th~ effective wavelength limits of the very popular Zeiss OPMI microscope are estimated to be about 360-2500 nm. Use of shorter wavelength ultraviolet radiation, perhaps down to 150-200 nm wavelength, might require use of quartz or magnesium fluoride optical elements. The sensors used to form the converted image will similarly have to be chosen in accordance with the wavelength of the penetrating radiation. Figure 1 shows, as mentioned, a plot of the relative absorptan~e of radiation by oxyhemoglobin tthat is, the pri~ary element of blood bearing oxygen) versus wavelength of the illuminating radiation in nanometers (nm). A~ can be seen, oxyhemoglobin shows several absorptance peaks in the blue (about 480 nm), greQn (about 545 nm) and yellow (about 578 nm) ranges, while its absorptance is relatively low in the red range (600-650 nm). This low absorbtance, of course, i5 why arterial blood appearz red. Deoxygenated hemoglobin has the ~ame red and infrared absorptance, but ~how~ only a single peak at about 550-560 nm, so that venous blood appears relatively blue. The relative absorptance o~ both t~pe~
of hemo~lobin drops rapidly to a value somewhat les~
than 0.05 at wavelengths gr~ater than about S20 nm.
However, as discussed above, at wavelength~ greater than about ~20 nm, the human eye responds very weakly if at all, such that it cannot effectively image thia longer wavelength radiation. Figure 1 thus show that hemoglobin, and hence blood, is effecti~ely more transparent to longer wavelength red light, which cannot be imaged by the eye, and to infrared radiation, than to visible radiation. Therefore, it i~ possible to irradiate an object obscured by a layer of blood with I'penetrating" radiation of wavelength greater than about 620 nm, and to form a "penetrating radiation" image of the reflected penetrating radiation. The penetrating radiation image can then be used to derive a corresponding "converted" image of the actual shape of the object underneath the layer of blood. The present invention exploits this fact.
Figure 2 shows a schematic diagram demonstrating the optical path of a typical operating microscope, in this case, the Zeiss "OPMI" binocular stereoscopic operating microscope. ~n object 10 in the operating field is covered by superficial blood vessels or capillaries or by an obscurlng layar 11 of material opaque to visibla radiation, such as blood. The operating field is imaged by a main objective 12 and a magnification changing unit 14. The imag is then 1 ~ ~J~ 7 ~ ~
passed through a binocular tube 16, and then via prisms 15 and 17 to parallel eye pieces 18. Such conventional microscopes are in common use in operating theater~.
It can be observed from Figure ~ that the light rays describing the optical path taken by the image of the obsurced object 10 are collimated between ~he magnification changer 14 and ths binocular tube 16.
While not necessarily critical to the present invention, this collimation makes it very convenient to provide the penetrating radiation imaging system of the present invention between the magni~ication changer 14 and binocular tube 16, and thereby to retrofit preexisting Zeiss OPMI microscopes with the penetrating radiation imaging systems of the present invention.
The fact that the Zeiss OPMI microscopes are manufactured in a modular fashion so as to be readily disassembled ~or modification permits the present invention to be conveniently provided in the form of a retrofit to such conventional microscopes. In addition, the inventors have found that the Zeiss OPMI micro~copes focus useful penetrating radiation as well as visible radiation, so that no modifications are needed to effectively gather penetrating radiation re~lected from the object and to provide it to the penetrating radiation imaging system 20 of the present invention.
Figure 3 is a schematic view of an embodiment of the apparatus of the present inventi~n as retrofit to the Zeiss OPMI microscope of Figure 2.
Referring now to Figure 3, the penetrating radiation imaging subsystem 20 of the present invention is interposed between the magnification changer 14 and the binocular tube 16. If needed, a source of the penetrating radiation 26 is provided. Penetrating radiation of a wavelength or of a range of wavelengths to which the obscuring layer 11 is tran~parent is reflected from the object 10 and collected by the main objective lens 12 exactly as i~ the vi~ible light.
Where the layer 11 to be penetrated is of blood, the penetrating radiation may be radiation o~ wavelength greater than 620 nm. The magni~ication changer 14 focuses the reflected penetrating radiati~n (forming the penetrating radiation image) in the same manner in which it focuses the visible light (forming the visible image~.
The penetrating radiation imaging system 20 of the present invention in the binocular embodiment shown has mirror image optical paths which are identical for both left-and right-eye optics. These optical paths begin with a pair of beamsplitters 22 which split the combined visible and penetrating radiation reflected images.
Each of the beamsplitters 22 provides a part of the combined visible and penetrati~g radiation image to a filter 24 and the remaining part to a beam combiner 3?.
Filters 24 then absorb the visible light of the part of the combined images provided to them and pass only the penetrating radiation image. Lenses 25 focus the penetrating radiation images on suitable sensors 28.
The sensors 28 may be so-called Newvicon video tubes, charge-coupled device (CCD) or metal oxide semiconductor (MOS~ image forming sensors, or other sensors sensitive to the wavelength of the penetrating radiation.
Multiple-element sensors, in which each elPment is sensitive to radiation of a different wavelength, could also be used. Image signals provided by sensors 28 drive display devices 30, which may be conventional cathode ray tube video displays or the equivalent.
'7F~
Display devices 30 produce the visible ~Iconverted~
images. These converted images are then focused by lenses 27 on beam com~iners 32, which combine the converted images, supplied by the displays 30 responsiYe to the signals provided by the ~ensors 28, with the visible images provided by beam ~plitters 22. The combined converted and visi~le images are then ~upplied to the surgeon Yia mirrors 15 and 17 at eyepiec~s 1~.
The Zeiss OPMI microscopes are stereoscopic, ~hat is, provide differing optical paths for ~he surgeon's right and left eyes. Provision of the dual optical paths i5 highly advantageous as it provides depth perceptisn. This advantage is retained according to the preferred embodiment of the present invention, as plural optical paths, each including penetrating radiation image formation and conversion elemPnts, are provided as discussed above.
As mentioned, the combination of the con~erted and visible images provided by the present invention has significant advantages. In particular, the surgeon is still provided with the visual clues with which he is most familiar, which are provided by the visible image, while simultaneously viewing the overlaid substantial additional detail provided by the converted imag~. In effect, the surgeon sees through the obscuring layer 11 of blood. In this way, the converted image is displayed to best advantage. By comparison, if the converted image were only provided on a video display or the like, separate from the visible image provided by the operating microscope, the surgeon would have substantial difficulty correlating the converted image with the visible image which he is accustomed to seeing.
According to the present invention, the correlation is 37~3 perfo~med automatically and in real time by pro~ision o~
the combined images.
Additional elements may be incorporat~d into ths microscope of the present invention, including real-time image processing device~ indic~ted generally by reference numeral 34. Conventional digital image processing can be used to enhance features of particular interest found in the penetrating radiation images for~ed by the sensors 28. Where appropriate, such image processing techniques are deemed to be within the scope o~ the present invention. Similarly, the provision of a video cassette recorder 36, for example to record the converted or combined images as a surgical operation proceeds, is within the scope of the present inv~ntion.
An optical camera (not shown3 may similarly be employed to record the combined or converted images.
Other modifications and variations on the present invention are similarly within its scope. For example, it would be posslble to have separate video images displayed and combined with respect to the penetrating radiation and visible images received from the magnification changer unit 14. In addition, the converted image can be formed by an array of phosphors (not shown). In the case of use of penetrating radiation of wavelength greater than 620 nm, phosphors could be employed which are excited by penetratinq radiation of this wavelength and which emit radiation in the visible spectrum. One could then co~bine an image of the phosphor array, for example, using a beam combiner 32 or the equivalsnt, with the Yisible image provided by ths optics o~ the Zeiss microscope. If phosphors or other sensors were used which were not ~P,~
sensitive to visible light, filters 24 could be dispensed with.
Other modifications and variations on the pr~ferr~d embodiment of the present invention are also within it~
scope. For example, one could ~orm a digital signal corresponding to the combined visible and penetrating radiation images received from the magnification changer 14. This signal can be digitally filtered to separate the p netrating radiation for subsequent image processing and enhancement as needed. The penetrating radiation might then be converted to visible wavelengths~ and combined with the digitized vi~ible portion of the signal to provide the combined Yisible and converted images. Similarly, the filters 24 might be ordinary optical ~ilter~ or be holographic; the beamsplitters 12 and beam combiners 32 may also be selected from a wide variety of suitable elements. A
filter (not shown) for the penetrating radiation could also be interposed prior to the eyepieces 18, to prevent the user ~rom eye damage caused by the penetrating radiation.
Furthermore, while the converted image i literally a "false-color" image, even if it is essentially a gray-scale image, it is also within the scope of the present invention to provide a true multi-color converted image, in which various colors of the displayed image correspond to differing wavelengths of the reflected penetrating radiation. Multiple-element displays, each element displaying a different portion of the visible spectrum, are also within the scope of the invention.
Similarly/ it will be appreciated that the present invention has applicability beyond the spPcific application shown and beyond the specific materials 7~
mentioned. The present invention could be used fsr inspection of goods during ~anufacture; for example, ~
manufacturing process in which the workpiece 10 i8 obscured by a material 11 which is opaque t~ visible light, preventing visual inspection of the underlying surfaces, but which is transpar~nt to radiation of other wavelengths, could be monitored by combination of a visible light image of the overall scene with ~
converted image made using radiation penetrating the obscuring material.
Therefore, while a preferred embodiment 9f the present invention has been shown and described, this should not be taken as a limitation on the invention but only as exemplary thereof. The invention is to be limited only by the following claims.
Claims (39)
1. A microscope for providing an image an the visible spectrum of an object obscured from direct view by a layer of material which is opaque to visible light, comprising:
means for illuminating the object with radiation including visible light and penetrating radiation, wherein the layer of material obscuring the object is substantially transparent to said penetrating radiation;
means for forming a visible image of the obscured object;
means for detecting penetrating radiation reflected from the object obscured by the layer of material and for producing a penetrating radiation image;
means for displaying a converted image of said object corresponding to said penetrating radiation image; and means for combining the visible image of the obscured object and the converted image to provide the image in the visible spectrum of the object.
means for illuminating the object with radiation including visible light and penetrating radiation, wherein the layer of material obscuring the object is substantially transparent to said penetrating radiation;
means for forming a visible image of the obscured object;
means for detecting penetrating radiation reflected from the object obscured by the layer of material and for producing a penetrating radiation image;
means for displaying a converted image of said object corresponding to said penetrating radiation image; and means for combining the visible image of the obscured object and the converted image to provide the image in the visible spectrum of the object.
2. The microscope of claim 1, wherein said layer of material is blood, and wherein said penetrating radiation is radiation of wavelength greater than about 620 nanometers.
3. The microscope of claim 1, further comprising image enhancement means, interposed between said mean for detecting and said means for displaying, for enhancing the converted image.
4. The microscope of claim 1, wherein said means for forming a visible image is a conventional microscope, and wherein said means for detecting, aid means for displaying and said means for combining are adapted to be retrofit to said conventional microscope.
5, The microscope of claim 4, wherein said conventional microscope is a binocular microscope, and wherein penetrating radiation imaging apparatus comprising two of each of said means for detecting, said means for displaying, and said means for combining is adapted to be retrofit to said binocular microscope.
6. The microscope of claim 4, wherein said conventional microscope is a surgeon's operating microscope, and wherein said layer of material is blood,
7. The microscope of claim 6, wherein said penetrating radiation is of wavelength at least about 620 nanometers.
8. The microscope of claim 1, wherein said means for displaying is a video display device.
9. The microscope of claim 8, wherein said means for combining is beam combiner means.
10. The microscope of claim 1, wherein said microscope comprises main optics which are substantially equally transmissive to visible light and to said penetrating radiation, and said microscope further comprising:
beamsplitter means for splitting a fraction of the visible light and the penetrating radiation reflected from said object, and filter means for passing only the split fraction of the reflected penetrating radiation to said means for detecting said penetrating radiation.
beamsplitter means for splitting a fraction of the visible light and the penetrating radiation reflected from said object, and filter means for passing only the split fraction of the reflected penetrating radiation to said means for detecting said penetrating radiation.
11. A method for providing an image of an object obscured by a layer of a material which is substantially opaque to visible light, comprising the steps of:
illuminating the object with visible light and with penetrating radiation to which the layer of material is substantially transparent;
forming a visible image of the obscured object using visible light reflected from the obscured object and the layer of material;
detecting penetrating radiation having been reflected from said object;
using said detected penetrating radiation to form a converted image of said object; and combining said visible and converted images to provide the image of the object.
illuminating the object with visible light and with penetrating radiation to which the layer of material is substantially transparent;
forming a visible image of the obscured object using visible light reflected from the obscured object and the layer of material;
detecting penetrating radiation having been reflected from said object;
using said detected penetrating radiation to form a converted image of said object; and combining said visible and converted images to provide the image of the object.
12. The method of claim 11, wherein said material is blood and said penetrating radiation is radiation of wavelength at least about 620 nanometers.
13. The method of claim 11, further comprising the step of enhancing the converted image of said object prior to combining said visible and converted images.
14. The method of claim 11, wherein said converted image is produced by video display means.
15. The method of claim 14, wherein said converted image produced by said video display means is combined optically with said image of the obscured object.
16. Apparatus for providing an image of an object obscured by a a layer of material, comprising:
means for illuminating the object with visible light and with penetrating radiation to which the material obscuring the object is substantially transparent;
optical means for gathering both visible light and penetrating radiation reflected from the object and the layer of material;
beamsplitter means for splitting the reflected visible light and penetrating radiation gathered by said optical means to produce a first split fraction and a second split fraction;
filter means for passing only the penetrating radiation portion of said first split fraction;
detector means for detecting a penetrating radiation image from the penetrating radiation portion of the first split fraction;
display means, responsive to said detector means, for providing a converted image corresponding to said penetrating radiation image; and means for combining in real time said converted image provided by said display means with a visible image of the obscured object formed from said second split fraction split by said beamsplitter means.
means for illuminating the object with visible light and with penetrating radiation to which the material obscuring the object is substantially transparent;
optical means for gathering both visible light and penetrating radiation reflected from the object and the layer of material;
beamsplitter means for splitting the reflected visible light and penetrating radiation gathered by said optical means to produce a first split fraction and a second split fraction;
filter means for passing only the penetrating radiation portion of said first split fraction;
detector means for detecting a penetrating radiation image from the penetrating radiation portion of the first split fraction;
display means, responsive to said detector means, for providing a converted image corresponding to said penetrating radiation image; and means for combining in real time said converted image provided by said display means with a visible image of the obscured object formed from said second split fraction split by said beamsplitter means.
17. The apparatus of claim 16, wherein the layer of material is blood, and said penetrating radiation is radiation of wavelength not less than about 620 nanometers.
18. The apparatus of claim 16, wherein said apparatus is comprised by a binocular microscope.
19. The apparatus of claim 18, wherein said beamsplitter means, said filter means, said detector means, said display means, and said means for combining are provided in duplicate in dual optical paths of said binocular microscope.
20. The apparatus of claim 19, wherein said duplicate elements are adapted to be conveniently and readily attached to a binocular microscope.
21. The apparatus of claim 20, wherein said binocular microscope is an operating microscope.
22. The apparatus of claim 16, further comprising image enhancement means for enhancing the converted image provided by said display means.
23. The apparatus of claim 16, wherein said display means is video display means.
24. A microscope for providing a real time image of an object obscured from direct view by a layer of blood, comprising:
means for illuminating the object with radiation including visible light and penetrating radiation of at least about 620 nanometers wavelength;
means for forming a visible image of the obscured object;
means for detecting the penetrating radiation reflected from the object beneath the layer of blood and for producing a penetrating radiation image;
means, responsive to said means for detecting, for generating a converted image of said object corresponding to said penetrating radiation image; and means for combining the visible and converted images for simultaneous, real time viewing of the object.
means for illuminating the object with radiation including visible light and penetrating radiation of at least about 620 nanometers wavelength;
means for forming a visible image of the obscured object;
means for detecting the penetrating radiation reflected from the object beneath the layer of blood and for producing a penetrating radiation image;
means, responsive to said means for detecting, for generating a converted image of said object corresponding to said penetrating radiation image; and means for combining the visible and converted images for simultaneous, real time viewing of the object.
25. The microscope of claim 24, further comprising image enhancement means for enhancing said converted image of the object.
26. The microscope of claim 24, wherein said means for forming a visible image of the object is a conventional microscope, and wherein said means for detecting, said means for generating a converted image, and said means for combining are adapted to be readily added to said conventional microscope.
27. The microscope of claim 26, wherein said conventional microscope is a binocular microscope, and two of each of said means for detecting, said means for generating a converted image, and said means for combining are added to said conventional microscope.
28. The microscope of claim 24, wherein said microscope is a surgeon's operating microscope.
29. The microscope of claim 24, wherein said means for generating a converted image is a video display device.
30. The microscope of claim 24, wherein said means for combining said visible and converted images is beam combiner means.
31. The microscope of claim 24, wherein said microscope comprises main optics which are substantially equally transmissive to visible light and to said penetrating radiation, said microscope further comprising beam-splitter means for splitting a fraction of the visible light and the penetrating radiation, and filter means for passing only said penetrating radiation of said fraction to said means for detecting the penetrating radiation.
32. A method for imaging an object obscured by a layer of blood, comprising the steps of:
illuminating the object with visible light and with penetrating radiation of wavelength greater than about 620 nanometers;
forming a visible image of the obscured object using visible light reflected from the obscured object;
detecting penetrating radiation having been reflected from said object;
using said detected penetrating radiation to form a converted image of said object; and combining said visible and converted images to produce an image of the object.
illuminating the object with visible light and with penetrating radiation of wavelength greater than about 620 nanometers;
forming a visible image of the obscured object using visible light reflected from the obscured object;
detecting penetrating radiation having been reflected from said object;
using said detected penetrating radiation to form a converted image of said object; and combining said visible and converted images to produce an image of the object.
33. The method of claim 32, further comprising the step of enhancing the converted image of said object prior to combining said visible and converted images.
34. The method of claim 33, wherein said converted image is formed by video display means.
35. The method of claim 34, wherein said converted image formed by said video display means is combined optically with said visible image.
36. Apparatus for providing a visible image of an object obscured by a layer of a material substantially opaque to visible light superimposed upon a converted image of the underlying object, comprising:
means for illuminating the object with visible light of wavelength in the range 380-620 nm and with penetrating radiation of wavelength less than 380 nm or more than 620 nm, wherein the material obscuring the object is substantially transparent to said penetrating radiation;
optical means for gathering both reflected visible light and penetrating radiation;
beamsplitter means for splitting the gathered visible light and penetrating radiation into first and second fractions;
filter means for passing substantially only the penetrating radiation portion of the first fraction;
detector means for forming an image responsive to the filtered reflected penetrating radiation;
display means responsive to said detector means for providing a visible converted image corresponding to the detected reflected penetrating radiation; and means for combining the visible converted image provided by the display means with a visible image formed using the second fraction of the gathered visible light and penetrating radiation.
means for illuminating the object with visible light of wavelength in the range 380-620 nm and with penetrating radiation of wavelength less than 380 nm or more than 620 nm, wherein the material obscuring the object is substantially transparent to said penetrating radiation;
optical means for gathering both reflected visible light and penetrating radiation;
beamsplitter means for splitting the gathered visible light and penetrating radiation into first and second fractions;
filter means for passing substantially only the penetrating radiation portion of the first fraction;
detector means for forming an image responsive to the filtered reflected penetrating radiation;
display means responsive to said detector means for providing a visible converted image corresponding to the detected reflected penetrating radiation; and means for combining the visible converted image provided by the display means with a visible image formed using the second fraction of the gathered visible light and penetrating radiation.
37. The apparatus of claim 36, wherein said material is blood, and said penetrating radiation is radiation of wavelength not less than substantially 620 nanometers.
38. The apparatus of claim 36, wherein said apparatus is a binocular microscope.
39. The apparatus of claim 38, wherein said beamsplitter means, said filter means, said detector means, said display means, and said means for combining are provided in duplicate in dual optical paths of said binocular microscope.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US06/942,254 US4786155A (en) | 1986-12-16 | 1986-12-16 | Operating microscope providing an image of an obscured object |
| US942,254 | 1986-12-16 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA1289788C true CA1289788C (en) | 1991-10-01 |
Family
ID=25477809
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA000554551A Expired CA1289788C (en) | 1986-12-16 | 1987-12-16 | Operating microscope providing an image of an obscured object |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US4786155A (en) |
| EP (1) | EP0338012A4 (en) |
| AU (1) | AU1084788A (en) |
| CA (1) | CA1289788C (en) |
| WO (1) | WO1988004788A1 (en) |
Families Citing this family (76)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5007723A (en) * | 1987-05-15 | 1991-04-16 | Storz Instrument Company | Documentation illumination module for a microscope system |
| GB8727769D0 (en) * | 1987-11-27 | 1987-12-31 | Sec Dep Department Of Educatio | Microscopes |
| GB2251089B (en) * | 1990-12-19 | 1994-05-11 | Marconi Electronic Devices | Arrangements for viewing electrical circiuts |
| JP3324780B2 (en) * | 1991-05-16 | 2002-09-17 | オリンパス光学工業株式会社 | UV microscope |
| DE4134481C2 (en) * | 1991-10-18 | 1998-04-09 | Zeiss Carl Fa | Surgical microscope for computer-aided, stereotactic microsurgery |
| US5539572A (en) * | 1992-10-06 | 1996-07-23 | Greenberg; Gary | Microscope illumination and stereo viewing |
| US6346074B1 (en) | 1993-02-22 | 2002-02-12 | Heartport, Inc. | Devices for less invasive intracardiac interventions |
| US6161543A (en) | 1993-02-22 | 2000-12-19 | Epicor, Inc. | Methods of epicardial ablation for creating a lesion around the pulmonary veins |
| US5797960A (en) * | 1993-02-22 | 1998-08-25 | Stevens; John H. | Method and apparatus for thoracoscopic intracardiac procedures |
| US5442443A (en) * | 1993-04-08 | 1995-08-15 | Polaroid Corporation | Stereoscopic photon tunneling microscope |
| US5860967A (en) * | 1993-07-21 | 1999-01-19 | Lucid, Inc. | Dermatological laser treatment system with electronic visualization of the area being treated |
| US5528426A (en) * | 1994-07-14 | 1996-06-18 | Tti Medical | Laser block beam splitter for microscopes |
| EP0717569A3 (en) * | 1994-12-16 | 2000-03-01 | Terumo Kabushiki Kaisha | Stereoscopic ocular fundus camera |
| DE69708334T2 (en) * | 1996-09-27 | 2002-05-23 | Leica Microsystems Inc | IN SITU OPTICAL INFORMATION SYSTEM |
| US6719755B2 (en) | 1996-10-22 | 2004-04-13 | Epicor Medical, Inc. | Methods and devices for ablation |
| US7052493B2 (en) | 1996-10-22 | 2006-05-30 | Epicor Medical, Inc. | Methods and devices for ablation |
| US6311692B1 (en) | 1996-10-22 | 2001-11-06 | Epicor, Inc. | Apparatus and method for diagnosis and therapy of electrophysiological disease |
| US6650357B1 (en) * | 1997-04-09 | 2003-11-18 | Richardson Technologies, Inc. | Color translating UV microscope |
| US8709007B2 (en) | 1997-10-15 | 2014-04-29 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Devices and methods for ablating cardiac tissue |
| US6031662A (en) * | 1998-02-06 | 2000-02-29 | Fisher - Price, Inc. | Convertible binocular/stereoscope device |
| US8308719B2 (en) | 1998-09-21 | 2012-11-13 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Apparatus and method for ablating tissue |
| WO2001005306A1 (en) * | 1999-07-19 | 2001-01-25 | Epicor, Inc. | Apparatus and method for ablating tissue |
| DE10107586A1 (en) * | 2001-02-10 | 2002-08-14 | Biotronik Mess & Therapieg | Endoscopic catheter |
| US6441958B1 (en) * | 2001-03-29 | 2002-08-27 | Chak Sing Richard Yeung | Digital imaging microscope |
| JP2002338688A (en) * | 2001-05-15 | 2002-11-27 | Sumitomo Chem Co Ltd | Method for producing purified polyethersulfone |
| GB0115731D0 (en) * | 2001-06-27 | 2001-08-22 | Isis Innovation | Temperature profile determination |
| DE10339784B4 (en) * | 2002-08-28 | 2021-09-16 | Carl Zeiss Meditec Ag | Microscopy system and microscopy method |
| US20050020914A1 (en) * | 2002-11-12 | 2005-01-27 | David Amundson | Coronary sinus access catheter with forward-imaging |
| DE10252837B4 (en) * | 2002-11-13 | 2005-03-24 | Carl Zeiss | Examination system and examination procedure |
| DE10304267B9 (en) * | 2003-02-03 | 2006-06-29 | Carl Zeiss | Eye surgery microscopy system |
| DE10339618A1 (en) * | 2003-08-28 | 2005-03-24 | Leica Microsystems (Schweiz) Ag | Light-emitting diode illumination for an optical observation device, in particular a stereo or a stereo operating microscope |
| DE10355527A1 (en) * | 2003-11-21 | 2005-06-09 | Carl Zeiss Jena Gmbh | microscope camera |
| US9205261B2 (en) | 2004-09-08 | 2015-12-08 | The Board Of Trustees Of The Leland Stanford Junior University | Neurostimulation methods and systems |
| US7580753B2 (en) * | 2004-09-08 | 2009-08-25 | Spinal Modulation, Inc. | Method and system for stimulating a dorsal root ganglion |
| US20120277839A1 (en) | 2004-09-08 | 2012-11-01 | Kramer Jeffery M | Selective stimulation to modulate the sympathetic nervous system |
| US8339447B2 (en) * | 2004-10-21 | 2012-12-25 | Truevision Systems, Inc. | Stereoscopic electronic microscope workstation |
| US8358330B2 (en) * | 2005-10-21 | 2013-01-22 | True Vision Systems, Inc. | Stereoscopic electronic microscope workstation |
| US20070188603A1 (en) * | 2005-10-21 | 2007-08-16 | Riederer Thomas P | Stereoscopic display cart and system |
| JP2007206107A (en) * | 2006-01-31 | 2007-08-16 | Olympus Corp | Microscope imaging apparatus, microscope imaging method, and information storage medium |
| US9314618B2 (en) | 2006-12-06 | 2016-04-19 | Spinal Modulation, Inc. | Implantable flexible circuit leads and methods of use |
| WO2008070808A2 (en) | 2006-12-06 | 2008-06-12 | Spinal Modulation, Inc. | Expandable stimulation leads and methods of use |
| US8983624B2 (en) | 2006-12-06 | 2015-03-17 | Spinal Modulation, Inc. | Delivery devices, systems and methods for stimulating nerve tissue on multiple spinal levels |
| AU2007329252A1 (en) | 2006-12-06 | 2008-06-12 | Spinal Modulation, Inc. | Hard tissue anchors and delivery devices |
| CN101678203A (en) | 2007-01-29 | 2010-03-24 | 脊髓调制公司 | Sutureless lead retention features |
| US9314298B2 (en) | 2007-04-17 | 2016-04-19 | St. Jude Medical, Atrial Fibrillation Divisions, Inc. | Vacuum-stabilized ablation system |
| JP2009083448A (en) * | 2007-10-03 | 2009-04-23 | Seiko Instruments Inc | Printer and issuing apparatus |
| US9168173B2 (en) * | 2008-04-04 | 2015-10-27 | Truevision Systems, Inc. | Apparatus and methods for performing enhanced visually directed procedures under low ambient light conditions |
| US10117721B2 (en) | 2008-10-10 | 2018-11-06 | Truevision Systems, Inc. | Real-time surgical reference guides and methods for surgical applications |
| US9226798B2 (en) * | 2008-10-10 | 2016-01-05 | Truevision Systems, Inc. | Real-time surgical reference indicium apparatus and methods for surgical applications |
| WO2010062622A2 (en) | 2008-10-27 | 2010-06-03 | Spinal Modulation, Inc. | Selective stimulation systems and signal parameters for medical conditions |
| US9173717B2 (en) | 2009-02-20 | 2015-11-03 | Truevision Systems, Inc. | Real-time surgical reference indicium apparatus and methods for intraocular lens implantation |
| CA2758459A1 (en) | 2009-03-24 | 2010-10-30 | Spinal Modulation, Inc. | Pain management with stimulation subthreshold to paresthesia |
| JP5711221B2 (en) | 2009-05-15 | 2015-04-30 | スパイナル・モデュレーション・インコーポレイテッドＳｐｉｎａｌ Ｍｏｄｕｌａｔｉｏｎ Ｉｎｃ． | Methods, systems, and devices for neuromodulating spinal cord tissue |
| US8784443B2 (en) * | 2009-10-20 | 2014-07-22 | Truevision Systems, Inc. | Real-time surgical reference indicium apparatus and methods for astigmatism correction |
| US20110213342A1 (en) * | 2010-02-26 | 2011-09-01 | Ashok Burton Tripathi | Real-time Virtual Indicium Apparatus and Methods for Guiding an Implant into an Eye |
| EP2568904B1 (en) | 2010-05-10 | 2019-10-02 | Spinal Modulation Inc. | Device for reducing migration |
| AU2012212150B2 (en) | 2011-02-02 | 2016-09-29 | Spinal Modulation, Inc | Devices, systems and methods for the targeted treatment of movement disorders |
| US8937769B2 (en) * | 2012-06-07 | 2015-01-20 | Alcon Research, Ltd. | Orthogonal light beam splitting for microscopes |
| US9642606B2 (en) | 2012-06-27 | 2017-05-09 | Camplex, Inc. | Surgical visualization system |
| US9629523B2 (en) | 2012-06-27 | 2017-04-25 | Camplex, Inc. | Binocular viewing assembly for a surgical visualization system |
| CA2883498C (en) | 2012-08-30 | 2022-05-31 | Truevision Systems, Inc. | Imaging system and methods displaying a fused multidimensional reconstructed image |
| EP2999414B1 (en) | 2013-05-21 | 2018-08-08 | Camplex, Inc. | Surgical visualization systems |
| US10881286B2 (en) | 2013-09-20 | 2021-01-05 | Camplex, Inc. | Medical apparatus for use with a surgical tubular retractor |
| JP6521982B2 (en) | 2013-09-20 | 2019-05-29 | キャンプレックス インコーポレイテッド | Surgical visualization system and display |
| DE102013021280A1 (en) * | 2013-12-19 | 2015-06-25 | Benedikt Schmalz | Object magnification device |
| DE102014205038B4 (en) | 2014-02-19 | 2015-09-03 | Carl Zeiss Meditec Ag | Visualization devices with calibration of a display and calibration methods for display in a visualization device |
| DE102014216511A1 (en) | 2014-08-20 | 2016-02-25 | Carl Zeiss Meditec Ag | Create chapter structures for video data with images from a surgical microscope object area |
| WO2016090336A1 (en) | 2014-12-05 | 2016-06-09 | Camplex, Inc. | Surgical visualization systems and displays |
| DE102015100765A1 (en) * | 2015-01-20 | 2016-07-21 | Carl Zeiss Meditec Ag | Surgical microscope and method for highlighting Augenlinsenstücken |
| DE102015203844A1 (en) | 2015-03-04 | 2016-09-08 | Carl Zeiss Meditec Ag | Optic system and surgical microscope |
| US11154378B2 (en) | 2015-03-25 | 2021-10-26 | Camplex, Inc. | Surgical visualization systems and displays |
| WO2017091704A1 (en) | 2015-11-25 | 2017-06-01 | Camplex, Inc. | Surgical visualization systems and displays |
| US10917543B2 (en) | 2017-04-24 | 2021-02-09 | Alcon Inc. | Stereoscopic visualization camera and integrated robotics platform |
| US10299880B2 (en) | 2017-04-24 | 2019-05-28 | Truevision Systems, Inc. | Stereoscopic visualization camera and platform |
| US11083537B2 (en) | 2017-04-24 | 2021-08-10 | Alcon Inc. | Stereoscopic camera with fluorescence visualization |
| WO2018208691A1 (en) | 2017-05-08 | 2018-11-15 | Camplex, Inc. | Variable light source |
Family Cites Families (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3124682A (en) * | 1964-03-10 | Microscope system for use with both | ||
| US3533683A (en) * | 1967-06-13 | 1970-10-13 | Whittaker Corp | Dynamic pupillometers using television camera system |
| US3699341A (en) * | 1968-09-23 | 1972-10-17 | Gen Electric | Muzzle flash detector |
| US3624400A (en) * | 1970-01-28 | 1971-11-30 | Barry George Cohen | Apparatus for the production of high-resolution visible images of objects illuminated by or emitting infrared radiation |
| US3743825A (en) * | 1971-07-13 | 1973-07-03 | B Cohen | Illumination assembly |
| US3748471A (en) * | 1971-09-24 | 1973-07-24 | Int Imaging Syst | False color radiant energy detection method and apparatus |
| GB1407021A (en) * | 1972-01-14 | 1975-09-24 | Vickers Ltd | Optical devices |
| US3805073A (en) * | 1973-08-22 | 1974-04-16 | Western Electric Co | Method and apparatus for obtaining a stereoscopic thermal image of internal and surface portions of an article |
| DE2437984B2 (en) * | 1974-08-07 | 1976-06-10 | Wilhelm Will Kg, Optisches Werk, 6331 Nauborn | METHOD FOR IMPROVING THE CONTRAST OF AN OPTICAL MICROSCOPE |
| SE416232B (en) * | 1976-11-05 | 1980-12-08 | Bofors Ab | DEVICE FOR A VIOLATION DETERMINATION FROM THE VIEW LINE |
| NL7804990A (en) * | 1978-05-09 | 1979-11-13 | Optische Ind De Oude Delft Nv | DEVICE FOR SENSING RESIDUAL LIGHT IN THE VISIBLE AND NEAR INFRARED SPECTRUM. |
| US4249797A (en) * | 1979-05-24 | 1981-02-10 | Steve Sendecki | Dual image viewer with mirror adjusting means |
| US4303340A (en) * | 1979-06-26 | 1981-12-01 | Robert Hoffman | Optical micrometer measuring system |
| IL61390A (en) * | 1980-11-02 | 1984-12-31 | Yitzhak Hadani | Night-vision equipment |
| DE3105018A1 (en) * | 1981-02-12 | 1982-09-02 | Fa. Carl Zeiss, 7920 Heidenheim | OPERATING MICROSCOPE |
| US4524385A (en) * | 1981-06-30 | 1985-06-18 | Ltv Aerospace And Defense Company | Predetection processing of optical information |
| US4484498A (en) * | 1982-10-19 | 1984-11-27 | Toshiba Tungaloy Co., Ltd. | Quick-change tool |
| US4596930A (en) * | 1983-04-21 | 1986-06-24 | Licentia Patent-Verwaltungs-Gmbh | Arrangement for multispectal imaging of objects, preferably targets |
| GB2143397B (en) * | 1983-06-30 | 1986-09-24 | Davin Optical Limited | Low light viewing apparatus |
| GB2150387A (en) * | 1983-10-14 | 1985-06-26 | Secr Defence | Thermal imager |
| JPS60194692A (en) * | 1984-03-14 | 1985-10-03 | Fujitsu Ltd | Infrared video display device |
| US4679068A (en) * | 1985-07-25 | 1987-07-07 | General Electric Company | Composite visible/thermal-infrared imaging system |
-
1986
- 1986-12-16 US US06/942,254 patent/US4786155A/en not_active Expired - Lifetime
-
1987
- 1987-12-15 AU AU10847/88A patent/AU1084788A/en not_active Abandoned
- 1987-12-15 EP EP19880900533 patent/EP0338012A4/en not_active Withdrawn
- 1987-12-15 WO PCT/US1987/003373 patent/WO1988004788A1/en not_active Application Discontinuation
- 1987-12-16 CA CA000554551A patent/CA1289788C/en not_active Expired
Also Published As
| Publication number | Publication date |
|---|---|
| EP0338012A4 (en) | 1990-02-22 |
| US4786155A (en) | 1988-11-22 |
| AU1084788A (en) | 1988-07-15 |
| WO1988004788A1 (en) | 1988-06-30 |
| EP0338012A1 (en) | 1989-10-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA1289788C (en) | Operating microscope providing an image of an obscured object | |
| US4786154A (en) | Enhanced-image operating microscope | |
| US10895742B2 (en) | Microsurgery system for displaying in real time magnified digital image sequences of an operated area | |
| EP1561416B1 (en) | Wavefront sensor with off-axis illumination | |
| US5519208A (en) | Infrared aided method and apparatus for venous examination | |
| EP3254606B1 (en) | Endoscope and imaging arrangement providing depth of field | |
| US8295693B2 (en) | Dual optical path prism and camera in a minimally invasive surgical system | |
| US5200819A (en) | Multi-dimensional imaging system for endoscope | |
| US5795295A (en) | OCT-assisted surgical microscope with multi-coordinate manipulator | |
| US6304372B1 (en) | Microscope including a fade-in element and related method of using a microscope | |
| CN110811498A (en) | Visible light and near-infrared fluorescence 3D fusion image endoscope system | |
| CN211934007U (en) | Surgical microscope having at least one beam path switching device | |
| WO1987004263A1 (en) | Stereoscopic optical system | |
| EP3241481B1 (en) | Dual path endoscope | |
| US20040061932A1 (en) | Ophthalmic surgical microscope with a subject illumination system | |
| JP2016159070A (en) | Laser therapy equipment | |
| CN211131438U (en) | Operation microscope system | |
| DE19731301C2 (en) | Device for controlling a microscope by means of gaze direction analysis | |
| US5914770A (en) | Ophthalmological examination instrument and method for operation thereof | |
| CA2224169C (en) | Imaging system with independent processing of visible and infrared light energy | |
| JP2002144914A (en) | Device for display of information in vehicle | |
| JP4426662B2 (en) | Stereo microscope | |
| JPH05344997A (en) | Medical stereoscopic microscope | |
| JP2001242417A (en) | Pupil position detector and image display device using the same | |
| US20070083123A1 (en) | Apparatus for displaying a tissue containing a fluorescent dye |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MKLA | Lapsed |