|Número de publicación||US8858425 B2|
|Tipo de publicación||Concesión|
|Número de solicitud||US 12/759,169|
|Fecha de publicación||14 Oct 2014|
|Fecha de presentación||13 Abr 2010|
|Fecha de prioridad||24 Sep 2004|
|También publicado como||US20100198009|
|Número de publicación||12759169, 759169, US 8858425 B2, US 8858425B2, US-B2-8858425, US8858425 B2, US8858425B2|
|Inventores||Mina Farr, Franklin J. Wall, Jr., Chris Togami, Gary D. Sasser|
|Cesionario original||Vivid Medical, Inc.|
|Exportar cita||BiBTeX, EndNote, RefMan|
|Citas de patentes (126), Otras citas (15), Citada por (17), Clasificaciones (23), Eventos legales (1)|
|Enlaces externos: USPTO, Cesión de USPTO, Espacenet|
This patent application is a continuation-in-part of U.S. patent application Ser. No. 12/413,457, field Mar. 27, 2009, and entitled PLUGGABLE VISION MODULE AND PORTABLE DISPLAY FOR ENDOSCOPY, which claims the benefit of U.S. Provisional Patent Application Ser. No. 61/082,432, filed Jul. 21, 2008 and entitled INDIVIDUAL STEREO VIEWER. U.S. patent application Ser. No. 12/413,457 is also a continuation-in-part of U.S. patent application Ser. No. 12/111,107, filed Apr. 28, 2008 and entitled OPTO-ELECTRONIC ILLUMINATION AND VISION MODULE FOR ENDOSOPY, which is a continuation-in-part of U.S. patent application Ser. No. 11/233,684, filed Sep. 23, 2005 and entitled SOLID STATE ILLUMINATION FOR ENDOSCOPY, which claims the benefit of U.S. Provisional Patent Application Ser. No. 60/612,889, filed Sep. 24, 2004 and entitled SOLID STATE ILLUMINATION FOR ENDOSCOPY.
The above-identified patent applications are hereby incorporated herein by reference in their entirety.
1. The Field of the Invention
The present invention relates generally to an apparatus for visualization of endoscopic and borescopic fields, in minimally invasive surgical (MIS) procedures, general or diagnostic medical or industrial procedures using endoscopes or borescopes, respectively. More particularly, embodiments of the invention relate to use of pluggable and removable vision systems in endoscopic and borescopic procedures, that are completely disposable, as a means of image capture.
2. The Relevant Technology
Endoscopy is used in both diagnostic and surgical procedures. Currently, MIS procedures, as opposed to open surgical procedures, are routinely done in almost all hospitals. Minimally invasive techniques minimize trauma to the patient by eliminating the need to make large incisions. This both reduces the risk of infection and reduces the patient's hospital stay. Endoscopic procedures in MIS use different types of endoscopes as imaging means, giving the surgeon an inside-the-body view of the surgical site. Specialized endoscopes are named depending on where they are intended to look. Examples include: cystoscope (bladder), nephroscope (kidney), bronchoscope (bronchi), laryngoscope (larynx+the voice box), otoscope (ear), arthroscope (joint), laparoscope (abdomen), gastrointestinal endoscopes, and specialized stereo endoscopes used as laparoscopes or for endoscopic cardiac surgery.
The endoscope may be inserted through a tiny surgical incision to view joints or organs in the chest or abdominal cavity. More often, the endoscope is inserted into a natural body orifice such as the nose, mouth, anus, bladder or vagina. There are three basic types of endoscopes: rigid, semi-rigid, and flexible. The rigid endoscope comes in a variety of diameters and lengths depending on the requirements of the procedure. Typical endoscopic procedures require a large amount of equipment. The main equipment used in conjunction to the visual part of the endoscopic surgery are the endoscope body, fiber optics illumination bundles, illumination light source, light source controller, imaging camera, camera control module, and video display unit.
The laparoscope is a rigid endoscope as illustrated in
As illustrated in
The rigid endoscope also comes in different viewing angles: 120 degree or retrograde, for viewing backward; 90 degree and 70 degree for lateral viewing; 30 degree (104 as illustrated in
Other surgical instruments and tools are also inserted into the body, for the operation and specific surgical manipulation by the surgeon. The insertion is done through open tubes provided inside the endoscope body for instrument insertion, such as in gastrointestinal endoscopes, or through separate incisions in the abdominal or chest wall 202, as illustrated in
In a typical gastrointestinal endoscope, a tool opening is provided at the distal end of the scope, where inserted medical instruments gain access to the body following the scope body.
Endoscopes can be diagnostic, for observation only, or operative, having channels or ports for irrigation, suction, and the insertion of accessory instruments when a surgical procedure is planned. Thus, endoscope bodies also could provide mechanical or electrical control sections, buttons for valves such as a suction valve, a CO2 valve, a water bottle connector, a water feed, a suction port, etc. The common component that all endoscopes must be equipped with is a light guide section for illumination.
An illustration showing typical endoscope optics is shown in
With recent technology improvements in the field of electronic imaging reducing the size of the image capture device (e.g., CCD), some endoscopes used in MIS and diagnostic procedures are equipped with a high resolution distal end camera system, commonly referred to as Chip on a Stick, one example of which is illustrated in
Other, more complicated MIS systems make use of robotic and articulating surgical tools and instruments, and/or provide stereoscopic images of the surgical site for the surgeon, improving the surgeon's dexterity, precision and speed of operation. In these more sophisticated MIS imaging applications more specific types of illumination systems or multiple illuminators are used.
Color CCD cameras use alternate color dies on the individual CCD pixels, to capture color images. Green and red, and green and blue pixels are alternated in rows. This spatial color sampling limits the color resolution of the color CCD cameras, since each pixel is dedicated to capturing a single color in the color image.
3 chip CCD cameras (red CCD chip, blue CCD chip, and green CCD chip) are also used in high resolution applications, where all the pixels in each CCD are dedicated to detecting the single color content of the image. The individual color captured images from the 3 CCDs are then put together electronically, as the multi-color image is reproduced on the viewing display. Three chip CCD cameras are expensive and bulky.
Recent advances in illumination and image capture technology demonstrate the rapid changes that can occur in the capabilities of emerging illumination and imaging systems. For instance, very compact high mega pixel cameras are currently being incorporated widely in cellular phone cameras, whereas just a few years ago this was not possible. It is quite likely that other technological advances in imaging and illumination will occur that can be used in endoscopic medical devices. And, although it may be desirable to incorporate the latest technological advances in illumination and imaging into an endoscopic medical device, this is often impossible without designing and purchasing a brand new replacement of the complete medical device having the improved technology. This complete new solution, however, can be prohibitively expensive especially in the circumstances that the medical providers are under high pressure to reduce cost. Incorporation of the advanced high quality opto-electronics in current and future low cost medical procedures can also be nearly impossible.
Medical diagnostic and treatment procedures are also becoming more available in mobile settings. However, conventional high quality imaging devices are generally not available in convenient packages that are portable and usable without an elaborate setup.
Due to delicate and complicated nature of current endoscope illumination and vision technology, current high performance endoscopes are often limited in sterilization capability, and for the major part not autoclavable. This shortcoming not only limits the life time of these endoscopes to limited number of procedures, but also creates possibility of infection with multiple sterilization and disinfection procedures performed on the current scopes.
These and other limitations are overcome by embodiments of the invention which relate to removable, pluggable, and completely disposable illumination and vision systems that can be coupled to the distal end or housed within the body of a single use removable body, and subsequently attached to various medical devices, including various endoscopic devices used as single use disposable unit, or autoclavable medical access devices used in minimally invasive surgical and other diagnostic procedures. Disposable illumination and vision systems according to some embodiments of the invention include one or more solid state light sources, illumination optics (such as wave guides) and optionally include separate imaging optics and image capture devices, collectively referred to as Opto-Electronic (OE) illumination and vision modules. Removable and pluggable OE illumination and vision modules may additionally include accompanying electronics for process and transfer of the image. Moreover the complete OE vision module and electronics could be housed in a disposable body, where the complete device including the connecting cable can be disposed of after use. Embodiments of the invention also relate to the layouts and functionality of such removable and pluggable vision systems within the body of a disposable endoscope or other disposable medical devices, or within a disposable container in which the removable and pluggable OE illumination and vision modules are housed, and plugged onto a separate non-disposable medical access device or carrier. Embodiments of the invention additionally relate to general layouts of such removable and pluggable vision systems incorporating mechanisms enabling stereoscopic, hyper or varying Field of View (FOV) visual systems.
Embodiments of the invention alternately or additionally include mobile and wearable displays that take advantage of the above embodiments. Some embodiments of mobile and wearable displays can enable minimally invasive surgical and other diagnostic procedures to be performed with minimal setup needs and/or in remote locations, with full connectivity.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
To further clarify the above and features of the present invention, a more particular description of the invention will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
Example embodiments of the invention are directed to disposable solid state opto-electronic vision modules, that can include monochromatic, polychromatic visible, Ultra Violet (UV), and/or Infra Red (IR) solid state light sources such as high power Light Emitting Devices (LEDs) and Laser Diodes as a means of illumination and one or more opto-electronic imaging systems for image capture in diagnostic or surgical endoscopic procedures, or functional borescopic systems.
In various endoscope geometries, it is also possible to install and remove the entire opto-electronic imaging system along with the removable LED illuminator, associated processing electronics, and cable connection for power and control of the device, within the disposable housing, allowing implementation of a removable and pluggable opto-electronic or electro-optic (OE or EO) illumination and/or vision module, as an entirely disposable unit, as described more fully below. The removability and pluggability of such OE vision modules described herein can provide instantly upgradeable illumination and image capture systems without any necessity to replace an entire medical or other functional device still having a remaining useful life.
Advantageously, with the OE vision module removed from the medical device that introduces the pluggable OE vision module into the body, the medical device (access device) can be made autoclavable, which is a highly desirable safety feature not currently available to many endoscopes.
In particular, these removable and pluggable OE illumination and vision modules can be incorporated with a protective disposable cover, at the distal end of a single use disposable or reusable endoscope, borescope, surgical or industrial tools, or be incorporated inside the distal tip end of single use cannulas, or the body of other disposable medical procedure functional devices. They can also be incorporated in a body that is inserted separately, or in conjunction with a lighted or dark scope, into the body. The OE illumination and vision module schemes of the present invention can replace, or can be used in addition to, conventional fiber optic illumination system and other diagnostic devices such as ultrasound imaging used in endoscopy and borescopy.
The portable control and display unit 610 generally includes a display screen, a housing, illumination and imaging control electronics, image processing electronics, and/or a power supply, such as a battery. Such compact vision and illumination modules without means of power or control electronics of their own, can be made in a compact and low cost form to make it easily introduced into the body within a disposable housing, by itself or introduced into the body using other standard medical access devices, where they can be removed and disposed of after a single use. Standard low cost and proven digital electronics can be used on the flexible or rigid electronic board 607, to convert the parallel digital video signals from a high resolution digital sensor 606, for example to high speed USB (Universal Serial Bus) video class camera signals (UVC, or USB Video Class format), similar to USB Web cameras, or to send MIPI (Mobile Industry Processor Interface) enabled serialized digital sensor output directly to the Portable Display and Controller 610 with MIPI interface.
In some embodiments, flex circuitry 605 a,b communicatively couples the portable control and display unit 610 to the OE vision module(s) 601 to communicate power and control signals, as well as high speed digital video imaging signals between the portable control and display unit 610 and the OE vision module(s) 601. As such, the flex circuitry 605 a,b serves as one example of a means for communicatively coupling the portable control and display unit 610 to the OE vision module(s) 601. Additionally, flex circuitry 605 a,b further communicatively couples the portable control and display unit 610 to OE illumination modules 602 to communicate power and control signals between the portable control and display unit 610 and the OE illumination modules 602. As such, the flex circuitry 605 a,b further serves as an example of a means for communicatively coupling the portable control and display unit 610 to the OE illumination module 602.
For any of the high digital speed communication methods used in cable 605 a,b between the display and control device 610 and OE vision and illumination module 600, appropriate connection can be made at the display and control unit, where the entire cable 605 a,b can be also disposed of, along with the OE vision and illumination module 600 that is housed in a disposable device housing. Using standard USB communication protocols and connections to the display and control unit, allows the display and control unit be or function as a computing and processing unit such as a UMPC (Ultra Mobile Personal Computer), MID (Mobile Internet Device), a Tablet Computer, or mini PC or a PDA (Personal Digital Assistant) accommodating such USB communication port. Use of such established video communication protocols such as UVC, for example in case of a high speed USB connection, makes the display and control unit to be a device readily available with multiple other connectivity solutions already available in a mobile form. As illustrated in
Other portable or non portable computing and display units, such as 620, and storage devices, such as 630, can be connected wirelessly, or with a wired connection, to the portable display and control unit 610.
Alternatively where a vision system with focusing capability is necessary, compact auto focus mechanism could be also integrated in camera module 601, where certain or all lens elements 608 are to be moved axially with respect to camera sensor 606, with drive and control signals from the control unit 610. Control unit 610 can be programmed to detect best focus of the remote camera module 601 with the imaging data it's provided from the camera and run it as if it's a local camera lens module within the control unit 601.
Removable and pluggable OE illumination and vision modules with protective disposable covers, or implemented in a single use disposable medical device, can enable numerous advantages. For instance, a disposable medical device housing the OE module in a fully sealed sterile cavity can be disposed of after removal of the pluggable OE module from the medical device it's used with, whereupon a new protected and sterile OE module can be plugged onto the medical device housing for subsequent use, thereby eliminating the likelihood of contaminating body cavities in which the disposable medical devices are used.
Some types of removable and pluggable OE vision modules can be plugged onto various designs of single use or reusable medical devices allowing for low cost variations in the medical device design and its functionality. The OE vision and illumination modules covered with a single use protective cover that is fully sealed can be made in various lengths and plugged onto the distal tip of various medical devices, where the protective cover running the length of the inserted medical device can be disposed of after use, and a new protective cover seal on a new OE vision module can be plugged onto the medical device for subsequent use.
Different OE vision and illumination modules, with various functionalities can also be plugged into the same type medical device depending on the procedure to be performed, providing means to choose from a variety of application specific medical vision capability. For instance, white light illumination or multi-spectral visible OE modules can be used for traditional imaging in the visible range.
A pluggable and disposable OE vision and illumination module, with additional deep blue or UV illumination could be used to induce bio-fluorescence inside the body and detect spectral emission from the object, at the same time as the visible imaging, to gain further information regarding the object, such as the tissue type and identifying lesions. An IR illumination can be used in the OE vision and illumination module, to image inside tissue or through scattering substances or fluids, to give additional in depth view. Different UV, visible and IR wavelength illumination with varying penetration depths can be used for depth dependent imaging inside the tissue. Various spectral component captured in 2D images, can be subsequently processed and put together to reconstruct a 3D view of inside the body.
Use of such removable and pluggable OE illumination and vision systems inside a cavity in the body replaces a variety of conventional instruments otherwise needed for the same purpose, such as an external light source, fiber light guides, means of transmitting the light to the desired object, imaging optics, and/or electronic cameras. Further, the removable and pluggable OE systems according to some embodiments of the invention can be used to perform tissue analysis inside the body, thereby eliminating the need for taking tissue for biopsy, and then performing a biopsy on dead tissue. This enables in vivo, in situ tissue analysis without the delay typically required to obtain a biopsy report, and further allows for real-time surgical procedures to be performed instead of possible follow-on surgical procedures after review of biopsy reports.
LED sources can provide illumination in a wide range of the electromagnetic spectrum, from UV, to visible and IR, where the individual LEDs in a specific spectral range can be independently controlled in time and the corresponding images independently processed based on individual captured frames. Each LED spectral component can be independently designed in the LED, or obtained with independent processing of each LED spectrum, via secondary photo-luminescence process on blue or UV LEDs, or using edge or band pass spectral color filters such as multilayer dielectric optical filter coatings. For imaging in the visible region, Red, Green, and Blue LEDs in primary colors can be used with or without other non-primary colors such as amber or cyan where the multiple spectral LEDs together form a white illumination.
By using multiple color LEDs and synchronizing a black and white image capture device to grab the synchronized color component images, the use of color camera chips or high resolution 3 CCD or 3 CMOS imaging devices are eliminated. In this case, a single CCD or CMOS image capture device is used to capture the three or more images in a time synchronized fashion, where each color component image takes advantage of the full image capture device resolution by incorporating all the pixels in each color image component. Simple black and white image capture devices are also cheaper to use, especially compared to 3 chip image capture devices, where in effect the resolution of a synchronized black and white imaging CCD or CMOS using synchronized color illumination provided by the LEDs is equivalent to a same pixel 3 chip image capture device.
Using color synchronized image capture devices also allows the use of much higher resolution image capture devices in chip on the stick cameras where space is limited at the distal tip of the endoscope for the image capture device. A variety of illumination configurations are possible using LED chips, where the uniformity, angle and extent of the illumination are freely controlled by the positioning and design of the LED light sources. Various illumination configurations are disclosed more fully in U.S. patent application Ser. No. 11/233,684.
In current endoscopic imaging systems where a white light illuminator is used, the illumination spectrum is determined by the light source and the optical path the light is transmitted through before reaching the object inside the body. Subsequently, a 3-color image capture device (e.g., a single-chip RGB camera or 3-chip RGB camera) captures the reflected light from the object according to its RGB filter set and image capture device spectral sensitivity. An image display unit in turn displays the captured RGB image according to its own color filters.
Infra Red (IR), Ultraviolet (UV) LEDs, or narrow spectral band VCSELs can be used based on their transmission characteristics in the medium of insertion, such as wavelength dependent penetration depth inside the medium or the effect they have on the object of interest (such as inducing auto-fluorescence). With an endoscope equipped with a full range of LED wavelengths, or a specific range of illumination wavelength, it is possible to obtain a full spectral image of the object by turning the various LEDs on and off at specified times, and in a controlled spectral range depending on application, while a time synchronized imaging process captures various spectral images based on the illumination at the time of capture. The LEDs can be distributed illuminators used with fixed image capture devices on the scope, introduced within the body of the disposable medical device as part of an OE vision module, or independently introduced inside the body with or without other medical devices.
LED illumination systems or removable and pluggable OE illumination and vision modules are modular, where one or multiple OE modules can be inserted into the body independent of one another, via separate medical device bodies, at the distal end of an disposable endoscope, or incorporated at convenient and efficient locations on surgical tool tips or disposable cannulas, or other single use medical access devices such as disposable catheters, providing an always sterile illumination and visualization of site inside the body. These single use medical devices incorporating the OE illumination and vision system could be battery operated by the portable display and control unit 610, or take power through the medical device that is plugged onto externally.
One embodiment of an OE illumination and vision module at the distal tip of a disposable cannula 700 is illustrated in
Further, as shown in
The viewing direction of the camera module 601 can be directed and adjusted towards the tip of the laryngoscope blade by the right angle prism 906 mounted on top of the camera unit 601. The LED illuminator 602 could be mounted on small thermal pads or heat sink 907 directing the heat from the LED to around the edges of the front surface of the right angle prism 906, that acts as the window 903 to the vision module for anti-fogging. Display and Control unit 610 can electronically process the video data from the vision module 601 by flipping the image or rotating it as necessary, for correct viewing of the FOV by the user.
By incorporating the OE vision module 601 and LED illuminator 602 at the side of the distal tip of blade 905, the blade opening in proximal end 904 remains completely free for access to inside the body, for endotracheal tube insertion. For example concurrently with insertion of an endotracheal tube, the user can visualize the field indirectly using the OE vision module 601 from the side, without the inserted tube substantially hindering the examiner's view.
Removable and pluggable OE vision and illumination modules containing LED illumination can be plugged onto a variety of single use disposable or reusable, articulating and non-articulating surgical medical device bodies, used in a fixed position with respect to the medical device body, or deployed (articulated) out of the medical device body once the medical device distal end is inside the body. Through the deployment and articulation process of the OE illumination and vision modules that are plugged onto the distal tip of the medical device, the OE module can position itself outside the normal medical device volume, creating space inside the medical device and enabling further tool insertion through the cavity that the OE module was stored in during the insertion of the medical device into the body, thus allowing for further medical device functionality, or articulated to a particular position, revealing a new direction of view by the medical device (perhaps behind some body organs).
In the case of surgical procedures where delicate surgery is performed using the disposable endoscope, such pluggable OE vision and illumination systems 600 can not only be made in minimal size, but can alternately or additionally house two miniature camera systems with an extended dual USB device connection for stereoscopic view of the surgical sight, and 3D viewing for extra precision and guidance with visual depth clues.
Incorporating disposable miniature solid state OE illumination and vision modules (600) in endoscope and surgical device bodies provides a desirable cost advantage over conventional lamp and fiber guide systems, as it replaces the expensive light sources, long fiber optic light guides to transfer illumination light from the light source to the scope, and the illumination light guides inside the scope as well. Low level power is needed for the LED light sources 602, image sensors 606, and drive electronics 607. The electrical connection 609 of the OE illumination and vision module 600 is also much easier using USB type communication and power protocols, with well established mobile web camera applications in video conferencing.
Only electrical power and LED control signals need to be provided for the endoscope, eliminating the heavy and bulky fiber optics illumination cable connection to the scope, increasing the maneuverability and durability of the endoscope. OE illumination and vision modules are also more robust to shock and vibrations or extreme environmental conditions than fiber optic illumination and external camera systems.
In addition to the embodiments of
In these embodiments (
In these embodiments (
The portable control and display unit 610 is connected to the pluggable module 1000, 1100, and 1200, using electrical cable 605 b, which extends as electrical cable 605 a to the electrical connection 609 of the electronic circuit board 607 of the OE vision and illumination module near distal end, within the flexible jacket 1005. The vision module 601 in
Multiple color LEDs can be used within the tip housing 1003 of the disposable endoscope 1000, where the display and control unit 610 synchronizes the on/off timing of each color LED with the frame rates of a black and white camera sensor 606. Such disposable endoscope could be used for spectral imaging with narrow band LED light output in the illuminator module, or with wider wavelength band illumination in the visible range time synchronized with a black and white image sensor 606, to provide full color vision where each color frame takes advantage of the full resolution of the image sensor 606.
In alternate embodiments of all of the pluggable OE illumination and vision modules in the form of cannulas, catheters, and other devices described above that use LEDs for illumination, Solid State Laser Diodes (LD) or VSCELs can alternately or additionally be employed within the OE illumination and vision module or independently at the distal end of pluggable single use devices. For instance, Infrared (IR) Imaging employs IR solid state light sources to illuminate intra-vein or close tissue diagnostic and surgical procedures. IR detectors and special image sensors with modified optical filters in front of their pixels can be employed within OE vision modules for through tissue and blood imaging along with infrared light sources that have appreciable penetration depth in human tissue, blood or other bodily fluids, such as urine. Using a high intensity IR source at the surgical or examination site with control over the intensity, radiation pattern, and the direction of illumination can help with critical surgical procedures inside the vein, heart and other body organs.
By placing the illumination light sources at close proximity to the object inside the body in diagnostic or surgical procedures, the losses in conjunction with the transmission of light from the external source to the surgical site are eliminated. Thus, light sources that have equal efficiency in converting electrical power to useful light, can be operated in much lower input power, eliminating the need for sophisticated power and heat management. Power and control signals transmitting through appropriate wires and flex circuitry, can be easily routed along the tool or endoscope body to the light source and OE vision module.
In some embodiments of the invention, multiple OE vision modules 601 are employed within a single pluggable module to obtain a combined hyper or extended field of view of an imaging site.
The portable control and display unit 610 can be a portable display unit used in a fixed position in a medical facility, or as a mobile application with an LCD, plasma, or other display unit capable of displaying 2D or 3D (stereoscopic) images. The portable control and display unit 610 can alternately or additionally be worn by a user, with a wired or wireless connection to the input devices (e.g., the OE vision module(s) 600), where the user can observe 2D or 3D stereo images and video conveniently by looking at the display mounted on an arm of the user, hanging from a neck of the user, or otherwise mounted (clipped on) to the user.
The portable control and display unit 610 can be electrically powered using a power cable, or use rechargeable or disposable batteries. In all the embodiments, the electrical power supply of the portable control and display unit 610, whether from a power cable or battery, provides power for the portable control and display unit 610 as well as the OE illumination and vision modules 602, 601 to which the portable control and display unit 610 is attached via cable 605 a,b. Single or multiple OE illumination 602 and vision modules 601 can be connected to the portable control and display unit 610, which portable control and display unit 610 can be configured to provide synchronized control of complete illumination and image capture. The portable control and display unit 610 could also provide means for local and transferable means of image and video storage, with magnetic and/or electrical storage devices within its housing. A user interface can be provided on the portable control and display unit 610 and may include hard or soft electronic keys, a mouse or joystick, a touch screen, and/or voice activated command electronics. The user interface can be employed to adjust, control, display, process, transfer, store or retrieve the image and video data. The portable control and display unit 610 can alternately or additionally comprise a multifunctional unit that is used as both a general portable medical display and one or more of: a cell phone, a mini computer with wireless capabilities, a GPS unit, a personal digital assistant (PDA), a note-taking device, a dictation device, a video conferencing device, or the like.
The user interface devices described above, including hard or soft electronic keys, a mouse or joystick, a touch screen, and voice activated command electronics all serve as examples of input and/or output means that can be included in the portable control and display unit 610. The portable control and display unit 610 can alternately or additionally include computing means, such as a processor, microprocessor, controller, or the like. Alternately or additionally, the portable control and display unit 610 can include cellular communication capabilities and/or wireless connectivity.
In some embodiments that include stereoscopic or 3D image capture 1200, as illustrated in
An independent 3D viewer illustrated in
The portable control and display unit 610 may comprise a flat panel LCD screen, plasma screen, or other suitable screen such as organic LED display. A separate sterile disposable cover could be draping the portable control and display unit, preserving all user interface and electrical connection functionalities. Alternately or additionally, the portable control and display unit 610, or it's separate sterile cover can have multiple positioning and attachment possibilities, depending on its size, the type of medical device it's used with, the type of medical procedure, the location the procedure is performed, and the type of user interface necessary. In fixed office or surgical environments, the portable control and display unit 610 can be fixed to a wall, mounted on an IV post, clipped onto as patient cover or drape, or can be hung from a frame structure, with tilt and rotation capabilities and in a removable and portable form. Alternately or additionally, a fixed control and display unit can be employed to control OE illumination and vision modules 602 and 601 and/or to display image data captured by OE vision modules 600.
The convenient and flexible Velcro based wearable attachment device of
Alternately or additionally, as shown in
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
|Patente citada||Fecha de presentación||Fecha de publicación||Solicitante||Título|
|US4000417||25 Ago 1975||28 Dic 1976||Honeywell Inc.||Scanning microscope system with automatic cell find and autofocus|
|US4337761||28 Nov 1979||6 Jul 1982||Upsher Michael S||Laryngoscope|
|US4437458||25 Nov 1981||20 Mar 1984||Upsher Michael S||Laryngoscope|
|US4473841||27 Sep 1982||25 Sep 1984||Fuji Photo Film Co., Ltd.||Video signal transmission system for endoscope using solid state image sensor|
|US4527553||28 Abr 1980||9 Jul 1985||Upsher Michael S||Laryngoscope with improved light source|
|US4869238||22 Abr 1988||26 Sep 1989||Opielab, Inc.||Endoscope for use with a disposable sheath|
|US4901708||22 Jul 1988||20 Feb 1990||Lee Tzium Shou||Viewing laryngoscope|
|US4974076||11 Dic 1989||27 Nov 1990||Olympus Optical Co., Ltd.||Imaging apparatus and endoscope apparatus using the same|
|US4982729||8 Dic 1989||8 Ene 1991||Wu Tzu Lang||Rigid fiberoptic intubating laryngoscope|
|US5025778||26 Mar 1990||25 Jun 1991||Opielab, Inc.||Endoscope with potential channels and method of using the same|
|US5056163||15 May 1990||15 Oct 1991||Chou Chih T||Sweat-absorbing strip for sport goggles|
|US5062697||8 Ago 1990||5 Nov 1991||Mitchell Phillip R||Portable microscope apparatus|
|US5166787||28 Jun 1990||24 Nov 1992||Karl Storz Gmbh & Co.||Endoscope having provision for repositioning a video sensor to a location which does not provide the same cross-sectionally viewed relationship with the distal end|
|US5203320||12 Jul 1991||20 Abr 1993||Augustine Medical, Inc.||Tracheal intubation guide|
|US5261392||3 Abr 1992||16 Nov 1993||Achi Corporation||Laryngoscope with interchangeable fiberoptic assembly|
|US5285397||21 Nov 1990||8 Feb 1994||Carl-Zeiss-Stiftung||Coordinate-measuring machine for non-contact measurement of objects|
|US5305121||8 Jun 1992||19 Abr 1994||Origin Medsystems, Inc.||Stereoscopic endoscope system|
|US5381784||30 Sep 1992||17 Ene 1995||Adair; Edwin L.||Stereoscopic endoscope|
|US5475316||27 Dic 1993||12 Dic 1995||Hypervision, Inc.||Transportable image emission microscope|
|US5494483||28 Oct 1994||27 Feb 1996||Adair; Edwin L.||Stereoscopic endoscope with miniaturized electronic imaging chip|
|US5538497||5 Ago 1994||23 Jul 1996||Oktas||Endoscope having parasitic light elements|
|US5614941||15 May 1995||25 Mar 1997||Hines; Stephen P.||Multi-image autostereoscopic imaging system|
|US5643221||9 Ago 1994||1 Jul 1997||Bullard; James Roger||Controlled targeting laryngoscope|
|US5645519||18 Mar 1994||8 Jul 1997||Jai S. Lee||Endoscopic instrument for controlled introduction of tubular members in the body and methods therefor|
|US5647840||14 Sep 1994||15 Jul 1997||Circon Corporation||Endoscope having a distally heated distal lens|
|US5653677 *||4 Abr 1995||5 Ago 1997||Fuji Photo Optical Co. Ltd||Electronic endoscope apparatus with imaging unit separable therefrom|
|US5667473||7 Jun 1995||16 Sep 1997||Clarus Medical Systems, Inc.||Surgical instrument and method for use with a viewing system|
|US5749830||27 Oct 1994||12 May 1998||Olympus Optical Co., Ltd.||Fluorescent endoscope apparatus|
|US5800342||17 Dic 1996||1 Sep 1998||Lee; Jai S.||Method of endotracheal intubation|
|US5836867 *||11 Nov 1997||17 Nov 1998||Linvatec Corporation||Magnetic coupling assembly for endoscope|
|US5840013||17 Dic 1996||24 Nov 1998||Lee; Jai S.||Method of introducing a tubular member at a site in the body|
|US5895350||16 Jul 1997||20 Abr 1999||Vista Medical Technologies, Inc.||Electronic endoscope|
|US6066090||18 Jun 1998||23 May 2000||Yoon; Inbae||Branched endoscope system|
|US6106457||31 Mar 1998||22 Ago 2000||Welch Allyn, Inc.||Compact imaging instrument system|
|US6178346||23 Oct 1998||23 Ene 2001||David C. Amundson||Infrared endoscopic imaging in a liquid with suspended particles: method and apparatus|
|US6203493||14 Feb 1997||20 Mar 2001||Biosense, Inc.||Attachment with one or more sensors for precise position determination of endoscopes|
|US6277064||29 Dic 1998||21 Ago 2001||Inbae Yoon||Surgical instrument with rotatably mounted offset endoscope|
|US6352517 *||27 May 1999||5 Mar 2002||Stephen Thomas Flock||Optical monitor of anatomical movement and uses thereof|
|US6441958||29 Mar 2001||27 Ago 2002||Chak Sing Richard Yeung||Digital imaging microscope|
|US6461359||10 Nov 1999||8 Oct 2002||Clifford Tribus||Spine stabilization device|
|US6471643||7 Abr 2000||29 Oct 2002||Karl Storz Gmbh & Co. Kg||Laryngoscope|
|US6485413||6 Mar 1998||26 Nov 2002||The General Hospital Corporation||Methods and apparatus for forward-directed optical scanning instruments|
|US6525875||13 Abr 1999||25 Feb 2003||Vincent Lauer||Microscope generating a three-dimensional representation of an object and images generated by such a microscope|
|US6616603||28 Feb 2002||9 Sep 2003||Sergio Bicocchi||Anoscope|
|US6648816||1 Oct 2001||18 Nov 2003||Karl Storz Gmbh & Co. Kg||Device for intracorporal, minimal-invasive treatment of a patient|
|US6711283||3 May 2000||23 Mar 2004||Aperio Technologies, Inc.||Fully automatic rapid microscope slide scanner|
|US6736773||25 Ene 2001||18 May 2004||Scimed Life Systems, Inc.||Endoscopic vision system|
|US6762794||1 Dic 1998||13 Jul 2004||Canon Kabushiki Kaisha||Image pick-up apparatus for stereoscope|
|US6878109||28 Feb 2002||12 Abr 2005||Olympus Corporation||Light source device for an endoscope using a DMD|
|US6916286||9 Ago 2001||12 Jul 2005||Smith & Nephew, Inc.||Endoscope with imaging probe|
|US6986738||6 Ago 2002||17 Ene 2006||Given Imaging Ltd||System and method for maneuvering a device in vivo|
|US7029435 *||16 Oct 2003||18 Abr 2006||Granit Medical Innovation, Llc||Endoscope having multiple working segments|
|US7048685||29 Jul 2002||23 May 2006||Olympus Corporation||Measuring endoscope system|
|US7074182||13 Ene 2004||11 Jul 2006||Tokendo||Videoendoscope|
|US7413543 *||29 Mar 2004||19 Ago 2008||Scimed Life Systems, Inc.||Endoscope with actively cooled illumination sources|
|US7435218||27 Oct 2003||14 Oct 2008||Storz Endoskop Gmbh||Optical instrument, in particular an endoscope, having an interchangeable head|
|US7442166||10 May 2005||28 Oct 2008||Chung Shan Institute Of Science And Technology||Disposable two-step endoscope|
|US7591783||30 Sep 2004||22 Sep 2009||Boston Scientific Scimed, Inc.||Articulation joint for video endoscope|
|US7819877||24 May 2002||26 Oct 2010||BePuy Products, Inc.||Method and apparatus for endoscopic minimally invasive orthopaedic plating procedures|
|US7892169||18 Jul 2001||22 Feb 2011||Olympus Corporation||Endoscope apparatus|
|US7951072||2 May 2006||31 May 2011||Boston Scientific Scimed, Inc.||Controllable endoscopic sheath apparatus and related method of use|
|US7955255||20 Abr 2006||7 Jun 2011||Boston Scientific Scimed, Inc.||Imaging assembly with transparent distal cap|
|US8212858||31 Oct 2007||3 Jul 2012||Visionsense Ltd.||Optical device|
|US20010007051||1 Dic 2000||5 Jul 2001||Asahi Kogaku Kogyo Kabushiki Kaisha||Electronic endoscope|
|US20020001202||23 Ago 2001||3 Ene 2002||Williams Jeffrey B.||Light delivery systems and applications thereof|
|US20020120181||24 Oct 2001||29 Ago 2002||Irion Klaus M.||Endoscope with LED illumination|
|US20020135871||3 Dic 2001||26 Sep 2002||Vodyanoy Vitaly J.||High-resolution optical microscope|
|US20020143239||7 Dic 2001||3 Oct 2002||Marc Henzler||Endoscope|
|US20020161283||26 Abr 2002||31 Oct 2002||Fuji Photo Film Co., Ltd.||Image obtaining method and apparatus of an endoscope apparatus|
|US20030023150||25 Jul 2002||30 Ene 2003||Olympus Optical Co., Ltd.||Capsule-type medical device and medical system|
|US20030120130||6 Ago 2002||26 Jun 2003||Arkady Glukhovsky||System and method for maneuvering a device in vivo|
|US20040039242||2 Abr 2003||26 Feb 2004||Seedling Enterprises, Llc||Apparatus and methods using visible light for debilitating and/or killing microorganisms within the body|
|US20040147806||20 Ene 2004||29 Jul 2004||Doron Adler||Intra vascular imaging method and apparatus|
|US20040196364||1 Abr 2004||7 Oct 2004||Pentax Corporation||Electronic endoscope system|
|US20040204628||13 Ene 2004||14 Oct 2004||Tokendo||Videoendoscope|
|US20050001899||11 May 2004||6 Ene 2005||Olympus Corporation||Three-dimensional observation system|
|US20050014994||15 Jul 2003||20 Ene 2005||Fowler Dennis L.||Insertable device and system for minimal access procedure|
|US20050024505||21 Jul 2004||3 Feb 2005||Shuhei Kawachi||Signal processing apparatus|
|US20050038321||14 May 2004||17 Feb 2005||Olympus Corporation||Capsular medical apparatus|
|US20050043586||12 Mar 2004||24 Feb 2005||Olympus Corporation||Capsule endoscope|
|US20050043588||10 Sep 2004||24 Feb 2005||Jory Tsai||Medical inspection device|
|US20050059860||2 Sep 2004||17 Mar 2005||Jun Matsumoto||Endoscope|
|US20050096502||29 Oct 2003||5 May 2005||Khalili Theodore M.||Robotic surgical device|
|US20050154262||30 Sep 2004||14 Jul 2005||Banik Michael S.||Imaging system for video endoscope|
|US20050180700 *||10 Dic 2004||18 Ago 2005||Finisar Corporation||Optical connectors for electronic devices|
|US20050182297||5 Nov 2004||18 Ago 2005||Dietrich Gravenstein||Imaging scope|
|US20050222499 *||30 Sep 2004||6 Oct 2005||Banik Michael S||Interface for video endoscope system|
|US20050234296||14 Abr 2004||20 Oct 2005||Usgi Medical Inc.||Method and apparatus for obtaining endoluminal access|
|US20050237605||15 Abr 2005||27 Oct 2005||Vodyanoy Vitaly J||Microscope illumination device and adapter therefor|
|US20050240077||1 Abr 2005||27 Oct 2005||Jean Rovegno||Device for metrology by laser mapping for a videoendoscopic probe|
|US20050272975||23 Mar 2005||8 Dic 2005||Mcweeney John O||In-vivo visualization system|
|US20060018017||22 Sep 2005||26 Ene 2006||Susumu Takahashi||3-D image observation apparatus|
|US20060020171||21 Oct 2003||26 Ene 2006||Gilreath Mark G||Intubation and imaging device and system|
|US20060041193||5 Abr 2005||23 Feb 2006||George Wright||Endoscope designs and methods of manufacture|
|US20060069313||30 Sep 2004||30 Mar 2006||Couvillon Lucien A Jr||Medical devices with light emitting regions|
|US20060069314 *||23 Sep 2005||30 Mar 2006||Mina Farr||Solid state illumination for endoscopy|
|US20060167531 *||14 Jun 2005||27 Jul 2006||Michael Gertner||Optical therapies and devices|
|US20060178556||27 Dic 2005||10 Ago 2006||Intuitive Surgical, Inc.||Articulate and swapable endoscope for a surgical robot|
|US20060189845 *||28 Feb 2006||24 Ago 2006||Usgi Medical Inc.||Methods and apparaus for off-axis visualization|
|US20060287582||15 Jun 2006||21 Dic 2006||Olympus Medical Systems Corporation||Endoscopic system|
|US20070015964||20 Abr 2006||18 Ene 2007||Eversull Christian S||Apparatus and Methods for Coronary Sinus Access|
|US20070058249||8 Sep 2006||15 Mar 2007||Kenji Hirose||Medical stereo observation system|
|US20070073109||21 Sep 2006||29 Mar 2007||Irion Klaus M||Lighting system for endoscopic examinations|
|US20070106117||24 Oct 2006||10 May 2007||Pentax Corporation||Intubation assistance apparatus|
|US20070106121||24 Oct 2006||10 May 2007||Junichi Koyama||Intubation assistance apparatus and intubation assistance used in the apparatus|
|US20070106122||24 Oct 2006||10 May 2007||Pentax Corporation||Intubation assistance apparatus|
|US20070167702||30 Dic 2005||19 Jul 2007||Intuitive Surgical Inc.||Medical robotic system providing three-dimensional telestration|
|US20070213590||17 May 2007||13 Sep 2007||Gyntec Medical, Inc.||Apparatus and methods for examining, visualizing, diagnosing, manipulating, treating and recording of abnormalities within interior regions of body cavities|
|US20070225561||20 Mar 2007||27 Sep 2007||Olympus Medical Systems Corp.||Endoscope and display device|
|US20070276183 *||27 Jun 2007||29 Nov 2007||Envisionier Medical Technologies Llc||Endoscopic imaging system|
|US20070292939||15 Jun 2006||20 Dic 2007||Stephen Liye Chen||Insert with concavity for organic culture and imaging|
|US20080045800||23 Sep 2005||21 Feb 2008||Mina Farr||Solid state illumination for endoscopy|
|US20080051632||5 Oct 2007||28 Feb 2008||Mitsuhiro Ito||Endoscope apparatus|
|US20080207996||6 Jun 2006||28 Ago 2008||Solar International Products, Inc||Portable Imaging Apparatus|
|US20080208006||28 Abr 2008||28 Ago 2008||Mina Farr||Opto-electronic illumination and vision module for endoscopy|
|US20090099550||20 Oct 2008||16 Abr 2009||Oscar Carrillo||Rapid Exchange Catheter with Depressable Channel|
|US20100198009||13 Abr 2010||5 Ago 2010||Vivid Medical, Inc.||Disposable endoscope and portable display|
|US20100234925 *||16 Mar 2010||16 Sep 2010||PinPoint U.S.A., Inc.||Treatment of microbiological pathogens in a toe nail with antimicrobial light|
|US20100312059||28 Ago 2008||9 Dic 2010||Aircraft Medical Limited||Laryngoscope|
|JP2000245689A||Título no disponible|
|JP2003093399A||Título no disponible|
|JP2003220023A||Título no disponible|
|JPH05285154A||Título no disponible|
|JPH05337073A||Título no disponible|
|JPH11216113A||Título no disponible|
|KR20080089579A||Título no disponible|
|1||Backman, V., et al., "Polarized Light Scattering Spectroscopy for Quantitative Measurement of Epithelial Cellular Structures in Situ," IEEE Journal of Selected Topics in Quantum Electronics, vol. 5, No. 4, pp. 1019-1026 (1999).|
|2||International Search Report and Written Opinion dated Oct. 30, 2009 as issued in International Application No. PCT/US2009/041118 filed Apr. 20, 2009.|
|3||International Search Report and Written Opinion Mailed Apr. 10, 2006 in related PCT application No. PCT-US2005-034793.|
|4||International Search Report and Written Opinion Mailed Oct. 30, 2009 in related PCT application No. PCT-US2009-041118.|
|5||International Search Report dated Apr. 23, 2012 as received in application No. PCT/US2011/052039.|
|6||KR Office Action dated Jul. 30, 2014 as received in Application No. 10-2013-7009566 (English Translation).|
|7||PCT/US2009/04118, filed Apr. 20, 2009, Farr et al.|
|8||U.S. App. No. 11/233,684, Jul. 13, 2009, Restriction Requirement.|
|9||U.S. Appl. No. 11/233,684, filed Sep. 23, 2005, Mina Farr.|
|10||U.S. Appl. No. 11/233,684, May 14, 2010, Office Action.|
|11||U.S. Appl. No. 11/233,684, Nov. 12, 2009, Office Action.|
|12||U.S. Appl. No. 12/111,107, filed Apr. 28, 2008, Farr et al.|
|13||U.S. Appl. No. 12/413,457, filed Mar. 27, 2009, Farr et al.|
|14||U.S. Appl. No. 12/771,087, filed Apr. 30, 2010, Farr et al.|
|15||Written Opinion of the International Searching Authority dated Apr. 23, 2012 as received in application No. PCT/US2011/052039.|
|Patente citante||Fecha de presentación||Fecha de publicación||Solicitante||Título|
|US9343489||8 Feb 2015||17 May 2016||DePuy Synthes Products, Inc.||Image sensor for endoscopic use|
|US9462234||26 Jul 2013||4 Oct 2016||DePuy Synthes Products, Inc.||Camera system with minimal area monolithic CMOS image sensor|
|US9492065||13 Mar 2013||15 Nov 2016||Camplex, Inc.||Surgical retractor with video cameras|
|US9492073||13 Mar 2013||15 Nov 2016||Camplex, Inc.||Binocular viewing assembly for a surgical visualization system|
|US9516239||26 Jul 2013||6 Dic 2016||DePuy Synthes Products, Inc.||YCBCR pulsed illumination scheme in a light deficient environment|
|US9615728||13 Mar 2013||11 Abr 2017||Camplex, Inc.||Surgical visualization system with camera tracking|
|US9622650||14 May 2012||18 Abr 2017||DePuy Synthes Products, Inc.||System and method for sub-column parallel digitizers for hybrid stacked image sensor using vertical interconnects|
|US9629523||13 Mar 2013||25 Abr 2017||Camplex, Inc.||Binocular viewing assembly for a surgical visualization system|
|US9641815||14 Mar 2014||2 May 2017||DePuy Synthes Products, Inc.||Super resolution and color motion artifact correction in a pulsed color imaging system|
|US9642606||17 Mar 2014||9 May 2017||Camplex, Inc.||Surgical visualization system|
|US9681796||10 Nov 2014||20 Jun 2017||Camplex, Inc.||Interface for viewing video from cameras on a surgical visualization system|
|US9723976||18 Dic 2015||8 Ago 2017||Camplex, Inc.||Optics for video camera on a surgical visualization system|
|US9762879||5 Dic 2016||12 Sep 2017||DePuy Synthes Products, Inc.||YCbCr pulsed illumination scheme in a light deficient environment|
|US9763566||31 Ago 2015||19 Sep 2017||DePuy Synthes Products, Inc.||Pixel array area optimization using stacking scheme for hybrid image sensor with minimal vertical interconnects|
|US9777913||15 Mar 2014||3 Oct 2017||DePuy Synthes Products, Inc.||Controlling the integral light energy of a laser pulse|
|US9782159||20 May 2014||10 Oct 2017||Camplex, Inc.||Surgical visualization systems|
|US20140249368 *||12 May 2014||4 Sep 2014||Fujikura Ltd.||Method of packaging imaging device chip, method of assembling endoscope, imaging module, and endoscope|
|Clasificación de EE.UU.||600/109, 600/110, 600/132|
|Clasificación internacional||A61B1/04, A61B1/00|
|Clasificación cooperativa||A61B2090/373, A61B2090/309, A61B2090/0813, A61B90/53, A61B90/37, A61B17/00234, A61B1/0676, A61B2017/3484, A61B1/00177, A61B17/3421, A61B1/00103, A61B17/3439, A61B1/05, A61B1/0638, A61B1/0615, A61B2017/00296, A61B1/0684, A61B2017/0023|
|13 Abr 2010||AS||Assignment|
Owner name: VIVID MEDICAL, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FARR, MINA;WALL, FRANKLIN J., JR.;TOGAMI, CHRIS;AND OTHERS;SIGNING DATES FROM 20100409 TO 20100412;REEL/FRAME:024224/0557