|Número de publicación||US7395249 B2|
|Tipo de publicación||Concesión|
|Número de solicitud||US 10/942,374|
|Fecha de publicación||1 Jul 2008|
|Fecha de presentación||16 Sep 2004|
|Fecha de prioridad||22 Sep 1994|
|También publicado como||CA2200716A1, CA2200716C, US6463361, US6965812, US20020183894, US20050033580, WO1996009587A1|
|Número de publicación||10942374, 942374, US 7395249 B2, US 7395249B2, US-B2-7395249, US7395249 B2, US7395249B2|
|Inventores||Yulun Wang, Darrin Uecker|
|Cesionario original||Intuitive Surgical, Inc.|
|Exportar cita||BiBTeX, EndNote, RefMan|
|Citas de patentes (131), Otras citas (50), Citada por (17), Clasificaciones (21), Eventos legales (4)|
|Enlaces externos: USPTO, Cesión de USPTO, Espacenet|
This is a continuation of U.S. patent application Ser. No. 10/095,488 filed Mar. 11, 2002, the full disclosure of which is incorporated herein by reference, which is a continuation U.S. patent application Ser. No. 08/310,665 filed on Sep. 22 1994.
The present invention is a robotic system which controls the movement of a surgical instrument in response to voice commands from the user. A surgical instrument is a tool or device used during a surgery or operation. Examples of surgical instruments include forceps, laparoscopes, endoscopes, and medical telescopes. The robotic system has a computer controlled arm that holds the surgical instrument. The user provides voice commands to the computer through a microphone. The computer contains a phrase recognizer that matches the user's speech with words stored in the computer. Matched words are then processed to determine whether the user has spoken a robot command. If the user has spoken a recognized robot command the computer will move the robotic arm in accordance with the command.
The objects and advantages of the present invention will become more readily apparent to those ordinarily skilled in the art after reviewing the following detailed description and accompanying drawings, wherein:
Referring to the drawings more particularly by reference numbers,
The robotic arm assembly 14 controlled by a computer 20. In the preferred embodiment, the robotic arm assembly 16 includes a linear actuator 24 fixed to the table 14. The linear actuator 24 is connected to a linkage arm assembly 26 and adapted to move the linkage assembly 26 along the z axis of a first coordinate system. The first coordinate system also has an x axis and a y axis.
The linkage arm assembly 26 includes a first linkage arm 28 attached to a first rotary actuator 30 and an end effector 32. The first rotary actuator 30 is adapted to rotate the first linkage arm 28 and end effector 32 in a plane perpendicular to the z axis (x-y plane) The first rotary actuator 30 is connected to a second rotary actuator 34 by a second linkage arm 36. The second actuator 34 is adapted to rotate the first actuator 30 in the x-y plane. The second rotary actuator 34 is connected to the output shaft of the linear actuator 24. The actuators 24, 30 and 34 rotate in response to output signals provided by the computer 20. As shown in
The arm assembly may have a pair of passive joints that allow the end effector to be rotated in the direction indicated by the arrows. The actuators 24, 30 and 34, and joints of the arm may each have position sensors (not shown) that are connected to the computer 20. The sensors provide positional feedback signals of each corresponding arm component.
The system has a microphone 40 that is connected to the computer 20. The system may also have a speaker 42 that is connected to the computer 20. The microphone 40 and speaker 42 may be mounted to a headset 44 that is worn by the user. Placing the microphone 40 in close proximity to the user reduces the amount of background noise provided to the computer and decreases the probability of an inadvertent input command.
As shown in
The processor 78 is connected to an address decoder 82 and separate digital to analog (D/A) converters 84. Each D/A converter is connected to an actuator 24, 30 and 34. The D/A converters 84 provide analog output signals to the actuators in response to output signals received from the processor 78. The analog output signals have a sufficient voltage level to energize the electric motors and move the robotic arm assembly. The decoder 82 correlates the addresses provided by the processor with a corresponding D/A converter, so that the correct motor(s) is driven. The address decoder 82 also provides an address for the input data from the A/D converter 76 so that the data is associated with the correct input channel.
The computer 20 has a phrase recognizer 86 connected to the microphone 40 and the processor 78. The phrase recognizer 86 digitizes voice commands provided by the user through the microphone 40. The voice commands are then processed to convert the spoken words into electronic form. The electronic words are typically generated by matching the user's speech with words stored within the computer 20. In the preferred embodiment, the recognizer 86 is an electronic board with accompanying software that is marketed by SCOTT INSTRUMENTS of Denton, Tex. under the trademark “Coretechs Technology”.
The electronic words are provided to the processor 78. The processor 78 compares a word, or a combination of words to predefined robot commands that are stored within a library in the memory 80 of the computer 20. If a word, or combination of words match a word or combination of words in the library, the processor 78 provides output commands to the D/A converter 84 to move the robotic arm in accordance with the command.
If the spoken word is AESOP the process continues to state 1. The process next determines whether the user has spoken a word that satisfies a condition to advance to states 2-6. These words include “move”, “step”, “save”, “return”, “speed”, “track instrument” and “track head”. The track instrument command is for a system which has the ability to move an endoscope to automatically track the movement of a second instrument that is inserted into the patient. The track head command may enable the system so that the endoscope movement tracks the user's eyes. For example, if the user looks to the right of the image displayed by the monitor, the robot will move the endoscope to move the image in a rightward direction. The move and step commands induce movement of the scope in a desired direction. The save command saves the position of the endoscope within the memory of the computer. The return command will return the scope to a saved position.
From states 2-6 the process will determine whether the user has spoken words that meet the next condition and so forth and so on. When a certain number of conditions have been met, the processor 78 will provide an output command to the D/A converter 84 in accordance with the voice commands. For example, if the user says “AESOP move left”, the processor 78 will provide output commands to move the endoscope 12, so that the image displayed by the monitor moves in a leftward direction. The microphone 40 phrase recognizer 86 and grammar process essentially provide the same input function as the foot pedal 50, multiplexer 74 and A/D converter 76.
The processor 78 can also provide the user with feedback regarding the recognized command through the speaker 42 or the monitor 18. For example, when the user states “AESOP move right”, after processing the speech, the processor 78 can provide an audio message through the speaker 42, or a visual message on the monitor 18, “AESOP move right”. Additionally, the processor 78 can provide messages regarding system errors, or the present state of the system such as “speed is set for slow”.
a2=angle between the second linkage arm 36 and the x axis.
a3=angle between the first linkage arm 28 and the longitudinal axis of the second linkage arm 36.
L1=length of the second linkage arm.
L2=length of the first linkage arm.
x=x coordinate of the end effector in the first coordinate system.
y=y coordinate of the end effector in the first coordinate system.
To move the end effector to a new location of the x-y plane the processor 78 computes the change in angles a2 and a3 and then provides output signals to move the actuators accordingly. The original angular position of the end effector is provided to the processor 78 by the position sensors. The processor moves the linkage arms an angle that corresponds to the difference between the new location and the original location of the end effector. A differential angle Δa2 corresponds to the amount of angular displacement provided by the second actuator 34, a differential angle Δa3 corresponds to the amount of angular displacement provided by the first actuator 30.
To improve the effectiveness of the system 10, the system is constructed so that the desired movement of the surgical instrument correlates to a direction relative to the image displayed by the monitor. Thus when the surgeon commands the scope to move up, the scope always appears to move in the up direction. To accomplish this result, the processor 78 converts the desired movement of the end of the endoscope in the third coordinate system to coordinates in the second coordinate system, and then converts the coordinates of the second coordinate system into the coordinates of the first coordinate system.
Δx″=the desired incremental movement of the scope along the x″ axis of the third coordinate system.
Δy″=the desired incremental movement of the scope along the y″ axis of the third coordinate system.
Δz″=the desired incremental movement of the scope along the z″ axis of the third coordinate system.
a5=the angle between the z′ axis and the scope in the y-z′ plane.
a6=the angle between the z′ axis and the scope in the x′-z′ plane.
Δx″=the computed incremental movement of the scope along the x′ axis of the second coordinate system.
Δy″=the computed incremental movement of the scope along the y′ axis of the second coordinate system.
Δz″=the computed incremental movement of the scope along the z′ axis of the second coordinate system.
The angles a5 and a6 are provided by position sensors located on the end effector 32. The angles a5 and a6 are shown in
The desired movement of the endoscope is converted from the second coordinate system to the first coordinate system by using the following transformation matrix:
Δx′=the computed incremental movement of the scope along the x′ axis of the second coordinate system.
Δy′=the computed incremental movement of the scope along the y′ axis of the second coordinate system.
Δz′=the computed incremental movement of the scope along the z′ axis of the second coordinate system.
π=is the angle between the first linkage arm and the x axis of the first coordinate system.
Δx=the computed incremental movement of the scope along the x axis of the first coordinate system.
Δy=the computed incremental movement of the scope along the y axis of the first coordinate system.
Δz=the computed incremental movement of the scope along the z axis of the first coordinate system.
The incremental movements Δx and Δy are inserted into the algorithms described above for computing the angular movements (Δa2 and Δa3) of the robotic arm assembly to determine the amount of rotation that is to be provided by each electric motor. The value Δz is used to determine the amount of linear movement provided by the linear actuator 24.
The surgical instrument is typically coupled to a camera and a viewing screen so that any spinning of the instrument about its own longitudinal axis will result in a corresponding rotation of the image on the viewing screen. Rotation of the instrument and viewing image may disorient the viewer. It is therefore desirable to maintain the orientation of the viewing image. In the preferred embodiment, the end effector has a worm gear (not shown) which rotates the surgical instrument about the longitudinal axis of the instrument. To insure proper orientation of the endoscope 16, the worm gear rotates the instrument 16 about its longitudinal axis an amount Δθ6 to insure that the y″ axis is oriented in the most vertical direction within the fixed coordinate system. Δθ6 is computed from the following cross-products.
Δθ6 =zi″ (yo″.yi″)
Δθ6 =the angle that the instrument is to be rotated about the z″ axis.
yo″=is the vector orientation of the y″ axis when the 20 instrument is in the first position.
yiΔ=is the vector orientation of the y″ axis when the instrument is in the second position.
zi″=is the vector orientation of the z″ axis when the instrument is in the second position.
The vectors of the yi″ and zi″ axis are computed with the following algorithms.
a5=is the angle between the instrument and the z axis in the y-z plane.
a6=is the angle between the instrument and the z axis in the x-z plane.
z=is the unit vector of the z axis in the first coordinate system.
The angles a5 and a6 are provided by position sensors. The vector yo″ is computed using the angles a5 and a6 of the instrument in the original or first position. For the computation of yi″ the angles a5 and a6 of the second position are used in the transformation matrix. After each arm movement yo″ is set to yi″ and a new yi″ vector and corresponding Δθ6 angle are computed and used to re-orient the endoscope. Using the above described algorithms, the worm gear continuously rotates the instrument about its longitudinal axis to insure that the pivotal movement of the endoscope does not cause a corresponding rotation of the viewing image.
The system may have a memory feature to store desired instrument positions within the patient. The memory feature may be enabled either by voice commands or through a button on an input device such as the foot pedal. When a save command is spoken, the coordinates of the end effector in the first coordinate system are saved in a dedicated address(es) of the computer memory. When a return command is spoken, the processor retrieves the data stored in memory and moves the end effector to the coordinates of the effector when the save command was enabled.
The memory feature allows the operator to store the coordinates of the end effector in a first position, move the end effector to a second position and then return to the first position with a simple command. By way of example, the surgeon may take a wide eye view of the patient from a predetermined location and store the coordinates of that location in memory. Subsequently, the surgeon may manipulate the endoscope to enter cavities, etc. which provide a more narrow view. The surgeon can rapidly move back to the wide eye view by merely stating “AESOP return to one”.
In operation, the user provides spoken words to the microphone. The phrase recognizer 86 matches the user's speech with stored words and provides matched electronic words to the processor 78. The processor performs a grammar process to determine whether the spoken words are robot commands. If the words are commands, the computer energizes the actuators and moves the endoscope, accordingly. The system also allows the user to control the movement of the endoscope with a foot pedal if voice commands are not desired.
While certain exemplary embodiments have been described and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention not be limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art:
|Patente citada||Fecha de presentación||Fecha de publicación||Solicitante||Título|
|US977825||8 Ene 1910||6 Dic 1910||George N Murphy||Surgical instrument.|
|US3171549||18 Jul 1962||2 Mar 1965||Molins Machine Co Ltd||Mechanical handling apparatus|
|US3280991||28 Abr 1964||25 Oct 1966||Programmed & Remote Syst Corp||Position control manipulator|
|US3300053 *||8 Abr 1964||24 Ene 1967||Melville F Peters||Fluid separating device|
|US4058001||2 Ago 1976||15 Nov 1977||G. D. Searle & Co.||Ultrasound imaging system with improved scan conversion|
|US4128880||30 Jun 1976||5 Dic 1978||Cray Research, Inc.||Computer vector register processing|
|US4158750 *||26 May 1977||19 Jun 1979||Nippon Electric Co., Ltd.||Speech recognition system with delayed output|
|US4207959||2 Jun 1978||17 Jun 1980||New York University||Wheelchair mounted control apparatus|
|US4216462||6 Mar 1978||5 Ago 1980||General Electric Company||Patient monitoring and data processing system|
|US4221997||18 Dic 1978||9 Sep 1980||Western Electric Company, Incorporated||Articulated robot arm and method of moving same|
|US4340800 *||18 Dic 1980||20 Jul 1982||Matsushita Electric Industrial Co., Ltd.||Heating apparatus having voice command control operative in a conversational processing manner|
|US4348553 *||2 Jul 1980||7 Sep 1982||International Business Machines Corporation||Parallel pattern verifier with dynamic time warping|
|US4367998||5 Sep 1980||11 Ene 1983||United Kingdom Atomic Energy Authority||Manipulators|
|US4401852||13 Ene 1982||30 Ago 1983||Nissan Motor Company, Limited||Voice response control system|
|US4454586 *||19 Nov 1981||12 Jun 1984||At&T Bell Laboratories||Method and apparatus for generating speech pattern templates|
|US4456961||5 Mar 1982||26 Jun 1984||Texas Instruments Incorporated||Apparatus for teaching and transforming noncoincident coordinate systems|
|US4460302||12 May 1981||17 Jul 1984||Commissariat A L'energie Atomique||Handling equipment comprising a telescopic supporting assembly carrying a motorized orientation support for at least one articulated slave arm|
|US4472617 *||18 Jun 1982||18 Sep 1984||Matsushita Electric Industrial Co., Ltd.||Heating apparatus with voice actuated door opening mechanism|
|US4474174||23 Feb 1983||2 Oct 1984||American Hospital Supply Corporation||Surgical instrument for an endoscope|
|US4482032 *||25 Abr 1983||13 Nov 1984||Westinghouse Electric Corp.||Elevator emergency control system|
|US4491135||3 Nov 1982||1 Ene 1985||Klein Harvey A||Surgical needle holder|
|US4503854||16 Jun 1983||12 Mar 1985||Jako Geza J||Laser surgery|
|US4517963||4 Ene 1983||21 May 1985||Harold Unger||Image-erecting barrel rotator for articulated optical arm|
|US4523884||8 Oct 1981||18 Jun 1985||Commissariat A L'energie Atomique||Remote manipulation assembly|
|US4586398||29 Sep 1983||6 May 1986||Hamilton Industries||Foot control assembly for power-operated tables and the like|
|US4604016||3 Ago 1983||5 Ago 1986||Joyce Stephen A||Multi-dimensional force-torque hand controller having force feedback|
|US4605080 *||25 Mar 1985||12 Ago 1986||Lemelson Jerome H||Speech recognition control system and method|
|US4616637||14 Sep 1984||14 Oct 1986||Precision Surgical Instruments, Inc.||Shoulder traction apparatus|
|US4624002||18 Jul 1985||18 Nov 1986||Vysoka Skola Chemicko-Technologicka||Circuit arrangement for decreasing the corrosion of the electrodes in a furnace for the electric melting of vitreous material|
|US4624008 *||9 Mar 1983||18 Nov 1986||International Telephone And Telegraph Corporation||Apparatus for automatic speech recognition|
|US4624011||28 Ene 1983||18 Nov 1986||Tokyo Shibaura Denki Kabushiki Kaisha||Speech recognition system|
|US4633389||1 Feb 1983||30 Dic 1986||Hitachi, Ltd.||Vector processor system comprised of plural vector processors|
|US4633499 *||8 Oct 1982||30 Dic 1986||Sharp Kabushiki Kaisha||Speech recognition system|
|US4635292||17 Dic 1984||6 Ene 1987||Matsushita Electric Industrial Co., Ltd.||Image processor|
|US4641292 *||21 Oct 1985||3 Feb 1987||George Tunnell||Voice controlled welding system|
|US4655257||1 Nov 1985||7 Abr 1987||Kabushiki Kaisha Machida Seisakusho||Guide tube assembly for industrial endoscope|
|US4672963||7 Jun 1985||16 Jun 1987||Israel Barken||Apparatus and method for computer controlled laser surgery|
|US4676243||31 Oct 1984||30 Jun 1987||Aldebaran Xiii Consulting Company||Automated anterior capsulectomy instrument|
|US4717364 *||4 Sep 1984||5 Ene 1988||Tomy Kogyo Inc.||Voice controlled toy|
|US4725956 *||15 Oct 1985||16 Feb 1988||Lockheed Corporation||Voice command air vehicle control system|
|US4728974||30 May 1986||1 Mar 1988||Yaskawa Electric Manufacturing Co., Ltd.||Apparatus for supporting an imaging device|
|US4750136||10 Ene 1986||7 Jun 1988||American Telephone And Telegraph, At&T Information Systems Inc.||Communication system having automatic circuit board initialization capability|
|US4757541 *||1 Dic 1986||12 Jul 1988||Research Triangle Institute||Audio visual speech recognition|
|US4762455||1 Jun 1987||9 Ago 1988||Remote Technology Corporation||Remote manipulator|
|US4776016 *||21 Nov 1985||4 Oct 1988||Position Orientation Systems, Inc.||Voice control system|
|US4791934||7 Ago 1986||20 Dic 1988||Picker International, Inc.||Computer tomography assisted stereotactic surgery system and method|
|US4791940||2 Feb 1987||20 Dic 1988||Florida Probe Corporation||Electronic periodontal probe with a constant force applier|
|US4794912||17 Ago 1987||3 Ene 1989||Welch Allyn, Inc.||Borescope or endoscope with fluid dynamic muscle|
|US4797924 *||25 Oct 1985||10 Ene 1989||Nartron Corporation||Vehicle voice recognition method and apparatus|
|US4799171 *||21 Nov 1983||17 Ene 1989||Kenner Parker Toys Inc.||Talk back doll|
|US4805219 *||3 Abr 1987||14 Feb 1989||Dragon Systems, Inc.||Method for speech recognition|
|US4807273||6 Oct 1987||21 Feb 1989||Joerg Haendle||Voice controlled x-ray diagnostics installation|
|US4815006||16 Sep 1987||21 Mar 1989||Asea Aktiebolag||Method and device for calibrating a sensor on an industrial robot|
|US4815450||1 Feb 1988||28 Mar 1989||Patel Jayendra I||Endoscope having variable flexibility|
|US4817050||21 Nov 1986||28 Mar 1989||Kabushiki Kaisha Toshiba||Database system|
|US4837734||26 Feb 1987||6 Jun 1989||Hitachi, Ltd.||Method and apparatus for master-slave manipulation supplemented by automatic control based on level of operator skill|
|US4852083||22 Jun 1987||25 Jul 1989||Texas Instruments Incorporated||Digital crossbar switch|
|US4853874||20 Nov 1987||1 Ago 1989||Hitachi, Ltd.||Master-slave manipulators with scaling|
|US4854301||12 Nov 1987||8 Ago 1989||Olympus Optical Co., Ltd.||Endoscope apparatus having a chair with a switch|
|US4860215||6 Abr 1987||22 Ago 1989||California Institute Of Technology||Method and apparatus for adaptive force and position control of manipulators|
|US4863133||26 May 1987||5 Sep 1989||Leonard Medical||Arm device for adjustable positioning of a medical instrument or the like|
|US4883400||24 Ago 1988||28 Nov 1989||Martin Marietta Energy Systems, Inc.||Dual arm master controller for a bilateral servo-manipulator|
|US4898253||30 May 1989||6 Feb 1990||Sartorius Gmbh||Electronic balance for dosing|
|US4903304 *||20 Oct 1988||20 Feb 1990||Siemens Aktiengesellschaft||Method and apparatus for the recognition of individually spoken words|
|US4930494||28 Dic 1988||5 Jun 1990||Olympus Optical Co., Ltd.||Apparatus for bending an insertion section of an endoscope using a shape memory alloy|
|US4945479||31 Jul 1985||31 Jul 1990||Unisys Corporation||Tightly coupled scientific processing system|
|US4949717||17 Mar 1988||21 Ago 1990||Shaw Edward L||Surgical instrument with suture cutter|
|US4954952||2 Oct 1989||4 Sep 1990||Trw Inc.||Robotic arm systems|
|US4965417||27 Mar 1989||23 Oct 1990||Massie Philip E||Foot-operated control|
|US4969709||11 Oct 1989||13 Nov 1990||Sumitomo Electric Industries, Ltd.||Mechanism for bending elongated body|
|US4969890||7 Jul 1988||13 Nov 1990||Nippon Zeon Co., Ltd.||Catheter|
|US4979933||1 Mar 1989||25 Dic 1990||Kraft, Inc.||Reclosable bag|
|US4979949||26 Abr 1988||25 Dic 1990||The Board Of Regents Of The University Of Washington||Robot-aided system for surgery|
|US4980626||10 Ago 1989||25 Dic 1990||The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration||Method and apparatus for positioning a robotic end effector|
|US4989253||15 Abr 1988||29 Ene 1991||The Montefiore Hospital Association Of Western Pennsylvania||Voice activated microscope|
|US4996975||1 Jun 1990||5 Mar 1991||Kabushiki Kaisha Toshiba||Electronic endoscope apparatus capable of warning lifetime of electronic scope|
|US5019968||29 Mar 1988||28 May 1991||Yulan Wang||Three-dimensional vector processor|
|US5020001||15 Sep 1989||28 May 1991||Toyoda Koki Kabushiki Kaisha||Robot controller|
|US5065741||9 Ene 1991||19 Nov 1991||Olympus Optical Co. Ltd.||Extracoporeal ultrasonic lithotripter with a variable focus|
|US5078140||23 Sep 1986||7 Ene 1992||Kwoh Yik S||Imaging device - aided robotic stereotaxis system|
|US5086401||11 May 1990||4 Feb 1992||International Business Machines Corporation||Image-directed robotic system for precise robotic surgery including redundant consistency checking|
|US5091656||27 Oct 1989||25 Feb 1992||Storz Instrument Company||Footswitch assembly with electrically engaged detents|
|US5097829||19 Mar 1990||24 Mar 1992||Tony Quisenberry||Temperature controlled cooling system|
|US5097839||13 Feb 1990||24 Mar 1992||Allen George S||Apparatus for imaging the anatomy|
|US5098426||6 Feb 1989||24 Mar 1992||Phoenix Laser Systems, Inc.||Method and apparatus for precision laser surgery|
|US5105367||16 Oct 1989||14 Abr 1992||Hitachi, Ltd.||Master slave manipulator system|
|US5109499||29 Ago 1988||28 Abr 1992||Hitachi, Ltd.||Vector multiprocessor system which individually indicates the data element stored in common vector register|
|US5123095||17 Ene 1989||16 Jun 1992||Ergo Computing, Inc.||Integrated scalar and vector processors with vector addressing by the scalar processor|
|US5131105||21 Nov 1990||21 Jul 1992||Diasonics, Inc.||Patient support table|
|US5142930||29 Mar 1991||1 Sep 1992||Allen George S||Interactive image-guided surgical system|
|US5145227||31 Dic 1990||8 Sep 1992||The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration||Electromagnetic attachment mechanism|
|US5166513||6 May 1991||24 Nov 1992||Coherent, Inc.||Dual actuation photoelectric foot switch|
|US5175694||8 Feb 1990||29 Dic 1992||The United States Of America As Represented By The Secretary Of The Navy||Centroid target tracking system utilizing parallel processing of digital data patterns|
|US5182641||17 Jun 1991||26 Ene 1993||The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration||Composite video and graphics display for camera viewing systems in robotics and teleoperation|
|US5184601||5 Ago 1991||9 Feb 1993||Putman John M||Endoscope stabilizer|
|US5187574||21 Ago 1991||16 Feb 1993||Kanda Tsushin Kogyo Co., Ltd.||Method for automatically adjusting field of view of television monitor system and apparatus for carrying out the same|
|US5196688||21 Feb 1978||23 Mar 1993||Telefunken Systemtechnik Gmbh||Apparatus for recognizing and following a target|
|US5201325||18 Sep 1991||13 Abr 1993||Andronic Devices Ltd.||Advanced surgical retractor|
|US5201743||5 May 1992||13 Abr 1993||Habley Medical Technology Corp.||Axially extendable endoscopic surgical instrument|
|US5217003||18 Mar 1991||8 Jun 1993||Wilk Peter J||Automated surgical system and apparatus|
|US5218969 *||17 Dic 1990||15 Jun 1993||Blood Line Technology, Inc.||Intelligent stethoscope|
|US5221283||15 May 1992||22 Jun 1993||General Electric Company||Apparatus and method for stereotactic surgery|
|US5228429||30 Nov 1992||20 Jul 1993||Tadashi Hatano||Position measuring device for endoscope|
|US5230023||30 Ene 1991||20 Jul 1993||Nec Corporation||Method and system for controlling an external machine by a voice command|
|US5230623||10 Dic 1991||27 Jul 1993||Radionics, Inc.||Operating pointer with interactive computergraphics|
|US5236432||24 Ago 1992||17 Ago 1993||Board Of Regents Of The University Of Washington||Robot-aided system for surgery|
|US5249121||27 Oct 1989||28 Sep 1993||American Cyanamid Company||Remote control console for surgical control system|
|US5251127||31 Jul 1990||5 Oct 1993||Faro Medical Technologies Inc.||Computer-aided surgery apparatus|
|US5257999||4 Jun 1992||2 Nov 1993||Slanetz Jr Charles A||Self-oriented laparoscopic needle holder for curved needles|
|US5271384||23 Ene 1992||21 Dic 1993||Mcewen James A||Powered surgical retractor|
|US5274862||18 May 1992||4 Ene 1994||Palmer Jr John M||Patient turning device and method for lateral traveling transfer system|
|US5279309||27 Jul 1992||18 Ene 1994||International Business Machines Corporation||Signaling device and method for monitoring positions in a surgical operation|
|US5282806||21 Ago 1992||1 Feb 1994||Habley Medical Technology Corporation||Endoscopic surgical instrument having a removable, rotatable, end effector assembly|
|US5289273||5 Nov 1992||22 Feb 1994||Semborg-Recrob, Corp.||Animated character system with real-time control|
|US5289365||23 Dic 1991||22 Feb 1994||Donnelly Corporation||Modular network control system|
|US5299288||18 Sep 1991||29 Mar 1994||International Business Machines Corporation||Image-directed robotic system for precise robotic surgery including redundant consistency checking|
|US5300926||2 May 1991||5 Abr 1994||Siemens Aktiengesellschaft||Medical apparatus, having a single actuating device|
|US5303148||30 Oct 1990||12 Abr 1994||Picker International, Inc.||Voice actuated volume image controller and display controller|
|US5303882||22 Feb 1993||19 Abr 1994||The United States Of America As Represented By The Secretary Of The Navy||Corner vortex suppressor|
|US5410638 *||3 May 1993||25 Abr 1995||Northwestern University||System for positioning a medical instrument within a biotic structure using a micromanipulator|
|US5417210 *||27 May 1992||23 May 1995||International Business Machines Corporation||System and method for augmentation of endoscopic surgery|
|US5622730 *||20 Oct 1995||22 Abr 1997||Toshiba Kikai Kabushiki Kaisha||Heat-displacing T-die|
|US5695500 *||6 Abr 1994||9 Dic 1997||International Business Machines Corporation||System for manipulating movement of a surgical instrument with computer controlled brake|
|US5707942 *||15 Jul 1996||13 Ene 1998||Tonen Corporation||Lubricating oil composition|
|US5758021 *||10 Sep 1992||26 May 1998||Alcatel N.V.||Speech recognition combining dynamic programming and neural network techniques|
|US5950629 *||28 Abr 1994||14 Sep 1999||International Business Machines Corporation||System for assisting a surgeon during surgery|
|US5976156 *||2 Nov 1993||2 Nov 1999||International Business Machines Corporation||Stereotaxic apparatus and method for moving an end effector|
|US5995930 *||19 Nov 1996||30 Nov 1999||U.S. Philips Corporation||Method and apparatus for recognizing spoken words in a speech signal by organizing the vocabulary in the form of a tree|
|US6463361 *||22 Sep 1994||8 Oct 2002||Computer Motion, Inc.||Speech interface for an automated endoscopic system|
|US6850817 *||29 Jun 2000||1 Feb 2005||Sri International||Surgical system|
|WO1995001757A1 *||5 Jul 1994||19 Ene 1995||Cornelius Borst||Robotic system for close inspection and remote treatment of moving parts|
|1||Abstract of a presentation "3-D Vision Technology Applied to Advanced Minimally Invasive Surgery Systems" given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992 (1 page total).|
|2||Abstract of a presentation "A Pneumatic Controlled Sewing Device for Endoscopic Application the MIS Sewing Instrument MSI" given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992 (1 page total).|
|3||Abstract of a presentation "Concept and Experimental Application of a Surgical Robot System and Steerable MIS Instrument SMI" given at the 3<SUP>rd </SUP>World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-29, 1992 (1 page total).|
|4||Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux (Jun. 18-20, 1992), entitled "Session 15/2" (1 page total).|
|5||Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux (Jun. 18-20, 1992), entitled "Session 15/4" (1 page total).|
|6||Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux (Jun. 18-20, 1992), entitled "Session 15/5" (1 page total).|
|7||Abstract of a presentation given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992, entitled "Session 15/1" (1 page total).|
|8||*||Advantage of computer aided teleoperation (CAT) in microsurgery Guerrouad, A.; Vidal, P.; Advanced Robotics, 1991. 'Robots in Unstructured Environments', 91 ICAR., Fifth International Conference on Jun. 19-22, 1991 pp. 910-914 vol. 1 Digital Object Identifier 10.1109/ICAR.1991.240557.|
|9||Alexander, "A Survey Study of Teleoperators, Robotics, and Remote Systems Technology", Remotely Manned Systems-Exploration and Operation in Space, California Institute of Technology 1973.|
|10||Alexander, "Impacts of Telemation on Modern Society", On the Theory and Practice of Robots and Manipulators vol. II, 1974.|
|11||*||Automatic analysis of weariness during a micromanipulation task by SMOSGuerrouad, A.; Jolly, D.; Engineering in Medicine and Biology Society, 1989. Images of the Twenty-First Century. Proceedings of the Annual International Conference of the IEEE Engineering in Nov. 9-12, 1989 pp. 906-907 vol. 3 Digital Object Identifier 10.1109/IEMBS.1989.96.|
|12||Bejczy, "Controlling Remote Manipulators through Kinesthetic Coupling," Computers in Mechanical Engineering 1983, pp. 48-60.|
|13||Besant et al., Abstract of a presentation "Camera Control for Laparoscopic Surgery by Speech-Recognizing Robot: Constant Attention and Better Use of Personnel," given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992 (1 page total).|
|14||Charles et al., "Design of a Surgeon-Machine Interface for Teleoperated Microsurgery," IEEE 1989 (3 pages total).|
|15||Colgate, "Power and Impedance Scaling in Bilateral Manipulation," IEEE, 1991, pp. 2292-2297.|
|16||Corcoran, "Robots for the Operating Room," The New York Times, Sunday Jul. 19, 1992, Section 3, p. 9, col. 1 (2 pages total).|
|17||Das et al., "Kinematic Control and Visual Display of Redundant Teleoperators," IEEE 1989 pp. 1072-1077.|
|18||Dolan et al., "A Robot in an Operating Room: A Bull in a China Shop," IEEE, 1987, pp. 1096-1097.|
|19||Fu et al., "Robotics: Control, Sensing, Vision and Intelligence", Table of Contents, McGraw-Hill Book Company, 1987.|
|20||Gayed et al., "An Advanced Control Micromanipulator for Surgical Applications," Systems Science vol. 13, 1987, pp. 23-24.|
|21||Green et al., Abstract of a presentation "Telepresence: Advanced Teleoperator Technology for Minimally Invasive Surgery," given at "Medicine meets virtual reality" symposium in San Diego, Jun. 4-7, 1992 (20 pages total).|
|22||Green et al., Abstract of a presentation "Telepresence: Advanced Teleoperator Technology for Minimally Invasive Surgery," given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992 (2 pages total).|
|23||Green, Statutory Declaration of Dr. Philip S. Green, presenter of the video entitled "Telepresence Surgery-The Future of Minimally Invasive Medicine" (32 page total).|
|24||Guerrouad et al., "S.M.O.S.: Stereotaxical Microtelemanipulator for Ocular Surgery," IEEE, 1989, pp. 879-880.|
|25||Guerrouad, "Voice Control in the Surgery Room," IEEE Engineering in Medicine & Biology Society 11th Annual International Conference 1989 (2 pages total).|
|26||Inoue et al., "Six-axis Bilateral Control of an Articulated Slave Manipulator Using a Cartesian Master Manipulator," Advanced Robotics, 4, No. 2, 1990, pp. 139-150.|
|27||Kazerooni, "Human/Robot Interaction via the Transfer of Power and Information Signals-Part I: Dynamics and Control Analysis," IEEE, 1989, pp. 1632-1640.|
|28||Kazerooni, "Human/Robot Interaction via the Transfer of Power and Information Signals-Part II: An Experimental Analysis," IEEE, 1989, pp. 1641-1647.|
|29||Krishnan et al., Abstract of a presentation "Design Considerations of a New Generation Endoscope Using Robotics and Computer Vision Technology," given at the 3rd World Congress of Endoscopic Surgery in Bordeaux, Jun. 18-20, 1992 (1 page total).|
|30||Lavallee, "A New System for Computer Assisted Neurosurgery," IEEE, 1989, vol. 11, pp. 926-927.|
|31||Mair, Industrial Robotics, Prentice Hall, 1988, pp. 41-43, 49-50, 54, 203-209.|
|32||Majima et al., "On a Micro-Manipulator for Medical Application-Stability Consideration of its Bilateral Controller," Mechatronics, 1991, pp. 293-309.|
|33||Nasa, "Anthropomorphic Remote Manipulator", NASA Tech Briefs, 1991 (1 page total).|
|34||Preising et al., "A Literature Review: Robots in Medicine," IEEE, Jun. 1991, pp. 13-22 & 71.|
|35||Rasor et al., "Endocorporeal Surgery Using Remote Manipulators", Remotely Manned Systems-Exploration and Operation in Space, California Institute of Technology 1973.|
|36||Sabatini et al., "Force Feedback-Based Telemicromanipulation for Robot Surgery on Soft Tissues," IEEE, 1989, pp. 890-891.|
|37||*||SMOS: stereotaxical microtelemanipulator for ocular surgery Guerrouad, A.; Vidal, P.; Engineering in Medicine and Biology Society, 1989. Images of the Twenty-First Century. Proceedings of the Annual International Conference of the IEEE Engineering in Nov. 9-12, 1989 pp. 879-880 vol. 3 Digital Object Identifier 10.1109/IEMBS.1989.96028.|
|38||Stryker Endoscopy, "Sidne", Operating and Maintenance Manual, 33 pages total.|
|39||Taubes, "Surgery in Cyberspace," Discover Magazine, Dec. 1994, pp. 85-92.|
|40||Taylor et al., "Taming the Bull: Safety in a Precise Surgical Robot," IEEE, 1991, pp. 865-871.|
|41||Tejima, "A New Microsurgical Robot System for Corneal Transplantation," Precision Machinery, 1988 vol. 2, pp. 1-9.|
|42||Tendick et al., "Analysis of the Surgeon's Grasp for Telerobotic Surgical Manipulation," IEEE, 1989, pp. 914-915.|
|43||Thring, "Robots and Telechirs: Manipulator with Memory: Remote Manipulators: Machine Limbs for the Handicapped," Wiley & Sons, 1983 (26 pages total).|
|44||Transcript of a video presented by SRI at the 3rd World Congress of Endoscopic Surgery in Bordeaux on Jun. 18-20, 1992, in Washington on Apr. 9, 1992, and in San Diego, CA on Jun. 4-7, 1992 entitled "Telepresence Surgery-The Future of Minimally Invasive Medicine" (3 pages total).|
|45||Trevelyan et al., "Motion Control for a Sheep Shearing Robot," Proceedings of the 1st International Symposium on Robotics Research, MIT, Cambridge, Massachusetts, USA, 1983, pp. 175.|
|46||Vertut, Jean and Coeffet, Philippe Coiffet; "Robot Technology; vol. 3A Teleoperation and Robotics Evolution and Development"; 1986; Prentice-Hall, Inc; Englewood Cliffs, N.J.|
|47||Vibet, "Properties of Master-Slave Robots," Motor-con, 1987, pp. 309-314.|
|48||*||Voice control in the surgery room Guerrouad, A.; Engineering in Medicine and Biology Society, 1989. Images of the Twenty-First Century. Proceedings of the Annual International Conference of the IEEE Engineering in Nov. 9-12, 1989 pp. 904-905 vol. 3 Digital Object Identifier 10.1109/IEMBS.1989.96040.|
|49||Wilson et al., "Filmless PACS in a multiple facility environment," Proceedings of the Spie, Spie, Bellingham, VA, US vol. 2711, pp. 500-509 (XP002082137).|
|50||Wolf et al., "Student Reference Manual for Electronic Instrumentation Laboratories," Prentice Hall, New Jersey 1990, pp. 498 and 499.|
|Patente citante||Fecha de presentación||Fecha de publicación||Solicitante||Título|
|US7848498 *||8 Dic 2005||7 Dic 2010||Siemens Aktiengesellschaft||Operating method for a support facility for a medical engineering system and objects corresponding herewith|
|US8002694 *||25 Ene 2008||23 Ago 2011||Hitachi, Ltd.||Master-slave manipulator system|
|US8543240 *||21 Sep 2010||24 Sep 2013||Intuitive Surgical Operations, Inc.||Master finger tracking device and method of use in a minimally invasive surgical system|
|US8725525 *||13 Abr 2005||13 May 2014||Olympus Corporation||Endoscope system|
|US8831782||15 Jul 2013||9 Sep 2014||Intuitive Surgical Operations, Inc.||Patient-side surgeon interface for a teleoperated surgical instrument|
|US8935003||21 Sep 2010||13 Ene 2015||Intuitive Surgical Operations||Method and system for hand presence detection in a minimally invasive surgical system|
|US8996173||21 Sep 2010||31 Mar 2015||Intuitive Surgical Operations, Inc.||Method and apparatus for hand gesture control in a minimally invasive surgical system|
|US9060674||11 Oct 2012||23 Jun 2015||Karl Storz Imaging, Inc.||Auto zoom for video camera|
|US9486189||19 Sep 2012||8 Nov 2016||Hitachi Aloka Medical, Ltd.||Assembly for use with surgery system|
|US9498291||15 Mar 2013||22 Nov 2016||Hansen Medical, Inc.||Touch-free catheter user interface controller|
|US9687140||19 Jun 2015||27 Jun 2017||Karl Storz Imaging, Inc.||Auto zoom for video camera|
|US9743989||24 Nov 2014||29 Ago 2017||Intuitive Surgical Operations, Inc.||Method and system for hand presence detection in a minimally invasive surgical system|
|US20050228294 *||13 Abr 2005||13 Oct 2005||Olympus Corporation||Endoscope system|
|US20060139136 *||8 Dic 2005||29 Jun 2006||Joachim Hornegger||Operating method for a support facility for a medical engineering system and objects corresponding herewith|
|US20080234866 *||25 Ene 2008||25 Sep 2008||Kosuke Kishi||Master-slave manipulator system|
|US20110118753 *||21 Sep 2010||19 May 2011||Brandon Itkowitz||Master finger tracking device and method of use in a minimally invasive surgical system|
|US20150058031 *||27 Jul 2014||26 Feb 2015||Kyle Samani||Methods and systems for a medical checklist|
|Clasificación de EE.UU.||706/14, 704/200, 704/E15.045|
|Clasificación internacional||G06F19/00, G06F15/00, G10L11/00, A61B17/00, A61B19/00, G10L15/26, G06F15/18|
|Clasificación cooperativa||A61B1/00149, A61B1/0016, A61B1/00041, A61B34/70, G10L15/26, A61B34/10, G06F19/3406, A61B2017/00203|
|Clasificación europea||G06F19/34A, A61B19/22, G10L15/26A|
|18 Nov 2004||AS||Assignment|
Owner name: INTUITIVE SURGICAL, INC., DELAWARE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:COMPUTER MOTION, INC.;REEL/FRAME:015384/0491
Effective date: 20041115
|19 Dic 2011||FPAY||Fee payment|
Year of fee payment: 4
|24 Dic 2015||FPAY||Fee payment|
Year of fee payment: 8
|27 Jun 2017||AS||Assignment|
Owner name: INTUITIVE SURGICAL OPERATIONS, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTUITIVE SURGICAL, INC.;REEL/FRAME:043016/0543
Effective date: 20100219