US20060220784A1 - General purpose distributed operating room control system - Google Patents

General purpose distributed operating room control system Download PDF

Info

Publication number
US20060220784A1
US20060220784A1 US11/443,797 US44379706A US2006220784A1 US 20060220784 A1 US20060220784 A1 US 20060220784A1 US 44379706 A US44379706 A US 44379706A US 2006220784 A1 US2006220784 A1 US 2006220784A1
Authority
US
United States
Prior art keywords
master
devices
control
master controller
slave
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/443,797
Inventor
Yulun Wang
Charles Jordan
Darrin Uecker
Chares Wooters
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intuitive Surgical Inc
Original Assignee
Intuitive Surgical Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/310,665 external-priority patent/US6463361B1/en
Priority claimed from US08/693,352 external-priority patent/US6646541B1/en
Application filed by Intuitive Surgical Inc filed Critical Intuitive Surgical Inc
Priority to US11/443,797 priority Critical patent/US20060220784A1/en
Publication of US20060220784A1 publication Critical patent/US20060220784A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70Manipulators specially adapted for use in surgery
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/40ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management of medical equipment or devices, e.g. scheduling maintenance or upgrades
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16ZINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
    • G16Z99/00Subject matter not provided for in other main groups of this subclass
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00017Electrical control of surgical instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00017Electrical control of surgical instruments
    • A61B2017/00203Electrical control of surgical instruments with speech control or speech recognition
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/23Pc programming
    • G05B2219/23386Voice, vocal command or message

Definitions

  • the present invention generally relates to control systems. More particularly, the present invention relates to a control system and apparatus that allows multiple surgical devices to be controlled from one or more input devices. Even more particularly, the present invention provides a run-time configurable control system allowing operating room component connectivity and control.
  • Each instrument has a unique control interface for its operation. Therefore, the surgeon must independently operate each device. For example, the surgeon must utilize a foot pedal to control the electrocautery device, a separate foot pedal to operate the robotic arm, and yet another interface to operate the laser.
  • control system for selecting from and controlling a plurality of devices in an operating room, the control system comprising:
  • the master controller comprising:
  • each selection command is associated with one specific device in electrical communication with the master controller
  • a master controller for selecting and controlling a plurality of devices.
  • Each of the plurality of devices to be controlled are in electrical communication or in wireless communication with the master controller, either directly or via a slave controller which will be discussed in more detail hereinbelow with respect to the second aspect of the present invention.
  • the master controller includes means for receiving selection commands issued by a user.
  • the selection commands available to the user are based upon the devices in electrical communication with the master controller.
  • the master controller may recognize those devices that are in electrical communication therewith upon startup of the master controller. This will be described in detail in the description of the preferred embodiment.
  • Each device in electrical communication with the master controller is represented by a correspondingly available selection command.
  • the master controller additionally includes means for receiving control commands from the user. Both the means for receiving selection commands and the means for receiving control commands from a user may be included in a voice control interface (VCI) for receiving voice commands.
  • VCI voice control interface
  • the system may additionally employ a foot pedal, a hand held device, or some other device which receives selection or control commands or inputs indicative of such commands from a user.
  • the VCI provides signals indicative of a user's selection of a specific device and signals indicative of control commands the user wishes to supply to the device specified by a specific selection command. These are known, respectively, as selection signals and control signals. If the user is using a foot pedal, hand controller or some other input device, the VCI is not utilized as the inputs are already in the form of electrical signals as opposed to voice input. Alternatively, a combination of devices may be used to receive selection and control commands and to provide selection and control signals indicative of such commands.
  • the master controller additionally includes means for routing control signals to a device specified by a selection command. For example, if the user wants to operate the laser, a device used in many surgeries and contemplated as being included as one of the devices that may be operated via the control system of the present invention, then the user may issue a selection command indicating such, i.e. speak the word “laser” or the words “select laser”. As such, the name of the device may serve as the selection command, or the selection command may be the combination of two or more words.
  • the master controller then routes control commands, or control signals for a selected device indicative of control commands received from the user to the device specified by the preceding selection command.
  • control signals would be routed to the laser.
  • a controller may include means for ensuring that control signals indicative of control commands issued subsequent to the receipt of a selection command are, in fact, valid control signals. This is accomplished via a database of valid control commands and grammars that are either prestored in the master, or are prestored in a slave prior to or at system startup which is described hereinbelow.
  • a second aspect of the present invention is at least one slave electrically connected to the master controller.
  • Each slave controller connected to the master controller operates similarly to the master controller for specific devices electrically connected thereto; additionally, the slave controllers may receive control commands directly from the user if they are to be used as a stand alone unit. However, if they are utilized as slaves then control commands are received at the master controller and converted into control signals and transmitted from the master controller to the slave controller that has the device specified by the last selection command received by the master controller connected thereto. This allows the control system of the present invention to operate with a plurality of different devices without the master controller requiring any knowledge of the devices connected to the slave controllers prior to startup of the control system.
  • the slave controllers are connected to the master controller just like any other device; however, each slave controller provides the master controller information relating to the specific devices that are connected thereto, so the master controller, generally at startup, is provided information as to exactly what devices are connected to the system.
  • the selection commands available to the user include all devices connected to each of the slave controllers as well as the devices directly connected to the master controller.
  • various devices may be controlled from a single controller, or a plurality of controllers, such that a doctor utilizing the control system will not have to switch between different control systems or interfaces, or at a minimum will have an easier interface to control each of the devices.
  • the main means for selecting and controlling each of the devices will be a voice recognition system which will be described in detail hereinbelow.
  • control system may include audio and video outputs which are capable of alerting the user to errors in selecting, or controlling specific devices.
  • the audio and video outputs may additionally be used to alert the user to problems with each of the specific devices as well as to provide status notices as to which device(s) are available, which devices are active, as well as a host of other device operation information which will be discussed further hereinbelow.
  • FIG. 1 is a block diagram of a master controller in electrical communication with both slave controllers and operating room devices in accordance with the present invention
  • FIG. 2 is a block diagram of the voice control interface in accordance with the present invention.
  • FIG. 3 is a schematic of the voice control interface card in accordance with the present invention.
  • FIG. 4 is a schematic diagram of a master controller in accordance with a the present invention.
  • FIG. 5 is an exemplary tree diagram of a grammar for operating a device in accordance with the present invention.
  • FIG. 1 an operating room control system, generally at 10 , in accordance with the present invention.
  • the operating room control system, or control system 10 generally comprises a master controller 12 , which is preferably attached to at least one slave controller 14 .
  • the exemplary preferred embodiment is shown as having both a master controller 12 and at least one slave controller 14 in electrical communication therewith, the control system 10 may be implemented with only a master controller 12 as will be described hereinbelow.
  • the master controller 12 is electrically connected to and in electrical communication with a plurality of devices 16 via a plurality of communication ports 46 .
  • the master controller 12 may be connected to any slave or specific medical device via wireless communications systems such as IR or RF signal transmitters and receivers on each of the master 12 , slaves 14 , and devices 16 .
  • Some of these devices 16 may be at least one slave controller 14 the operation of which will be described hereinbelow.
  • Other devices that are intended to be electrically connected to the master controller 12 , either directly or via the at least one slave controller 14 include devices that are commonly found in an operating room environment.
  • an electrocautery device 18 directly connected to the master controller 12 in FIG. 1 is an electrocautery device 18 .
  • a robotic arm 20 for holding and manipulating an endoscope such as that produced by Computer Motion of Goleta, Calif. and marketed under the tradename AESOP is electrically connected with the master controller 12 via one of the at least one slave controllers 14 .
  • Also in electrical communication with the master controller 12 via a slave controller is an operating room table 22 , an insufflator 24 , and an operating room lighting system 26 . It is envisioned that any electrically controlled device utilized in an operating room environment may be attached to the master controller 12 either directly or via one of the at least one slave controllers 14 .
  • the master controller 12 is configured to provide a main user interface for each of the devices electrically connected thereto. As such, a doctor can manipulate the operating room environment in a simpler and more direct fashion.
  • each device in an operating room includes a separate interface. The proximity of the doctor to each interface requires a substantial amount of movement either on the part of the doctor or a nurse to effectuate changes required by the doctor during a medical procedure.
  • the master controller 12 generally comprises a voice control interface (VCI) 32 .
  • VCI 32 includes means 28 for receiving selection commands from a user wherein each selection command is associated with one specific device in electrical communication with the master controller 12 . This is accomplished by providing the master controller 12 a list of the devices that are in electrical communication therewith upon start-up of the control system 10 . The process and hardware for providing the master controller 12 with such a list will be described hereinbelow.
  • the VCI 32 additionally comprises means 30 for receiving control commands from a user.
  • both the means 28 for receiving selection commands and the means 30 for receiving control commands may coexist in the VCI 32 as a microphone 34 , for receiving the actual speech of the user, an analog to digital converter 36 for converting the analog speech into a digital representation thereof, a feature extractor 38 for converting the digital representation to a digital representation that is suited for decoding, and a decoder 40 for comparing the features of the transformed digital representation of the speech to a set of presaved user-models 41 to determine whether the speech received at the microphone 34 was a selection command, a control command, or some other speech to be ignored by the master controller 12 .
  • Such “other speech” would include extraneous noise, speech between the doctor and another person in the operating suite, as well as speech of other people in the operating suite in general.
  • Feature extractors such as the one employed in the present invention, are well known in the art of voice recognition.
  • Feature vectors are preferably generated by the feature extractor 38 utilizing techniques such as Mel-Cepstrum, or linear prediction. It is to be appreciated that such techniques are well-known and are employed in the feature extractor 38 to develop feature vectors that represent speech received by the VCI 32 .
  • voice software is also available that provides extractors and decoders such as the ones set out in the present application.
  • voice recognition it may be carried out by the inclusion of a pre-made voice recognition system that is purchased from a vendor such as Creative labs under the tradename VOICE BLASTER, Dragon Dictate produced by Dragon Systems, or VOICE PAD produced by Kurzweil AI of Massachusetts, each of these companies produce front-end voice recognition systems.
  • the decoder 40 utilizes the information produced by the feature extractor 38 , by matching the stored user models 41 to the output of the feature extractor 38 utilizing a well-known method, such as a Hidden Markov Modeling.
  • a well-known method such as a Hidden Markov Modeling.
  • One Hidden Markov Model (HMM) is created for each phoneme.
  • the HMMs are trained to identify their respective phonemes given the Mel-Cepstrum output from the feature extractor 38 .
  • Hidden Markov Models for voice recognition is generally well known.
  • the stored user models 41 used by the decoder 40 may be placed in a memory 44 associated with the VCI itself. As depicted in FIG. 3 , such a memory 44 may be incorporated onto a VCI board 46 as an EPROM, a PROM or some other programmable memory storage device. However, it is preferable to store the models on a transportable memory device 45 , such as a disk, transportable storage medium or the like. It is even more preferable that the transportable memory device be a PCMCIA format card 48 as data transfer times are reduced and the ruggedness of the system is increased. PCMCIA format cards retain data better than floppy disks.
  • PCMCIA form factor card is preferable in the control system 10 of the present invention.
  • FIG. 3 depicts, in more detail, the VCI 32 .
  • the feature extractor 38 functions as set out hereinabove.
  • the feature extractor 38 converts the igitized signal into a representation that is suitable for decoding (e.g. Mel-Cepstrum).
  • This representation is then passed to the decoder 40 which compares the representations produced at the feature extractor 38 to the models stored on a memory 44 which contains the user models 41 .
  • the memory 44 may be supplied the models 41 via a downloading process from the transportable memory device 45 .
  • the models stored in the memory 44 constitute a lexicon, which is the entire set of valid pronunciations, or all of the valid words that the master 12 is to recognize. Because the lexicon is stored on a transportable data storage medium 41 , the lexicon may be added to or subtracted from depending upon the devices that are to be connected to the master controller 12 . In this fashion, if new equipment is purchased at a date subsequent to the purchase of the master controller 12 , then new words may be added to the lexicon through a well-known data acquisition technique, wherein the user speaks the words that are to be added to the lexicon and they are used to update the user models 41 on the transportable memory 45 .
  • the master controller 12 there is provided one master controller 12 and at least one slave 14 controller.
  • the master controller or master 12 receives a selection command, all speech received at the VCI 32 of the master 12 that is not a new selection command is fed to the feature extractor of the appropriately attached slave 14 .
  • the feature extractor of the appropriately attached slave 14 In this way, a plurality of devices may be attached to several different controllers and the lexicon stored in each controller does not have to be downloaded into the master 12 .
  • the master 12 only contains the lexicon of all the devices that may be connected to the system 10 as well as the lexicon for the commands of those devices that are directly attached to the master 12 as opposed to being attached to a slave 14 which is, in turn, attached to the master 12 .
  • All the other controllers which for purposes herein, are referred to as slaves 14 , include the lexicon for the devices that are directly connected thereto.
  • one slave includes the lexicon for the control commands and the select commands for a robotic arm and an operating table. This way, that controller can have a microphone plugged into the VCI which is included in the unit and it may serve as a solo unit. Or, depending upon the configuration of the control system 10 , it may actually server as a master.
  • the entire system 10 is configurable at startup and as such is expandable. Every controller preferably includes a VCI.
  • the decoder 40 additionally contains a language model. This term is well-known on the art and will be explained further hereinbelow. In essence, certain words may be validly said in certain orders.
  • the language model is implemented by developing a network representing all the valid possibilities of word combinations and decoding the extracted vectors along each path in the network. Whichever path has the highest probability of matching the incoming speech, the information associated with that path is selected by the decoder 40 . It is to additionally be appreciated that to carry out the present invention, a silence path is available and an unrecognized command path is provided as well. As such, even though a user speaks, if valid commands are not given, the system 10 will not respond.
  • FIG. 5 sets out one exemplary language model for the proper operation of the robotic arm 20 .
  • Such language models are developed for each device in electrical communication with the master controller 12 .
  • a device may be in wireless communication with the master controller 12 . It is preferable to store the language models for each device in their respective controller. For example, if a device is directly connected to a slave 14 then the control language model (that language model containing the language used to control the device) for the device is stored in the slave VCI. If the device is directly connected to the master 12 then the control language model is included in the VCI of the master 12 . It is to be appreciated that the select language model must be stored in the master 12 for all the possible devices that may be directly connected to the master 12 as opposed to being connected to a slave.
  • a user may select from any of the connected devices. If a device is not connected, the system will recognize this upon startup and will not attempt to access the device as it is not there. This will be discussed in more detail hereinbelow.
  • a device is connected directly to the master controller 12 , then it is preferable to store the language model for controlling the device either in the VCI itself, or in the transportable memory 45 .
  • the advantages of this configuration are set out hereinbelow with respect to the startup of the control system 10 .
  • the information is passed to the decoder in the master 12 and the decoder 40 generates a packet 52 of information.
  • the packet includes the address of the device to be operated, a code representing the specific operation, and a checksum to ensure that as the packet 52 is transferred over various busses, the data does not become corrupted.
  • Such information packaging is well-known although the specific package set out hereinabove has heretofore not been utilized to control one of a plurality of medical devices. Data checking using a checksum is also well-known in the art.
  • the decoder 40 upon decoding a valid selection command, activates the address of the device which has been stored in a lookup table and is related to the device. This is accomplished as follows. At startup every controller, whether the master 12 or a slave 14 knows the addresses of its communication ports. It sends a query to each communication port to see if a device is connected thereto. If so, an adapter connected to the device specifies the name of the device and an indication that it is functioning properly. Such adapters are well known in the electrical arts and as such will not be further discussed herein. Every slave controller establishes a lookup table of addresses and associated device codes or names. The device codes or names are transmitted to the master 12 which includes all the devices and the corresponding address of the port to which the associated slave controller is connected to the master 12 .
  • the addresses of all devices available are initially stored in a memory associated with the VCI such that a multiplexer may be used to activate a specific address or make that address accessible.
  • the master 12 receives a valid selection command, which it is able to identify, it then routes all the control commands to the VCI of the appropriate slave controller in the case where the device selected is connected to a slave controller. If the selected device is connected directly to the master 12 then the control commands are fed through the decoder 40 of the master 12 and the control information packet is produced and sent to the device via the central processor 44 of the master 12 .
  • the VCI of a slave is fed control signals and processes those signals as though they were received from the A/D converter, which is where the input to the slave is routed. Every slave can be attached to one master, and that master, can, in turn be attached to another master, thus providing a daisychain of slaves all of which are connected to one master having a microphone attached thereto.
  • the master controller 12 comprises means 42 for routing control signals to a device specified by a selection command received at the VCI 32 .
  • FIG. 4 depicts the master controller 12 having one slave controller 14 and two medical devices in electrical communication therewith.
  • the master controller includes the VCI 32 as well as the means 42 for routing control signals.
  • the means 42 for routing control signals is incorporated into the central processor 44 of the master controller 12 .
  • the means 42 for routing is essentially an addressable multiplexer and has a memory of the addresses for each device and their associated one of the plurality of communication ports 46 to which they are connected. If the addresses are stored in the decoder 40 , then the central processor 44 will be in communication with that memory.
  • the means 42 for routing takes the packet 50 of information or the control signal, if the information is to be sent to a slave 14 , checks which of the plurality of communication ports 46 it is to direct the information to and then directs the information to the desired one of the plurality 46 of ports.
  • the addresses and their associated ports are uploaded into the master 12 upon startup of the system. This procedure is embedded in the software and such a procedure is well-known in the art.
  • an electrocautery device 18 transmits an address to the master controller 12 .
  • the address is received at a one of a plurality of communication ports 46 , the address is saved in the memory along with the associated communication port number.
  • the valid selection commands are stored on the transportable memory.
  • the language model may be stored in a memory in the master 12 or in the transportable memory.
  • Language models are stored in associated slaves for devices that are directly connected to a slave 14 . In this fashion, upon startup, the master 12 knows all devices that are connected to the system, as each slave sends to the master the addresses of each device and the name (i.e. coded phonemes that constitute the device) of the device.
  • the names of the devices are uploaded into the master so that the validity of selection commands may take place in the master 12 .
  • language models for the validity of control commands are not transmitted to the master 12 as this would take much time and slow the control system 10 down. Therefore, the master controller 12 actually contains a subset of the grammar necessary to operate the devices in connection therewith, but that language model is limited to only the device names.
  • the information regarding valid sequences of control commands i.e. their control language model
  • the language model is stored at the master 12 as described hereinabove.
  • the control system 10 in accordance with the present invention provides a way to configure and reconfigure an operating room in a very simple fashion. Additionally, it is to be appreciated that the system 10 provides an intuitive interface whereby a user can select a device to control and then subsequently control that device. The system checks to ensure that control commands received for a specific device are valid.
  • the system 10 requires the inclusion of adapters 52 placed intermediate a specific one of the plurality of devices 16 and a slave or the master 12 .
  • the adapters 52 transmit signals to their respective slave 14 or master 12 indicative of the address of the device, and translate control signals sent from the controller to which they are connected to signals understood by the particular device for which they are intended.
  • Such adapters are easily constructed and are well-known in the art. Additionally, such adapters may be included either in the respective slave 14 or master 12 or attached to the particular one of the plurality of devices 16 itself.
  • PCMCIA format card such as the card that stores the user voice models.
  • the card may be inserted into the same interface, however, system software may be uploaded into the master to make the upgrade without having to disassemble the master. This is accomplished by incorporating a serial interface on the PCMCIA format card.
  • the central processor 44 additionally checks upon startup whether there is a system upgrade to be made by checking the data being supplied by the PCMCIA format card. Checking the activity of a serial interface is well known, however it is not heretofore known to incorporate a serial interface on a single PCMCIA format card. Therefore, the combination is seen to be novel. Additionally, it is heretofore not known to incorporate voice models on such a PCMCIA format card.
  • Each of the at least one slave 14 is substantially similar to the master controller 12 .
  • each of the plurality of slaves 14 may include the full VCI so that each slave 14 can operate as a master.
  • the slaves may not include the feature extractor, and only contain a subset of the language model (i.e. control commands) relating to the operation of each specific device. This is all that may be necessary in the slave because the slave receives from the master controller the specific address a command is to be sent and that it is in fact a command. Therefore, the slave only needs to check to ensure that it is a valid command for the specific device. In this fashion, devices may be directly connected to the master, or they may be connected to a slave which is in communication with the master 12 .
  • the system 10 may include output means including a video monitor 86 and a speaker 88 .
  • the speaker may be incorporated into the VCI 32 via a D/A converter 90 such that the system may communicate to the user any errors committed by the user in operating or selecting a specific device.
  • the output means may communicate system errors or the malfunction of a specific device. Such information is included in each specific adapter and is specific to the device attached to the adapter. It is to be appreciated that such communications would be transmitted to the master where they would be either auditorially or visually displayed.
  • the system and controller in accordance with the invention may additionally include a foot controller, a hand controller or other well-known controllers.
  • Each of these controllers may be used to control any of the devices connected to the master or a slave, as is described in the patent application incorporated herein by reference.
  • the VCI may only be used to select certain devices, and once selected the device may be controlled via one of the well-known controllers.
  • the flexibility of such a system can reduce costs and increase the safety of surgical procedures.

Abstract

The present invention pertains to control systems and provides a run time configurable control system for selecting and operating one of a plurality of operating room devices from a single input source, the system comprising a master controller having a voice control interface and means for routing control signals. The system additionally may include a plurality of slave controllers to provide expandability of the system. Also, the system includes output means for generating messages to the user relating to the status of the control system in general and to the status of devices connected thereto.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This is a continuation patent application which claims priority from U.S. patent application Ser. No. 08/693,352 filed Aug. 6, 1996, the full disclosure of which is incorporated herein by reference.
  • STATEMENT AS TO RIGHTS TO INVENTIONS MADE UNDER FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT
  • Not Applicable
  • REFERENCE TO A “SEQUENCE LISTING,” A TABLE, OR A COMPUTER PROGRAM LISTING APPENDIX SUBMITTED ON A COMPACT DISK
  • Not Applicable
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention generally relates to control systems. More particularly, the present invention relates to a control system and apparatus that allows multiple surgical devices to be controlled from one or more input devices. Even more particularly, the present invention provides a run-time configurable control system allowing operating room component connectivity and control.
  • 2. Description of Related Art
  • Many surgical procedures are performed with multiple instruments. For example, some laproscopic procedures are performed utilizing a robotic arm system produced by Computer Motion, Inc. of Goleta, Calif. to hold and move an endoscope. The surgeon may also use a laser to cut tissue, an electrocautery device to cauterize the tissue, and lights to illuminate the surgical site.
  • Each instrument has a unique control interface for its operation. Therefore, the surgeon must independently operate each device. For example, the surgeon must utilize a foot pedal to control the electrocautery device, a separate foot pedal to operate the robotic arm, and yet another interface to operate the laser.
  • Operating multiple devices may distract the surgeon, thereby reducing the efficiency of performing various procedures. Additionally, it is cumbersome utilizing various devices where each device has a separate user interface. If a new device is introduced into the operating room environment, the doctor must learn how to use the new user interface. Additionally, there is currently no known run time configurable system for operating more than one specific operating room device via voice control. As such, if there are two or more devices in the operating room that are voice controlled, the doctor has to remove the microphone used for one device and replace it with the microphone for the other device. Obviously, this creates many problems associated with productivity. Additionally, the necessity of actually switching between many user interfaces takes a measurable amount of time and as such, extends the time that a patient is under anesthesia, which may add to the danger of a procedure.
  • Therefore, what is needed in the art is a general purpose platform for controlling a plurality of devices such that devices can be added or subtracted from the platform depending upon the environment into which the platform, also known as a control system is introduced. The system may additionally be automatically configured at start up. Additionally, what is needed is a system and method for selecting and operating one of the plurality of the attached devices, namely operating room devices. It is to the solution of the hereinabove mentioned problems to which the present invention is directed.
  • BRIEF SUMMARY OF THE INVENTION
  • In accordance with the present invention there is provided a control system for selecting from and controlling a plurality of devices in an operating room, the control system comprising:
  • a master controller, the master controller comprising:
  • means for receiving selection commands from a user wherein each selection command is associated with one specific device in electrical communication with the master controller;
  • means for receiving control commands from a user;
  • means for converting selection commands and control commands into corresponding selection signals and control signals;
  • d) means for routing control signals to a device specified by a selection command received by the means for receiving selection commands.
  • In accordance with a first aspect of the present invention, there is provided a master controller for selecting and controlling a plurality of devices. Each of the plurality of devices to be controlled are in electrical communication or in wireless communication with the master controller, either directly or via a slave controller which will be discussed in more detail hereinbelow with respect to the second aspect of the present invention.
  • The master controller includes means for receiving selection commands issued by a user. The selection commands available to the user are based upon the devices in electrical communication with the master controller. The master controller may recognize those devices that are in electrical communication therewith upon startup of the master controller. This will be described in detail in the description of the preferred embodiment. Each device in electrical communication with the master controller is represented by a correspondingly available selection command.
  • The master controller additionally includes means for receiving control commands from the user. Both the means for receiving selection commands and the means for receiving control commands from a user may be included in a voice control interface (VCI) for receiving voice commands. The system may additionally employ a foot pedal, a hand held device, or some other device which receives selection or control commands or inputs indicative of such commands from a user. The VCI provides signals indicative of a user's selection of a specific device and signals indicative of control commands the user wishes to supply to the device specified by a specific selection command. These are known, respectively, as selection signals and control signals. If the user is using a foot pedal, hand controller or some other input device, the VCI is not utilized as the inputs are already in the form of electrical signals as opposed to voice input. Alternatively, a combination of devices may be used to receive selection and control commands and to provide selection and control signals indicative of such commands.
  • The master controller additionally includes means for routing control signals to a device specified by a selection command. For example, if the user wants to operate the laser, a device used in many surgeries and contemplated as being included as one of the devices that may be operated via the control system of the present invention, then the user may issue a selection command indicating such, i.e. speak the word “laser” or the words “select laser”. As such, the name of the device may serve as the selection command, or the selection command may be the combination of two or more words.
  • Subsequent to receiving a selection command from the user and converting the selection command into a selection signal, if necessary, the master controller then routes control commands, or control signals for a selected device indicative of control commands received from the user to the device specified by the preceding selection command. In this exemplary instance, control signals would be routed to the laser. Preferred structures for both selection commands and control commands are disclosed herein in the detailed description of the preferred embodiment of the present invention.
  • Additionally, a controller may include means for ensuring that control signals indicative of control commands issued subsequent to the receipt of a selection command are, in fact, valid control signals. This is accomplished via a database of valid control commands and grammars that are either prestored in the master, or are prestored in a slave prior to or at system startup which is described hereinbelow.
  • A second aspect of the present invention is at least one slave electrically connected to the master controller. Each slave controller connected to the master controller operates similarly to the master controller for specific devices electrically connected thereto; additionally, the slave controllers may receive control commands directly from the user if they are to be used as a stand alone unit. However, if they are utilized as slaves then control commands are received at the master controller and converted into control signals and transmitted from the master controller to the slave controller that has the device specified by the last selection command received by the master controller connected thereto. This allows the control system of the present invention to operate with a plurality of different devices without the master controller requiring any knowledge of the devices connected to the slave controllers prior to startup of the control system.
  • The slave controllers are connected to the master controller just like any other device; however, each slave controller provides the master controller information relating to the specific devices that are connected thereto, so the master controller, generally at startup, is provided information as to exactly what devices are connected to the system. The selection commands available to the user include all devices connected to each of the slave controllers as well as the devices directly connected to the master controller.
  • By providing an open architecture such as that generally set out hereinabove, and more particularly, a master controller and slave controllers, various devices may be controlled from a single controller, or a plurality of controllers, such that a doctor utilizing the control system will not have to switch between different control systems or interfaces, or at a minimum will have an easier interface to control each of the devices. It is additionally envisioned that the main means for selecting and controlling each of the devices will be a voice recognition system which will be described in detail hereinbelow.
  • Also, the control system may include audio and video outputs which are capable of alerting the user to errors in selecting, or controlling specific devices. The audio and video outputs may additionally be used to alert the user to problems with each of the specific devices as well as to provide status notices as to which device(s) are available, which devices are active, as well as a host of other device operation information which will be discussed further hereinbelow.
  • For a more complete understanding of the present invention, reference is made to the following detailed description and accompanying drawings. In the drawings, like reference characters refer to like parts, in which:
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of a master controller in electrical communication with both slave controllers and operating room devices in accordance with the present invention;
  • FIG. 2 is a block diagram of the voice control interface in accordance with the present invention;
  • FIG. 3 is a schematic of the voice control interface card in accordance with the present invention;
  • FIG. 4 is a schematic diagram of a master controller in accordance with a the present invention;
  • FIG. 5 is an exemplary tree diagram of a grammar for operating a device in accordance with the present invention.
  • DETAILED DESCRIPTION OF THE INVENTION
  • In accordance with the present invention, there is shown in FIG. 1 an operating room control system, generally at 10, in accordance with the present invention. The operating room control system, or control system 10, generally comprises a master controller 12, which is preferably attached to at least one slave controller 14. Although the exemplary preferred embodiment is shown as having both a master controller 12 and at least one slave controller 14 in electrical communication therewith, the control system 10 may be implemented with only a master controller 12 as will be described hereinbelow.
  • The master controller 12 is electrically connected to and in electrical communication with a plurality of devices 16 via a plurality of communication ports 46. Alternatively, the master controller 12 may be connected to any slave or specific medical device via wireless communications systems such as IR or RF signal transmitters and receivers on each of the master 12, slaves 14, and devices 16. Some of these devices 16 may be at least one slave controller 14 the operation of which will be described hereinbelow. Other devices that are intended to be electrically connected to the master controller 12, either directly or via the at least one slave controller 14 include devices that are commonly found in an operating room environment.
  • For purposes of non-limiting example, directly connected to the master controller 12 in FIG. 1 is an electrocautery device 18. A robotic arm 20 for holding and manipulating an endoscope, such as that produced by Computer Motion of Goleta, Calif. and marketed under the tradename AESOP is electrically connected with the master controller 12 via one of the at least one slave controllers 14. Also in electrical communication with the master controller 12 via a slave controller is an operating room table 22, an insufflator 24, and an operating room lighting system 26. It is envisioned that any electrically controlled device utilized in an operating room environment may be attached to the master controller 12 either directly or via one of the at least one slave controllers 14.
  • The master controller 12 is configured to provide a main user interface for each of the devices electrically connected thereto. As such, a doctor can manipulate the operating room environment in a simpler and more direct fashion. Currently, each device in an operating room includes a separate interface. The proximity of the doctor to each interface requires a substantial amount of movement either on the part of the doctor or a nurse to effectuate changes required by the doctor during a medical procedure.
  • For example, if the doctor needs the lights dimmed slightly, then a nurse currently has to approach the lighting system of the operating room and dim the lights. It would be highly advantageous for the doctor to be able to control such changes directly to keep movement in the operating room to a minimum to increase sterility, and because direct control by the doctor of the operating room environment and the devices he or she is using ensures the highest degree of safety with the smallest amount of error due to miscommunication between people in the operating room. Minimization of movement in an operating room environment is additionally advantageous to reduce the risk of contamination of specific sterile instruments, as well as the operative site itself.
  • To effectuate such a control system 10, the master controller 12 generally comprises a voice control interface (VCI) 32. The VCI 32 includes means 28 for receiving selection commands from a user wherein each selection command is associated with one specific device in electrical communication with the master controller 12. This is accomplished by providing the master controller 12 a list of the devices that are in electrical communication therewith upon start-up of the control system 10. The process and hardware for providing the master controller 12 with such a list will be described hereinbelow.
  • As shown in FIG. 2, The VCI 32 additionally comprises means 30 for receiving control commands from a user. In the preferred embodiment, both the means 28 for receiving selection commands and the means 30 for receiving control commands may coexist in the VCI 32 as a microphone 34, for receiving the actual speech of the user, an analog to digital converter 36 for converting the analog speech into a digital representation thereof, a feature extractor 38 for converting the digital representation to a digital representation that is suited for decoding, and a decoder 40 for comparing the features of the transformed digital representation of the speech to a set of presaved user-models 41 to determine whether the speech received at the microphone 34 was a selection command, a control command, or some other speech to be ignored by the master controller 12. Such “other speech” would include extraneous noise, speech between the doctor and another person in the operating suite, as well as speech of other people in the operating suite in general.
  • Feature extractors, such as the one employed in the present invention, are well known in the art of voice recognition. Feature vectors are preferably generated by the feature extractor 38 utilizing techniques such as Mel-Cepstrum, or linear prediction. It is to be appreciated that such techniques are well-known and are employed in the feature extractor 38 to develop feature vectors that represent speech received by the VCI 32.
  • Additionally, voice software is also available that provides extractors and decoders such as the ones set out in the present application. As such, although a specific implementation is presented herein for voice recognition, it may be carried out by the inclusion of a pre-made voice recognition system that is purchased from a vendor such as Creative labs under the tradename VOICE BLASTER, Dragon Dictate produced by Dragon Systems, or VOICE PAD produced by Kurzweil AI of Massachusetts, each of these companies produce front-end voice recognition systems.
  • The decoder 40 utilizes the information produced by the feature extractor 38, by matching the stored user models 41 to the output of the feature extractor 38 utilizing a well-known method, such as a Hidden Markov Modeling. One Hidden Markov Model (HMM) is created for each phoneme. The HMMs are trained to identify their respective phonemes given the Mel-Cepstrum output from the feature extractor 38. The use of Hidden Markov Models for voice recognition is generally well known.
  • The stored user models 41 used by the decoder 40 may be placed in a memory 44 associated with the VCI itself. As depicted in FIG. 3, such a memory 44 may be incorporated onto a VCI board 46 as an EPROM, a PROM or some other programmable memory storage device. However, it is preferable to store the models on a transportable memory device 45, such as a disk, transportable storage medium or the like. It is even more preferable that the transportable memory device be a PCMCIA format card 48 as data transfer times are reduced and the ruggedness of the system is increased. PCMCIA format cards retain data better than floppy disks. Additionally, the configuration of currently produced PCMCIA cards allows for additional program data to be stored on the PCMCIA format card and downloaded into the master controller 12 when system changes are made (i.e. upgrades to the system software etc.). Therefore, the use of such a PCMCIA form factor card is preferable in the control system 10 of the present invention.
  • FIG. 3 depicts, in more detail, the VCI 32. Once the user's speech has been digitized at the A/D converter 36, it is fed to the feature extractor 38. The feature extractor 38 functions as set out hereinabove. In more detail, the feature extractor 38 converts the igitized signal into a representation that is suitable for decoding (e.g. Mel-Cepstrum). This representation is then passed to the decoder 40 which compares the representations produced at the feature extractor 38 to the models stored on a memory 44 which contains the user models 41. The memory 44 may be supplied the models 41 via a downloading process from the transportable memory device 45. The models stored in the memory 44 constitute a lexicon, which is the entire set of valid pronunciations, or all of the valid words that the master 12 is to recognize. Because the lexicon is stored on a transportable data storage medium 41, the lexicon may be added to or subtracted from depending upon the devices that are to be connected to the master controller 12. In this fashion, if new equipment is purchased at a date subsequent to the purchase of the master controller 12, then new words may be added to the lexicon through a well-known data acquisition technique, wherein the user speaks the words that are to be added to the lexicon and they are used to update the user models 41 on the transportable memory 45.
  • Most preferable to the implementation of the present system 10, there is provided one master controller 12 and at least one slave 14 controller. In such a configuration, which will be discussed in more detail hereinbelow, once the master controller or master 12 receives a selection command, all speech received at the VCI 32 of the master 12 that is not a new selection command is fed to the feature extractor of the appropriately attached slave 14. In this way, a plurality of devices may be attached to several different controllers and the lexicon stored in each controller does not have to be downloaded into the master 12. The master 12 only contains the lexicon of all the devices that may be connected to the system 10 as well as the lexicon for the commands of those devices that are directly attached to the master 12 as opposed to being attached to a slave 14 which is, in turn, attached to the master 12.
  • All the other controllers, which for purposes herein, are referred to as slaves 14, include the lexicon for the devices that are directly connected thereto. For example, in FIG. 1, one slave includes the lexicon for the control commands and the select commands for a robotic arm and an operating table. This way, that controller can have a microphone plugged into the VCI which is included in the unit and it may serve as a solo unit. Or, depending upon the configuration of the control system 10, it may actually server as a master. The entire system 10 is configurable at startup and as such is expandable. Every controller preferably includes a VCI.
  • The decoder 40 additionally contains a language model. This term is well-known on the art and will be explained further hereinbelow. In essence, certain words may be validly said in certain orders. The language model is implemented by developing a network representing all the valid possibilities of word combinations and decoding the extracted vectors along each path in the network. Whichever path has the highest probability of matching the incoming speech, the information associated with that path is selected by the decoder 40. It is to additionally be appreciated that to carry out the present invention, a silence path is available and an unrecognized command path is provided as well. As such, even though a user speaks, if valid commands are not given, the system 10 will not respond.
  • FIG. 5 sets out one exemplary language model for the proper operation of the robotic arm 20. Such language models are developed for each device in electrical communication with the master controller 12. Once again, a device may be in wireless communication with the master controller 12. It is preferable to store the language models for each device in their respective controller. For example, if a device is directly connected to a slave 14 then the control language model (that language model containing the language used to control the device) for the device is stored in the slave VCI. If the device is directly connected to the master 12 then the control language model is included in the VCI of the master 12. It is to be appreciated that the select language model must be stored in the master 12 for all the possible devices that may be directly connected to the master 12 as opposed to being connected to a slave. As such, depending upon what devices are connected to the system at any given time, a user may select from any of the connected devices. If a device is not connected, the system will recognize this upon startup and will not attempt to access the device as it is not there. This will be discussed in more detail hereinbelow.
  • If a device is connected directly to the master controller 12, then it is preferable to store the language model for controlling the device either in the VCI itself, or in the transportable memory 45. The advantages of this configuration are set out hereinbelow with respect to the startup of the control system 10.
  • If a select command is given for a device that is directly connected to the master 12, then the information is passed to the decoder in the master 12 and the decoder 40 generates a packet 52 of information. The packet includes the address of the device to be operated, a code representing the specific operation, and a checksum to ensure that as the packet 52 is transferred over various busses, the data does not become corrupted. Such information packaging is well-known although the specific package set out hereinabove has heretofore not been utilized to control one of a plurality of medical devices. Data checking using a checksum is also well-known in the art.
  • The decoder 40, upon decoding a valid selection command, activates the address of the device which has been stored in a lookup table and is related to the device. This is accomplished as follows. At startup every controller, whether the master 12 or a slave 14 knows the addresses of its communication ports. It sends a query to each communication port to see if a device is connected thereto. If so, an adapter connected to the device specifies the name of the device and an indication that it is functioning properly. Such adapters are well known in the electrical arts and as such will not be further discussed herein. Every slave controller establishes a lookup table of addresses and associated device codes or names. The device codes or names are transmitted to the master 12 which includes all the devices and the corresponding address of the port to which the associated slave controller is connected to the master 12.
  • The addresses of all devices available are initially stored in a memory associated with the VCI such that a multiplexer may be used to activate a specific address or make that address accessible. In this fashion, once the master 12 receives a valid selection command, which it is able to identify, it then routes all the control commands to the VCI of the appropriate slave controller in the case where the device selected is connected to a slave controller. If the selected device is connected directly to the master 12 then the control commands are fed through the decoder 40 of the master 12 and the control information packet is produced and sent to the device via the central processor 44 of the master 12. In this fashion, the VCI of a slave is fed control signals and processes those signals as though they were received from the A/D converter, which is where the input to the slave is routed. Every slave can be attached to one master, and that master, can, in turn be attached to another master, thus providing a daisychain of slaves all of which are connected to one master having a microphone attached thereto.
  • In addition to the VCI 32, the master controller 12 comprises means 42 for routing control signals to a device specified by a selection command received at the VCI 32. FIG. 4 depicts the master controller 12 having one slave controller 14 and two medical devices in electrical communication therewith. The master controller includes the VCI 32 as well as the means 42 for routing control signals. Once the speech has been extracted and decoded into either a selection command, or a control command, the specific command is transmitted to the Central Processor 44 of the master controller 12.
  • In the preferred embodiment, the means 42 for routing control signals is incorporated into the central processor 44 of the master controller 12. The means 42 for routing is essentially an addressable multiplexer and has a memory of the addresses for each device and their associated one of the plurality of communication ports 46 to which they are connected. If the addresses are stored in the decoder 40, then the central processor 44 will be in communication with that memory.
  • The means 42 for routing, takes the packet 50 of information or the control signal, if the information is to be sent to a slave 14, checks which of the plurality of communication ports 46 it is to direct the information to and then directs the information to the desired one of the plurality 46 of ports.
  • The addresses and their associated ports are uploaded into the master 12 upon startup of the system. This procedure is embedded in the software and such a procedure is well-known in the art.
  • For example, in FIG. 4, an electrocautery device 18 transmits an address to the master controller 12. The address is received at a one of a plurality of communication ports 46, the address is saved in the memory along with the associated communication port number. It is to be appreciated that the valid selection commands are stored on the transportable memory. For devices directly connected to the master, the language model may be stored in a memory in the master 12 or in the transportable memory. Language models are stored in associated slaves for devices that are directly connected to a slave 14. In this fashion, upon startup, the master 12 knows all devices that are connected to the system, as each slave sends to the master the addresses of each device and the name (i.e. coded phonemes that constitute the device) of the device. The names of the devices are uploaded into the master so that the validity of selection commands may take place in the master 12. However, language models for the validity of control commands are not transmitted to the master 12 as this would take much time and slow the control system 10 down. Therefore, the master controller 12 actually contains a subset of the grammar necessary to operate the devices in connection therewith, but that language model is limited to only the device names. The information regarding valid sequences of control commands (i.e. their control language model) is stored on each slave controller to which they are connected. Of course, if the device 14 is directly connected to the master, then the language model is stored at the master 12 as described hereinabove.
  • The control system 10 in accordance with the present invention provides a way to configure and reconfigure an operating room in a very simple fashion. Additionally, it is to be appreciated that the system 10 provides an intuitive interface whereby a user can select a device to control and then subsequently control that device. The system checks to ensure that control commands received for a specific device are valid.
  • Additionally, the system 10 requires the inclusion of adapters 52 placed intermediate a specific one of the plurality of devices 16 and a slave or the master 12. The adapters 52 transmit signals to their respective slave 14 or master 12 indicative of the address of the device, and translate control signals sent from the controller to which they are connected to signals understood by the particular device for which they are intended. Such adapters are easily constructed and are well-known in the art. Additionally, such adapters may be included either in the respective slave 14 or master 12 or attached to the particular one of the plurality of devices 16 itself. There is substantial advantage to attaching the adapters 52 to the devices 16 as then the devices may be attached to any port, whereas, if the adapters are attached interior the controller 12, 14, the specific device for which they were designed must be attached to the specific one of the plurality of communication ports 46.
  • If new devices are added to the system, or if improvements or upgrades are made to the system software, such changes may be incorporated into a PCMCIA format card, such as the card that stores the user voice models. The card may be inserted into the same interface, however, system software may be uploaded into the master to make the upgrade without having to disassemble the master. This is accomplished by incorporating a serial interface on the PCMCIA format card. As such, the central processor 44 additionally checks upon startup whether there is a system upgrade to be made by checking the data being supplied by the PCMCIA format card. Checking the activity of a serial interface is well known, however it is not heretofore known to incorporate a serial interface on a single PCMCIA format card. Therefore, the combination is seen to be novel. Additionally, it is heretofore not known to incorporate voice models on such a PCMCIA format card.
  • Each of the at least one slave 14 is substantially similar to the master controller 12. And, each of the plurality of slaves 14 may include the full VCI so that each slave 14 can operate as a master. Alternatively, although not preferred, the slaves may not include the feature extractor, and only contain a subset of the language model (i.e. control commands) relating to the operation of each specific device. This is all that may be necessary in the slave because the slave receives from the master controller the specific address a command is to be sent and that it is in fact a command. Therefore, the slave only needs to check to ensure that it is a valid command for the specific device. In this fashion, devices may be directly connected to the master, or they may be connected to a slave which is in communication with the master 12.
  • Finally, the system 10 may include output means including a video monitor 86 and a speaker 88. The speaker may be incorporated into the VCI 32 via a D/A converter 90 such that the system may communicate to the user any errors committed by the user in operating or selecting a specific device. Additionally, the output means may communicate system errors or the malfunction of a specific device. Such information is included in each specific adapter and is specific to the device attached to the adapter. It is to be appreciated that such communications would be transmitted to the master where they would be either auditorially or visually displayed. The system and controller in accordance with the invention may additionally include a foot controller, a hand controller or other well-known controllers. Each of these controllers may be used to control any of the devices connected to the master or a slave, as is described in the patent application incorporated herein by reference. As such, the VCI may only be used to select certain devices, and once selected the device may be controlled via one of the well-known controllers. Ultimately, the flexibility of such a system can reduce costs and increase the safety of surgical procedures.
  • While certain exemplary embodiments of the present invention have been described and shown on the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention not be limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those ordinarily skilled in the art. As such,

Claims (2)

1-9. (canceled)
10. An operating room voice command system comprising:
a first medical device having a first device lexicon of verbal device commands associated therewith;
a second medical device having a second device lexicon of verbal device commands associated therewith; and
a control system in electrical communication with the first medical device and the second medical device, the control system having a voice interface for receiving a verbal device selection command included in a device selection lexicon, the device selection lexicon including a first device selection command and a second device selection command, the control system directing a command signal to a selected device in response to the verbal device selection command, the selected device being either the first medical device or the second medical device, the voice interface also for receiving a verbal device command associated with the selected device, the command signal corresponding to the device command, the control system identifying the device command from among the first device lexicon when the selected device is the first medical device, and the control system identifying the device command from among the second device lexicon when the selected device is the second medical device.
US11/443,797 1994-09-22 2006-05-30 General purpose distributed operating room control system Abandoned US20060220784A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/443,797 US20060220784A1 (en) 1994-09-22 2006-05-30 General purpose distributed operating room control system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US08/310,665 US6463361B1 (en) 1994-09-22 1994-09-22 Speech interface for an automated endoscopic system
US08/693,352 US6646541B1 (en) 1996-06-24 1996-08-06 General purpose distributed operating room control system
US10/666,922 US7053752B2 (en) 1996-08-06 2003-09-18 General purpose distributed operating room control system
US11/443,797 US20060220784A1 (en) 1994-09-22 2006-05-30 General purpose distributed operating room control system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/666,922 Continuation US7053752B2 (en) 1994-09-22 2003-09-18 General purpose distributed operating room control system

Publications (1)

Publication Number Publication Date
US20060220784A1 true US20060220784A1 (en) 2006-10-05

Family

ID=29270989

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/666,922 Expired - Fee Related US7053752B2 (en) 1994-09-22 2003-09-18 General purpose distributed operating room control system
US11/443,797 Abandoned US20060220784A1 (en) 1994-09-22 2006-05-30 General purpose distributed operating room control system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/666,922 Expired - Fee Related US7053752B2 (en) 1994-09-22 2003-09-18 General purpose distributed operating room control system

Country Status (1)

Country Link
US (2) US7053752B2 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050033161A1 (en) * 2000-12-21 2005-02-10 Rainer Birkenbach Cable-free medical detection and treatment system
US20080109402A1 (en) * 2006-11-02 2008-05-08 Gang Wang Device control system employing extensible markup language for defining information resources
US20090276515A1 (en) * 2008-05-02 2009-11-05 Boston Scientific Scimed, Inc. Multi-modality network for improved workflow
US20100245116A1 (en) * 2009-03-25 2010-09-30 Senecal Pierre Method and apparatus for distributing motion signals in a multi-seat environment
US20140012587A1 (en) * 2012-07-03 2014-01-09 Samsung Electronics Co., Ltd. Method and apparatus for connecting service between user devices using voice
CN107966910A (en) * 2017-11-30 2018-04-27 深圳Tcl新技术有限公司 Method of speech processing, intelligent sound box and readable storage medium storing program for executing
US11417329B2 (en) * 2019-01-30 2022-08-16 Siemens Healthcare Gmbh System for performing a magnetic resonance tomography and method for controlling an MR scanner

Families Citing this family (193)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6463361B1 (en) * 1994-09-22 2002-10-08 Computer Motion, Inc. Speech interface for an automated endoscopic system
CA2493556C (en) 2002-07-25 2012-04-03 Thomas L. Ii Buchman Electrosurgical pencil with drag sensing capability
US7244257B2 (en) 2002-11-05 2007-07-17 Sherwood Services Ag Electrosurgical pencil having a single button variable control
US7235072B2 (en) 2003-02-20 2007-06-26 Sherwood Services Ag Motion detector for controlling electrosurgical output
JP2004351533A (en) * 2003-05-27 2004-12-16 Fanuc Ltd Robot system
US7126303B2 (en) * 2003-07-08 2006-10-24 Board Of Regents Of The University Of Nebraska Robot for surgical applications
US7960935B2 (en) 2003-07-08 2011-06-14 The Board Of Regents Of The University Of Nebraska Robotic devices with agent delivery components and related methods
US7503917B2 (en) * 2003-11-20 2009-03-17 Covidien Ag Electrosurgical pencil with improved controls
US7156842B2 (en) * 2003-11-20 2007-01-02 Sherwood Services Ag Electrosurgical pencil with improved controls
US7879033B2 (en) * 2003-11-20 2011-02-01 Covidien Ag Electrosurgical pencil with advanced ES controls
US8065418B1 (en) * 2004-02-02 2011-11-22 Apple Inc. NAT traversal for media conferencing
US8295909B2 (en) * 2005-06-16 2012-10-23 Brainlab Ag Medical tracking system with infrared data transfer
US7500974B2 (en) 2005-06-28 2009-03-10 Covidien Ag Electrode with rotatably deployable sheath
US20070015999A1 (en) * 2005-07-15 2007-01-18 Heldreth Mark A System and method for providing orthopaedic surgical information to a surgeon
US7828794B2 (en) 2005-08-25 2010-11-09 Covidien Ag Handheld electrosurgical apparatus for controlling operating room equipment
EP1762198A1 (en) * 2005-09-13 2007-03-14 Sherwood Services AG Handheld electrosurgical apparatus for controlling operating room equipment
US20070078678A1 (en) * 2005-09-30 2007-04-05 Disilvestro Mark R System and method for performing a computer assisted orthopaedic surgical procedure
US7620553B2 (en) * 2005-12-20 2009-11-17 Storz Endoskop Produktions Gmbh Simultaneous support of isolated and connected phrase command recognition in automatic speech recognition systems
US20070260240A1 (en) 2006-05-05 2007-11-08 Sherwood Services Ag Soft tissue RF transection and resection device
US8635082B2 (en) 2006-05-25 2014-01-21 DePuy Synthes Products, LLC Method and system for managing inventories of orthopaedic implants
US8015014B2 (en) * 2006-06-16 2011-09-06 Storz Endoskop Produktions Gmbh Speech recognition system with user profiles management component
US9579088B2 (en) 2007-02-20 2017-02-28 Board Of Regents Of The University Of Nebraska Methods, systems, and devices for surgical visualization and device manipulation
CA2991346C (en) 2006-06-22 2020-03-10 Board Of Regents Of The University Of Nebraska Magnetically coupleable robotic devices and related methods
US8974440B2 (en) 2007-08-15 2015-03-10 Board Of Regents Of The University Of Nebraska Modular and cooperative medical devices and related systems and methods
US8679096B2 (en) 2007-06-21 2014-03-25 Board Of Regents Of The University Of Nebraska Multifunctional operational component for robotic devices
US8502876B2 (en) * 2006-09-12 2013-08-06 Storz Endoskop Producktions GmbH Audio, visual and device data capturing system with real-time speech recognition command and control system
US9514746B2 (en) * 2006-09-26 2016-12-06 Storz Endoskop Produktions Gmbh System and method for hazard mitigation in voice-driven control applications
US7926118B2 (en) * 2006-12-27 2011-04-19 Illinois Tool Works Inc. Voice control welding/cutting helmet functions and settings
JP5591696B2 (en) 2007-07-12 2014-09-17 ボード オブ リージェンツ オブ ザ ユニバーシティ オブ ネブラスカ Biopsy elements, arm devices, and medical devices
US20090076536A1 (en) 2007-08-15 2009-03-19 Board Of Regents Of The University Of Nebraska Medical inflation, attachment, and delivery devices and related methods
US8506565B2 (en) 2007-08-23 2013-08-13 Covidien Lp Electrosurgical device with LED adapter
US8265949B2 (en) 2007-09-27 2012-09-11 Depuy Products, Inc. Customized patient surgical plan
CN102670275B (en) 2007-09-30 2016-01-20 德普伊产品公司 The patient-specific orthopaedic surgical instrumentation of customization
US8235987B2 (en) 2007-12-05 2012-08-07 Tyco Healthcare Group Lp Thermal penetration and arc length controllable electrosurgical pencil
US8597292B2 (en) 2008-03-31 2013-12-03 Covidien Lp Electrosurgical pencil including improved controls
US8663218B2 (en) 2008-03-31 2014-03-04 Covidien Lp Electrosurgical pencil including improved controls
US8636733B2 (en) 2008-03-31 2014-01-28 Covidien Lp Electrosurgical pencil including improved controls
US8162937B2 (en) 2008-06-27 2012-04-24 Tyco Healthcare Group Lp High volume fluid seal for electrosurgical handpiece
US8231620B2 (en) 2009-02-10 2012-07-31 Tyco Healthcare Group Lp Extension cutting blade
US8894633B2 (en) 2009-12-17 2014-11-25 Board Of Regents Of The University Of Nebraska Modular and cooperative medical devices and related systems and methods
US8968267B2 (en) 2010-08-06 2015-03-03 Board Of Regents Of The University Of Nebraska Methods and systems for handling or delivering materials for natural orifice surgery
US8731939B1 (en) * 2010-08-06 2014-05-20 Google Inc. Routing queries based on carrier phrase registration
US20120252367A1 (en) * 2011-04-04 2012-10-04 Meditalk Devices, Llc Auditory Speech Module For Medical Devices
US9060781B2 (en) 2011-06-10 2015-06-23 Board Of Regents Of The University Of Nebraska Methods, systems, and devices relating to surgical end effectors
CA3082073C (en) 2011-07-11 2023-07-25 Board Of Regents Of The University Of Nebraska Robotic surgical devices, systems, and related methods
JP6377530B2 (en) 2012-01-10 2018-08-22 ボード オブ リージェンツ オブ ザ ユニバーシティ オブ ネブラスカ Surgical insertion device
US10076383B2 (en) 2012-01-25 2018-09-18 Covidien Lp Electrosurgical device having a multiplexer
US9498292B2 (en) 2012-05-01 2016-11-22 Board Of Regents Of The University Of Nebraska Single site robotic device and related systems and methods
US11871901B2 (en) 2012-05-20 2024-01-16 Cilag Gmbh International Method for situational awareness for surgical network or surgical network connected device capable of adjusting function based on a sensed situation or usage
WO2013186794A2 (en) * 2012-06-15 2013-12-19 Suresh DESHPANDE A voice controlled operation theater automation system
CA2876846C (en) 2012-06-22 2021-04-06 Board Of Regents Of The University Of Nebraska Local control robotic surgical devices and related methods
CA2880622C (en) 2012-08-08 2021-01-12 Board Of Regents Of The University Of Nebraska Robotic surgical devices, systems and related methods
US9770305B2 (en) 2012-08-08 2017-09-26 Board Of Regents Of The University Of Nebraska Robotic surgical devices, systems, and related methods
US9060674B2 (en) 2012-10-11 2015-06-23 Karl Storz Imaging, Inc. Auto zoom for video camera
WO2014152418A1 (en) 2013-03-14 2014-09-25 Board Of Regents Of The University Of Nebraska Methods, systems, and devices relating to force control surgical systems
US9414740B2 (en) 2013-03-14 2016-08-16 Arthrex, Inc. Endoscopic imaging system and method for adapting to remote stimulus
US9743987B2 (en) 2013-03-14 2017-08-29 Board Of Regents Of The University Of Nebraska Methods, systems, and devices relating to robotic surgical devices, end effectors, and controllers
WO2014144220A1 (en) 2013-03-15 2014-09-18 Board Of Regents Of The University Of Nebraska Robotic surgical devices, systems, and related methdos
JP6479790B2 (en) 2013-07-17 2019-03-06 ボード オブ リージェンツ オブ ザ ユニバーシティ オブ ネブラスカ Robotic surgical device, system and related methods
US9477215B2 (en) * 2014-04-14 2016-10-25 Abl Ip Holding Llc Anthropomorphic control of lighting and other output conditions
EP2958010A1 (en) * 2014-06-20 2015-12-23 Thomson Licensing Apparatus and method for controlling the apparatus by a user
EP3868322A1 (en) 2014-09-12 2021-08-25 Board of Regents of the University of Nebraska Quick-release effectors and related systems
US11504192B2 (en) 2014-10-30 2022-11-22 Cilag Gmbh International Method of hub communication with surgical instrument systems
EP4286104A3 (en) 2014-11-11 2024-02-14 Board of Regents of the University of Nebraska Robotic device with compact joint design and related systems and methods
WO2017024081A1 (en) 2015-08-03 2017-02-09 Board Of Regents Of The University Of Nebraska Robotic surgical devices systems and related methods
EP3457951B1 (en) 2016-05-18 2024-03-06 Virtual Incision Corporation Robotic surgical devices and systems
CN116269696A (en) 2016-08-25 2023-06-23 内布拉斯加大学董事会 Quick release tool coupler and related systems and methods
CN109890580B (en) 2016-08-30 2022-06-28 内布拉斯加大学董事会 Robotic devices with compact joint design and additional degrees of freedom and related systems and methods
EP3544539A4 (en) 2016-11-22 2020-08-05 Board of Regents of the University of Nebraska Improved gross positioning device and related systems and methods
CN115553922A (en) 2016-11-29 2023-01-03 虚拟切割有限公司 User controller with user presence detection and related systems and methods
US10722319B2 (en) 2016-12-14 2020-07-28 Virtual Incision Corporation Releasable attachment device for coupling to medical devices and related systems and methods
US10028794B2 (en) * 2016-12-19 2018-07-24 Ethicon Llc Surgical system with voice control
CA3076625A1 (en) 2017-09-27 2019-04-04 Virtual Incision Corporation Robotic surgical devices with tracking camera technology and related systems and methods
US11317919B2 (en) 2017-10-30 2022-05-03 Cilag Gmbh International Clip applier comprising a clip crimping system
US11229436B2 (en) 2017-10-30 2022-01-25 Cilag Gmbh International Surgical system comprising a surgical tool and a surgical hub
US11129636B2 (en) 2017-10-30 2021-09-28 Cilag Gmbh International Surgical instruments comprising an articulation drive that provides for high articulation angles
US11801098B2 (en) 2017-10-30 2023-10-31 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11564756B2 (en) 2017-10-30 2023-01-31 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11311342B2 (en) 2017-10-30 2022-04-26 Cilag Gmbh International Method for communicating with surgical instrument systems
US11911045B2 (en) 2017-10-30 2024-02-27 Cllag GmbH International Method for operating a powered articulating multi-clip applier
US11291510B2 (en) 2017-10-30 2022-04-05 Cilag Gmbh International Method of hub communication with surgical instrument systems
US11406390B2 (en) 2017-10-30 2022-08-09 Cilag Gmbh International Clip applier comprising interchangeable clip reloads
US11510741B2 (en) 2017-10-30 2022-11-29 Cilag Gmbh International Method for producing a surgical instrument comprising a smart electrical system
US20190201113A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Controls for robot-assisted surgical platforms
US11903601B2 (en) 2017-12-28 2024-02-20 Cilag Gmbh International Surgical instrument comprising a plurality of drive systems
US11432885B2 (en) 2017-12-28 2022-09-06 Cilag Gmbh International Sensing arrangements for robot-assisted surgical platforms
US11234756B2 (en) 2017-12-28 2022-02-01 Cilag Gmbh International Powered surgical tool with predefined adjustable control algorithm for controlling end effector parameter
US11202570B2 (en) 2017-12-28 2021-12-21 Cilag Gmbh International Communication hub and storage device for storing parameters and status of a surgical device to be shared with cloud based analytics systems
US11364075B2 (en) 2017-12-28 2022-06-21 Cilag Gmbh International Radio frequency energy device for delivering combined electrical signals
US11832899B2 (en) 2017-12-28 2023-12-05 Cilag Gmbh International Surgical systems with autonomously adjustable control programs
US11744604B2 (en) 2017-12-28 2023-09-05 Cilag Gmbh International Surgical instrument with a hardware-only control circuit
US11410259B2 (en) 2017-12-28 2022-08-09 Cilag Gmbh International Adaptive control program updates for surgical devices
US20190201146A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Safety systems for smart powered surgical stapling
US20190201039A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Situational awareness of electrosurgical systems
US11179208B2 (en) 2017-12-28 2021-11-23 Cilag Gmbh International Cloud-based medical analytics for security and authentication trends and reactive measures
US11324557B2 (en) 2017-12-28 2022-05-10 Cilag Gmbh International Surgical instrument with a sensing array
US11376002B2 (en) 2017-12-28 2022-07-05 Cilag Gmbh International Surgical instrument cartridge sensor assemblies
US10892995B2 (en) 2017-12-28 2021-01-12 Ethicon Llc Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs
US11571234B2 (en) 2017-12-28 2023-02-07 Cilag Gmbh International Temperature control of ultrasonic end effector and control system therefor
US11857152B2 (en) 2017-12-28 2024-01-02 Cilag Gmbh International Surgical hub spatial awareness to determine devices in operating theater
US11464559B2 (en) 2017-12-28 2022-10-11 Cilag Gmbh International Estimating state of ultrasonic end effector and control system therefor
US10987178B2 (en) 2017-12-28 2021-04-27 Ethicon Llc Surgical hub control arrangements
US11308075B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Surgical network, instrument, and cloud responses based on validation of received dataset and authentication of its source and integrity
US10695081B2 (en) 2017-12-28 2020-06-30 Ethicon Llc Controlling a surgical instrument according to sensed closure parameters
US11317937B2 (en) 2018-03-08 2022-05-03 Cilag Gmbh International Determining the state of an ultrasonic end effector
US11659023B2 (en) 2017-12-28 2023-05-23 Cilag Gmbh International Method of hub communication
US10932872B2 (en) 2017-12-28 2021-03-02 Ethicon Llc Cloud-based medical analytics for linking of local usage trends with the resource acquisition behaviors of larger data set
US11424027B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Method for operating surgical instrument systems
US11076921B2 (en) 2017-12-28 2021-08-03 Cilag Gmbh International Adaptive control program updates for surgical hubs
US11147607B2 (en) 2017-12-28 2021-10-19 Cilag Gmbh International Bipolar combination device that automatically adjusts pressure based on energy modality
US11540855B2 (en) 2017-12-28 2023-01-03 Cilag Gmbh International Controlling activation of an ultrasonic surgical instrument according to the presence of tissue
US11559307B2 (en) 2017-12-28 2023-01-24 Cilag Gmbh International Method of robotic hub communication, detection, and control
US11056244B2 (en) 2017-12-28 2021-07-06 Cilag Gmbh International Automated data scaling, alignment, and organizing based on predefined parameters within surgical networks
US11109866B2 (en) 2017-12-28 2021-09-07 Cilag Gmbh International Method for circular stapler control algorithm adjustment based on situational awareness
US11576677B2 (en) 2017-12-28 2023-02-14 Cilag Gmbh International Method of hub communication, processing, display, and cloud analytics
US11266468B2 (en) 2017-12-28 2022-03-08 Cilag Gmbh International Cooperative utilization of data derived from secondary sources by intelligent surgical hubs
US20190201042A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Determining the state of an ultrasonic electromechanical system according to frequency shift
US11304699B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Method for adaptive control schemes for surgical network control and interaction
US11666331B2 (en) 2017-12-28 2023-06-06 Cilag Gmbh International Systems for detecting proximity of surgical end effector to cancerous tissue
US11160605B2 (en) 2017-12-28 2021-11-02 Cilag Gmbh International Surgical evacuation sensing and motor control
US11832840B2 (en) 2017-12-28 2023-12-05 Cilag Gmbh International Surgical instrument having a flexible circuit
US11589888B2 (en) 2017-12-28 2023-02-28 Cilag Gmbh International Method for controlling smart energy devices
US11559308B2 (en) 2017-12-28 2023-01-24 Cilag Gmbh International Method for smart energy device infrastructure
US11311306B2 (en) 2017-12-28 2022-04-26 Cilag Gmbh International Surgical systems for detecting end effector tissue distribution irregularities
US11304720B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Activation of energy devices
US11864728B2 (en) 2017-12-28 2024-01-09 Cilag Gmbh International Characterization of tissue irregularities through the use of mono-chromatic light refractivity
US11291495B2 (en) 2017-12-28 2022-04-05 Cilag Gmbh International Interruption of energy due to inadvertent capacitive coupling
US11278281B2 (en) 2017-12-28 2022-03-22 Cilag Gmbh International Interactive surgical system
US11096693B2 (en) 2017-12-28 2021-08-24 Cilag Gmbh International Adjustment of staple height of at least one row of staples based on the sensed tissue thickness or force in closing
US11937769B2 (en) 2017-12-28 2024-03-26 Cilag Gmbh International Method of hub communication, processing, storage and display
US11464535B2 (en) 2017-12-28 2022-10-11 Cilag Gmbh International Detection of end effector emersion in liquid
US11284936B2 (en) 2017-12-28 2022-03-29 Cilag Gmbh International Surgical instrument having a flexible electrode
US11132462B2 (en) 2017-12-28 2021-09-28 Cilag Gmbh International Data stripping method to interrogate patient records and create anonymized record
US10892899B2 (en) 2017-12-28 2021-01-12 Ethicon Llc Self describing data packets generated at an issuing instrument
US11389164B2 (en) 2017-12-28 2022-07-19 Cilag Gmbh International Method of using reinforced flexible circuits with multiple sensors to optimize performance of radio frequency devices
US11069012B2 (en) 2017-12-28 2021-07-20 Cilag Gmbh International Interactive surgical systems with condition handling of devices and data capabilities
US11257589B2 (en) 2017-12-28 2022-02-22 Cilag Gmbh International Real-time analysis of comprehensive cost of all instrumentation used in surgery utilizing data fluidity to track instruments through stocking and in-house processes
US11253315B2 (en) 2017-12-28 2022-02-22 Cilag Gmbh International Increasing radio frequency to create pad-less monopolar loop
US11423007B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Adjustment of device control programs based on stratified contextual data in addition to the data
US11273001B2 (en) 2017-12-28 2022-03-15 Cilag Gmbh International Surgical hub and modular device response adjustment based on situational awareness
US11786251B2 (en) 2017-12-28 2023-10-17 Cilag Gmbh International Method for adaptive control schemes for surgical network control and interaction
US11446052B2 (en) 2017-12-28 2022-09-20 Cilag Gmbh International Variation of radio frequency and ultrasonic power level in cooperation with varying clamp arm pressure to achieve predefined heat flux or power applied to tissue
US11419667B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Ultrasonic energy device which varies pressure applied by clamp arm to provide threshold control pressure at a cut progression location
US11844579B2 (en) 2017-12-28 2023-12-19 Cilag Gmbh International Adjustments based on airborne particle properties
US20190200981A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Method of compressing tissue within a stapling device and simultaneously displaying the location of the tissue within the jaws
US11051876B2 (en) 2017-12-28 2021-07-06 Cilag Gmbh International Surgical evacuation flow paths
US10898622B2 (en) 2017-12-28 2021-01-26 Ethicon Llc Surgical evacuation system with a communication circuit for communication between a filter and a smoke evacuation device
US10849697B2 (en) 2017-12-28 2020-12-01 Ethicon Llc Cloud interface for coupled surgical devices
US10966791B2 (en) 2017-12-28 2021-04-06 Ethicon Llc Cloud-based medical analytics for medical facility segmented individualization of instrument function
US10944728B2 (en) 2017-12-28 2021-03-09 Ethicon Llc Interactive surgical systems with encrypted communication capabilities
US11602393B2 (en) 2017-12-28 2023-03-14 Cilag Gmbh International Surgical evacuation sensing and generator control
US11818052B2 (en) 2017-12-28 2023-11-14 Cilag Gmbh International Surgical network determination of prioritization of communication, interaction, or processing based on system or device needs
US10943454B2 (en) 2017-12-28 2021-03-09 Ethicon Llc Detection and escalation of security responses of surgical instruments to increasing severity threats
US20190201087A1 (en) 2017-12-28 2019-07-04 Ethicon Llc Smoke evacuation system including a segmented control circuit for interactive surgical platform
US11304745B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Surgical evacuation sensing and display
US11529187B2 (en) 2017-12-28 2022-12-20 Cilag Gmbh International Surgical evacuation sensor arrangements
US11896322B2 (en) 2017-12-28 2024-02-13 Cilag Gmbh International Sensing the patient position and contact utilizing the mono-polar return pad electrode to provide situational awareness to the hub
US11786245B2 (en) 2017-12-28 2023-10-17 Cilag Gmbh International Surgical systems with prioritized data transmission capabilities
US11100631B2 (en) 2017-12-28 2021-08-24 Cilag Gmbh International Use of laser light and red-green-blue coloration to determine properties of back scattered light
US11304763B2 (en) 2017-12-28 2022-04-19 Cilag Gmbh International Image capturing of the areas outside the abdomen to improve placement and control of a surgical device in use
US11633237B2 (en) 2017-12-28 2023-04-25 Cilag Gmbh International Usage and technique analysis of surgeon / staff performance against a baseline to optimize device utilization and performance for both current and future procedures
US11419630B2 (en) 2017-12-28 2022-08-23 Cilag Gmbh International Surgical system distributed processing
US11166772B2 (en) 2017-12-28 2021-11-09 Cilag Gmbh International Surgical hub coordination of control and communication of operating room devices
US11896443B2 (en) * 2017-12-28 2024-02-13 Cilag Gmbh International Control of a surgical system through a surgical barrier
US11026751B2 (en) 2017-12-28 2021-06-08 Cilag Gmbh International Display of alignment of staple cartridge to prior linear staple line
US11678881B2 (en) 2017-12-28 2023-06-20 Cilag Gmbh International Spatial awareness of surgical hubs in operating rooms
US10758310B2 (en) 2017-12-28 2020-09-01 Ethicon Llc Wireless pairing of a surgical device with another device within a sterile surgical field based on the usage and situational awareness of devices
US11213359B2 (en) 2017-12-28 2022-01-04 Cilag Gmbh International Controllers for robot-assisted surgical platforms
WO2019136360A1 (en) 2018-01-05 2019-07-11 Board Of Regents Of The University Of Nebraska Single-arm robotic device with compact joint design and related systems and methods
US11259882B1 (en) 2018-01-25 2022-03-01 Integrity Implants Inc. Robotic surgical instrument system
US11701162B2 (en) 2018-03-08 2023-07-18 Cilag Gmbh International Smart blade application for reusable and disposable devices
US11259830B2 (en) 2018-03-08 2022-03-01 Cilag Gmbh International Methods for controlling temperature in ultrasonic device
US11839396B2 (en) 2018-03-08 2023-12-12 Cilag Gmbh International Fine dissection mode for tissue classification
US11090047B2 (en) 2018-03-28 2021-08-17 Cilag Gmbh International Surgical instrument comprising an adaptive control system
US11589865B2 (en) 2018-03-28 2023-02-28 Cilag Gmbh International Methods for controlling a powered surgical stapler that has separate rotary closure and firing systems
US11207067B2 (en) 2018-03-28 2021-12-28 Cilag Gmbh International Surgical stapling device with separate rotary driven closure and firing systems and firing member that engages both jaws while firing
US11471156B2 (en) 2018-03-28 2022-10-18 Cilag Gmbh International Surgical stapling devices with improved rotary driven closure systems
US11219453B2 (en) 2018-03-28 2022-01-11 Cilag Gmbh International Surgical stapling devices with cartridge compatible closure and firing lockout arrangements
US11278280B2 (en) 2018-03-28 2022-03-22 Cilag Gmbh International Surgical instrument comprising a jaw closure lockout
US11096688B2 (en) 2018-03-28 2021-08-24 Cilag Gmbh International Rotary driven firing members with different anvil and channel engagement features
US11129611B2 (en) 2018-03-28 2021-09-28 Cilag Gmbh International Surgical staplers with arrangements for maintaining a firing member thereof in a locked configuration unless a compatible cartridge has been installed therein
US10973520B2 (en) 2018-03-28 2021-04-13 Ethicon Llc Surgical staple cartridge with firing member driven camming assembly that has an onboard tissue cutting feature
US11051829B2 (en) 2018-06-26 2021-07-06 DePuy Synthes Products, Inc. Customized patient-specific orthopaedic surgical instrument
US11903658B2 (en) 2019-01-07 2024-02-20 Virtual Incision Corporation Robotically assisted surgical system and related devices and methods
US11317915B2 (en) 2019-02-19 2022-05-03 Cilag Gmbh International Universal cartridge based key feature that unlocks multiple lockout arrangements in different surgical staplers
US11259807B2 (en) 2019-02-19 2022-03-01 Cilag Gmbh International Staple cartridges with cam surfaces configured to engage primary and secondary portions of a lockout of a surgical stapling device
US11357503B2 (en) 2019-02-19 2022-06-14 Cilag Gmbh International Staple cartridge retainers with frangible retention features and methods of using same
US11369377B2 (en) 2019-02-19 2022-06-28 Cilag Gmbh International Surgical stapling assembly with cartridge based retainer configured to unlock a firing lockout
US11751872B2 (en) 2019-02-19 2023-09-12 Cilag Gmbh International Insertable deactivator element for surgical stapler lockouts
USD950728S1 (en) 2019-06-25 2022-05-03 Cilag Gmbh International Surgical staple cartridge
USD964564S1 (en) 2019-06-25 2022-09-20 Cilag Gmbh International Surgical staple cartridge retainer with a closure system authentication key
USD952144S1 (en) 2019-06-25 2022-05-17 Cilag Gmbh International Surgical staple cartridge retainer with firing system authentication key
US11564732B2 (en) 2019-12-05 2023-01-31 Covidien Lp Tensioning mechanism for bipolar pencil

Citations (95)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3171549A (en) * 1961-07-21 1965-03-02 Molins Machine Co Ltd Mechanical handling apparatus
US3300053A (en) * 1964-04-08 1967-01-24 Melville F Peters Fluid separating device
US4367998A (en) * 1979-09-13 1983-01-11 United Kingdom Atomic Energy Authority Manipulators
US4491135A (en) * 1982-11-03 1985-01-01 Klein Harvey A Surgical needle holder
US4503854A (en) * 1983-06-16 1985-03-12 Jako Geza J Laser surgery
US4517963A (en) * 1983-01-04 1985-05-21 Harold Unger Image-erecting barrel rotator for articulated optical arm
US4586398A (en) * 1983-09-29 1986-05-06 Hamilton Industries Foot control assembly for power-operated tables and the like
US4635292A (en) * 1983-12-19 1987-01-06 Matsushita Electric Industrial Co., Ltd. Image processor
US4641292A (en) * 1983-06-20 1987-02-03 George Tunnell Voice controlled welding system
US4655257A (en) * 1985-03-25 1987-04-07 Kabushiki Kaisha Machida Seisakusho Guide tube assembly for industrial endoscope
US4717364A (en) * 1983-09-05 1988-01-05 Tomy Kogyo Inc. Voice controlled toy
US4725956A (en) * 1985-10-15 1988-02-16 Lockheed Corporation Voice command air vehicle control system
US4728974A (en) * 1985-05-31 1988-03-01 Yaskawa Electric Manufacturing Co., Ltd. Apparatus for supporting an imaging device
US4794912A (en) * 1987-08-17 1989-01-03 Welch Allyn, Inc. Borescope or endoscope with fluid dynamic muscle
US4797924A (en) * 1985-10-25 1989-01-10 Nartron Corporation Vehicle voice recognition method and apparatus
US4799171A (en) * 1983-06-20 1989-01-17 Kenner Parker Toys Inc. Talk back doll
US4805219A (en) * 1987-04-03 1989-02-14 Dragon Systems, Inc. Method for speech recognition
US4807723A (en) * 1983-10-17 1989-02-28 Otis Elevator Company Elevator roping arrangement
US4815006A (en) * 1986-09-29 1989-03-21 Asea Aktiebolag Method and device for calibrating a sensor on an industrial robot
US4817050A (en) * 1985-11-22 1989-03-28 Kabushiki Kaisha Toshiba Database system
US4815450A (en) * 1988-02-01 1989-03-28 Patel Jayendra I Endoscope having variable flexibility
US4898253A (en) * 1988-06-04 1990-02-06 Sartorius Gmbh Electronic balance for dosing
US4903304A (en) * 1985-04-19 1990-02-20 Siemens Aktiengesellschaft Method and apparatus for the recognition of individually spoken words
US4989253A (en) * 1988-04-15 1991-01-29 The Montefiore Hospital Association Of Western Pennsylvania Voice activated microscope
US4996975A (en) * 1989-06-01 1991-03-05 Kabushiki Kaisha Toshiba Electronic endoscope apparatus capable of warning lifetime of electronic scope
US5020001A (en) * 1988-09-19 1991-05-28 Toyoda Koki Kabushiki Kaisha Robot controller
US5019968A (en) * 1988-03-29 1991-05-28 Yulan Wang Three-dimensional vector processor
US5078140A (en) * 1986-05-08 1992-01-07 Kwoh Yik S Imaging device - aided robotic stereotaxis system
US5086401A (en) * 1990-05-11 1992-02-04 International Business Machines Corporation Image-directed robotic system for precise robotic surgery including redundant consistency checking
US5091656A (en) * 1989-10-27 1992-02-25 Storz Instrument Company Footswitch assembly with electrically engaged detents
US5098426A (en) * 1989-02-06 1992-03-24 Phoenix Laser Systems, Inc. Method and apparatus for precision laser surgery
US5097829A (en) * 1990-03-19 1992-03-24 Tony Quisenberry Temperature controlled cooling system
US5097839A (en) * 1987-11-10 1992-03-24 Allen George S Apparatus for imaging the anatomy
US5105367A (en) * 1988-10-19 1992-04-14 Hitachi, Ltd. Master slave manipulator system
US5109499A (en) * 1987-08-28 1992-04-28 Hitachi, Ltd. Vector multiprocessor system which individually indicates the data element stored in common vector register
US5182641A (en) * 1991-06-17 1993-01-26 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Composite video and graphics display for camera viewing systems in robotics and teleoperation
US5184601A (en) * 1991-08-05 1993-02-09 Putman John M Endoscope stabilizer
US5187574A (en) * 1990-08-24 1993-02-16 Kanda Tsushin Kogyo Co., Ltd. Method for automatically adjusting field of view of television monitor system and apparatus for carrying out the same
US5196688A (en) * 1975-02-04 1993-03-23 Telefunken Systemtechnik Gmbh Apparatus for recognizing and following a target
US5201325A (en) * 1989-09-01 1993-04-13 Andronic Devices Ltd. Advanced surgical retractor
US5201743A (en) * 1992-05-05 1993-04-13 Habley Medical Technology Corp. Axially extendable endoscopic surgical instrument
US5274862A (en) * 1992-05-18 1994-01-04 Palmer Jr John M Patient turning device and method for lateral traveling transfer system
US5279309A (en) * 1991-06-13 1994-01-18 International Business Machines Corporation Signaling device and method for monitoring positions in a surgical operation
US5282806A (en) * 1992-08-21 1994-02-01 Habley Medical Technology Corporation Endoscopic surgical instrument having a removable, rotatable, end effector assembly
US5289365A (en) * 1991-12-23 1994-02-22 Donnelly Corporation Modular network control system
US5289273A (en) * 1989-09-20 1994-02-22 Semborg-Recrob, Corp. Animated character system with real-time control
US5300926A (en) * 1990-05-09 1994-04-05 Siemens Aktiengesellschaft Medical apparatus, having a single actuating device
US5303148A (en) * 1987-11-27 1994-04-12 Picker International, Inc. Voice actuated volume image controller and display controller
US5304185A (en) * 1992-11-04 1994-04-19 Unisurge, Inc. Needle holder
US5303882A (en) * 1993-02-22 1994-04-19 The United States Of America As Represented By The Secretary Of The Navy Corner vortex suppressor
US5305244A (en) * 1992-04-06 1994-04-19 Computer Products & Services, Inc. Hands-free, user-supported portable computer
US5305203A (en) * 1988-02-01 1994-04-19 Faro Medical Technologies Inc. Computer-aided surgery apparatus
US5305427A (en) * 1991-05-21 1994-04-19 Sony Corporation Robot with virtual arm positioning based on sensed camera image
US5309717A (en) * 1993-03-22 1994-05-10 Minch Richard B Rapid shape memory effect micro-actuators
US5313306A (en) * 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5382885A (en) * 1993-08-09 1995-01-17 The University Of British Columbia Motion scaling tele-operating system with force feedback suitable for microsurgery
US5388987A (en) * 1990-04-17 1995-02-14 Cheval Freres, Sa Laser beam dental instrument
US5395369A (en) * 1993-06-10 1995-03-07 Symbiosis Corporation Endoscopic bipolar electrocautery instruments
US5397323A (en) * 1992-10-30 1995-03-14 International Business Machines Corporation Remote center-of-motion robot for surgery
US5403319A (en) * 1988-04-26 1995-04-04 Board Of Regents Of The University Of Washington Bone imobilization device
US5410638A (en) * 1993-05-03 1995-04-25 Northwestern University System for positioning a medical instrument within a biotic structure using a micromanipulator
US5482073A (en) * 1994-11-14 1996-01-09 R. W. Lyall & Company, Inc. Method of changing out gas meters
US5490117A (en) * 1993-03-23 1996-02-06 Seiko Epson Corporation IC card with dual level power supply interface and method for operating the IC card
US5490843A (en) * 1992-06-30 1996-02-13 Ethicon, Inc. Flexible endoscopic surgical port
US5500854A (en) * 1992-12-23 1996-03-19 Instrumentarium Corporation Data transmission system and equipment
US5506912A (en) * 1990-01-26 1996-04-09 Olympus Optical Co., Ltd. Imaging device capable of tracking an object
US5511256A (en) * 1994-07-05 1996-04-30 Capaldi; Guido Patient lift mechanism
US5512919A (en) * 1992-03-31 1996-04-30 Pioneer Electronic Corporation Three-dimensional coordinates input apparatus
US5609560A (en) * 1992-08-19 1997-03-11 Olympus Optical Co., Ltd. Medical operation device control system for controlling a operation devices accessed respectively by ID codes
US5622730A (en) * 1994-10-20 1997-04-22 Toshiba Kikai Kabushiki Kaisha Heat-displacing T-die
US5707900A (en) * 1995-11-17 1998-01-13 Stanley Electric Co., Ltd. Method of heat-treating semiconductor crystal of a group II-group VI compound
US5707942A (en) * 1995-07-20 1998-01-13 Tonen Corporation Lubricating oil composition
US5713350A (en) * 1995-09-06 1998-02-03 Fukuda Denshi Kabushiki Kaisha Patient information analysis management system and method
US5715823A (en) * 1996-02-27 1998-02-10 Atlantis Diagnostics International, L.L.C. Ultrasonic diagnostic imaging system with universal access to diagnostic information and images
US5715548A (en) * 1994-01-25 1998-02-10 Hill-Rom, Inc. Chair bed
US5718038A (en) * 1994-12-23 1998-02-17 National Semiconductor Corporation Electronic assembly for connecting to an electronic system and method of manufacture thereof
US5727569A (en) * 1996-02-20 1998-03-17 Cardiothoracic Systems, Inc. Surgical devices for imposing a negative pressure to fix the position of cardiac tissue during surgery
US5729659A (en) * 1995-06-06 1998-03-17 Potter; Jerry L. Method and apparatus for controlling a digital computer using oral input
US5737711A (en) * 1994-11-09 1998-04-07 Fuji Jukogyo Kabuishiki Kaisha Diagnosis system for motor vehicle
US5735290A (en) * 1993-02-22 1998-04-07 Heartport, Inc. Methods and systems for performing thoracoscopic coronary bypass and other procedures
US5855583A (en) * 1996-02-20 1999-01-05 Computer Motion, Inc. Method and apparatus for performing minimally invasive cardiac procedures
US5859934A (en) * 1994-05-05 1999-01-12 Sri International Method and apparatus for transforming coordinate systems in a telemanipulation system
US5857967A (en) * 1997-07-09 1999-01-12 Hewlett-Packard Company Universally accessible healthcare devices with on the fly generation of HTML files
US5860995A (en) * 1995-09-22 1999-01-19 Misener Medical Co. Inc. Laparoscopic endoscopic surgical instrument
US5876325A (en) * 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
US5878193A (en) * 1992-08-10 1999-03-02 Computer Motion, Inc. Automated endoscope system for optimal positioning
US5877819A (en) * 1993-03-31 1999-03-02 Branson; Philip J. Managing information in an endoscopy system
US5882206A (en) * 1995-03-29 1999-03-16 Gillio; Robert G. Virtual surgery system
US5884350A (en) * 1992-05-18 1999-03-23 Sirona Dental Systems Gmbh & Co. Kg Process and device for placing a patient in the correct position for treatment
US5887121A (en) * 1995-04-21 1999-03-23 International Business Machines Corporation Method of constrained Cartesian control of robotic mechanisms with active and passive joints
US5895461A (en) * 1996-07-30 1999-04-20 Telaric, Inc. Method and system for automated data storage and retrieval with uniform addressing scheme
US5897498A (en) * 1996-09-25 1999-04-27 Atl Ultrasound, Inc. Ultrasonic diagnostic imaging system with electronic message communications capability
US6201984B1 (en) * 1991-06-13 2001-03-13 International Business Machines Corporation System and method for augmentation of endoscopic surgery
US6850817B1 (en) * 1992-01-21 2005-02-01 Sri International Surgical system
US20050033580A1 (en) * 1994-09-22 2005-02-10 Computer Motion, Inc. Speech interface for an automated endoscope system

Family Cites Families (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US977825A (en) 1910-01-08 1910-12-06 George N Murphy Surgical instrument.
US3280991A (en) 1964-04-28 1966-10-25 Programmed & Remote Syst Corp Position control manipulator
GB1569450A (en) * 1976-05-27 1980-06-18 Nippon Electric Co Speech recognition system
US4128880A (en) 1976-06-30 1978-12-05 Cray Research, Inc. Computer vector register processing
US4058001A (en) 1976-08-02 1977-11-15 G. D. Searle & Co. Ultrasound imaging system with improved scan conversion
US4216462A (en) 1978-03-06 1980-08-05 General Electric Company Patient monitoring and data processing system
US4207959A (en) * 1978-06-02 1980-06-17 New York University Wheelchair mounted control apparatus
US4221997A (en) 1978-12-18 1980-09-09 Western Electric Company, Incorporated Articulated robot arm and method of moving same
WO1980002499A1 (en) 1979-05-21 1980-11-27 American Cystoscope Makers Inc Surgical instrument for an endoscope
FR2482508A1 (en) 1980-05-14 1981-11-20 Commissariat Energie Atomique MANIPULATOR AND MOTORIZED ORIENTATION BRACKET FOR SUCH A MANIPULATOR
FR2492304A1 (en) 1980-10-17 1982-04-23 Commissariat Energie Atomique TELEMANIPULATION ASSEMBLY MOUNTED ON A MOBILE PLATFORM AND COMPRISING A RETRACTABLE TELESCOPIC CARRIER ASSEMBLY WITHIN A SEALED HOOD, AND METHOD FOR SETTING UP ON AN ENCLOSURE
JPS57118299A (en) 1981-01-14 1982-07-23 Nissan Motor Voice load driver
JPS58130393A (en) 1982-01-29 1983-08-03 株式会社東芝 Voice recognition equipment
JPS58134357A (en) 1982-02-03 1983-08-10 Hitachi Ltd Array processor
US4456961A (en) * 1982-03-05 1984-06-26 Texas Instruments Incorporated Apparatus for teaching and transforming noncoincident coordinate systems
US4604016A (en) 1983-08-03 1986-08-05 Joyce Stephen A Multi-dimensional force-torque hand controller having force feedback
US4616637A (en) 1984-09-14 1986-10-14 Precision Surgical Instruments, Inc. Shoulder traction apparatus
US4676243A (en) 1984-10-31 1987-06-30 Aldebaran Xiii Consulting Company Automated anterior capsulectomy instrument
US4672963A (en) 1985-06-07 1987-06-16 Israel Barken Apparatus and method for computer controlled laser surgery
US4945479A (en) 1985-07-31 1990-07-31 Unisys Corporation Tightly coupled scientific processing system
US4776016A (en) 1985-11-21 1988-10-04 Position Orientation Systems, Inc. Voice control system
US4750136A (en) 1986-01-10 1988-06-07 American Telephone And Telegraph, At&T Information Systems Inc. Communication system having automatic circuit board initialization capability
JPH085018B2 (en) 1986-02-26 1996-01-24 株式会社日立製作所 Remote manipulation method and apparatus
US4791934A (en) 1986-08-07 1988-12-20 Picker International, Inc. Computer tomography assisted stereotactic surgery system and method
DE3636678A1 (en) * 1986-10-28 1988-05-11 Siemens Ag X-RAY DIAGNOSTIC DEVICE
US4854301A (en) 1986-11-13 1989-08-08 Olympus Optical Co., Ltd. Endoscope apparatus having a chair with a switch
JPH0829509B2 (en) 1986-12-12 1996-03-27 株式会社日立製作所 Control device for manipulator
US4791940A (en) 1987-02-02 1988-12-20 Florida Probe Corporation Electronic periodontal probe with a constant force applier
CA1307177C (en) 1987-02-09 1992-09-08 Ichiro Sogawa Mechanism for bending elongated body
US4860215A (en) 1987-04-06 1989-08-22 California Institute Of Technology Method and apparatus for adaptive force and position control of manipulators
US5065741A (en) 1987-04-16 1991-11-19 Olympus Optical Co. Ltd. Extracoporeal ultrasonic lithotripter with a variable focus
US4863133A (en) 1987-05-26 1989-09-05 Leonard Medical Arm device for adjustable positioning of a medical instrument or the like
US4762455A (en) 1987-06-01 1988-08-09 Remote Technology Corporation Remote manipulator
US4852083A (en) 1987-06-22 1989-07-25 Texas Instruments Incorporated Digital crossbar switch
JPH088933B2 (en) 1987-07-10 1996-01-31 日本ゼオン株式会社 Catheter
US5251127A (en) 1988-02-01 1993-10-05 Faro Medical Technologies Inc. Computer-aided surgery apparatus
US4964062A (en) 1988-02-16 1990-10-16 Ubhayakar Shivadev K Robotic arm systems
US4930494A (en) 1988-03-09 1990-06-05 Olympus Optical Co., Ltd. Apparatus for bending an insertion section of an endoscope using a shape memory alloy
US4949717A (en) 1988-03-17 1990-08-21 Shaw Edward L Surgical instrument with suture cutter
US4979933A (en) 1988-04-27 1990-12-25 Kraft, Inc. Reclosable bag
US4883400A (en) 1988-08-24 1989-11-28 Martin Marietta Energy Systems, Inc. Dual arm master controller for a bilateral servo-manipulator
US5123095A (en) 1989-01-17 1992-06-16 Ergo Computing, Inc. Integrated scalar and vector processors with vector addressing by the scalar processor
US4965417A (en) 1989-03-27 1990-10-23 Massie Philip E Foot-operated control
US4980626A (en) 1989-08-10 1990-12-25 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Method and apparatus for positioning a robotic end effector
US5271384A (en) 1989-09-01 1993-12-21 Mcewen James A Powered surgical retractor
DE69026196T2 (en) 1989-11-08 1996-09-05 George S Allen Mechanical arm for an interactive, image-controlled, surgical system
JP2964518B2 (en) 1990-01-30 1999-10-18 日本電気株式会社 Voice control method
US5175694A (en) 1990-02-08 1992-12-29 The United States Of America As Represented By The Secretary Of The Navy Centroid target tracking system utilizing parallel processing of digital data patterns
US5131105A (en) 1990-11-21 1992-07-21 Diasonics, Inc. Patient support table
US5145227A (en) 1990-12-31 1992-09-08 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Electromagnetic attachment mechanism
US5228429A (en) 1991-01-14 1993-07-20 Tadashi Hatano Position measuring device for endoscope
US5627584A (en) * 1991-01-17 1997-05-06 Olympus Optical Co., Ltd. Endoscope system with centralized control of associated peripheral equipment
US5217003A (en) 1991-03-18 1993-06-08 Wilk Peter J Automated surgical system and apparatus
US5166513A (en) 1991-05-06 1992-11-24 Coherent, Inc. Dual actuation photoelectric foot switch
US5230623A (en) 1991-12-10 1993-07-27 Radionics, Inc. Operating pointer with interactive computergraphics
US5626595A (en) * 1992-02-14 1997-05-06 Automated Medical Instruments, Inc. Automated surgical instrument
US5221283A (en) 1992-05-15 1993-06-22 General Electric Company Apparatus and method for stereotactic surgery
US5257999A (en) 1992-06-04 1993-11-02 Slanetz Jr Charles A Self-oriented laparoscopic needle holder for curved needles
US5754741A (en) * 1992-08-10 1998-05-19 Computer Motion, Inc. Automated endoscope for optimal positioning
US5515478A (en) * 1992-08-10 1996-05-07 Computer Motion, Inc. Automated endoscope system for optimal positioning
US5629594A (en) * 1992-12-02 1997-05-13 Cybernet Systems Corporation Force feedback system
US5417701A (en) * 1993-03-30 1995-05-23 Holmed Corporation Surgical instrument with magnetic needle holder
US6642836B1 (en) * 1996-08-06 2003-11-04 Computer Motion, Inc. General purpose distributed operating room control system
US6224542B1 (en) * 1999-01-04 2001-05-01 Stryker Corporation Endoscopic camera system with non-mechanical zoom

Patent Citations (101)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3171549A (en) * 1961-07-21 1965-03-02 Molins Machine Co Ltd Mechanical handling apparatus
US3300053A (en) * 1964-04-08 1967-01-24 Melville F Peters Fluid separating device
US5196688A (en) * 1975-02-04 1993-03-23 Telefunken Systemtechnik Gmbh Apparatus for recognizing and following a target
US4367998A (en) * 1979-09-13 1983-01-11 United Kingdom Atomic Energy Authority Manipulators
US4491135A (en) * 1982-11-03 1985-01-01 Klein Harvey A Surgical needle holder
US4517963A (en) * 1983-01-04 1985-05-21 Harold Unger Image-erecting barrel rotator for articulated optical arm
US4503854A (en) * 1983-06-16 1985-03-12 Jako Geza J Laser surgery
US4799171A (en) * 1983-06-20 1989-01-17 Kenner Parker Toys Inc. Talk back doll
US4641292A (en) * 1983-06-20 1987-02-03 George Tunnell Voice controlled welding system
US4717364A (en) * 1983-09-05 1988-01-05 Tomy Kogyo Inc. Voice controlled toy
US4586398A (en) * 1983-09-29 1986-05-06 Hamilton Industries Foot control assembly for power-operated tables and the like
US4807723A (en) * 1983-10-17 1989-02-28 Otis Elevator Company Elevator roping arrangement
US4635292A (en) * 1983-12-19 1987-01-06 Matsushita Electric Industrial Co., Ltd. Image processor
US4655257A (en) * 1985-03-25 1987-04-07 Kabushiki Kaisha Machida Seisakusho Guide tube assembly for industrial endoscope
US4903304A (en) * 1985-04-19 1990-02-20 Siemens Aktiengesellschaft Method and apparatus for the recognition of individually spoken words
US4728974A (en) * 1985-05-31 1988-03-01 Yaskawa Electric Manufacturing Co., Ltd. Apparatus for supporting an imaging device
US4725956A (en) * 1985-10-15 1988-02-16 Lockheed Corporation Voice command air vehicle control system
US4797924A (en) * 1985-10-25 1989-01-10 Nartron Corporation Vehicle voice recognition method and apparatus
US4817050A (en) * 1985-11-22 1989-03-28 Kabushiki Kaisha Toshiba Database system
US5078140A (en) * 1986-05-08 1992-01-07 Kwoh Yik S Imaging device - aided robotic stereotaxis system
US4815006A (en) * 1986-09-29 1989-03-21 Asea Aktiebolag Method and device for calibrating a sensor on an industrial robot
US4805219A (en) * 1987-04-03 1989-02-14 Dragon Systems, Inc. Method for speech recognition
US4794912A (en) * 1987-08-17 1989-01-03 Welch Allyn, Inc. Borescope or endoscope with fluid dynamic muscle
US5109499A (en) * 1987-08-28 1992-04-28 Hitachi, Ltd. Vector multiprocessor system which individually indicates the data element stored in common vector register
US5097839A (en) * 1987-11-10 1992-03-24 Allen George S Apparatus for imaging the anatomy
US5303148A (en) * 1987-11-27 1994-04-12 Picker International, Inc. Voice actuated volume image controller and display controller
US4815450A (en) * 1988-02-01 1989-03-28 Patel Jayendra I Endoscope having variable flexibility
US5305203A (en) * 1988-02-01 1994-04-19 Faro Medical Technologies Inc. Computer-aided surgery apparatus
US5019968A (en) * 1988-03-29 1991-05-28 Yulan Wang Three-dimensional vector processor
US4989253A (en) * 1988-04-15 1991-01-29 The Montefiore Hospital Association Of Western Pennsylvania Voice activated microscope
US5403319A (en) * 1988-04-26 1995-04-04 Board Of Regents Of The University Of Washington Bone imobilization device
US4898253A (en) * 1988-06-04 1990-02-06 Sartorius Gmbh Electronic balance for dosing
US5020001A (en) * 1988-09-19 1991-05-28 Toyoda Koki Kabushiki Kaisha Robot controller
US5105367A (en) * 1988-10-19 1992-04-14 Hitachi, Ltd. Master slave manipulator system
US5098426A (en) * 1989-02-06 1992-03-24 Phoenix Laser Systems, Inc. Method and apparatus for precision laser surgery
US4996975A (en) * 1989-06-01 1991-03-05 Kabushiki Kaisha Toshiba Electronic endoscope apparatus capable of warning lifetime of electronic scope
US5201325A (en) * 1989-09-01 1993-04-13 Andronic Devices Ltd. Advanced surgical retractor
US5289273A (en) * 1989-09-20 1994-02-22 Semborg-Recrob, Corp. Animated character system with real-time control
US5091656A (en) * 1989-10-27 1992-02-25 Storz Instrument Company Footswitch assembly with electrically engaged detents
US5506912A (en) * 1990-01-26 1996-04-09 Olympus Optical Co., Ltd. Imaging device capable of tracking an object
US5097829A (en) * 1990-03-19 1992-03-24 Tony Quisenberry Temperature controlled cooling system
US5388987A (en) * 1990-04-17 1995-02-14 Cheval Freres, Sa Laser beam dental instrument
US5300926A (en) * 1990-05-09 1994-04-05 Siemens Aktiengesellschaft Medical apparatus, having a single actuating device
US5086401A (en) * 1990-05-11 1992-02-04 International Business Machines Corporation Image-directed robotic system for precise robotic surgery including redundant consistency checking
US5299288A (en) * 1990-05-11 1994-03-29 International Business Machines Corporation Image-directed robotic system for precise robotic surgery including redundant consistency checking
US5408409A (en) * 1990-05-11 1995-04-18 International Business Machines Corporation Image-directed robotic system for precise robotic surgery including redundant consistency checking
US5187574A (en) * 1990-08-24 1993-02-16 Kanda Tsushin Kogyo Co., Ltd. Method for automatically adjusting field of view of television monitor system and apparatus for carrying out the same
US5313306A (en) * 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5305427A (en) * 1991-05-21 1994-04-19 Sony Corporation Robot with virtual arm positioning based on sensed camera image
US5279309A (en) * 1991-06-13 1994-01-18 International Business Machines Corporation Signaling device and method for monitoring positions in a surgical operation
US6024695A (en) * 1991-06-13 2000-02-15 International Business Machines Corporation System and method for augmentation of surgery
US5402801A (en) * 1991-06-13 1995-04-04 International Business Machines Corporation System and method for augmentation of surgery
US6201984B1 (en) * 1991-06-13 2001-03-13 International Business Machines Corporation System and method for augmentation of endoscopic surgery
US5182641A (en) * 1991-06-17 1993-01-26 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Composite video and graphics display for camera viewing systems in robotics and teleoperation
US5184601A (en) * 1991-08-05 1993-02-09 Putman John M Endoscope stabilizer
US5289365A (en) * 1991-12-23 1994-02-22 Donnelly Corporation Modular network control system
US6850817B1 (en) * 1992-01-21 2005-02-01 Sri International Surgical system
US5512919A (en) * 1992-03-31 1996-04-30 Pioneer Electronic Corporation Three-dimensional coordinates input apparatus
US5305244A (en) * 1992-04-06 1994-04-19 Computer Products & Services, Inc. Hands-free, user-supported portable computer
US5305244B2 (en) * 1992-04-06 1997-09-23 Computer Products & Services I Hands-free user-supported portable computer
US5305244B1 (en) * 1992-04-06 1996-07-02 Computer Products & Services I Hands-free, user-supported portable computer
US5201743A (en) * 1992-05-05 1993-04-13 Habley Medical Technology Corp. Axially extendable endoscopic surgical instrument
US5884350A (en) * 1992-05-18 1999-03-23 Sirona Dental Systems Gmbh & Co. Kg Process and device for placing a patient in the correct position for treatment
US5274862A (en) * 1992-05-18 1994-01-04 Palmer Jr John M Patient turning device and method for lateral traveling transfer system
US5490843A (en) * 1992-06-30 1996-02-13 Ethicon, Inc. Flexible endoscopic surgical port
US5878193A (en) * 1992-08-10 1999-03-02 Computer Motion, Inc. Automated endoscope system for optimal positioning
US5609560A (en) * 1992-08-19 1997-03-11 Olympus Optical Co., Ltd. Medical operation device control system for controlling a operation devices accessed respectively by ID codes
US5282806A (en) * 1992-08-21 1994-02-01 Habley Medical Technology Corporation Endoscopic surgical instrument having a removable, rotatable, end effector assembly
US5397323A (en) * 1992-10-30 1995-03-14 International Business Machines Corporation Remote center-of-motion robot for surgery
US5304185A (en) * 1992-11-04 1994-04-19 Unisurge, Inc. Needle holder
US5500854A (en) * 1992-12-23 1996-03-19 Instrumentarium Corporation Data transmission system and equipment
US5735290A (en) * 1993-02-22 1998-04-07 Heartport, Inc. Methods and systems for performing thoracoscopic coronary bypass and other procedures
US5303882A (en) * 1993-02-22 1994-04-19 The United States Of America As Represented By The Secretary Of The Navy Corner vortex suppressor
US5309717A (en) * 1993-03-22 1994-05-10 Minch Richard B Rapid shape memory effect micro-actuators
US5490117A (en) * 1993-03-23 1996-02-06 Seiko Epson Corporation IC card with dual level power supply interface and method for operating the IC card
US5877819A (en) * 1993-03-31 1999-03-02 Branson; Philip J. Managing information in an endoscopy system
US5410638A (en) * 1993-05-03 1995-04-25 Northwestern University System for positioning a medical instrument within a biotic structure using a micromanipulator
US5395369A (en) * 1993-06-10 1995-03-07 Symbiosis Corporation Endoscopic bipolar electrocautery instruments
US5382885A (en) * 1993-08-09 1995-01-17 The University Of British Columbia Motion scaling tele-operating system with force feedback suitable for microsurgery
US5876325A (en) * 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
US5715548A (en) * 1994-01-25 1998-02-10 Hill-Rom, Inc. Chair bed
US5859934A (en) * 1994-05-05 1999-01-12 Sri International Method and apparatus for transforming coordinate systems in a telemanipulation system
US5511256A (en) * 1994-07-05 1996-04-30 Capaldi; Guido Patient lift mechanism
US20050033580A1 (en) * 1994-09-22 2005-02-10 Computer Motion, Inc. Speech interface for an automated endoscope system
US5622730A (en) * 1994-10-20 1997-04-22 Toshiba Kikai Kabushiki Kaisha Heat-displacing T-die
US5737711A (en) * 1994-11-09 1998-04-07 Fuji Jukogyo Kabuishiki Kaisha Diagnosis system for motor vehicle
US5482073A (en) * 1994-11-14 1996-01-09 R. W. Lyall & Company, Inc. Method of changing out gas meters
US5718038A (en) * 1994-12-23 1998-02-17 National Semiconductor Corporation Electronic assembly for connecting to an electronic system and method of manufacture thereof
US5882206A (en) * 1995-03-29 1999-03-16 Gillio; Robert G. Virtual surgery system
US5887121A (en) * 1995-04-21 1999-03-23 International Business Machines Corporation Method of constrained Cartesian control of robotic mechanisms with active and passive joints
US5729659A (en) * 1995-06-06 1998-03-17 Potter; Jerry L. Method and apparatus for controlling a digital computer using oral input
US5707942A (en) * 1995-07-20 1998-01-13 Tonen Corporation Lubricating oil composition
US5713350A (en) * 1995-09-06 1998-02-03 Fukuda Denshi Kabushiki Kaisha Patient information analysis management system and method
US5860995A (en) * 1995-09-22 1999-01-19 Misener Medical Co. Inc. Laparoscopic endoscopic surgical instrument
US5707900A (en) * 1995-11-17 1998-01-13 Stanley Electric Co., Ltd. Method of heat-treating semiconductor crystal of a group II-group VI compound
US5855583A (en) * 1996-02-20 1999-01-05 Computer Motion, Inc. Method and apparatus for performing minimally invasive cardiac procedures
US5727569A (en) * 1996-02-20 1998-03-17 Cardiothoracic Systems, Inc. Surgical devices for imposing a negative pressure to fix the position of cardiac tissue during surgery
US5715823A (en) * 1996-02-27 1998-02-10 Atlantis Diagnostics International, L.L.C. Ultrasonic diagnostic imaging system with universal access to diagnostic information and images
US5895461A (en) * 1996-07-30 1999-04-20 Telaric, Inc. Method and system for automated data storage and retrieval with uniform addressing scheme
US5897498A (en) * 1996-09-25 1999-04-27 Atl Ultrasound, Inc. Ultrasonic diagnostic imaging system with electronic message communications capability
US5857967A (en) * 1997-07-09 1999-01-12 Hewlett-Packard Company Universally accessible healthcare devices with on the fly generation of HTML files

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7294106B2 (en) * 2000-12-21 2007-11-13 Brainlab Ag Cable-free medical detection and treatment system
US20050033161A1 (en) * 2000-12-21 2005-02-10 Rainer Birkenbach Cable-free medical detection and treatment system
US8037179B2 (en) * 2006-11-02 2011-10-11 Storz Endoskop Produktions Gmbh Device control system employing extensible markup language for defining information resources
US20080109402A1 (en) * 2006-11-02 2008-05-08 Gang Wang Device control system employing extensible markup language for defining information resources
US20090276515A1 (en) * 2008-05-02 2009-11-05 Boston Scientific Scimed, Inc. Multi-modality network for improved workflow
US9878264B2 (en) 2009-03-25 2018-01-30 D-Box Technologies Inc. Method and apparatus for distributing motion signals in a multi-seat environment
US9178849B2 (en) * 2009-03-25 2015-11-03 D-Box Technologies Inc. Method and apparatus for distributing motion signals in a multi-seat environment
US20100245116A1 (en) * 2009-03-25 2010-09-30 Senecal Pierre Method and apparatus for distributing motion signals in a multi-seat environment
US20140012587A1 (en) * 2012-07-03 2014-01-09 Samsung Electronics Co., Ltd. Method and apparatus for connecting service between user devices using voice
US9805733B2 (en) * 2012-07-03 2017-10-31 Samsung Electronics Co., Ltd Method and apparatus for connecting service between user devices using voice
US10475464B2 (en) 2012-07-03 2019-11-12 Samsung Electronics Co., Ltd Method and apparatus for connecting service between user devices using voice
CN107966910A (en) * 2017-11-30 2018-04-27 深圳Tcl新技术有限公司 Method of speech processing, intelligent sound box and readable storage medium storing program for executing
US11417329B2 (en) * 2019-01-30 2022-08-16 Siemens Healthcare Gmbh System for performing a magnetic resonance tomography and method for controlling an MR scanner

Also Published As

Publication number Publication date
US20040124964A1 (en) 2004-07-01
US7053752B2 (en) 2006-05-30

Similar Documents

Publication Publication Date Title
US7053752B2 (en) General purpose distributed operating room control system
US6642836B1 (en) General purpose distributed operating room control system
US6646541B1 (en) General purpose distributed operating room control system
US7259652B2 (en) General purpose distributed operating room control system
US7408439B2 (en) Method and apparatus for accessing medical data over a network
EP1031137B1 (en) General purpose distributed operating room control system
EP1172064A2 (en) Method and apparatus for accessing medical data over a network
US5970457A (en) Voice command and control medical care system
US5425128A (en) Automatic management system for speech recognition processes
EP1676540B1 (en) Apparatus for performing a voice-assisted orthopaedic surgical procedure
US11176945B2 (en) Healthcare systems and methods using voice inputs
JP2007334301A (en) Speech recognition system with user profile management component
US8010368B2 (en) Surgical system controlling apparatus and surgical system controlling method
JPH11312073A (en) System for recognizing meaning
JP2004086150A (en) Voice control system
US7588534B2 (en) Endoscope system for operating medical device by voice
JP2008161706A (en) General-purpose distribution type operation room control system
Custers Speech recognition for an environmental control system
JPS58141146A (en) Medical treating apparatus
JP3052447U (en) A device that recognizes and responds to voice
JPH06114077A (en) Voice controller for microscope for operation
Joshi et al. Freedom Voice Control [voice-activated bed control]
JP2002311985A (en) Medical control system
ES2237245A1 (en) Auxiliary robot for performing surgical work in operating room, has processing unit to control movement of robot arm using captured and digitized images of operating room and digitized vocal commands from operator

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION