EP2815789A1 - Apparatus for controlling the generation of ultrasound - Google Patents

Apparatus for controlling the generation of ultrasound Download PDF

Info

Publication number
EP2815789A1
EP2815789A1 EP13193911.8A EP13193911A EP2815789A1 EP 2815789 A1 EP2815789 A1 EP 2815789A1 EP 13193911 A EP13193911 A EP 13193911A EP 2815789 A1 EP2815789 A1 EP 2815789A1
Authority
EP
European Patent Office
Prior art keywords
ultrasound
irradiation device
tissue
parameter
medical image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP13193911.8A
Other languages
German (de)
French (fr)
Other versions
EP2815789B1 (en
Inventor
Young-Kyoo Hwang
Won-Chul Bang
Ho-Taik Lee
Sang-Hyun Kim
Ji-Young Park
Do Kyoon Kim
Chang-Yeong Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP2815789A1 publication Critical patent/EP2815789A1/en
Application granted granted Critical
Publication of EP2815789B1 publication Critical patent/EP2815789B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/32Surgical cutting instruments
    • A61B17/320068Surgical cutting instruments using mechanical vibrations, e.g. ultrasonic
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B18/00Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/02Devices for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computerised tomographs
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/54Control of the diagnostic device
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N7/02Localised ultrasound hyperthermia
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00017Electrical control of surgical instruments
    • A61B2017/00022Sensing or detecting at the treatment site
    • A61B2017/00106Sensing or detecting at the treatment site ultrasonic
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/101Computer-aided simulation of surgical operations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364Correlation of different images or relation of image positions in respect to the body
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/374NMR or MRI
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/376Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
    • A61B2090/3762Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/378Surgical systems with images on a monitor during operation using ultrasound
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0858Detecting organic movements or changes, e.g. tumours, cysts, swellings involving measuring tissue layers, e.g. skin, interfaces
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N7/00Ultrasound therapy
    • A61N2007/0004Applications of ultrasound therapy

Definitions

  • the present disclosure relates to methods, apparatus, and a high-intensity focused ultrasound (HIFU) system for generating ultrasound.
  • HIFU high-intensity focused ultrasound
  • HIFU high-intensity focused ultrasound
  • a treatment using a HIFU knife includes focusing and irradiating HIFU on a desired region of a tumor to cause focal destruction or necrosis of tumor tissue and removing and treating the tumor.
  • Technical challenges to be solved are not limited thereto, and other technical challenges may exist.
  • a method to generate a control signal for controlling an ultrasound irradiation device to generate an ultrasound including receiving a medical image including anatomical information about a subject; calculating one or more characteristics of a tissue in the subject affecting propagation of the ultrasound based on the medical image; determining a parameter of the control signal to create a focal point on the subject using the calculated characteristics; and generating the control signal according to the determined parameter.
  • the calculating of the at least one characteristic may include processing the medical image to calculate the at least one characteristic of the tissue on a path along which the ultrasound propagates from an element of the ultrasound irradiation device to the focal point.
  • Receiving a medical image may comprise acquiring a medical image, e.g. from a data storage, CT scanner, MRI scanner or other device.
  • the characteristic may also include a speed of the ultrasound passing through the tissue, a density of the tissue, an attenuation coefficient of the ultrasound for the tissue, or a combination thereof.
  • the method may also include calibrating the ultrasound irradiation device using the medical image.
  • the calculating of the characteristics may further include processing the ultrasound irradiation device and the medical image to calculate the characteristics of the tissue along a path that the ultrasound propagates from an element of the ultrasound irradiation device to the focal point.
  • the calibrating of the ultrasound irradiation device may include generating an ultrasound image of the subject using a diagnostic ultrasound irradiation device; calibrating the diagnostic ultrasound irradiation device using an image obtained by registering the ultrasound image with the medical image; and calibrating the ultrasound irradiation device using the calibrated diagnostic ultrasound irradiation device.
  • the calibration may be performed by adjusting coordinates of the ultrasound irradiation device.
  • the medical image may include a computed tomography (CT) image.
  • CT computed tomography
  • the determining of the parameter of the ultrasound may include determining the parameter by combining characteristics of the ultrasound with the calculated characteristics affecting the propagation of the ultrasound.
  • an apparatus for controlling the generation of an ultrasound including an interface unit configured to receive a medical image including anatomical information about a subject; a characteristics calculation unit configured to calculate characteristics of a tissue in the subject affecting propagation of the ultrasound based on the medical image; a parameter determiner configured to determine a parameter of the ultrasound to create a focal point on the subject using the calculated characteristics; and a control unit configured to produce a control signal according to the determined parameter to generate the ultrasound, the control signal being produced for a therapeutic ultrasound irradiation device.
  • the characteristics calculation unit may process the medical image to calculate the one or more characteristic of the tissue on a path along which the ultrasound propagates from an element of the therapeutic ultrasound irradiation device to the focal point.
  • the characteristic may include a speed of the ultrasound passing through the tissue, a density of the tissue, an attenuation coefficient of the ultrasound for the tissue, or a combination thereof.
  • the apparatus may also include a calibration unit configured to calibrate the apparatus using the medical image.
  • the calibration unit may be configured to acquire an ultrasound image of the subject from the interface unit, to calibrate a diagnostic ultrasound irradiation device by using an image obtained by registering the ultrasound image with the medical image, and calibrates the apparatus by using the calibrated diagnostic ultrasound irradiation device.
  • Registering the ultrasound image with the medical image may comprise correlating the ultrasound image to the medical image.
  • Calibrating the apparatus may comprise calibrating the calculation unit and/or the control unit.
  • the medical image may include a computed tomography (CT) image.
  • CT computed tomography
  • a non-transitory computer-readable recording medium having recorded thereon a program for executing the method as described above.
  • a method to generate an ultrasound including acquiring an image of a subject including heterogeneous tissue; and determining a parameter of the ultrasound, in which characteristics of the heterogeneous tissue has been reflected using the image.
  • the image of the subject may include human internal organs.
  • the determining of the parameter of the ultrasound includes calculating characteristics of the heterogeneous tissue affecting propagation of the ultrasound using the image; and determining the parameter of the ultrasound to create a focal point on the subject using the calculated characteristic.
  • the determining of the parameter of the ultrasound using the calculated characteristic includes calculating a first sound pressure representing a sound pressure at the focal point when the ultrasound propagates in homogeneous tissue; determining an element that transmits the ultrasound among elements in the ultrasound irradiation device and setting a particle velocity of the determined element; calculating a second sound pressure representing a sound pressure at the focal point when the ultrasound using the particle velocity propagates in the heterogeneous tissue; and determining the parameter of the ultrasound based on a relationship between the first sound pressure and the second sound pressure.
  • the determining of the parameter of the ultrasound based on the relationship between the first and second sound pressures may include determining whether a difference between the first and second sound pressures exceeds a threshold value; and resetting or adjusting a particle velocity of the element in response to the difference exceeding the threshold value.
  • an ultrasound control apparatus including a processor configured to process a medical image of a subject to determine a parameter based on a speed of a therapeutic ultrasound passing through a tissue, a density of the tissue, and an attenuation coefficient and to control the therapeutic ultrasound to create a focal point onto a subject; and a controller producing a signal to generate ultrasound waves according to the determined parameter.
  • the method and apparatus may comprise generating the ultrasound using a therapeutic ultrasound irradiation device on the basis of the control signal.
  • the ultrasound irradiation device may be connected to the control unit.
  • the characteristics calculation unit may be further configured to control an intensity and a duration of the therapeutic ultrasound.
  • the apparatus may also include a calibration unit processing the medical image to calibrate the processor and the controller.
  • FIG. 1 illustrates an apparatus 10 to control ultrasound (hereinafter, referred to as "ultrasound control apparatus"), according to an embodiment.
  • the ultrasound control apparatus 10 includes an interface unit 110, a characteristics calculation unit 120, a parameter determiner 130, and a control unit 140.
  • the ultrasound control apparatus 10 of FIG. 1 includes certain components, it will be understood by those skilled in the art that the ultrasound control apparatus 10 may further include additional components to the components shown in FIG. 1 . Also, in an alternative configuration, the ultrasound control apparatus 10 may exclude, for instance, the interface unit 110 and the characteristic calculation unit 120 may include an interface to receive a signal representative of a medical image.
  • the ultrasound control apparatus 10 may correspond to one or more processors.
  • the interface unit 110 acquires a medical image 20 including anatomical information about a subject.
  • the object may include at least one tissue of a patient.
  • the object may be a heterogeneous part of a human body, which includes different kinds of tissues such as skin, bone, muscle, blood, and an organ, or a combination thereof, but is not limited thereto.
  • the anatomical information about the object may be information about locations and sizes of one or more tissues.
  • a therapeutic ultrasound irradiation device (not shown), such as a HIFU apparatus, may create a focal point of therapeutic ultrasound at a target position of the object, e.g. to generate the medical image 20.
  • the medical image 20 may be a previously acquired and stored as a computed tomography (CT) image or magnetic resonance (MR) image of the object, but is not limited thereto.
  • CT computed tomography
  • MR magnetic resonance
  • images that have been previously acquired and stored for the same object, and images acquired just prior to ultrasound treatment may be input to the ultrasound control apparatus 10 through the interface unit 110.
  • Images may contain 2D and/or 3D information, e.g. multiple 2D image slices of the subject.
  • the interface unit 110 may be a unit to perform data input or output or to transmit information directly input by a user to another unit.
  • the characteristics calculation unit 120 processes the medical image 20 to calculate characteristics of one or more tissues in the object that may affect the propagation of therapeutic ultrasound.
  • the characteristics calculation unit 120 receives the medical image 20 from the interface unit 110 to calculate characteristics of one or more tissues in the object that may affect the propagation of therapeutic ultrasound.
  • Characteristics that may affect the propagation of therapeutic ultrasound may be physical characteristics of each of the one or more tissues.
  • the physical characteristics may include speed of the therapeutic ultrasound passing through each of the tissues, a density of each tissue, an attenuation coefficient of the therapeutic ultrasound for the tissue, or a combination thereof, but are not limited thereto.
  • ultrasound is a radiated wave produced by vibrations through a physical medium
  • propagation speed of an ultrasound wave is affected by a density of the physical medium. More specifically, as the density of the physical medium increases, a speed of the ultrasound wave increases. Furthermore, as the ultrasound wave travels through the medium, the ultrasound wave may be absorbed or scattered by the medium, thereby reducing its intensity or amplitude. A reduction in intensity or amplitude of the ultrasound wave is called an attenuation of the ultrasound wave.
  • An amount of attenuation of an ultrasound wave is proportional to a frequency of the ultrasound wave and an amount of protein in a tissue through which the ultrasound wave passes. The amount of attenuation of the ultrasound wave is inversely proportional to water content of the tissue.
  • the characteristics calculation unit may calculate an attenuation coefficient, e.g. based on water or protein content or otherwise.
  • the parameter determiner 130 determines a parameter of therapeutic ultrasound to create a focal point onto a subject using the calculated characteristics. For example, the parameter determiner 130 receives the calculated characteristics from the characteristics calculation unit 120 and determines a parameter for the therapeutic ultrasound irradiation on the focal point by using the calculated characteristics.
  • the control unit 140 produces a signal to generate ultrasound waves according to the determined parameter.
  • the control unit 140 receives the parameter determined by the parameter determiner 130 to generate a control signal for a therapeutic ultrasound irradiation device 30 as shown in FIG. 2 .
  • the ultrasound control apparatus 10 having the above-described configuration calculates the speed of therapeutic ultrasound passing through tissue, a density of the tissue, and an/or attenuation coefficient of therapeutic ultrasound and precisely controls the therapeutic ultrasound by means of the control signal of control unit 140 so that a therapeutic ultrasound irradiation device creates a focal point at a desired position.
  • the ultrasound control apparatus 10 may also control the intensity and duration of therapeutic ultrasound being transmitted.
  • FIG. 2 illustrates a configuration of an ultrasound control apparatus 10 according to another embodiment.
  • the ultrasound control apparatus 10 includes an interface unit 110, a characteristics calculation unit 120, a parameter determiner 130, a control unit 140, and a calibration unit 150.
  • the ultrasound control apparatus 10 of FIG. 2 includes certain components, it will be understood by those skilled in the art that the ultrasound control apparatus 10 may further include additional components to the components shown in FIG. 2 . Also, in an alternative configuration, the ultrasound control apparatus 10 may exclude, for instance, the interface unit 110 and/or the calibration unit 150 and the characteristic calculation unit 120 may include an interface to receive a signal representative of a medical image and/or a calibration function.
  • the ultrasound control apparatus 10 of FIG. 2 may correspond to one or more processors.
  • the interface unit 110 acquires an ultrasound image of a subject from a diagnostic ultrasound irradiation device 40. Alternatively or additionally, a medical image of the subject is input to the interface unit 110 from a CT scanner, MRI scanner, or a previously stored ultrasound, CT, MRI and/or other medical image is used.
  • the interface unit 110, the characteristics calculation unit 120, the parameter determiner 130, and the control unit 140 have substantially the same functions as those of their counterparts in FIG. 1 .
  • the diagnostic ultrasound irradiation device 40 transmits diagnostic ultrasound to a subject and acquires an ultrasound signal reflected from the subject. More specifically, in response to the diagnostic ultrasound irradiation device 40 transmitting a diagnostic ultrasound having a frequency range of 2 to 18 MHz to the subject, the diagnostic ultrasound is partially reflected from layers between different tissues of the subject. The diagnostic ultrasound is reflected from an area of the subject where there is a change in density, for instance, from blood cells within a blood plasma or small structures within organs. The reflected diagnostic ultrasound vibrates a piezoelectric converter of the diagnostic ultrasound irradiation device 40. As the piezoelectric converter vibrates, it emits electrical pulses producing the ultrasound signal.
  • the diagnostic ultrasound irradiation device 40 converts or processes the ultrasound signal to an ultrasound image of the subject to be then transmitted to the interface unit 110. For instance, the diagnostic ultrasound irradiation device 40 directly generates ultrasound images of the subject using electrical pulse signals, or the calibration unit 150, which will be described below, produces ultrasound images of the subject by using the electrical pulse signals. When the diagnostic ultrasound irradiation device 40 directly generates ultrasound images, the diagnostic ultrasound irradiation device 40 transmits information about the ultrasound images to the interface unit 110. On the other hand, when the calibration unit 150 generates ultrasound images, the diagnostic ultrasound irradiation device 40 transmits the electrical pulse signals to the interface unit 110.
  • the diagnostic ultrasound irradiation device 40 has a particular location relationship with a therapeutic ultrasound irradiation device 30.
  • the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30 may be separated from each other with a predetermined distance interposed therebetween for operation, may be located adjacent to each other, or may be integrated as a single device.
  • the therapeutic ultrasound irradiation device 30 may include a combination of one or more elements, e.g. actuator elements such as piezoelectric elements.
  • the plurality of elements receive signals from the control unit 140 to individually transmit therapeutic ultrasound waves.
  • durations of transmission of the therapeutic ultrasound may be set differently for each of the elements. Because the plurality of elements may individually transmit therapeutic ultrasound as described above, it is possible to change a position of a focal point of the therapeutic ultrasound while the therapeutic ultrasound irradiation device 30 remains stationary.
  • therapeutic ultrasound may be focused along lesions of an internal organ moving due to a patient's respiration or other motions.
  • the therapeutic ultrasound irradiation device 30 may converge therapeutic ultrasound on a focal point by using a phase array technique.
  • the phase array technique is understood by those skilled in the art, and a detailed description thereof is omitted.
  • therapeutic ultrasound may be high intensity focused ultrasound (HIFU) having enough energy to cause necrosis of a tumor inside a patient's body.
  • HIFU high intensity focused ultrasound
  • a HIFU system focuses and irradiates HIFU onto a portion of a subject to be treated to cause focal destruction or necrosis of a lesion and removes or treats the lesion.
  • the therapeutic ultrasound irradiation device 30 in the HIFU system continues to irradiate the focal point by setting the focal point of the HIFU to a certain position, the temperature of a cell irradiated with HIFU rises above a predetermined temperature to cause necrosis of the surrounding tissue.
  • the description of the present embodiment may also apply to other devices that transmit focused ultrasound similar to HIFU or devices to adjust a focal point using a sound pressure.
  • the calibration unit 150 uses the medical image 20 to calibrate the diagnostic ultrasound irradiation device 30, through the control unit 140, to transmit therapeutic ultrasound.
  • the calibration refers to a process of adjusting coordinates of the therapeutic ultrasound irradiation device 30 so that the therapeutic ultrasound irradiation device 30 may transmit the therapeutic ultrasound to a point corresponding to a predetermined point (for instance, a lesion) within the medical image 20.
  • FIG. 3 illustrates a method of calibrating the therapeutic ultrasound irradiation device 30 in the calibration unit 150. It is assumed herein that medical images 310 are computed tomography (CT) images, but other types of medical images may be provided.
  • CT computed tomography
  • the calibration unit 150 receives electrical pulse signals from the interface unit 110 to generate ultrasound images 320 of a subject.
  • the calibration unit 150 may use the electrical pulse signals to generate two-dimensional (2D) or three-dimensional (3D) ultrasound images of the subject.
  • the diagnostic ultrasound irradiation device 40 irradiates the subject with diagnostic ultrasound by changing a location and an orientation relative to the subject, receives a reflected ultrasound, and transmits electrical pulse signals corresponding to the reflected ultrasound to the interface unit 110.
  • the calibration unit 150 uses the electrical pulse signals received from the interface unit 110 to generate a plurality of cross-sectional images of the subject.
  • the calibration unit 150 then accumulates the plurality of cross-sectional images to create a 3D ultrasound image of the subject.
  • the calibration unit 150 acquires the ultrasound images through the interface unit 110.
  • the method at the calibration unit 150 registers the medical image 310 received from the interface unit 110 with the ultrasound image 320 of the subject.
  • the registration refers to a method of configuring a first coordinate system of the medical image 310 to correspond to a second coordinate system of the ultrasound image 320.
  • An image obtained after the registration may be a single medical image into which the medical image 310 and the ultrasound image 320 are combined, or an image in which the medical image 310 and the ultrasound image 320, having the same coordinate system, are disposed in parallel.
  • the registration may comprise correlating the medical image to the ultrasound image, i.e. correlating the first coordinate system to the second coordinate system.
  • the calibration unit 150 registers the medical images 310 with the ultrasound images 320 using geometrical correlations between tissues in the medical images 310 and those in the ultrasound images 320.
  • the geometrical correlations may be relationships between landmark points (also called reference points) extracted from the tissues.
  • the calibration unit 150 may determine a point at which anatomical structure of tissue is distinctly reflected as a landmark point. For example, if a tissue of interest from which a landmark point will be extracted is a liver, a point at which blood vessels branch off in a vascular structure of the liver may be determined as the landmark point. If the tissue of interest is a heart, the landmark point may be a boundary between the right and left atria or a boundary where the vena cava and an outer wall of the heart meet.
  • the calibration unit 150 may determine an uppermost or a lowermost point of tissue in a predetermined coordinate system as a landmark point.
  • the calibration unit 150 may also determine uniformly spaced points, which can be interpolated between the landmark points selected in the above examples, as landmark points.
  • the method at the calibration unit 150 registers the ultrasound image 320 with the medical image 310 and calculates a transformation relation between the first coordinate system of the medical image 310 and the second coordinate system of the ultrasound image 310.
  • the calibration unit 150 finds points in the ultrasound image 320 corresponding to points in the medical image 310, respectively, and calculates a coordinate transformation matrix to map any point in the medical image 310 to the corresponding point in the ultrasound image 320.
  • the calibration unit 150 may set coordinates of a predetermined position Pi (xi, yi, zi), for instance, a position at which a focal point of therapeutic ultrasound is to be formed, in the medical image 310 with respect to its arbitrary origin.
  • the method at the calibration unit 150 then registers the ultrasound image 320 with the medical image 310 (operation 330) and finds coordinates of a point Pt(xt, yt, zt) in the ultrasound image 320 corresponding to the coordinates of the position Pi(xi, yi, zi) through the registration.
  • the calibration unit 150 calculates variations ⁇ x, ⁇ y, and ⁇ z in positions of the points Pi and Pt along x-, y-, and z-axes. According to a process described above, at operation 340, the method at the calibration unit 150 calibrates the diagnostic ultrasound irradiation device 40.
  • the method at the calibration unit 150 uses the calibrated diagnostic ultrasound irradiation device 40 to calibrate the therapeutic ultrasound irradiation device 30.
  • the calibration is a method of adjusting coordinates of the therapeutic ultrasound irradiation device 30 so that the therapeutic ultrasound irradiation device 30 transmits therapeutic ultrasound to a point corresponding to a predetermined point within the medical image 310.
  • the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30 have a predetermined position relationship with each other.
  • the method at the calibration unit 150 calibrates the therapeutic ultrasound irradiation device 30 based on the known relationship between coordinates of the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30.
  • the relationship between coordinates of the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30 are calculated by rotation and translation of a coordinate axis and enlargement or reduction using a scale factor.
  • the relationship between coordinates of focal points of diagnostic ultrasound and therapeutic ultrasound transmitted from the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30, respectively, may be calculated by rotation and translation of a coordinate axis and enlargement or reduction using a scale factor.
  • the calibration unit 150 calibrates the therapeutic ultrasound irradiation device 30 by calculating a position of a focal point of a therapeutic ultrasound transmitted from the therapeutic ultrasound irradiation device 30 within the ultrasound image 320.
  • the calibration unit 150 calculates the position of the focal point based on the known relationship between coordinates of the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30.
  • the calibration unit 150 calculates a position of a focal point of therapeutic ultrasound to be transmitted from the therapeutic ultrasound irradiation device 30 within the medical image 310.
  • the calibration unit 150 transmits a generated signal to the control unit 140, and the control unit 140 changes a position to be irradiated by the therapeutic ultrasound irradiation device 30 with therapeutic ultrasound so that the position corresponds to the calibrated coordinates.
  • the calibration unit 150 calibrates the therapeutic ultrasound irradiation device 30 in this way so that therapeutic ultrasound is transmitted from the therapeutic ultrasound irradiation device 30 to precisely form a focal point at a desired position.
  • FIG. 4 illustrates a configuration of the characteristics calculation unit 120, in accordance with an embodiment.
  • the characteristics calculation unit 120 includes a group generator 121, a first model generator 122, a second model generator 123, and a calculator 124.
  • characteristics calculation unit 120 of FIG. 4 includes certain components, it will be understood by those skilled in the art that the characteristics calculation unit 120 may further include additional components to the components shown in FIG. 4 .
  • the characteristics calculation unit 120 may correspond to one or more processors.
  • the characteristics calculation unit 120 uses the medical image 20 to calculate characteristics of one or more tissues lying on a path along which therapeutic ultrasound propagates from the therapeutic ultrasound irradiation device 30 to a position of a focal point. For example, the characteristics calculation unit 120 generates models for characteristics of each of the tissues that construct a heterogeneous subject and calculates the characteristics of the one or more tissues on the propagation path using the generated models.
  • the group generator 121 identifies a type of the one or more tissues on a path along which therapeutic ultrasound propagates through the therapeutic ultrasound irradiation device 30 to a position of a focal point.
  • FIG. 5 illustrates an example of at least one tissue located on a path along which therapeutic ultrasound propagates through the therapeutic ultrasound irradiation device 30 as shown in FIG. 2 ) to a position of a focal point.
  • At least one tissue 520 through 550 may be located on a path along which therapeutic ultrasound propagates through an element 510 in the therapeutic ultrasound irradiation device 30 to a focal point 560.
  • the at least one tissue 520 through 550 may include skin, bone, muscle, blood, and an organ.
  • the group generator 121 identifies the type of the at least one tissue 520 through 550 shown in FIG. 5 on a path along which the therapeutic ultrasound propagates from the element 510 of the calibrated therapeutic ultrasound irradiation device 30 to a position of the focal point 560 using information about the element 510 that is received from the calibration unit 150.
  • the group generator 121 divides the one or more tissues into a plurality of groups based on the identified types of the tissues. For example, when a medical image is a CT image, the group generator 121 divides the one or more tissues in a subject, lying on the propagation path of the therapeutic ultrasound, into first and second groups based on a CT number obtained from the medical image of each of the tissues.
  • the CT number is a value that represents the degree of absorption for each pixel in a CT image.
  • the pixel is a pixel in a 2D image or a voxel in a 3D image.
  • the CT number is a relative X-ray attenuation coefficient determined for each tissue.
  • CT numbers of air, water, and bone are -1000 Hu, 0 Hu, and +1000 Hu, respectively.
  • the group generator 121 divides the tissues into the first and second groups based on a distribution of the CT numbers. In one example, the group generator 121 determines tissues having the CT numbers in a predetermined range as the first group and tissues having very high or very low CT numbers as the second group.
  • the CT number of bone is +1000 Hu
  • the CT number of fat is from about 100 Hu to about -50 Hu.
  • the bone has a very high CT number while the fat has a very low CT number compared to the liver (40 to 60 Hu), the kidney (30 Hu), the brain (37 Hu), and blood (40 Hu).
  • the group generator 121 determines tissues, other than the bone and fat, as the first group and the bone and fat as the second group.
  • the group generator 121 After dividing the tissues into the first and second groups in the manner described above, the group generator 121 transmits information about the tissues in the first group and information about the tissues in the second group to the first model generator 122 and the second model generator 123, respectively.
  • the first model generator 122 uses CT numbers of the tissues in the first group to generate a first model representing characteristics of each of the tissues in the first group.
  • the characteristics are physical characteristics of each of the one or more tissues.
  • the physical characteristics may include the speed of therapeutic ultrasound passing through each of the tissues, a density of each tissue, an attenuation coefficient of therapeutic ultrasound for the tissue, or a combination thereof, but are not limited thereto.
  • the first model generator 122 uses CT numbers of the respective tissues in the first group to generate a graph model for the speed of the therapeutic ultrasound passing through the tissues.
  • the first model generator 122 uses the CT numbers of the respective tissues in the first group to generate a table model for the speed of therapeutic ultrasound passing through the tissues.
  • FIG. 6 is an example of a graph model 620 generated by the first model generator 122 shown in FIG. 4 , in accord with an embodiment.
  • the first model generator 122 calculates the speed of therapeutic ultrasound for each of the tissues in the first group and approximates the calculated speed to generate the graph model 620 for the speeds of therapeutic ultrasound passing through the tissues.
  • the first model generator 122 uses CT numbers corresponding to the respective tissues in the first group to generate a graph model or table model for densities of the tissues.
  • the first model generator 122 calculates the density of each of the tissues in the first group and approximates the calculated densities to generate a graph model for the densities of the tissues. In this case, the first model generator 122 generates a graph model for the density in the same manner as described above with regards to the generating of the graph model 620 for the speed of therapeutic ultrasound.
  • the first model generator 122 uses the CT numbers of the respective tissues in the first group to generate a graph model or table model for attenuation coefficients of therapeutic ultrasound for the tissues.
  • the first model generator 122 calculates the attenuation coefficient of the therapeutic ultrasound for each of the tissues in the first group and approximates the calculated attenuation coefficients to generate a graph model for the attenuation coefficients of the therapeutic ultrasound for each of the tissues.
  • the first model generator 122 may generate a graph model for the attenuation coefficient of the therapeutic ultrasound in the same manner as described above with regards to the generating of the graph model 620 for the speed of therapeutic ultrasound.
  • the first model generator 122 transmits information about the generated first model to the calculator 124.
  • the second model generator 123 generates a second model representing characteristics of each of the tissues in the second group.
  • the characteristics are physical characteristics of each of the one or more tissues.
  • the physical characteristics may include the speed of therapeutic ultrasound passing through each of the tissues, a density of each tissue, an attenuation coefficient of therapeutic ultrasound for the tissue, or a combination thereof, but are not limited thereto.
  • the second model generator 123 generates a table model including the known speed of therapeutic ultrasound passing through each of the tissues (e.g., bone and fat) in the second group, the density of the tissue, and the attenuation coefficient of the therapeutic ultrasound for the tissue.
  • FIG. 7 is an example of a table model generated by the second model generator 123, in accord with an embodiment.
  • the second model generator 123 generates the table model as a second model that indicates names, CT numbers, densities, and speeds and attenuation coefficients of therapeutic ultrasound for the tissues in the second group.
  • the second model generator 123 transmits information about the generated second model to the calculator 124.
  • the characteristics calculation unit 120 outputs a graph model or table model generated in the same manner, as described above, to a display device (not shown) through the interface unit 110.
  • the characteristics calculation unit 120 has been described to include the group generator 121 and the first and second model generators 122 and 123, the embodiment is not limited thereto.
  • Equations (1) through (3) and the table model of FIG. 7 may be stored in the characteristics calculation unit 120 for future use, or operations to generate the first and second models may be performed independently to the operation of the characteristics calculation unit 120.
  • the calculator 124 uses the graph model and the table model to calculate the characteristics.
  • the calculator 124 combines information about the graph model received from the first model generator 122 with information about the table model received from the second model generator 123.
  • the calculator 124 also calculates characteristics of one or more tissues on a path along which therapeutic ultrasound propagates from an element of the therapeutic ultrasound irradiation device 30 to a position of a focal point.
  • the calculator 124 transmits information about the calculated characteristics to the parameter determiner 130.
  • the parameter determiner 130 determines a parameter of the therapeutic ultrasound to create a focal point onto a subject using calculated characteristics.
  • the parameter determiner 130 determines a parameter by combining predetermined characteristics of the therapeutic ultrasound transmitted from the therapeutic ultrasound irradiation device 30 with the characteristics that the calculator 124 calculated and may affect the propagation of the therapeutic ultrasound.
  • the parameter is a combination of variables used to create a focal point of the therapeutic ultrasound.
  • the variables may include, but are not limited to, a frequency, amplitude, phase, peak intensity, pulse length, and duty ratio of the therapeutic ultrasound and the number or positions of elements in the therapeutic ultrasound irradiation device 30.
  • FIG. 10 is a flowchart illustrating an example of operation of the parameter determiner 130, in accord with an embodiment.
  • a medium through which therapeutic ultrasound passes is a heterogeneous medium including several different tissues as shown in FIG. 5 .
  • a parameter of therapeutic ultrasound that reflects the effect of a heterogeneous medium so that a focal point is formed at a desired position will now be described with reference to FIG. 10 .
  • the method includes calculating a sound pressure P HOMO at a position of a focal point created by the therapeutic ultrasound by assuming that the therapeutic ultrasound travels through a homogeneous medium.
  • the sound pressure P HOMO is also calculated by adjusting a parameter of the therapeutic ultrasound so that the absolute value of a difference between the sound pressure, P HOMO , and a sound pressure, P HET , at a position of a focal point when the therapeutic ultrasound propagates through a heterogeneous medium is less than or equal to a threshold value.
  • the parameter of the therapeutic ultrasound may be a particle velocity that represents the amplitude and phase of the therapeutic ultrasound.
  • FIG. 12 illustrates a relationship between a focal point and the therapeutic ultrasound irradiation device (30 in FIG. 2 ), according to an embodiment.
  • therapeutic ultrasound is transmitted from N elements in the therapeutic ultrasound irradiation device 30 and creates focal points at M target positions.
  • the therapeutic ultrasound irradiation device 30 may include two or more elements, all or some of which transmit the therapeutic ultrasound.
  • r n is a position vector of the n-th element 1210
  • r m is a position vector of an m-th focal point position 1220.
  • the method calculates a sound pressure P HOMO at the position of the focal point by assuming that the therapeutic ultrasound travels through homogeneous tissue.
  • the method at the parameter determiner 130 calculates a particle velocity of each element.
  • the position of the focal point is specified based on information input from a user through the interface unit 110, or automatically designated by the apparatus 10 as illustrated in FIG. 2 to control an ultrasound automatically, dynamically, or without user intervention.
  • a phase of the particle velocity may be calculated assuming that the speed of a sound wave is constant generally at 1540 m/s. For example, after computing a time taken for a sound wave to arrive at a focal point from each element, based on a distance between the focal point and the element, a phase is calculated for each element to compensate for the time difference between sound waves generated by the respective elements.
  • a user is enabled to determine an amplitude of the particle velocity to create a desired sound pressure P HOMO at a focal point position. For example, when an amplitude is input through the interface unit 110, the parameter determiner 130 calculates the sound pressure P HOMO exerted by the N elements at the m-th focal point position using a Rayleigh-Sommerfeld integral as defined by Equation (4). Furthermore, the user may adjust the amplitude so as to create the desired sound pressure P HOMO .
  • ⁇ , p, and c are attenuation coefficients of a homogeneous tissue, a density of the tissue, and a speed of a sound wave, respectively.
  • S n , U n , and P HOMO (r m ) are cross-sectional areas of an n-th element, a particle velocity for the n-th element, and a sound pressure at a focal point position having a position vector of r m , respectively.
  • the particle velocity u n e.g. velocity of tranducer element n
  • the particle velocity u n is precalculated so as to create a focal point at a desired position in the homogeneous tissue.
  • the method at the parameter determiner 130 sets elements that will transmit therapeutic ultrasound among the elements in the therapeutic ultrasound irradiation device 30 and arbitrarily sets a particle velocity of each of the set elements.
  • the parameter determiner 130 uses a generic operator to set some or all of the N elements in the therapeutic ultrasound irradiation device 30 as elements to transmit the therapeutic ultrasound.
  • the parameter determiner 130 sets particle velocities of the respective set elements and combines the particle velocities with one another.
  • a particle velocity u that will be described below is the combined particle velocity obtained by the parameter determiner 130.
  • the method at the parameter determiner 130 calculates a sound pressure P HET at a focal point position under the assumption that therapeutic ultrasound having the combined particle velocity u obtained at operation 1020 propagates through heterogeneous tissue.
  • the heterogeneous tissue refers to a tissue that reflects characteristics of one or more tissues on a path along which therapeutic ultrasound propagates.
  • the characteristics calculation unit 120 calculates characteristics, which may include a density of each tissue and the speed and attenuation coefficient of therapeutic ultrasound waves within the tissue.
  • the parameter determiner 130 calculates a sound pressure P HET (r m ) at a focal point position having a position vector of r m , which reflects characteristics of the heterogeneous tissue, using an angular spectrum method (ASM).
  • ASM angular spectrum method
  • the ASM involves expanding a complex wave field into a sum of an infinite number of plane waves.
  • the parameter determiner 130 calculates a sound pressure P HET (r m ) using the ASM as follows:
  • the parameter determiner 130 calculates a transmitted acoustic field w 1b that passes through a discontinuous boundary D 1 of a medium by combining an incident acoustic field, w 1f , incident on the boundary D 1 with a transmission coefficient T.
  • the parameter determiner 130 then applies a 2D Fourier Transform to the transmitted acoustic field w 1b to compute an angular spectrum W 1b in a plane D 1 .
  • the parameter determiner 130 calculates an angular spectrum W 2 by correcting a phase change due to a distance difference between planes D 1 and D 2 based on the angular spectrum W 1b . Thereafter, the parameter determiner 130 applies a 2D Inverse Fourier Transform to the angular spectrum W 2 to calculate an acoustic field w 2 in a plane D 2 .
  • the parameter determiner 130 repeats the above operations a predetermined number of times corresponding to the number of boundaries on the propagation path of the therapeutic ultrasound to calculate the sound pressure P HET (r m ) at a position of the focal point 560 having a position vector of r m , which reflects characteristics of the heterogeneous tissue.
  • the parameter determiner 130 calculates the sound pressure P HET (r m ) by using the ASM, the embodiment is not limited thereto.
  • the method at the parameter determiner 130 determines whether a difference between the sound pressures P HOMO and P HET calculated in operations 1010 and 1030, respectively, is less than a predetermined threshold value.
  • the predetermined threshold value may be automatically determined by the method at the parameter determiner 130 or determined by a user through the interface unit 110.
  • the method at the parameter determiner 130 determines the particle velocity, u, of the elements as a final value. However, when the difference exceeds the threshold, the method proceeds to operation 1050.
  • the method at the parameter determiner 130 resets a particle velocity of each of the elements that are selected among the elements in the therapeutic ultrasound irradiation device 30 to transmit therapeutic ultrasound.
  • the method at the parameter determiner 130 then combines particle velocities of the set elements with one another and returns to operations 1030 and 1040.
  • the method at the parameter determiner 130 transmits the determined parameter to the control unit 140.
  • FIG. 10 shows that the parameter of therapeutic ultrasound is set so that a difference between the sound pressure P HOMO in a homogeneous medium and the sound pressure P HET in a heterogeneous medium is less than or equal to a predetermined threshold
  • other methods may be used. Another method of setting a parameter of therapeutic ultrasound in the parameter determiner 130 will now be described in detail with reference to FIG. 11 .
  • FIG. 11 is a flowchart of another example of operation of the parameter determiner 130, in accordance with an embodiment.
  • the method at the parameter determiner 130 may determine a parameter of therapeutic ultrasound using a sound pressure P HET in a heterogeneous medium without comparing the sound pressure P HET with a sound pressure P HOMO in a homogeneous medium. In other words, by repeating setting of the parameter of therapeutic ultrasound until the desired sound pressure P HET is created in a heterogeneous medium, an operation of comparing the sound pressure P HET with a sound pressure P HOMO in a homogeneous medium may be omitted.
  • the method at the parameter determiner 130 sets elements to transmit therapeutic ultrasound among the elements in the therapeutic ultrasound irradiation device 30 and arbitrarily sets a particle velocity of each of the set elements.
  • the process at the parameter determiner 130 combines particle velocities of the respective set elements with one another.
  • the method at the parameter determiner 130 sets particle velocities of the respective set elements and combines the particle velocities with one another.
  • the method at the parameter determiner 130 calculates a sound pressure P HET at a position of a focal point that the therapeutic ultrasound, which includes the combined particle velocity u obtained at operation 1110, propagates through a heterogeneous tissue.
  • the parameter determiner 130 determines whether the sound pressure P HET satisfies a predetermined condition. When the sound pressure P HET satisfies the predetermined condition, the parameter determiner 130 determines the particle velocity of the elements as a final value. On the other hand, when the sound pressure P HET does not satisfy the predetermined condition, the method proceeds to operation 1140.
  • the method at the parameter determiner 130 resets or adjusts a particle velocity of each of the elements that are selected among the elements in the therapeutic ultrasound irradiation device 30 to transmit the therapeutic ultrasound.
  • the parameter determiner 130 then combines particle velocities of the set elements with one another and returns to the operations 1120 and 1130.
  • control unit 140 generates a control signal for an element of the therapeutic ultrasound irradiation device 30.
  • the control signal is the particle velocity u of the elements that transmit therapeutic ultrasound, e.g. the velocity of the tranducer element.
  • the control unit 140 then transmits the control signal to the therapeutic ultrasound irradiation device 30.
  • the parameter determiner 130 determines a parameter by combining the characteristics of therapeutic ultrasound, transmitted through elements of the therapeutic ultrasound irradiation device 30, and characteristics calculated in the calculator 124, which may affect the propagation of the therapeutic ultrasound. As a result, the parameter determiner 130 enables automatic transformation of the characteristics of tissues into characteristics of the therapeutic ultrasound.
  • FIG. 8 illustrates a configuration of a HIFU system 800, according to an embodiment.
  • the HIFU system 800 includes an ultrasound control apparatus 10, a therapeutic ultrasound irradiation device 30, and a diagnostic ultrasound irradiation device 40.
  • the HIFU system 800 of FIG. 8 includes certain components related to the embodiment, it will be understood by those skilled in the art that the HIFU system 800 may further include less or more components than the components shown in FIG. 8 .
  • the HIFU system 800 includes the ultrasound control apparatus 10 shown in FIGS. 1, 2 , and/or 4.
  • the descriptions of the ultrasound control apparatus 10 with reference to FIGS. 1, 2 , and 4 may apply to the HIFU system 800 of FIG. 8 , and, thus, are not repeated.
  • the HIFU system 800 focuses therapeutic ultrasound on a focal point using the therapeutic ultrasound irradiation device 30.
  • the HIFU system 800 controls the therapeutic ultrasound irradiation device 30 to transmit therapeutic ultrasound using an externally input medical image 20 and an ultrasound image generated by the diagnostic ultrasound irradiation device 40 transmitting diagnostic ultrasound to a subject 810.
  • the HIFU system 800 is configured to generate therapeutic ultrasound by reflecting heterogeneity in characteristics of one or more tissues on a path along which the therapeutic ultrasound propagates, so that a focal point is formed accurately at a desired position.
  • the HIFU system 800 may also generate therapeutic ultrasound by reflecting an examinee's characteristics, thereby minimizing a variation in treatment effects among examinees or patients.
  • the diagnostic ultrasound irradiation device 40 transmits diagnostic ultrasound to the subject 810 and acquires a reflected ultrasound signal to generate an ultrasound image of the subject 810.
  • the diagnostic ultrasound irradiation device 40 processes the acquired reflected ultrasound signal to generate an ultrasound image of the subject 810.
  • the ultrasound control apparatus 10 calibrates the therapeutic ultrasound irradiation device 30 using an image obtained by registering the medical image 20 containing anatomical information about the subject 810 with the ultrasound image, and generates a control signal to generate therapeutic ultrasound that the calibrated therapeutic ultrasound irradiation device will transmit to a focal point.
  • the ultrasound control apparatus 10 controls generation of therapeutic ultrasound by automatically reflecting characteristics of the one or more tissues in a path along which the therapeutic ultrasound will propagate, thereby allowing the therapeutic ultrasound irradiation device 30 to focus the therapeutic ultrasound at a desired position without user intervention. Furthermore, the ultrasound control apparatus 10 enables treatment of one or more tissues with a single surgical procedure.
  • the therapeutic ultrasound irradiation device 30 uses the control signal generated by the ultrasound control apparatus 10 to transmit the therapeutic ultrasound towards a position of a focal point.
  • FIG. 9 is a flowchart of a method to generate therapeutic ultrasound to be transmitted from a therapeutic ultrasound irradiation device, according to an embodiment.
  • the method to generate therapeutic ultrasound includes operations that are performed in a time series by the ultrasound control apparatus 10 shown in FIGS. 1, 2 , and 4 or by the HIFU system 800 in FIG. 8 .
  • the above descriptions of the ultrasound control apparatus 10 or the HIFU system 800 with reference to FIGS. 1, 2 , 4 , and 8 may apply to the method to generate therapeutic ultrasound illustrated in FIG. 9 .
  • the method at the interface unit 110 acquires a medical image including anatomical information of a subject.
  • the method at the characteristics calculation unit 120 calculates characteristics of one or more tissues in a subject, which may affect the propagation of therapeutic ultrasound, using the medical image acquired at operation 910. More specifically, the method at the characteristics calculation unit 120 uses the acquired medical image to calculate characteristics of the one or more tissues on a path along which therapeutic ultrasound propagates from an element of the therapeutic ultrasound irradiation device 30 to a focal point.
  • the method at the characteristics calculation unit 120 may generate models for characteristics of each of the tissues that construct the subject and calculate the characteristics of the one or more tissues on the propagation path by using the generated models.
  • the method at the characteristics calculation unit 120 also acquires the medical image and an ultrasound image of the subject from the interface unit 110 and registers the medical image with the ultrasound image.
  • the method at the characteristics calculation unit 120 then calibrates the diagnostic ultrasound irradiation device 40 using an image obtained after the registration, and generates a signal to calibrate the therapeutic ultrasound irradiation device using the calibrated diagnostic ultrasound irradiation device 40.
  • the method at the parameter determiner 130 determines a parameter of therapeutic ultrasound to create a focal point on a subject using the characteristics calculated in operation 920.
  • the method at the control unit 140 produces a control signal to generate the therapeutic ultrasound according to the parameter determined at operation 930.
  • the ultrasound control apparatus 10 and the HIFU system 800 enable irradiation of therapeutic ultrasound by reflecting heterogeneity in characteristics of one or more tissues in a path along which the therapeutic ultrasound propagates, thereby improving the accuracy of treatment using HIFU.
  • the ultrasound control apparatus 10 and the HIFU system 800 are also configured to automatically reflect characteristics of tissues encountered on a travel path of the therapeutic ultrasound at a parameter to transmit the therapeutic ultrasound.
  • the ultrasound control apparatus 10 and HIFU system 800 generate therapeutic ultrasound to create a focal point accurately at a desired position without user intervention.
  • the ultrasound control apparatus 10 and the HIFU system 800 may also individually generate therapeutic ultrasound by reflecting individual examinee tissue characteristics, thereby minimizing a variation in HIFU treatment effects among examinees or patients.
  • the ultrasound control apparatus 10 and the HIFU system 800 may generate therapeutic ultrasound by reflecting characteristics of tissues along a travel path of the therapeutic ultrasound, thereby allowing treatment of one or more organs with a single surgical procedure.
  • first, second, third, etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer or section from another region, layer or section. These terms do not necessarily imply a specific order or arrangement of the elements, components, regions, layers and/or sections. Thus, a first element, component, region, layer or section discussed below could be termed a second element, component, region, layer or section without departing from the teachings description of the present invention.
  • the units described herein may be implemented using hardware components, including, but not limited to a processing device.
  • the processing device may be implemented using one or more general-purpose or special purpose computers, such as, for example, a processor, a controller and an arithmetic logic unit, a digital signal processor, a microcomputer, a field programmable array, a programmable logic unit, a microprocessor or any other device capable of responding to and executing instructions in a defined manner.
  • the processing device may run an operating system (OS) and one or more software applications that run on the OS.
  • the processing device also may access, store, manipulate, process, and create data in response to execution of the software.
  • OS operating system
  • a processing device may include multiple processing elements and multiple types of processing elements.
  • a processing device may include multiple processors or a processor and a controller.
  • different processing configurations are possible, such a parallel processors.
  • Program instructions to perform methods described in FIGS. 3 and 9-11 , or one or more operations thereof, may be recorded, stored, or fixed in one or more non-transitory computer-readable storage media.
  • the program instructions may be implemented by a computer.
  • the computer may cause a processor to execute the program instructions.
  • the media may include, alone or in combination with the program instructions, data files, data structures, and the like.
  • Examples of computer-readable media include magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM disks and DVDs; magneto-optical media, such as optical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like.
  • Examples of program instructions include machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter.
  • the program instructions that is, software, may be distributed over network coupled computer systems so that the software is stored and executed in a distributed fashion.
  • the software and data may be stored by one or more computer readable recording mediums.
  • functional programs, codes, and code segments for accomplishing the example embodiments disclosed herein can be easily construed by programmers skilled in the art to which the embodiments pertain based on and using the flow diagrams and block diagrams of the figures and their corresponding descriptions as provided herein..

Abstract

An apparatus and a method are provided for controlling the generation of an ultrasound. The apparatus and the method include receiving 910 a medical image including anatomical information about a subject, and calculating 920 at least one characteristic of a tissue in the subject, which may affect propagation of the ultrasound based on the medical image. The apparatus and method also determine 930 a parameter of the ultrasound to create a focal point on the subject using the calculated characteristics, and generate a control signal for generating 940 the ultrasound according to the determined parameter.

Description

    BACKGROUND 1. Field
  • The present disclosure relates to methods, apparatus, and a high-intensity focused ultrasound (HIFU) system for generating ultrasound.
  • 2. Description of Related Art
  • With the advancement of medical science, techniques for local treatment of tumors have been developed from invasive surgery, such as open surgery, to minimal-invasive surgery. A recently developed method is a non-invasive surgery using a gamma knife, a cyber knife, and a high-intensity focused ultrasound (HIFU) knife. The HIFU knife using ultrasound has been widely used in commercial applications as part of a treatment that is environment-friendly and harmless to the human body.
  • A treatment using a HIFU knife includes focusing and irradiating HIFU on a desired region of a tumor to cause focal destruction or necrosis of tumor tissue and removing and treating the tumor.
  • SUMMARY
  • This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
  • Provided are methods, apparatuses, and systems for controlling the generation of ultrasound. Provided also are non-transitory computer-readable recording media having recorded thereon programs for executing the method on a computer. Technical challenges to be solved are not limited thereto, and other technical challenges may exist.
  • In accordance with an illustrative configuration, there is provided a method to generate a control signal for controlling an ultrasound irradiation device to generate an ultrasound, the method including receiving a medical image including anatomical information about a subject; calculating one or more characteristics of a tissue in the subject affecting propagation of the ultrasound based on the medical image; determining a parameter of the control signal to create a focal point on the subject using the calculated characteristics; and generating the control signal according to the determined parameter.
  • The calculating of the at least one characteristic may include processing the medical image to calculate the at least one characteristic of the tissue on a path along which the ultrasound propagates from an element of the ultrasound irradiation device to the focal point.
  • Receiving a medical image may comprise acquiring a medical image, e.g. from a data storage, CT scanner, MRI scanner or other device.
  • The characteristic may also include a speed of the ultrasound passing through the tissue, a density of the tissue, an attenuation coefficient of the ultrasound for the tissue, or a combination thereof.
  • The method may also include calibrating the ultrasound irradiation device using the medical image.
  • The calculating of the characteristics may further include processing the ultrasound irradiation device and the medical image to calculate the characteristics of the tissue along a path that the ultrasound propagates from an element of the ultrasound irradiation device to the focal point.
  • The calibrating of the ultrasound irradiation device may include generating an ultrasound image of the subject using a diagnostic ultrasound irradiation device; calibrating the diagnostic ultrasound irradiation device using an image obtained by registering the ultrasound image with the medical image; and calibrating the ultrasound irradiation device using the calibrated diagnostic ultrasound irradiation device.
  • The calibration may be performed by adjusting coordinates of the ultrasound irradiation device.
  • The medical image may include a computed tomography (CT) image.
  • The determining of the parameter of the ultrasound may include determining the parameter by combining characteristics of the ultrasound with the calculated characteristics affecting the propagation of the ultrasound.
  • In accordance with an illustrative configuration, there is provided an apparatus for controlling the generation of an ultrasound, the apparatus including an interface unit configured to receive a medical image including anatomical information about a subject; a characteristics calculation unit configured to calculate characteristics of a tissue in the subject affecting propagation of the ultrasound based on the medical image; a parameter determiner configured to determine a parameter of the ultrasound to create a focal point on the subject using the calculated characteristics; and a control unit configured to produce a control signal according to the determined parameter to generate the ultrasound, the control signal being produced for a therapeutic ultrasound irradiation device.
  • The characteristics calculation unit may process the medical image to calculate the one or more characteristic of the tissue on a path along which the ultrasound propagates from an element of the therapeutic ultrasound irradiation device to the focal point.
  • The characteristic may include a speed of the ultrasound passing through the tissue, a density of the tissue, an attenuation coefficient of the ultrasound for the tissue, or a combination thereof.
  • The apparatus may also include a calibration unit configured to calibrate the apparatus using the medical image.
  • The calibration unit may be configured to acquire an ultrasound image of the subject from the interface unit, to calibrate a diagnostic ultrasound irradiation device by using an image obtained by registering the ultrasound image with the medical image, and calibrates the apparatus by using the calibrated diagnostic ultrasound irradiation device. Registering the ultrasound image with the medical image may comprise correlating the ultrasound image to the medical image.
  • Calibrating the apparatus may comprise calibrating the calculation unit and/or the control unit.
  • The medical image may include a computed tomography (CT) image.
  • A non-transitory computer-readable recording medium having recorded thereon a program for executing the method as described above.
  • In accordance with an illustrative configuration, there is provided a method to generate an ultrasound, the method including acquiring an image of a subject including heterogeneous tissue; and determining a parameter of the ultrasound, in which characteristics of the heterogeneous tissue has been reflected using the image.
  • The image of the subject may include human internal organs.
  • The determining of the parameter of the ultrasound includes calculating characteristics of the heterogeneous tissue affecting propagation of the ultrasound using the image; and determining the parameter of the ultrasound to create a focal point on the subject using the calculated characteristic.
  • The determining of the parameter of the ultrasound using the calculated characteristic includes calculating a first sound pressure representing a sound pressure at the focal point when the ultrasound propagates in homogeneous tissue; determining an element that transmits the ultrasound among elements in the ultrasound irradiation device and setting a particle velocity of the determined element; calculating a second sound pressure representing a sound pressure at the focal point when the ultrasound using the particle velocity propagates in the heterogeneous tissue; and determining the parameter of the ultrasound based on a relationship between the first sound pressure and the second sound pressure.
  • The determining of the parameter of the ultrasound based on the relationship between the first and second sound pressures may include determining whether a difference between the first and second sound pressures exceeds a threshold value; and resetting or adjusting a particle velocity of the element in response to the difference exceeding the threshold value.
  • In accordance with an illustrative configuration, there is provided an ultrasound control apparatus, including a processor configured to process a medical image of a subject to determine a parameter based on a speed of a therapeutic ultrasound passing through a tissue, a density of the tissue, and an attenuation coefficient and to control the therapeutic ultrasound to create a focal point onto a subject; and a controller producing a signal to generate ultrasound waves according to the determined parameter.
  • The method and apparatus may comprise generating the ultrasound using a therapeutic ultrasound irradiation device on the basis of the control signal. The ultrasound irradiation device may be connected to the control unit.
  • The characteristics calculation unit may be further configured to control an intensity and a duration of the therapeutic ultrasound. The apparatus may also include a calibration unit processing the medical image to calibrate the processor and the controller.
  • Other features and aspects may be apparent from the following detailed description, the drawings, and the claims.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and/or other aspects will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings in which:
    • FIG. 1 illustrates a configuration of an apparatus to control ultrasound, according to an embodiment;
    • FIG. 2 illustrates a configuration of an apparatus to control ultrasound according to another embodiment;
    • FIG. 3 illustrates a method of calibrating a therapeutic ultrasound irradiation device in a calibration unit, according to an embodiment;
    • FIG. 4 illustrates an example of a characteristics calculation unit, according to an embodiment;
    • FIG. 5 illustrates an example of a tissue located on a path along which therapeutic ultrasound travels from an element of a therapeutic ultrasound irradiation device to a focal point, according to an embodiment;
    • FIG. 6 is an example of a graph model generated by a first model generator, according to an embodiment;
    • FIG. 7 is an example of a table model generated by a second model generator, according to an embodiment;
    • FIG. 8 illustrates a construction of a high intensity focused ultrasound (HIFU) system, according to an embodiment;
    • FIG. 9 is a flowchart of a method to generate therapeutic ultrasound, according to an embodiment;
    • FIG. 10 is a flowchart illustrating an operation of a parameter determiner, according to an embodiment;
    • FIG. 11 is a flowchart of another operation of a parameter determiner, according to an embodiment; and
    • FIG. 12 illustrates a relationship between a focal point and a therapeutic ultrasound irradiation device, according to an embodiment.
  • Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals will be understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated for clarity, illustration, and convenience.
  • DETAILED DESCRIPTION
  • The following detailed description is provided to assist the reader in gaining a comprehensive understanding of the methods, apparatuses, and/or systems described herein. Accordingly, various changes, modifications, and equivalents of the systems, apparatuses and/or methods described herein will be suggested to those of ordinary skill in the art. Also, descriptions of well-known functions and constructions may be omitted for increased clarity and conciseness. Expressions such as "at least one of," when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
  • FIG. 1 illustrates an apparatus 10 to control ultrasound (hereinafter, referred to as "ultrasound control apparatus"), according to an embodiment. Referring to FIG. 1, the ultrasound control apparatus 10, according to an illustrative example, includes an interface unit 110, a characteristics calculation unit 120, a parameter determiner 130, and a control unit 140.
  • Although the ultrasound control apparatus 10 of FIG. 1 includes certain components, it will be understood by those skilled in the art that the ultrasound control apparatus 10 may further include additional components to the components shown in FIG. 1. Also, in an alternative configuration, the ultrasound control apparatus 10 may exclude, for instance, the interface unit 110 and the characteristic calculation unit 120 may include an interface to receive a signal representative of a medical image. The ultrasound control apparatus 10 may correspond to one or more processors.
  • As illustrated in FIG. 1, the interface unit 110 acquires a medical image 20 including anatomical information about a subject. The object may include at least one tissue of a patient. For example, the object may be a heterogeneous part of a human body, which includes different kinds of tissues such as skin, bone, muscle, blood, and an organ, or a combination thereof, but is not limited thereto. The anatomical information about the object may be information about locations and sizes of one or more tissues. A therapeutic ultrasound irradiation device (not shown), such as a HIFU apparatus, may create a focal point of therapeutic ultrasound at a target position of the object, e.g. to generate the medical image 20.
  • The medical image 20 may be a previously acquired and stored as a computed tomography (CT) image or magnetic resonance (MR) image of the object, but is not limited thereto. For example, images that have been previously acquired and stored for the same object, and images acquired just prior to ultrasound treatment may be input to the ultrasound control apparatus 10 through the interface unit 110. Images may contain 2D and/or 3D information, e.g. multiple 2D image slices of the subject.
  • The interface unit 110 may be a unit to perform data input or output or to transmit information directly input by a user to another unit. The characteristics calculation unit 120 processes the medical image 20 to calculate characteristics of one or more tissues in the object that may affect the propagation of therapeutic ultrasound. For example, the characteristics calculation unit 120 receives the medical image 20 from the interface unit 110 to calculate characteristics of one or more tissues in the object that may affect the propagation of therapeutic ultrasound.
  • Characteristics that may affect the propagation of therapeutic ultrasound may be physical characteristics of each of the one or more tissues. The physical characteristics may include speed of the therapeutic ultrasound passing through each of the tissues, a density of each tissue, an attenuation coefficient of the therapeutic ultrasound for the tissue, or a combination thereof, but are not limited thereto.
  • Because ultrasound is a radiated wave produced by vibrations through a physical medium, propagation speed of an ultrasound wave is affected by a density of the physical medium. More specifically, as the density of the physical medium increases, a speed of the ultrasound wave increases. Furthermore, as the ultrasound wave travels through the medium, the ultrasound wave may be absorbed or scattered by the medium, thereby reducing its intensity or amplitude. A reduction in intensity or amplitude of the ultrasound wave is called an attenuation of the ultrasound wave. An amount of attenuation of an ultrasound wave is proportional to a frequency of the ultrasound wave and an amount of protein in a tissue through which the ultrasound wave passes. The amount of attenuation of the ultrasound wave is inversely proportional to water content of the tissue. The characteristics calculation unit may calculate an attenuation coefficient, e.g. based on water or protein content or otherwise. The parameter determiner 130 determines a parameter of therapeutic ultrasound to create a focal point onto a subject using the calculated characteristics. For example, the parameter determiner 130 receives the calculated characteristics from the characteristics calculation unit 120 and determines a parameter for the therapeutic ultrasound irradiation on the focal point by using the calculated characteristics.
  • The control unit 140 produces a signal to generate ultrasound waves according to the determined parameter. For example, the control unit 140 receives the parameter determined by the parameter determiner 130 to generate a control signal for a therapeutic ultrasound irradiation device 30 as shown in FIG. 2.
  • The ultrasound control apparatus 10 having the above-described configuration calculates the speed of therapeutic ultrasound passing through tissue, a density of the tissue, and an/or attenuation coefficient of therapeutic ultrasound and precisely controls the therapeutic ultrasound by means of the control signal of control unit 140 so that a therapeutic ultrasound irradiation device creates a focal point at a desired position. The ultrasound control apparatus 10 may also control the intensity and duration of therapeutic ultrasound being transmitted.
  • FIG. 2 illustrates a configuration of an ultrasound control apparatus 10 according to another embodiment. Referring to FIG. 2, the ultrasound control apparatus 10 includes an interface unit 110, a characteristics calculation unit 120, a parameter determiner 130, a control unit 140, and a calibration unit 150.
  • Although the ultrasound control apparatus 10 of FIG. 2 includes certain components, it will be understood by those skilled in the art that the ultrasound control apparatus 10 may further include additional components to the components shown in FIG. 2. Also, in an alternative configuration, the ultrasound control apparatus 10 may exclude, for instance, the interface unit 110 and/or the calibration unit 150 and the characteristic calculation unit 120 may include an interface to receive a signal representative of a medical image and/or a calibration function. The ultrasound control apparatus 10 of FIG. 2 may correspond to one or more processors.
  • The interface unit 110 acquires an ultrasound image of a subject from a diagnostic ultrasound irradiation device 40. Alternatively or additionally, a medical image of the subject is input to the interface unit 110 from a CT scanner, MRI scanner, or a previously stored ultrasound, CT, MRI and/or other medical image is used. The interface unit 110, the characteristics calculation unit 120, the parameter determiner 130, and the control unit 140 have substantially the same functions as those of their counterparts in FIG. 1.
  • The diagnostic ultrasound irradiation device 40 transmits diagnostic ultrasound to a subject and acquires an ultrasound signal reflected from the subject. More specifically, in response to the diagnostic ultrasound irradiation device 40 transmitting a diagnostic ultrasound having a frequency range of 2 to 18 MHz to the subject, the diagnostic ultrasound is partially reflected from layers between different tissues of the subject. The diagnostic ultrasound is reflected from an area of the subject where there is a change in density, for instance, from blood cells within a blood plasma or small structures within organs. The reflected diagnostic ultrasound vibrates a piezoelectric converter of the diagnostic ultrasound irradiation device 40. As the piezoelectric converter vibrates, it emits electrical pulses producing the ultrasound signal.
  • The diagnostic ultrasound irradiation device 40 converts or processes the ultrasound signal to an ultrasound image of the subject to be then transmitted to the interface unit 110. For instance, the diagnostic ultrasound irradiation device 40 directly generates ultrasound images of the subject using electrical pulse signals, or the calibration unit 150, which will be described below, produces ultrasound images of the subject by using the electrical pulse signals. When the diagnostic ultrasound irradiation device 40 directly generates ultrasound images, the diagnostic ultrasound irradiation device 40 transmits information about the ultrasound images to the interface unit 110. On the other hand, when the calibration unit 150 generates ultrasound images, the diagnostic ultrasound irradiation device 40 transmits the electrical pulse signals to the interface unit 110.
  • In addition, the diagnostic ultrasound irradiation device 40 has a particular location relationship with a therapeutic ultrasound irradiation device 30. For example, the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30 may be separated from each other with a predetermined distance interposed therebetween for operation, may be located adjacent to each other, or may be integrated as a single device.
  • Although not shown in FIG. 2, the therapeutic ultrasound irradiation device 30 may include a combination of one or more elements, e.g. actuator elements such as piezoelectric elements. When the therapeutic ultrasound irradiation device 30 includes a plurality of elements, the plurality of elements receive signals from the control unit 140 to individually transmit therapeutic ultrasound waves. Furthermore, durations of transmission of the therapeutic ultrasound may be set differently for each of the elements. Because the plurality of elements may individually transmit therapeutic ultrasound as described above, it is possible to change a position of a focal point of the therapeutic ultrasound while the therapeutic ultrasound irradiation device 30 remains stationary. Thus, therapeutic ultrasound may be focused along lesions of an internal organ moving due to a patient's respiration or other motions. For example, the therapeutic ultrasound irradiation device 30 may converge therapeutic ultrasound on a focal point by using a phase array technique. The phase array technique is understood by those skilled in the art, and a detailed description thereof is omitted. In one example, therapeutic ultrasound may be high intensity focused ultrasound (HIFU) having enough energy to cause necrosis of a tumor inside a patient's body. A HIFU system focuses and irradiates HIFU onto a portion of a subject to be treated to cause focal destruction or necrosis of a lesion and removes or treats the lesion.
  • When the therapeutic ultrasound irradiation device 30 in the HIFU system continues to irradiate the focal point by setting the focal point of the HIFU to a certain position, the temperature of a cell irradiated with HIFU rises above a predetermined temperature to cause necrosis of the surrounding tissue. The description of the present embodiment may also apply to other devices that transmit focused ultrasound similar to HIFU or devices to adjust a focal point using a sound pressure.
  • The calibration unit 150 uses the medical image 20 to calibrate the diagnostic ultrasound irradiation device 30, through the control unit 140, to transmit therapeutic ultrasound. The calibration refers to a process of adjusting coordinates of the therapeutic ultrasound irradiation device 30 so that the therapeutic ultrasound irradiation device 30 may transmit the therapeutic ultrasound to a point corresponding to a predetermined point (for instance, a lesion) within the medical image 20.
  • FIG. 3 illustrates a method of calibrating the therapeutic ultrasound irradiation device 30 in the calibration unit 150. It is assumed herein that medical images 310 are computed tomography (CT) images, but other types of medical images may be provided.
  • The calibration unit 150 receives electrical pulse signals from the interface unit 110 to generate ultrasound images 320 of a subject. In this case, the calibration unit 150 may use the electrical pulse signals to generate two-dimensional (2D) or three-dimensional (3D) ultrasound images of the subject. For example, the diagnostic ultrasound irradiation device 40 irradiates the subject with diagnostic ultrasound by changing a location and an orientation relative to the subject, receives a reflected ultrasound, and transmits electrical pulse signals corresponding to the reflected ultrasound to the interface unit 110. The calibration unit 150 uses the electrical pulse signals received from the interface unit 110 to generate a plurality of cross-sectional images of the subject. The calibration unit 150 then accumulates the plurality of cross-sectional images to create a 3D ultrasound image of the subject.
  • In response to the diagnostic ultrasound irradiation device 40 generating ultrasound images, the calibration unit 150 acquires the ultrasound images through the interface unit 110.
  • As illustrated in FIG. 3, at operation 330, the method at the calibration unit 150 registers the medical image 310 received from the interface unit 110 with the ultrasound image 320 of the subject. The registration refers to a method of configuring a first coordinate system of the medical image 310 to correspond to a second coordinate system of the ultrasound image 320. An image obtained after the registration may be a single medical image into which the medical image 310 and the ultrasound image 320 are combined, or an image in which the medical image 310 and the ultrasound image 320, having the same coordinate system, are disposed in parallel. The registration may comprise correlating the medical image to the ultrasound image, i.e. correlating the first coordinate system to the second coordinate system.
  • In one example, the calibration unit 150 registers the medical images 310 with the ultrasound images 320 using geometrical correlations between tissues in the medical images 310 and those in the ultrasound images 320. The geometrical correlations may be relationships between landmark points (also called reference points) extracted from the tissues. The calibration unit 150 may determine a point at which anatomical structure of tissue is distinctly reflected as a landmark point. For example, if a tissue of interest from which a landmark point will be extracted is a liver, a point at which blood vessels branch off in a vascular structure of the liver may be determined as the landmark point. If the tissue of interest is a heart, the landmark point may be a boundary between the right and left atria or a boundary where the vena cava and an outer wall of the heart meet.
  • In another example, the calibration unit 150 may determine an uppermost or a lowermost point of tissue in a predetermined coordinate system as a landmark point.
  • In another example, the calibration unit 150 may also determine uniformly spaced points, which can be interpolated between the landmark points selected in the above examples, as landmark points.
  • Referring to FIG. 3, at operation 330, the method at the calibration unit 150 registers the ultrasound image 320 with the medical image 310 and calculates a transformation relation between the first coordinate system of the medical image 310 and the second coordinate system of the ultrasound image 310. For example, the calibration unit 150 finds points in the ultrasound image 320 corresponding to points in the medical image 310, respectively, and calculates a coordinate transformation matrix to map any point in the medical image 310 to the corresponding point in the ultrasound image 320.
  • In one example, the calibration unit 150 may set coordinates of a predetermined position Pi (xi, yi, zi), for instance, a position at which a focal point of therapeutic ultrasound is to be formed, in the medical image 310 with respect to its arbitrary origin. The method at the calibration unit 150 then registers the ultrasound image 320 with the medical image 310 (operation 330) and finds coordinates of a point Pt(xt, yt, zt) in the ultrasound image 320 corresponding to the coordinates of the position Pi(xi, yi, zi) through the registration. The calibration unit 150 calculates variations Δ x, Δy, and Δz in positions of the points Pi and Pt along x-, y-, and z-axes. According to a process described above, at operation 340, the method at the calibration unit 150 calibrates the diagnostic ultrasound irradiation device 40.
  • At operation 350, the method at the calibration unit 150 uses the calibrated diagnostic ultrasound irradiation device 40 to calibrate the therapeutic ultrasound irradiation device 30. The calibration is a method of adjusting coordinates of the therapeutic ultrasound irradiation device 30 so that the therapeutic ultrasound irradiation device 30 transmits therapeutic ultrasound to a point corresponding to a predetermined point within the medical image 310.
  • In one example, the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30 have a predetermined position relationship with each other. Thus, the method at the calibration unit 150 calibrates the therapeutic ultrasound irradiation device 30 based on the known relationship between coordinates of the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30.
  • In this example, the relationship between coordinates of the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30 are calculated by rotation and translation of a coordinate axis and enlargement or reduction using a scale factor. The relationship between coordinates of focal points of diagnostic ultrasound and therapeutic ultrasound transmitted from the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30, respectively, may be calculated by rotation and translation of a coordinate axis and enlargement or reduction using a scale factor.
  • For example, the calibration unit 150 calibrates the therapeutic ultrasound irradiation device 30 by calculating a position of a focal point of a therapeutic ultrasound transmitted from the therapeutic ultrasound irradiation device 30 within the ultrasound image 320. The calibration unit 150 calculates the position of the focal point based on the known relationship between coordinates of the diagnostic ultrasound irradiation device 40 and the therapeutic ultrasound irradiation device 30.
  • Further, the calibration unit 150 calculates a position of a focal point of therapeutic ultrasound to be transmitted from the therapeutic ultrasound irradiation device 30 within the medical image 310.
  • Referring back to FIG. 2, the calibration unit 150 transmits a generated signal to the control unit 140, and the control unit 140 changes a position to be irradiated by the therapeutic ultrasound irradiation device 30 with therapeutic ultrasound so that the position corresponds to the calibrated coordinates.
  • The calibration unit 150 calibrates the therapeutic ultrasound irradiation device 30 in this way so that therapeutic ultrasound is transmitted from the therapeutic ultrasound irradiation device 30 to precisely form a focal point at a desired position.
  • FIG. 4 illustrates a configuration of the characteristics calculation unit 120, in accordance with an embodiment. Referring to FIG. 4, the characteristics calculation unit 120 includes a group generator 121, a first model generator 122, a second model generator 123, and a calculator 124.
  • Although the characteristics calculation unit 120 of FIG. 4 includes certain components, it will be understood by those skilled in the art that the characteristics calculation unit 120 may further include additional components to the components shown in FIG. 4. The characteristics calculation unit 120 may correspond to one or more processors.
  • Referring back to FIG. 2, the characteristics calculation unit 120 uses the medical image 20 to calculate characteristics of one or more tissues lying on a path along which therapeutic ultrasound propagates from the therapeutic ultrasound irradiation device 30 to a position of a focal point. For example, the characteristics calculation unit 120 generates models for characteristics of each of the tissues that construct a heterogeneous subject and calculates the characteristics of the one or more tissues on the propagation path using the generated models.
  • Referring to FIG. 4, the group generator 121 identifies a type of the one or more tissues on a path along which therapeutic ultrasound propagates through the therapeutic ultrasound irradiation device 30 to a position of a focal point.
  • FIG. 5 illustrates an example of at least one tissue located on a path along which therapeutic ultrasound propagates through the therapeutic ultrasound irradiation device 30 as shown in FIG. 2) to a position of a focal point.
  • Referring to FIG. 5, at least one tissue 520 through 550 may be located on a path along which therapeutic ultrasound propagates through an element 510 in the therapeutic ultrasound irradiation device 30 to a focal point 560. For example, the at least one tissue 520 through 550 may include skin, bone, muscle, blood, and an organ.
  • Referring back to FIG. 4, the group generator 121 identifies the type of the at least one tissue 520 through 550 shown in FIG. 5 on a path along which the therapeutic ultrasound propagates from the element 510 of the calibrated therapeutic ultrasound irradiation device 30 to a position of the focal point 560 using information about the element 510 that is received from the calibration unit 150.
  • The group generator 121 divides the one or more tissues into a plurality of groups based on the identified types of the tissues. For example, when a medical image is a CT image, the group generator 121 divides the one or more tissues in a subject, lying on the propagation path of the therapeutic ultrasound, into first and second groups based on a CT number obtained from the medical image of each of the tissues.
  • In one example, the CT number is a value that represents the degree of absorption for each pixel in a CT image. The pixel is a pixel in a 2D image or a voxel in a 3D image. The CT number is a relative X-ray attenuation coefficient determined for each tissue. CT numbers of air, water, and bone are -1000 Hu, 0 Hu, and +1000 Hu, respectively.
  • The group generator 121 divides the tissues into the first and second groups based on a distribution of the CT numbers. In one example, the group generator 121 determines tissues having the CT numbers in a predetermined range as the first group and tissues having very high or very low CT numbers as the second group.
  • For example, as known in the art, the CT number of bone is +1000 Hu, and the CT number of fat is from about 100 Hu to about -50 Hu. The bone has a very high CT number while the fat has a very low CT number compared to the liver (40 to 60 Hu), the kidney (30 Hu), the brain (37 Hu), and blood (40 Hu). Thus, the group generator 121 determines tissues, other than the bone and fat, as the first group and the bone and fat as the second group.
  • After dividing the tissues into the first and second groups in the manner described above, the group generator 121 transmits information about the tissues in the first group and information about the tissues in the second group to the first model generator 122 and the second model generator 123, respectively.
  • The first model generator 122 uses CT numbers of the tissues in the first group to generate a first model representing characteristics of each of the tissues in the first group. In one instance, the characteristics are physical characteristics of each of the one or more tissues. The physical characteristics may include the speed of therapeutic ultrasound passing through each of the tissues, a density of each tissue, an attenuation coefficient of therapeutic ultrasound for the tissue, or a combination thereof, but are not limited thereto.
  • In one embodiment, the first model generator 122 uses CT numbers of the respective tissues in the first group to generate a graph model for the speed of the therapeutic ultrasound passing through the tissues. Alternatively, the first model generator 122 uses the CT numbers of the respective tissues in the first group to generate a table model for the speed of therapeutic ultrasound passing through the tissues.
  • FIG. 6 is an example of a graph model 620 generated by the first model generator 122 shown in FIG. 4, in accord with an embodiment.
  • The first model generator 122 calculates the speed of therapeutic ultrasound passing through each tissue using Equation (1) below: c = 0.0028 h 3 - 0.28 h 2 + 8.2313 h + 1497.6
    Figure imgb0001

    where c is the speed of therapeutic ultrasound passing through each tissue (expressed in m/s) and h is a CT number (expressed in Hounsfield units (Hu)) for the tissue.
  • The first model generator 122 calculates the speed of therapeutic ultrasound for each of the tissues in the first group and approximates the calculated speed to generate the graph model 620 for the speeds of therapeutic ultrasound passing through the tissues.
  • In another embodiment, the first model generator 122 uses CT numbers corresponding to the respective tissues in the first group to generate a graph model or table model for densities of the tissues. The first model generator may calculate the density of each tissue using the following Equation (2): ρ = 0.00129 h 3 - 0.14661 h 2 + 5.1286 h + 990.34
    Figure imgb0002

    where p is a density of each tissue (expressed in kg/m3), and h is a CT number for the tissue (expressed as Hu).
  • The first model generator 122 calculates the density of each of the tissues in the first group and approximates the calculated densities to generate a graph model for the densities of the tissues. In this case, the first model generator 122 generates a graph model for the density in the same manner as described above with regards to the generating of the graph model 620 for the speed of therapeutic ultrasound.
  • In another embodiment, the first model generator 122 uses the CT numbers of the respective tissues in the first group to generate a graph model or table model for attenuation coefficients of therapeutic ultrasound for the tissues. The first model generator 122 calculates an attenuation coefficient of therapeutic ultrasound for each tissue using the following Equation (3): α = 0.0000044 h 3 - 0.0045 h 2 + 0.13 h + 0.022
    Figure imgb0003

    where α is an attenuation coefficient of therapeutic ultrasound for each tissue (expressed in dB/ (MHz*cm)), and h is a CT number for the tissue.
  • The first model generator 122 calculates the attenuation coefficient of the therapeutic ultrasound for each of the tissues in the first group and approximates the calculated attenuation coefficients to generate a graph model for the attenuation coefficients of the therapeutic ultrasound for each of the tissues. In this case, the first model generator 122 may generate a graph model for the attenuation coefficient of the therapeutic ultrasound in the same manner as described above with regards to the generating of the graph model 620 for the speed of therapeutic ultrasound.
  • The first model generator 122 transmits information about the generated first model to the calculator 124.
  • Referring to FIG. 4, the second model generator 123 generates a second model representing characteristics of each of the tissues in the second group. In one example, the characteristics are physical characteristics of each of the one or more tissues. The physical characteristics may include the speed of therapeutic ultrasound passing through each of the tissues, a density of each tissue, an attenuation coefficient of therapeutic ultrasound for the tissue, or a combination thereof, but are not limited thereto.
  • For example, the second model generator 123 generates a table model including the known speed of therapeutic ultrasound passing through each of the tissues (e.g., bone and fat) in the second group, the density of the tissue, and the attenuation coefficient of the therapeutic ultrasound for the tissue.
  • FIG. 7 is an example of a table model generated by the second model generator 123, in accord with an embodiment.
  • Referring to FIG. 7, the second model generator 123 generates the table model as a second model that indicates names, CT numbers, densities, and speeds and attenuation coefficients of therapeutic ultrasound for the tissues in the second group.
  • The second model generator 123 transmits information about the generated second model to the calculator 124.
  • The characteristics calculation unit 120 outputs a graph model or table model generated in the same manner, as described above, to a display device (not shown) through the interface unit 110.
  • Although the characteristics calculation unit 120 has been described to include the group generator 121 and the first and second model generators 122 and 123, the embodiment is not limited thereto. For example, Equations (1) through (3) and the table model of FIG. 7 may be stored in the characteristics calculation unit 120 for future use, or operations to generate the first and second models may be performed independently to the operation of the characteristics calculation unit 120.
  • Referring back to FIG. 4, the calculator 124 uses the graph model and the table model to calculate the characteristics. In one example, the calculator 124 combines information about the graph model received from the first model generator 122 with information about the table model received from the second model generator 123. The calculator 124 also calculates characteristics of one or more tissues on a path along which therapeutic ultrasound propagates from an element of the therapeutic ultrasound irradiation device 30 to a position of a focal point. The calculator 124 transmits information about the calculated characteristics to the parameter determiner 130.
  • Referring back to FIG. 2, the parameter determiner 130 determines a parameter of the therapeutic ultrasound to create a focal point onto a subject using calculated characteristics. In one example, the parameter determiner 130 determines a parameter by combining predetermined characteristics of the therapeutic ultrasound transmitted from the therapeutic ultrasound irradiation device 30 with the characteristics that the calculator 124 calculated and may affect the propagation of the therapeutic ultrasound.
  • In this case, the parameter is a combination of variables used to create a focal point of the therapeutic ultrasound. The variables may include, but are not limited to, a frequency, amplitude, phase, peak intensity, pulse length, and duty ratio of the therapeutic ultrasound and the number or positions of elements in the therapeutic ultrasound irradiation device 30.
  • FIG. 10 is a flowchart illustrating an example of operation of the parameter determiner 130, in accord with an embodiment.
  • A medium through which therapeutic ultrasound passes is a heterogeneous medium including several different tissues as shown in FIG. 5. Thus, an embodiment to determine a parameter of therapeutic ultrasound that reflects the effect of a heterogeneous medium so that a focal point is formed at a desired position will now be described with reference to FIG. 10.
  • Briefly, the method includes calculating a sound pressure PHOMO at a position of a focal point created by the therapeutic ultrasound by assuming that the therapeutic ultrasound travels through a homogeneous medium. The sound pressure PHOMO is also calculated by adjusting a parameter of the therapeutic ultrasound so that the absolute value of a difference between the sound pressure, PHOMO, and a sound pressure, PHET, at a position of a focal point when the therapeutic ultrasound propagates through a heterogeneous medium is less than or equal to a threshold value. In this example, the parameter of the therapeutic ultrasound may be a particle velocity that represents the amplitude and phase of the therapeutic ultrasound.
  • FIG. 12 illustrates a relationship between a focal point and the therapeutic ultrasound irradiation device (30 in FIG. 2), according to an embodiment.
  • In this embodiment, it is assumed that therapeutic ultrasound is transmitted from N elements in the therapeutic ultrasound irradiation device 30 and creates focal points at M target positions. The therapeutic ultrasound irradiation device 30 may include two or more elements, all or some of which transmit the therapeutic ultrasound.
  • FIG. 12 illustrates position vectors of an n-th element 1210 (n=1, 2, ..., N) and an m-th focal point position 1220 (m=1, 2, ..., M). In FIG. 12, rn is a position vector of the n-th element 1210, and rm is a position vector of an m-th focal point position 1220.
  • Referring back to FIG. 10, at operation 1010, when a position of a focal point is specified, the method calculates a sound pressure PHOMO at the position of the focal point by assuming that the therapeutic ultrasound travels through homogeneous tissue. For example, when a position at which a focal point is to be formed is designated, the method at the parameter determiner 130 calculates a particle velocity of each element. In this case, the position of the focal point is specified based on information input from a user through the interface unit 110, or automatically designated by the apparatus 10 as illustrated in FIG. 2 to control an ultrasound automatically, dynamically, or without user intervention.
  • A phase of the particle velocity may be calculated assuming that the speed of a sound wave is constant generally at 1540 m/s. For example, after computing a time taken for a sound wave to arrive at a focal point from each element, based on a distance between the focal point and the element, a phase is calculated for each element to compensate for the time difference between sound waves generated by the respective elements.
  • A user is enabled to determine an amplitude of the particle velocity to create a desired sound pressure PHOMO at a focal point position. For example, when an amplitude is input through the interface unit 110, the parameter determiner 130 calculates the sound pressure PHOMO exerted by the N elements at the m-th focal point position using a Rayleigh-Sommerfeld integral as defined by Equation (4). Furthermore, the user may adjust the amplitude so as to create the desired sound pressure PHOMO.
  • Although the parameter determiner 130 calculates the sound pressure PHOMO using the Rayleigh-Sommerfeld integral, the embodiment is not limited thereto. n = 1 N u n jk 2 π S n ρ ce - j α k r m - r n r m - r n d S n = p HOMO r m
    Figure imgb0004

    where k is a wave number of therapeutic ultrasound and is related to a wavelength of ultrasound using the equation k=2π/λ, and α, p, and c are attenuation coefficients of a homogeneous tissue, a density of the tissue, and a speed of a sound wave, respectively.
  • Sn, Un, and PHOMO(rm) are cross-sectional areas of an n-th element, a particle velocity for the n-th element, and a sound pressure at a focal point position having a position vector of rm, respectively. The particle velocity un (e.g. velocity of tranducer element n) is precalculated so as to create a focal point at a desired position in the homogeneous tissue.
  • At operation 1020, the method at the parameter determiner 130 sets elements that will transmit therapeutic ultrasound among the elements in the therapeutic ultrasound irradiation device 30 and arbitrarily sets a particle velocity of each of the set elements. For instance, the parameter determiner 130 uses a generic operator to set some or all of the N elements in the therapeutic ultrasound irradiation device 30 as elements to transmit the therapeutic ultrasound. The parameter determiner 130 sets particle velocities of the respective set elements and combines the particle velocities with one another. A particle velocity u that will be described below is the combined particle velocity obtained by the parameter determiner 130.
  • At operation 1030, the method at the parameter determiner 130 calculates a sound pressure PHET at a focal point position under the assumption that therapeutic ultrasound having the combined particle velocity u obtained at operation 1020 propagates through heterogeneous tissue. The heterogeneous tissue refers to a tissue that reflects characteristics of one or more tissues on a path along which therapeutic ultrasound propagates. The characteristics calculation unit 120 calculates characteristics, which may include a density of each tissue and the speed and attenuation coefficient of therapeutic ultrasound waves within the tissue.
  • For example, the parameter determiner 130 calculates a sound pressure PHET (rm) at a focal point position having a position vector of rm, which reflects characteristics of the heterogeneous tissue, using an angular spectrum method (ASM). The ASM involves expanding a complex wave field into a sum of an infinite number of plane waves. When a medium on the propagation path of therapeutic ultrasound is heterogeneous, the parameter determiner 130 calculates a sound pressure PHET (rm) using the ASM as follows:
  • Referring back to FIG. 5, when a plurality of different media, for instance, internal tissues, are located on the propagation path of therapeutic ultrasound, the parameter determiner 130 calculates a transmitted acoustic field w1b that passes through a discontinuous boundary D1 of a medium by combining an incident acoustic field, w1f, incident on the boundary D1 with a transmission coefficient T. The parameter determiner 130 then applies a 2D Fourier Transform to the transmitted acoustic field w1b to compute an angular spectrum W1b in a plane D1. Then, the parameter determiner 130 calculates an angular spectrum W2 by correcting a phase change due to a distance difference between planes D1 and D2 based on the angular spectrum W1b. Thereafter, the parameter determiner 130 applies a 2D Inverse Fourier Transform to the angular spectrum W2 to calculate an acoustic field w2 in a plane D2.
  • The parameter determiner 130 repeats the above operations a predetermined number of times corresponding to the number of boundaries on the propagation path of the therapeutic ultrasound to calculate the sound pressure PHET (rm) at a position of the focal point 560 having a position vector of rm, which reflects characteristics of the heterogeneous tissue. Although the parameter determiner 130 calculates the sound pressure PHET (rm) by using the ASM, the embodiment is not limited thereto.
  • At operation 1040, the method at the parameter determiner 130 determines whether a difference between the sound pressures PHOMO and PHET calculated in operations 1010 and 1030, respectively, is less than a predetermined threshold value. The predetermined threshold value may be automatically determined by the method at the parameter determiner 130 or determined by a user through the interface unit 110. In response to the difference between the sound pressures PHOMO and PHET being less than or equal to the predetermined threshold value, the method at the parameter determiner 130 determines the particle velocity, u, of the elements as a final value. However, when the difference exceeds the threshold, the method proceeds to operation 1050.
  • At operation 1050, the method at the parameter determiner 130 resets a particle velocity of each of the elements that are selected among the elements in the therapeutic ultrasound irradiation device 30 to transmit therapeutic ultrasound. The method at the parameter determiner 130 then combines particle velocities of the set elements with one another and returns to operations 1030 and 1040.
  • After determining a parameter, for instance, a particle velocity of an element to transmit therapeutic ultrasound to a focal point by performing operations 1010 through 1050 as described above, the method at the parameter determiner 130 transmits the determined parameter to the control unit 140.
  • While FIG. 10 shows that the parameter of therapeutic ultrasound is set so that a difference between the sound pressure PHOMO in a homogeneous medium and the sound pressure PHET in a heterogeneous medium is less than or equal to a predetermined threshold, other methods may be used. Another method of setting a parameter of therapeutic ultrasound in the parameter determiner 130 will now be described in detail with reference to FIG. 11.
  • FIG. 11 is a flowchart of another example of operation of the parameter determiner 130, in accordance with an embodiment.
  • The method at the parameter determiner 130 may determine a parameter of therapeutic ultrasound using a sound pressure PHET in a heterogeneous medium without comparing the sound pressure PHET with a sound pressure PHOMO in a homogeneous medium. In other words, by repeating setting of the parameter of therapeutic ultrasound until the desired sound pressure PHET is created in a heterogeneous medium, an operation of comparing the sound pressure PHET with a sound pressure PHOMO in a homogeneous medium may be omitted.
  • Referring to FIG. 11, at operation 110, the method at the parameter determiner 130 sets elements to transmit therapeutic ultrasound among the elements in the therapeutic ultrasound irradiation device 30 and arbitrarily sets a particle velocity of each of the set elements. The process at the parameter determiner 130 combines particle velocities of the respective set elements with one another. The method at the parameter determiner 130 sets particle velocities of the respective set elements and combines the particle velocities with one another.
  • At operation 1120, the method at the parameter determiner 130 calculates a sound pressure PHET at a position of a focal point that the therapeutic ultrasound, which includes the combined particle velocity u obtained at operation 1110, propagates through a heterogeneous tissue.
  • At operation 1130, the parameter determiner 130 determines whether the sound pressure PHET satisfies a predetermined condition. When the sound pressure PHET satisfies the predetermined condition, the parameter determiner 130 determines the particle velocity of the elements as a final value. On the other hand, when the sound pressure PHET does not satisfy the predetermined condition, the method proceeds to operation 1140.
  • At operation 1140, the method at the parameter determiner 130 resets or adjusts a particle velocity of each of the elements that are selected among the elements in the therapeutic ultrasound irradiation device 30 to transmit the therapeutic ultrasound. The parameter determiner 130 then combines particle velocities of the set elements with one another and returns to the operations 1120 and 1130.
  • Referring back to FIG. 2, the control unit 140 generates a control signal for an element of the therapeutic ultrasound irradiation device 30. In one example, the control signal is the particle velocity u of the elements that transmit therapeutic ultrasound, e.g. the velocity of the tranducer element. The control unit 140 then transmits the control signal to the therapeutic ultrasound irradiation device 30.
  • As described above, the parameter determiner 130 determines a parameter by combining the characteristics of therapeutic ultrasound, transmitted through elements of the therapeutic ultrasound irradiation device 30, and characteristics calculated in the calculator 124, which may affect the propagation of the therapeutic ultrasound. As a result, the parameter determiner 130 enables automatic transformation of the characteristics of tissues into characteristics of the therapeutic ultrasound.
  • FIG. 8 illustrates a configuration of a HIFU system 800, according to an embodiment. Referring to FIG. 8, the HIFU system 800 includes an ultrasound control apparatus 10, a therapeutic ultrasound irradiation device 30, and a diagnostic ultrasound irradiation device 40.
  • Although the HIFU system 800 of FIG. 8 includes certain components related to the embodiment, it will be understood by those skilled in the art that the HIFU system 800 may further include less or more components than the components shown in FIG. 8.
  • Furthermore, the HIFU system 800 includes the ultrasound control apparatus 10 shown in FIGS. 1, 2, and/or 4. Thus, the descriptions of the ultrasound control apparatus 10 with reference to FIGS. 1, 2, and 4 may apply to the HIFU system 800 of FIG. 8, and, thus, are not repeated.
  • The HIFU system 800 focuses therapeutic ultrasound on a focal point using the therapeutic ultrasound irradiation device 30. For example, the HIFU system 800 controls the therapeutic ultrasound irradiation device 30 to transmit therapeutic ultrasound using an externally input medical image 20 and an ultrasound image generated by the diagnostic ultrasound irradiation device 40 transmitting diagnostic ultrasound to a subject 810.
  • The HIFU system 800 is configured to generate therapeutic ultrasound by reflecting heterogeneity in characteristics of one or more tissues on a path along which the therapeutic ultrasound propagates, so that a focal point is formed accurately at a desired position. The HIFU system 800 may also generate therapeutic ultrasound by reflecting an examinee's characteristics, thereby minimizing a variation in treatment effects among examinees or patients.
  • The diagnostic ultrasound irradiation device 40 transmits diagnostic ultrasound to the subject 810 and acquires a reflected ultrasound signal to generate an ultrasound image of the subject 810. The diagnostic ultrasound irradiation device 40 processes the acquired reflected ultrasound signal to generate an ultrasound image of the subject 810.
  • The ultrasound control apparatus 10 calibrates the therapeutic ultrasound irradiation device 30 using an image obtained by registering the medical image 20 containing anatomical information about the subject 810 with the ultrasound image, and generates a control signal to generate therapeutic ultrasound that the calibrated therapeutic ultrasound irradiation device will transmit to a focal point.
  • The ultrasound control apparatus 10 controls generation of therapeutic ultrasound by automatically reflecting characteristics of the one or more tissues in a path along which the therapeutic ultrasound will propagate, thereby allowing the therapeutic ultrasound irradiation device 30 to focus the therapeutic ultrasound at a desired position without user intervention. Furthermore, the ultrasound control apparatus 10 enables treatment of one or more tissues with a single surgical procedure.
  • The therapeutic ultrasound irradiation device 30 uses the control signal generated by the ultrasound control apparatus 10 to transmit the therapeutic ultrasound towards a position of a focal point.
  • FIG. 9 is a flowchart of a method to generate therapeutic ultrasound to be transmitted from a therapeutic ultrasound irradiation device, according to an embodiment. Referring to FIG. 9, the method to generate therapeutic ultrasound includes operations that are performed in a time series by the ultrasound control apparatus 10 shown in FIGS. 1, 2, and 4 or by the HIFU system 800 in FIG. 8. Thus, although omitted hereinafter, the above descriptions of the ultrasound control apparatus 10 or the HIFU system 800 with reference to FIGS. 1, 2, 4, and 8 may apply to the method to generate therapeutic ultrasound illustrated in FIG. 9.
  • At operation 910, the method at the interface unit 110 acquires a medical image including anatomical information of a subject.
  • At operation 920, the method at the characteristics calculation unit 120 calculates characteristics of one or more tissues in a subject, which may affect the propagation of therapeutic ultrasound, using the medical image acquired at operation 910. More specifically, the method at the characteristics calculation unit 120 uses the acquired medical image to calculate characteristics of the one or more tissues on a path along which therapeutic ultrasound propagates from an element of the therapeutic ultrasound irradiation device 30 to a focal point.
  • For example, the method at the characteristics calculation unit 120 may generate models for characteristics of each of the tissues that construct the subject and calculate the characteristics of the one or more tissues on the propagation path by using the generated models.
  • The method at the characteristics calculation unit 120 also acquires the medical image and an ultrasound image of the subject from the interface unit 110 and registers the medical image with the ultrasound image. The method at the characteristics calculation unit 120 then calibrates the diagnostic ultrasound irradiation device 40 using an image obtained after the registration, and generates a signal to calibrate the therapeutic ultrasound irradiation device using the calibrated diagnostic ultrasound irradiation device 40.
  • At operation 930, the method at the parameter determiner 130 determines a parameter of therapeutic ultrasound to create a focal point on a subject using the characteristics calculated in operation 920.
  • At operation 940, the method at the control unit 140 produces a control signal to generate the therapeutic ultrasound according to the parameter determined at operation 930.
  • The ultrasound control apparatus 10 and the HIFU system 800, according to various embodiments, enable irradiation of therapeutic ultrasound by reflecting heterogeneity in characteristics of one or more tissues in a path along which the therapeutic ultrasound propagates, thereby improving the accuracy of treatment using HIFU.
  • The ultrasound control apparatus 10 and the HIFU system 800 are also configured to automatically reflect characteristics of tissues encountered on a travel path of the therapeutic ultrasound at a parameter to transmit the therapeutic ultrasound. Thus, the ultrasound control apparatus 10 and HIFU system 800 generate therapeutic ultrasound to create a focal point accurately at a desired position without user intervention.
  • The ultrasound control apparatus 10 and the HIFU system 800 may also individually generate therapeutic ultrasound by reflecting individual examinee tissue characteristics, thereby minimizing a variation in HIFU treatment effects among examinees or patients.
  • In addition, the ultrasound control apparatus 10 and the HIFU system 800 may generate therapeutic ultrasound by reflecting characteristics of tissues along a travel path of the therapeutic ultrasound, thereby allowing treatment of one or more organs with a single surgical procedure.
  • It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer or section from another region, layer or section. These terms do not necessarily imply a specific order or arrangement of the elements, components, regions, layers and/or sections. Thus, a first element, component, region, layer or section discussed below could be termed a second element, component, region, layer or section without departing from the teachings description of the present invention.
  • The units described herein may be implemented using hardware components, including, but not limited to a processing device. The processing device may be implemented using one or more general-purpose or special purpose computers, such as, for example, a processor, a controller and an arithmetic logic unit, a digital signal processor, a microcomputer, a field programmable array, a programmable logic unit, a microprocessor or any other device capable of responding to and executing instructions in a defined manner. The processing device may run an operating system (OS) and one or more software applications that run on the OS. The processing device also may access, store, manipulate, process, and create data in response to execution of the software. For purpose of simplicity, the description of a processing device is used as singular; however, one skilled in the art will appreciated that a processing device may include multiple processing elements and multiple types of processing elements. For example, a processing device may include multiple processors or a processor and a controller. In addition, different processing configurations are possible, such a parallel processors.
  • Program instructions to perform methods described in FIGS. 3 and 9-11, or one or more operations thereof, may be recorded, stored, or fixed in one or more non-transitory computer-readable storage media. The program instructions may be implemented by a computer. For example, the computer may cause a processor to execute the program instructions. The media may include, alone or in combination with the program instructions, data files, data structures, and the like. Examples of computer-readable media include magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM disks and DVDs; magneto-optical media, such as optical disks; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like. Examples of program instructions include machine code, such as produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter. The program instructions, that is, software, may be distributed over network coupled computer systems so that the software is stored and executed in a distributed fashion. For example, the software and data may be stored by one or more computer readable recording mediums. Also, functional programs, codes, and code segments for accomplishing the example embodiments disclosed herein can be easily construed by programmers skilled in the art to which the embodiments pertain based on and using the flow diagrams and block diagrams of the figures and their corresponding descriptions as provided herein..
  • A number of examples have been described above. Nevertheless, it will be understood that various modifications may be made. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in a described system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components or their equivalents. Accordingly, other implementations are within the scope of the following claims.

Claims (15)

  1. An ultrasound control apparatus for controlling the generation of an ultrasound, the apparatus comprising:
    an interface unit configured to receive a medical image comprising anatomical information about a subject;
    a characteristics calculation unit configured to calculate at least one characteristic of a tissue in the subject affecting propagation of the ultrasound based on the medical image;
    a parameter determiner configured to determine a parameter of the ultrasound to create a focal point on the subject using the calculated characteristic; and
    a control unit configured to produce a control signal for a therapeutic ultrasound irradiation device to generate the ultrasound according to the determined parameter.
  2. The ultrasound control apparatus of claim 1, wherein the characteristics calculation unit is configured to process the medical image to calculate the characteristic of the tissue on a path along which the ultrasound propagates from an element of the therapeutic ultrasound irradiation device to the focal point.
  3. The ultrasound control apparatus of claims 1 or 2, wherein the characteristic comprises a speed of the ultrasound passing through the tissue, a density of the tissue, an attenuation coefficient of the ultrasound for the tissue, or a combination thereof.
  4. The ultrasound control apparatus of claims 1, 2 or 3, further comprising:
    a calibration unit configured to calibrate the apparatus using the medical image.
  5. The ultrasound control apparatus of claim 4, wherein the calibration unit is configured to receive an ultrasound image of the subject from the interface unit, to calibrate a diagnostic ultrasound irradiation device based on the ultrasound image and the medical image, and to calibrate the apparatus by using the calibrated diagnostic ultrasound irradiation device.
  6. The ultrasound control apparatus of the claims 1-5, wherein the apparatus is further configured to control an intensity and a duration of the therapeutic ultrasound.
  7. A method to generate a control signal for controlling an ultrasound irradiation device to generate an ultrasound, the method comprising:
    receiving a medical image comprising anatomical information about a subject;
    calculating at least one characteristic of a tissue in the subject affecting propagation of the ultrasound based on the medical image;
    determining a parameter of the ultrasound for creating a focal point on the subject using the calculated characteristic; and
    generating the control signal according to the determined parameter.
  8. The method of claim 7, wherein the calculating of the characteristic comprises:
    processing the medical image to calculate the at least one characteristic of the tissue on a path along which the ultrasound propagates from an element of the ultrasound irradiation device to the focal point.
  9. The method of claim 7 or 8, wherein the characteristics comprise a speed of the ultrasound passing through the tissue, a density of the tissue, an attenuation coefficient of the ultrasound for the tissue, or a combination thereof.
  10. The method of 7, 8 or 9, further comprising:
    calibrating the ultrasound irradiation device using the medical image,
    wherein the calibrating of the ultrasound irradiation device preferably comprises:
    generating an ultrasound image of the subject using a diagnostic ultrasound irradiation device;
    calibrating the diagnostic ultrasound irradiation device using an image obtained by registering the ultrasound image with the medical image; and
    calibrating the ultrasound irradiation device using the calibrated diagnostic ultrasound irradiation device; and/or
    adjusting coordinates of the ultrasound irradiation device.
  11. The method of any of the claims 7-10, wherein the medical image comprises a computed tomography (CT) image.
  12. The method of any of the claims 7-11, wherein the determining of the parameter of the ultrasound comprises:
    determining the parameter by combining characteristics of the ultrasound with the calculated characteristic affecting the propagation of the ultrasound.
  13. The method of any of the claims 7-12, wherein the determining of the parameter of the ultrasound using the calculated characteristics comprises:
    calculating a first sound pressure representing a sound pressure at the focal point when the ultrasound propagates in homogeneous tissue;
    determining an element that transmits the ultrasound among elements in the ultrasound irradiation device and setting a particle velocity of the determined element;
    calculating a second sound pressure representing a sound pressure at the focal point when the ultrasound using the particle velocity propagates in the heterogeneous tissue; and
    determining the parameter of the ultrasound based on a relationship between the first sound pressure and the second sound pressure.
  14. The method of any of the claims 7-13, wherein the determining of the parameter of the ultrasound based on the relationship between the first and second sound pressures comprises:
    determining whether a difference between the first and second sound pressures exceeds a threshold value; and
    adjusting a particle velocity of the element in response to the difference exceeding the threshold value.
  15. A non-transitory computer-readable recording medium having recorded thereon a program configured to execute the method of any of the claims 7-14 when run on a computer.
EP13193911.8A 2013-06-18 2013-11-21 Apparatus for controlling the generation of ultrasound Active EP2815789B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130069958A KR102207919B1 (en) 2013-06-18 2013-06-18 Method, apparatus and system for generating ultrasound

Publications (2)

Publication Number Publication Date
EP2815789A1 true EP2815789A1 (en) 2014-12-24
EP2815789B1 EP2815789B1 (en) 2020-04-29

Family

ID=49709458

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13193911.8A Active EP2815789B1 (en) 2013-06-18 2013-11-21 Apparatus for controlling the generation of ultrasound

Country Status (5)

Country Link
US (1) US10136912B2 (en)
EP (1) EP2815789B1 (en)
JP (1) JP2015002983A (en)
KR (1) KR102207919B1 (en)
CN (1) CN104224277A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180247452A1 (en) * 2015-11-17 2018-08-30 Neuboron Medtech Ltd. Geometric model establishment method based on medical image data

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9357921B2 (en) 2009-10-16 2016-06-07 At&T Intellectual Property I, Lp Wearable health monitoring system
KR101777365B1 (en) * 2016-04-19 2017-09-11 한국지이초음파 유한회사 Beam-forming method based on local measurement of tissue attenuation
CN107789752B (en) * 2016-08-31 2019-05-31 重庆海扶医疗科技股份有限公司 Focusing ultrasonic therapeutic system
CN106491208B (en) * 2016-11-11 2019-04-12 北京唯迈医疗设备有限公司 A kind of perspective navigation map system, generation method and localization method
US10786306B2 (en) * 2018-01-24 2020-09-29 Medtronic Ardian Luxembourg S.A.R.L. Denervation therapy
WO2019219485A1 (en) * 2018-05-15 2019-11-21 Koninklijke Philips N.V. Synthetic transmit focusing ultrasound system with speed of sound mapping
JP2022504299A (en) * 2018-10-03 2022-01-13 メイヨ フオンデーシヨン フオー メデイカル エジユケーシヨン アンド リサーチ Phase velocity imaging using an imaging system
US20220011270A1 (en) * 2018-11-09 2022-01-13 Georgia Tech Research Corporation Systems and methods for ultrasound imaging and focusing
CN111826262B (en) * 2019-04-18 2023-06-20 深圳先进技术研究院 Biological 3D printing system and method
KR102525621B1 (en) * 2019-09-19 2023-04-26 기초과학연구원 Neural Plasticity Control Device and Method Using Theta-Burst Ultrasound
CN110680398A (en) * 2019-10-11 2020-01-14 深圳开立生物医疗科技股份有限公司 Ultrasonic echo imaging method and system and ultrasonic equipment
US20230181165A1 (en) * 2021-12-15 2023-06-15 GE Precision Healthcare LLC System and methods for image fusion

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1847294A1 (en) * 2005-01-31 2007-10-24 Chongqing Haifu(Hifu)Technology Co., Ltd Focused ultrasound therapy system
US20090048514A1 (en) * 2006-03-09 2009-02-19 Slender Medical Ltd. Device for ultrasound monitored tissue treatment
US20130079681A1 (en) * 2011-09-27 2013-03-28 Samsung Electronics Co., Ltd. Focused ultrasound therapy apparatus and focal point controlling method thereof

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6749570B2 (en) * 2002-08-23 2004-06-15 Acuson Corporation Ultrasound method and apparatus for imaging breast
US8088067B2 (en) * 2002-12-23 2012-01-03 Insightec Ltd. Tissue aberration corrections in ultrasound therapy
FR2869548B1 (en) 2004-04-29 2006-07-28 Centre Nat Rech Scient Cnrse THERMAL TREATMENT ASSEMBLY FOR BIOLOGICAL TISSUES.
JP5255964B2 (en) 2008-09-18 2013-08-07 株式会社日立メディコ Surgery support device
US8845559B2 (en) 2008-10-03 2014-09-30 Mirabilis Medica Inc. Method and apparatus for treating tissues with HIFU
US20100210940A1 (en) 2008-11-14 2010-08-19 Hoag Memorial Hospital Presbyterian CT-Guided Focused Ultrasound for Stroke Treatment
US9399148B2 (en) 2009-06-02 2016-07-26 Koninklijke Philips N.V. MR imaging guided theraphy
JP5611754B2 (en) 2010-10-07 2014-10-22 株式会社日立メディコ Surgery support system
CN103765239B (en) * 2011-07-01 2017-04-19 皇家飞利浦有限公司 Intra-operative image correction for image-guided interventions

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1847294A1 (en) * 2005-01-31 2007-10-24 Chongqing Haifu(Hifu)Technology Co., Ltd Focused ultrasound therapy system
US20090048514A1 (en) * 2006-03-09 2009-02-19 Slender Medical Ltd. Device for ultrasound monitored tissue treatment
US20130079681A1 (en) * 2011-09-27 2013-03-28 Samsung Electronics Co., Ltd. Focused ultrasound therapy apparatus and focal point controlling method thereof

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180247452A1 (en) * 2015-11-17 2018-08-30 Neuboron Medtech Ltd. Geometric model establishment method based on medical image data
EP3357537A4 (en) * 2015-11-17 2018-10-24 Neuboron Medtech Ltd. Geometric model establishment method based on medical image data
US10692283B2 (en) 2015-11-17 2020-06-23 Neuboron Medtech Ltd. Geometric model establishment method based on medical image data

Also Published As

Publication number Publication date
KR20140146955A (en) 2014-12-29
US20140371774A1 (en) 2014-12-18
EP2815789B1 (en) 2020-04-29
KR102207919B1 (en) 2021-01-26
CN104224277A (en) 2014-12-24
JP2015002983A (en) 2015-01-08
US10136912B2 (en) 2018-11-27

Similar Documents

Publication Publication Date Title
EP2815789B1 (en) Apparatus for controlling the generation of ultrasound
KR102189678B1 (en) A method, apparatus and HIFU system for generating ultrasound forming multi-focuses using medical image in region of interest
CN110248606B (en) Air pocket positioning
JP5681727B2 (en) Optimization of high-density focused ultrasonic transducer
US10449395B2 (en) Rib identification for transcostal focused ultrasound surgery
US10368809B2 (en) Method and apparatus for tracking a position of a tumor
JP4558504B2 (en) Correction of tissue abnormalities in ultrasonic therapy
US20150051480A1 (en) Method and system for tracing trajectory of lesion in a moving organ using ultrasound
US20130150704A1 (en) Magnetic resonance imaging methods for rib identification
JP6046743B2 (en) Calculation of ultrasonic intensity estimates using incoherent summation of ultrasonic pressure generated by multiple transducer elements
EP3897391B1 (en) Echo-based focusing correction
US20130346050A1 (en) Method and apparatus for determining focus of high-intensity focused ultrasound
CN108885781B (en) Method and system for synthesizing a virtual high dose or high kV computed tomography image from a low dose or low kV computed tomography image
KR20140113172A (en) Method and apparatus for making a plan of ultrasonic irradiation, and an ultrasonic irradiation method
US20130079681A1 (en) Focused ultrasound therapy apparatus and focal point controlling method thereof
KR20140102994A (en) A method, apparatus and HIFU system for generating ultrasound forming multi-focuses in region of interest
US10765892B1 (en) Systems and methods for optimizing transcranial ultrasound focusing
JP2018143416A (en) In-vivo motion tracking device
US9380945B2 (en) Method and apparatus for generating a temperature image
Bobina et al. Effect of abdominal wall inhomogeneities on the focusing of an ultrasonic beam at different positions of the transducer
JP4394440B2 (en) Ultrasound treatment
JP2020018789A (en) Ultrasound ct apparatus, ultrasound image generation apparatus, and ultrasound image generation method
KR20140021109A (en) Method and system to trace trajectory of lesion in a moving organ using ultrasound
Hudson Simulating thermal effects of MR-guided focused ultrasound (MRgFUS) in cortical bone and its surrounding tissue
Möri Generation of treatment plans for Magnetic Resonance guided High Intensity Focused Ultrasound (MRgHIFU) in the liver

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20131121

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

R17P Request for examination filed (corrected)

Effective date: 20150624

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602013068388

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: A61N0007020000

Ipc: A61N0007000000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 90/00 20160101ALN20191021BHEP

Ipc: A61N 7/00 20060101AFI20191021BHEP

Ipc: A61B 34/10 20160101ALI20191021BHEP

Ipc: A61B 8/08 20060101ALN20191021BHEP

INTG Intention to grant announced

Effective date: 20191113

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 8/08 20060101ALN20191101BHEP

Ipc: A61B 34/10 20160101ALI20191101BHEP

Ipc: A61B 90/00 20160101ALN20191101BHEP

Ipc: A61N 7/00 20060101AFI20191101BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1262399

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200515

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013068388

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200429

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200730

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200729

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200831

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200829

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1262399

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200729

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013068388

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201121

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20201130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201121

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200429

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201130

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230530

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231019

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231024

Year of fee payment: 11

Ref country code: DE

Payment date: 20231024

Year of fee payment: 11