US9433390B2 - System for measuring the true dimensions and orientation of objects in a two dimensional image - Google Patents

System for measuring the true dimensions and orientation of objects in a two dimensional image Download PDF

Info

Publication number
US9433390B2
US9433390B2 US14/106,771 US201314106771A US9433390B2 US 9433390 B2 US9433390 B2 US 9433390B2 US 201314106771 A US201314106771 A US 201314106771A US 9433390 B2 US9433390 B2 US 9433390B2
Authority
US
United States
Prior art keywords
image
given
medical image
markers
organ
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/106,771
Other versions
US20140180064A1 (en
Inventor
Ram Nathaniel
Dan Rappaport
Oren Drori
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ORTHOPEDIC NAVIGATION Ltd
Original Assignee
SURGIX Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SURGIX Ltd filed Critical SURGIX Ltd
Priority to US14/106,771 priority Critical patent/US9433390B2/en
Publication of US20140180064A1 publication Critical patent/US20140180064A1/en
Assigned to SURGIX LTD. reassignment SURGIX LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DRORI, OREN, NATHANIEL, RAM, RAPPAPORT, DAN
Assigned to ORTHOPEDIC NAVIGATION LTD. reassignment ORTHOPEDIC NAVIGATION LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SURGIX LTD.
Priority to US15/256,642 priority patent/US20170128027A1/en
Application granted granted Critical
Publication of US9433390B2 publication Critical patent/US9433390B2/en
Priority to US16/946,665 priority patent/US20210038176A1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/12Devices for detecting or locating foreign bodies
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/46Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment with special arrangements for interfacing with the operator or the patient
    • A61B6/461Displaying means of special interest
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/52Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • G06T7/0042
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3966Radiopaque markers visible in an X-ray image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/04Indexing scheme for image data processing or generation, in general involving 3D image data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10116X-ray image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10116X-ray image
    • G06T2207/10121Fluoroscopy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30008Bone
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30021Catheter; Guide wire
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30052Implant; Prosthesis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30204Marker
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/012Dimensioning, tolerancing

Definitions

  • the invention is related to the field of medical radiography. More specifically the invention relates to devices and methods of accurately measuring the dimensions in a specific orientation of objects observable in two-dimensional images, e.g. radiographic images.
  • X-ray source 10 is roughly a point source that emits a cone of x-rays that project an image 40 of radiopaque object 20 on surface 30 .
  • Surface 30 is in some cases essentially planar but is usually distorted as a result of the configuration of the equipment used to make the images.
  • the surface 30 can be of any type made sensitive to x-rays, e.g.
  • the scale of image 40 on surface 30 depends on the distance of identical objects 20 from the source 10 ( FIG. 1A ) and/or on the angle of the object with reference to planar surface mentioned parameters. In the absence of this information, time consuming trial and error is needed to complete the procedure and the lack of accurate measurements has been determined to be one of the causes of failures of orthopedic procedures.
  • the invention comprises a grid of radiopaque wires placed between the object being x-rayed (inside a human body) and the planar surface on which the images are recorded and an “angle plate” which is applied to the body to insure parallelism of the x-rays.
  • the object of the invention being to provide “an improved radiographic apparatus whereby the exact location of an invisible object, not permeable or difficulty permeable by the so-called “Roentgen” or “X” rays, may be accurately ascertained and measurements made by which operations necessary for the removal of such objects are controlled and guided”.
  • the invention is a system for measuring the true dimensions and orientation of objects in a two dimensional image.
  • the system is comprised of a ruler comprising at least one set of features each comprised of two or more markers that are identifiable in the image and having a known spatial relationship between them and a software package comprising programs that allow extension of the ruler and other objects in the two dimensional image beyond their physical dimensions or shape.
  • the markers in each set are arranged in one or more rows having a known spatial relationship between them. If there is more than one of the sets, at least some of the sets are aligned in a direction non-parallel to the measurement direction or to each other.
  • Embodiments of the system are adapted to measuring x-ray images. Embodiments of the system are adapted to enable it to be used for measuring the true dimensions and orientation of objects and for aiding in the identification and location of a surgery tool vs. anatomy in a radiographic image.
  • the invention is an apparatus adapted to enable it to take x-ray images and to measure the true dimensions and orientation of objects and to aid in the identification and location of a surgery tool vs. anatomy in those x-ray images.
  • the apparatus comprises:
  • the software package comprises programs that allow the processing means to recognize the features of the ruler on the radiographic image and to use the features to create a virtual extension of the at least one ruler and to draw the virtual extension of the at least one ruler on the radiographic image as an overlay, thereby enabling the user who is pointing the at least one ruler and looking at the radiographic image to accurately measure objects that appear in the radiographic image.
  • the software package comprises a program that allows the zero scale on the virtual extension of the ruler to be dragged and moved around at will.
  • the software package comprises a program that allows the processing means to measure the angle between two lines projected on the measuring plane.
  • the software package comprises a program that allows the processing and display means to provide real time visualization by using either a one or a three dimensional ruler in order to draw how at least how a part of the result of the operation will look given the positioning of the ruler or some other surgical tool visible in the image.
  • the software package comprises a program that allows the processing and display means to find markers in the image and place templates of implants or other objects on the image.
  • the software package comprises a program that allows the processing means to automatically determine the location of a surgical tool in the image and to apply an image enhancement algorithm that automatically concentrates on the specific area of interest to the surgeon.
  • the software package comprises a program that allows the processing and display means to synchronize AP and axial images.
  • the invention is a ruler for use in the system of the first and second aspects.
  • the ruler has at least one set of features each comprised of two or more markers that are identifiable in the image having a known spatial relationship between them.
  • the markers in each set are arranged in one or more rows having a known spatial relationship between them and, if there is more than one of the sets, at least some of the sets are aligned in a direction non-parallel to the measurement direction or to each other.
  • the ruler can be a hand-held ruler used to “point and “measure”.
  • the ruler may comprise means for slideably attaching it to a tool.
  • the ruler may be an integral part of a tool, made by making at least part of the tool from a translucent material and embedding opaque markers into it.
  • the ruler may be comprised of small radiopaque markers, with a known spatial relationship between them, embedded in a radiolucent envelope.
  • the invention is a method of drawing and displaying on a two dimensional x-ray image measurements of objects visible in said image, graphical information, or templates of surgical devices.
  • the method comprises the steps of:
  • the method is characterized in that the measurements, graphical information, or templates are not a part of the known object.
  • the known object can be a ruler according to the third aspect of the invention, a surgical tool, or an anatomical feature.
  • FIG. 1A and FIG. 1B illustrate the technical problem that is addressed by the present invention
  • FIG. 2 shows a compression hip plate assembly
  • FIG. 3 illustrates the tip-apex distance (TAD);
  • FIGS. 4, 5A and 5B illustrate two embodiments of one dimensional rulers of the invention
  • FIG. 6 illustrates an embodiment of a three dimensional ruler of the invention
  • FIG. 7 and FIG. 8 schematically show respectively how one and two dimensional virtual extensions of the ruler of the invention are created overlaying the x-ray image of the object of interest;
  • FIG. 9A to FIG. 9C show a handle comprising a ruler of the invention to be used by a surgeon to correctly align a drill guide;
  • FIG. 10A to FIG. 15 illustrate some of the modes of operation of the system of the invention
  • FIG. 16 symbolically shows how the system of the invention is integrated with an imaging system
  • FIG. 17 is a flow chart outlining the main stages in processing and displaying the images using the system of the invention.
  • the invention is a system that can be used for measuring the true dimensions in a specific orientation of objects in two and three dimensional images.
  • the images considered herein are radiographic images, in particular x-ray images, wherein by x-ray images are meant radiographic images, fluoroscopic images, digital fluoroscopy images, or images taken using any other type that uses x-rays to obtain them.
  • x-ray images are meant radiographic images, fluoroscopic images, digital fluoroscopy images, or images taken using any other type that uses x-rays to obtain them.
  • the device and methods of the invention can be used in any imaging situation.
  • the device and system of the invention are used to measure the true dimensions and orientation of objects that appear in the image and to aid the surgeon in the identification and location of surgery tools vs. anatomy in the radiographic image.
  • FIG. 16 symbolically shows how the system of the invention is integrated with an imaging system to improve the users understanding of the images produced with the imaging system.
  • the essential components of imaging system 200 are the source of radiation 202 and the detector 204 .
  • the imaging system 200 is connected to a computer 206 .
  • object 202 blocks some of the radiation causing a shadow to appear on the detector.
  • the output signals from detector 204 are sent to computer 206 where they are processed to produce images that can be stored in the memory of computer 206 and/or displayed on display device 208 .
  • the system of the invention comprises two components: a calibration device 70 , which is called a “ruler” herein and a computer software package 216 .
  • Radiolucent ruler 70 comprises radiopaque markers 76 . It is placed in the space between source 202 and detector 204 such that at least some of the markers 76 will be visible in the images gathered by imaging system 200 .
  • Computer software package 216 is loaded into computer 206 in order to provide the computer with advanced capabilities for processing and displaying the images as a graphical overlay, displayed over the x-ray image on the display 206 , thereby providing the user with information not previously available. Illustrative embodiments of the ruler and of the software as well as descriptions of the new types of visual information that can be provided to the user will be described herein below.
  • markers is used to mean features that are visible in the image, by virtue of their color, luminance or intensity. In the case of x-ray images, markers have a different radio-opacity than their immediate surrounding, or comprise different radio-opacity levels. Markers are regarded as a singular point in space, e.g. the center of a ball or a corner of a cubical shape, which is well defined and can be noticed in the image.
  • markers and “feature” are used interchangeably.
  • the ruler comprises two or more features having a known spatial relationship between them that are visible and recognizable in a radiographic image.
  • the two or more features are aligned parallel to the measurement direction.
  • the associated software allows, amongst many other modes of operation to be described herein, the automatic recognition of features of the ruler in the radiographic image and the use of these features to create a virtual extension of the ruler, i.e. to extend the ruler beyond its physical dimensions, and drawing the virtual extension on the image as an overlay.
  • the invention enables the surgeon who is pointing the ruler and looking at the image to accurately measure dimensions of objects that appear in the radiographic image.
  • the invention is especially useful and convenient for use with x-ray imaging in which frequently it is desired to measure the internal organs, bones, etc. of a body.
  • the invention can be used with any technique of producing two dimensional images, e.g. regular photography.
  • the invention in its various embodiments, can be used to assist the operator in any procedure in which it is desirable or necessary to measure distances or dimensions of objects in radiographic images.
  • Such procedures range from common chest x-rays, that are analyzed “off-line”, to orthopedic and other surgical procedures that can only be carried out “on-line”, i.e. with the aid of inter-surgery radiographic imagery using, for example, a mobile C-arm x-ray unit.
  • Typical non-limitative examples of on-line procedures that can be performed with the aid of the invention are:
  • DHS dynamic hip screw
  • a specific protocol for carrying out the surgical procedure can be downloaded from the web site of Smith & Nephew at [http://www.smithnephew.com/Downloads/71180375.pdf]
  • FIG. 2 shows a compression hip plate assembly 50 manufactured by Smith & Nephew.
  • the assembly comprises a plate 54 that fits against the outer surface of the femur with an attached barrel 52 that fits into a hole bored into the femur. After reduction and fixation of the fracture a hole is bored into the bone through the neck and into the head of the femur in order to attach lag screw 56 . After lag screw 56 has been screwed into the head of the femur, the barrel is inserted into the hole, the plate is positioned on the side of the femur, and compression screw 60 is screwed in to attach the plate 54 to the lag screw and tightened to bring the broken pieces of bone together.
  • Self tapping bone screws 58 are used to attach the plate firmly to the shaft of the femur and if necessary, depending on the type of break, cannulated or cancellous screw 62 can be inserted into the bone to capture medial fragments.
  • hip plate kits available to the surgeon having many variations of the basic design. The variations include, for example, the length of lag screw 56 , the angle between screw 56 and plate 54 , and the number of cortical screws 58 .
  • the most demanding part of the procedure is creating the hole into which the lag screw is inserted.
  • the hole must pass through the bone in a path following the central axis of the neck of the femur towards the apex of the femoral head.
  • the surgeon assisted by a series of x-ray images taken during the course of the proceeding, uses a small diameter guide drill to make an initial guide hole.
  • the first problem is to determine the neck angle to select an appropriate angle plate, which is used to help determine the proper entry point and to aim the guide drill.
  • the surgeon referring to the x-ray images, estimates the correct angle and entry point and begins to drill with the guide drill.
  • a typical C-arm equipped with an image intensifier tube for generating the images creates a distortion to the image usually causing straight lines to appear curved in the images: It is noted that if the surgeon has only to extend the line from the drill theoretically he is not influenced by the scale and a line in three dimensional world will still appear to be a line in the two dimensional projection image; however this theoretical extension is not an easy task, especially when precision is so important. If the drill path appears to be correct, then the surgeon drills a bit further before stopping to check again by repeated x ray imaging. If, at any stage, the path appears to be incorrect, then the surgeon must withdraw the guide drill and begin drilling again using a different angle and/or entry point. Another difficulty is ascertaining exactly where to stop drilling.
  • lag screw it is essential that the lag screw be attached to as much of the bone as possible; however sufficient bone must remain at the apex of the head to prevent the lag screw from breaking through into the hip joint when the screw is inserted in the hole. This issue involves not only measurement of drilling orientation but also of drilling depth.
  • TAD tip-apex distance
  • X ap and D ap mark the distances from the tip of the lag screw to the apex of the femoral head and the measured diameter of the lag screw measured on an anteroposterior (AP) radiograph, respectively.
  • X lat and D lat mark the same parameters measured on a lateral radiograph, and D true is the actual diameter of the lag screw.
  • FIGS. 4, 5A, and 5B illustrate two embodiments of a one-dimensional ruler of the invention.
  • ruler 70 is comprised of a cylinder 72 of radiolucent material.
  • a slot 74 is created lengthwise in cylinder 72 so that the ruler can be slipped over the surgical tool, e.g. a guide, i.e. a thin bone drill sometimes known as a guide wire, without the necessity of releasing the guide from the power drill.
  • the dimensions of the slot are such that the longitudinal axis of the guide and cylinder 72 coincide when ruler 70 is attached to the guide.
  • the guide fits tightly in the slot so that the ruler will not slide freely but can be shifted easily by the surgeon to a new position when desired.
  • Some embodiments of the ruler will rotate with the guide and other embodiments of the ruler can be attached so that the guide may rotate without rotating the attached ruler.
  • Metal balls 76 are embedded into cylinder 72 in rows that are parallel to the direction of slot 74 .
  • Metal balls “floating” in a plastic cylinder are preferably used so that the x-ray signature of the ruler will be dark circles that are easily detectable in the image.
  • One row of balls 76 is theoretically sufficient; however it is preferred that at least three rows of balls 76 , equally radially spaced around the circumference of the base of cylinder 72 , be used to insure that at any position of the ruler on the guide at least one row of balls will not be overlaid by the radiopaque guide or another row of balls, and will be visible on the x-ray image.
  • the exact distance between balls 76 is known so that when their shadows are detected on the x-ray image the dedicated software of the invention can identify them and measure the apparent distance between them directly from the image and use this measurement together with the known actual distance to calculate the scale that is used to create the overlays that allow the surgeon to determine the exact position of the guide relative to the anatomical structure, dimensions, and other related information displayed on a screen in “real time”.
  • the dedicated software of the invention can identify them and measure the apparent distance between them directly from the image and use this measurement together with the known actual distance to calculate the scale that is used to create the overlays that allow the surgeon to determine the exact position of the guide relative to the anatomical structure, dimensions, and other related information displayed on a screen in “real time”.
  • only two balls 76 in one row are needed to be visible in the image in order to create an acceptable approximation of the C-arm magnification factor and the sizes of organs and tools for most common cases.
  • the distance between markers i.e. the scale
  • the distance between markers will grow smaller to one direction and larger in the other direction, changing with the distance from the x-ray source.
  • the rate of change of the distance can be measured and therefore an accurate scale in both directions can be calculated.
  • FIG. 5A shows another embodiment of a ruler 70 ′ of the invention.
  • the radiolucent body 80 of the ruler is roughly a prism having an isosceles triangle as its base. The sides of the prism are cut away to leave a Y-shaped cross section.
  • a row of metal balls 76 (seen in FIG. 5B , which is a cross-sectional view of ruler 70 ′) is embedded at the apex of each of the arms of the “Y”.
  • a slot 74 is created along the longitudinal symmetry axis of body 80 of ruler 70 ′.
  • Body 80 is slipped over guide 78 and then a clip 82 is attached to body 80 to hold guide 78 in slot 74 . This can be done with the guide attached to the drill.
  • the width of slot 74 need not necessarily be essentially equal to the diameter of the guide but it can be wide enough to allow the ruler to be attached to guides having a wide range of diameters.
  • Clip 82 comprises a spring loaded brake (not shown) that locks ruler 70 ′ in place, preventing it from sliding along guide 78 .
  • FIG. 6 illustrates an embodiment of a three dimensional ruler 70 ′′ of the invention.
  • the radiolucent body 86 of the ruler has an “L” shaped cross section. Rows of radiopaque balls 76 are embedded in the walls of body 86 .
  • a suitable arrangement e.g. a slit and/or a clip such as described above, are provided to slidingly hold ruler 70 ′′ in place on guide 78 .
  • markers are described herein with regard to specific illustrative examples of the ruler.
  • the minimal requirement of the invention for the number and arrangement of markers is one of the following:
  • the triangular sleeve with handle that is used by orthopedic surgeons to aid them in maintaining the alignment of the drill in a DHS placement procedure, as known to persons skilled in the art, can be modified by embedding a three dimensional ruler of the invention inside it, in which case, the modified sleeve itself can be used to fulfill the functions of the ruler of the invention that are described herein.
  • the sleeve is made of radiolucent material and comprises a set of metal balls, arranged in a known spatial arrangement, such that the 3D orientation of the ruler may be calculated using the balls that appear in the image.
  • FIG. 9A to FIG. 9C respectively show front and back perspective views and a cross-sectional view of a handle 90 comprising a ruler of the invention that can replace the traditional triangular sleeve used by surgeons to aid in aligning a guide drill.
  • handle 90 has a “T” shape with a crosspiece 92 at the top of shaft 93 that allows the user to easily and firmly grip handle 90 with one hand.
  • a foot 94 At the bottom of shaft 93 is a foot 94 .
  • the bottom surface of foot 94 comprises means, e.g. cleats 96 , to prevent the device from sliding on the surface of the skin.
  • the exit hole 98 of slot 74 FIG.
  • At least the foot 94 and the lower portion of shaft 93 (through which slot 74 passes) of handle 90 are made of a radiolucent material.
  • embedded in this material are two rows comprised of five of radiopaque markers 76 each, a horizontal row embedded in the foot 94 and a vertical row embedded in the lower part of shaft 93 . Notice that the markers in each row are not equally spaced and that neither of the rows of markers is aligned in parallel to the direction of the drilling.
  • the software of the system can identify the markers 76 and from them determine the location and orientation of the handle 90 , from this the exact orientation of slot 74 , and can create a virtual extension of the guide that is inserted into slot 74 , in the direction of drilling, beyond its physical dimension.
  • a ruler need not be attached to the drill and the system of the invention will recognize the handle and can extrapolate it in both directions and can also display the implant template, i.e., a graphic overlay of where the implant would be, including all its parts, at the current position of the triangle (see, for example, FIG. 14 and FIG. 15 ).
  • This approach allows an “intra-operative real time” visualization and measurement ability using the tools that are familiar to the surgeon.
  • preferred embodiments of three dimensional rulers can be constructed comprising two sets of non-parallel rows of markers in order to provide a device for which the markers will be identified even when the ruler is partially occluded by other objects, e.g. bones or tools in the image.
  • a three dimensional grid can be projected onto the image.
  • embodiments of the ruler of the invention comprise an elongated radiolucent body in which rows of radiopaque markers of known size and distance apart are symmetrically embedded.
  • the ruler of the invention can be: a hand-held ruler used to “point: and “measure”; the ruler can comprise means for slideably attaching it to a surgical tool, e.g. handle 90 shown in FIGS. 9A to 9C ; or the ruler can be an integral part of a surgical tool, possibly made by making at least part of the tool from a translucent material and embedding radiopaque markers into it.
  • the ruler can be a one dimensional ruler in which the rows of radiopaque markers are parallel to the measuring direction or a three dimensional ruler in which a non parallel rows of markers are embedded.
  • the ruler could comprise a metal comb or a metal jig, with no translucent material.
  • the radiopaque markers would then be either characteristic features of the ruler, e.g. the teeth of the comb, or could be, e.g. metal balls attached to the body of the ruler.
  • the ruler when the ruler is attached to a surgical tool as will be demonstrated by example hereinbelow, during a medical procedure the ruler stays in a fixed position, e.g. at a location on the surface of the body or an organ within the body of a patient, while the tool is advanced into or withdrawn from the body or organ during the course of a diagnostic or surgical procedure.
  • the ruler is made of bio-compatible USP class 6 materials and is reusable after sterilization using, for example, ETO.
  • the entire ruler, except for the metal balls, is made of plastic. Under x-ray the ruler is seen as semi transparent and the metal balls are seen “floating” around the guide/drill. Based on these fundamentals and the examples of the embodiments described herein, skilled persons should have no trouble designing a ruler suitable for use with any diagnostic or surgical tool.
  • FIG. 7 and FIG. 8 schematically show respectively how one and two dimensional virtual extensions of the ruler of the invention are created overlaying the x-ray image of the object of interest.
  • object 20 and radiopaque balls 76 embedded in a ruler of the invention, that is attached to guide drill 78 are shown positioned in the path of a beam of x-rays emitted by source 10 .
  • the dashed lines represent the shadows of the radiopaque objects that form images 40 on the electronic camera.
  • the digital signals from the camera are processed using the software package of the invention to determine the distance between the images of the balls of the ruler. From the measured and known distances a scale factor is determined and a virtual extension 88 of the ruler is constructed.
  • the virtual extension can be added as an overlay on the displayed x-ray image in a number of ways that can be selected by the operator.
  • the suggested display mode is to place the graphic presentation of the virtual extension exactly on top of the longitudinal axis of the guide drill with the origin at the distal tip of the drill, as seen in the x ray image. This is shown in FIG. 7 on the image plane representing the displayed image in the actual system. In this way, the surgeon can, using both forward distance scales and rearward distance scales, determine respectively how much farther the drill must be advanced and how far into the object the drill has penetrated.
  • display features are possible, e.g. color coding to easily distinguish between forward and rearward distances, the addition of transverse scales at locations selected by the operator to enable measurement of the distance from the center of the drill to the sides of the object for example to confirm that the hole is being drilled exactly through the center of the object, and the addition of color coded markings to indicate when the drill is approaching and/or has arrived at the location that drilling should cease.
  • color coding to easily distinguish between forward and rearward distances
  • transverse scales at locations selected by the operator to enable measurement of the distance from the center of the drill to the sides of the object for example to confirm that the hole is being drilled exactly through the center of the object
  • color coded markings to indicate when the drill is approaching and/or has arrived at the location that drilling should cease.
  • FIG. 8 is similar to FIG. 7 with the exception that use of the three dimensional ruler provides sufficient information for the software to construct a two dimensional grid that can be displayed on the screen as an overlay on top of the x-ray image.
  • the three dimensional ruler can provide a complete three dimensional orientation, the grid could be drawn in any orientation, and not just the original orientation of the ruler (as shown in the Figure).
  • the system of the invention is used with a C-arm X-ray unit or some other imaging system. It comprises a ruler, and software that enables display of the virtual extension and allows display of the overlays and other features described herein, e.g. the software may include computer vision and recognition algorithms that are used to identify implants, surgical tools and anatomical features and to draw their counterparts or extensions during the operation as an overlay on the x-ray image (see FIG. 11 ).
  • the software works in semi-automatic mode wherein it allows the user to mark on the balls on the computer screen, e.g. by pointing to and clicking on them using a computer mouse, and then calculates the scale and draws the virtual extension. In other embodiments it is not necessary to mark all or some of the balls in an image or to mark the balls in successive images. The process may be started with a user click and then the software automatically searches for the markers and for the guide in the next image.
  • the system can be given the ability to display the images in many different formats to assist the surgeon, e.g. different colors can be used to differentiate how far the drill has penetrated into the bone from the remaining distance.
  • other types of information can be provided by audible signal, e.g. signifying the remaining distance or when to stop drilling.
  • an anti-distortion system for extra accuracy.
  • the anti-distortion system is a conventional one, as known to persons skilled in the art, comprises a grid placed on the image intensifier (the receiving end of the C-arm) and software that uses the image of the grid to correct the image obtained from the C-arm.
  • Anti-distortion systems suitable for use with the present invention are described in: [Gronenschild E., “Correction for geometric image distortion in the x-ray imaging chain: local technique versus global technique” Med Phys. 1999, December; 26(12):2602-16]. In cases in which an anti-distortion system is used, the detection of the ruler markers using the software of the present invention has to be done on the image after the anti-distortion process.
  • FIG. 17 is a flow chart outlining the main stages in processing and displaying the images using the system of the invention.
  • the x-ray image obtained using the imaging system 200 undergoes an image distortion process.
  • This phase is not mandatory, and depends on the imaging system. Some imaging systems do not create significant distortions and for these systems this phase can be skipped. Image distortion correction is done in any one of the standard ways, known in the art.
  • the next stage 502 is marker identification in the image.
  • the marker, identification can be done either manually, where the user points at the location of the markers using a pointing device, such as a computer mouse; can be done in a semi-automatic manner, where some user input is required and some of the marker identification is done automatically; or can be done in a fully automatic manner, where an image processing algorithm, provided in the software of the system, is used to detect the markers in the image.
  • the software of the system calculates the scale, using the markers in the image identified in stage 502 . If a one dimensional ruler has been used, then the markers are co-linear and the only scale that can be deduced is in the direction of the markers. Since the magnification of an object depends on its distance from the x-ray source, if only two markers are used, the exact position and orientation of the ruler cannot be determined, since a rotation of the ruler may have the same effect, as a change of distance from the x-ray source, on the distance between the markers on the image (see FIGS. 1A and 1B ).
  • the minimal requirement in the three dimensional case is at least 3 markers that are not co-linear.
  • the system draws an overlay over the x-ray image.
  • the overlay may include any type of graphical or other information, drawn or printed over the image. Amongst other things, it may include a virtual extension of a drill, an implant image, taken from a pre-stored library of implants, or a virtual drawing of a measurement ruler, aligned with the device.
  • the overlay can make use of the location and orientation of the device in the image.
  • Preferred embodiments may include a GUI that enables the user to easily select and customize the overlay shown over the images.
  • DHS dynamic hip screw
  • the software package of the invention enables the surgeon to apply templates of the tools and lag screws of different dimensions and to determine accurate measurements of the anatomical features to plan exactly the operation, including screw selection, and to visualize the end result.
  • FIG. 15 shows this feature of the operation planning stage.
  • FIG. 12 shows the display during operation, after the skin was already cut and some of the surgical tools were inserted to the body.
  • the drill 78 is about to enter the femur and the surgeon uses a triangular sleeve to enter at the correct angle (135 degrees).
  • a two dimensional grid has been drawn to illustrate how the ruler of the invention and its virtual extension 104 would appear.
  • FIG. 13 shows the situation after drilling with the guide drill 78 .
  • the virtual ruler 104 displayed on the screen overlaying the guide and the bone allows the surgeon to see exactly how far the drill has penetrated the bone and to confirm that the path is correct.
  • a three dimensional ruler is used to determine the plane on which to draw the line perpendicular to the drilling direction, i.e. to correct for the change of scale of the ruler on the drill caused by the fact that the drill is tilted at an angle relative to the plane of the image.
  • a one dimensional ruler could be just as useful; but in either case, the surgeon can see how far the guide tip is from the hip joint. This is useful for determining the expected distance from the joint. Note that this is not exactly the tip apex distance, but rather a more accurate 3D measurement, that is similar in concept to the TAD.
  • the virtual ruler allows the surgeon to accurately measure the tip-apex distance and verify that the surgery has been performed properly.
  • embodiments of the invention are very versatile when applied to orthopedic surgery and the software package may have the capability of allowing the operator to choose from many different operating modes, depending on the requirements or stage of the procedure.
  • FIG. 10A is a drawing showing the guide drill 78 brought close to the femur 100 .
  • FIG. 10B shows guide 78 in contact with femur 100 .
  • the software of the system of the invention at a command from the operator, recognizes the guide in the x-ray image and draws its virtual extension (thin line 102 ) through the bone. This allows the surgeon to easily see the path that the drill will follow through the bone and correct it, if necessary, before starting to drill.
  • the pointing aspect of the ruler of the invention is essentially different from image calibration or normal rulers.
  • the system extends the ruler so that the operator only needs to look at the image, which also shows the ruler, and to point the ruler in the direction he wants to measure in order to get the measurement.
  • the zero scale on the ruler of the virtual extension can be dragged and moved around on the image at will, thereby making it easy for the operator to make any measurement that he feels is necessary. Note that in prior art calibration techniques the points the operator wishes to measure must be marked on the image and the calibration device moved to measure between the points.
  • the pointing aspect is especially important in measuring objects in live video since in this case the operator can't take the time to mark the points of interest.
  • An example of such a measurement is to measure the size of the heart under x-ray while injecting a contrast liquid to the blood.
  • FIG. 11 shows how a surgeon would use the virtual extension 104 of a one dimensional ruler 76 , mounted on a guide 78 , to measure how deep he wants to drill.
  • FIG. 12 shows how a surgeon would use the virtual extension of a three dimensional ruler 76 , mounted on a guide 78 , to measure the distance from the insertion point of the drill, in the direction of drilling.
  • FIG. 13 shows how a surgeon would use the virtual extension 104 of a three dimensional ruler 76 , mounted on a guide 78 , to measure the distance from the hip joint, both in the direction of drilling, and in the direction perpendicular to it. This is not exactly the tip-apex distance, but a more accurate 3D measurement that was not possible in the prior art, and is similar to the TAD.
  • Real time visualization This has two aspects: Use either a one or a three dimensional ruler in order to draw how the result of the operation (or part of it) will look given the positioning of the ruler or some other surgical tool. For example, if it is decided to drill in a particular direction, the system of the invention can show how the DHS will be positioned.
  • the other aspect, based on mode 1, is to simply use an approximate dimensional scale based on the known or approximate dimensions of the objects seen in the image to create the grids. This may be inaccurate and spatially wrong, but can sometimes be good enough. For example, it is enough to see a guide drill in the image to know the approximate scale of the image and draw the DHS screw or the entire DHS implant around it.
  • FIG. 14 illustrates this mode of operation.
  • the surgeon cuts the skin and brings the tip of the guide drill 78 into contact with the bone. He then takes an x-ray image and asks the system of the invention to draw a virtual extension 102 of the guide on the image.
  • the pre-operation planning step (described herein below) he knows which DHS assembly to use. He now requests that the system of the invention retrieve the template 106 of the selected DHS assembly and draw it around the extension 102 of the guide 78 . Note that in FIG.
  • the guide has been deliberately placed in a wrong direction of drilling and a wrong entry point in order to demonstrate how drawing the template on the guide can be helpful for the surgeon, i.e. having the template drawn on the image makes it very easy for the surgeon to see that he/she is/or is not drilling in the right place/direction.
  • FIG. 15 illustrates this mode of operation. This mode is carried out on an image taken after the fracture reduction, using a calibration and a template library. Here the surgeon chooses different templates and has them drawn, i.e. overlaid, on the image of the bone to determine exactly which DHS assembly has the proper parameters to use with the specific bone and how to place it. Note that this is very different from the instant visualization, although sometimes the images look similar. Also, although operation planning is not new, the inventors are not aware of any other computerized system that enables the planning to be done inside the operating room. In trauma cases, the planning has to be done in the operating room since only after fracture reduction can the operation be planned.
  • Image enhancement The processing means of the system automatically determines the location of the guide in the image, therefore an image enhancement algorithm can be applied that automatically concentrates on the specific area of interest to the surgeon.

Abstract

The invention is a system for measuring the true dimensions and orientation of objects in a two dimensional image. The system is comprised of a ruler comprising at least one set of features each comprised of two or more markers that are identifiable in the image and having a known spatial relationship between them and a software package comprising programs that allow extension of the ruler and other objects in the two dimensional image beyond their physical dimensions or shape. The system can be used together with radiographic imagery means, processing means, and display means to take x-ray images and to measure the true dimensions and orientation of objects and to aid in the identification and location of a surgery tool vs. anatomy in those x-ray images. The invention provides a method of drawing and displaying on a two dimensional x-ray image measurements of objects visible in said image, graphical information, or templates of surgical devices.

Description

FIELD OF THE INVENTION
The invention is related to the field of medical radiography. More specifically the invention relates to devices and methods of accurately measuring the dimensions in a specific orientation of objects observable in two-dimensional images, e.g. radiographic images.
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright whatsoever.
BACKGROUND OF THE INVENTION
The technical problem that is addressed by the present invention has been known since the earliest application of x-rays as an aid in medical diagnostics and the performance of medical procedures. The problem is easily understood with reference to FIG. 1A and FIG. 1B. X-ray source 10 is roughly a point source that emits a cone of x-rays that project an image 40 of radiopaque object 20 on surface 30. Surface 30 is in some cases essentially planar but is usually distorted as a result of the configuration of the equipment used to make the images. The surface 30 can be of any type made sensitive to x-rays, e.g. a sheet of glass or plastic or a thin paper or plastic film coated with a material that fluoresces when struck by x-rays or coated with a photographic emulsion or an electronic device whose surface has an array of pixels such as a CCD device. As can be seen in the Figures, the scale of image 40 on surface 30 depends on the distance of identical objects 20 from the source 10 (FIG. 1A) and/or on the angle of the object with reference to planar surface mentioned parameters. In the absence of this information, time consuming trial and error is needed to complete the procedure and the lack of accurate measurements has been determined to be one of the causes of failures of orthopedic procedures.
As mentioned above, this problem was recognized very early in the development of the field of medical radiography. In January 1897, only a little over one year after the ground breaking paper by Roentgen that gave the first scientific explanation of the phenomenon that he called x-rays, a patent application that eventually became U.S. Pat. No. 581,540 was filed in the U.S. Patent Office. The invention comprises a grid of radiopaque wires placed between the object being x-rayed (inside a human body) and the planar surface on which the images are recorded and an “angle plate” which is applied to the body to insure parallelism of the x-rays. The object of the invention being to provide “an improved radiographic apparatus whereby the exact location of an invisible object, not permeable or difficulty permeable by the so-called “Roentgen” or “X” rays, may be accurately ascertained and measurements made by which operations necessary for the removal of such objects are controlled and guided”.
In the intervening years since the publication of U.S. Pat. No. 581,540 and the present, numerous patents have been granted and scientific articles published that provide different solutions to different aspects of the same problem. A brief review of some of these solutions can be found by reviewing the following patents:
    • U.S. Pat. No. 1,396,920 describes an indicator comprising radiopaque marks on a plane parallel to the object to be observed and the x-ray sensitive plate. In this way the indicator appears on the x-ray image and the known distances between the marks can be used to determine the correct scale of the distances that appear in the image and thus the size of the object can be accurately determined
    • U.S. Pat. No. 5,970,119 describes a scaling device comprising an easily observable radiopaque member having radiolucent gaps spaced a known distance apart. The embodiments of the scaling device can be use externally or incorporated into a catheter to allow the device to be manipulated into a position in the vicinity of the anatomical structure to be measured as close as possible to the plane of the structure while being oriented as closely as possible to perpendicular to the x-ray beam.
    • U.S. Pat. No. 5,052,035 describes a device comprised of a transparent substrate on which is created a grid of parallel radiopaque lines. The film is placed over the area of the body of the patient of interest and an x-ray image is taken. The grid appears in the x-ray image as an overlay on the anatomical structure. The transparent substrate is adapted so that, by use of a marking instrument, marks can be applied to the body. In this way features that appear in the x-ray image can be accurately located on/in the body of the patient.
    • U.S. Pat. No. 3,706,883 describes an elongated probe (catheter) that includes at least one radiopaque segment of known length. The probe is introduced into the body and is brought into proximity to the object to be measured. The radiopaque portion of the probe appears on the x-ray image next to the object whose size is unknown. The ratio of the apparent length of the radiopaque portion of the probe to its known length provides the scale factor necessary to determine the length of the other objects that appear in the x-ray image.
    • U.S. Pat. No. 4,005,527 describes a depth gauge comprised of alternating sections of radiopaque and radiolucent material of known length. The depth gauge can be inserted into a hole or cavity to be observed using x-ray methods. The gauge will be seen on the x-ray image and can be used to provide a scale to measure the depth of the hole and dimensions of other features seen in the image. In one embodiment, the depth gauge is the shaft of a drill and serves to enable the surgeon to know the depth of the hole that he has drilled into a bone.
This brief survey of the prior art gives an indication of a fact of life that is well known to surgeons, i.e. that the solution to the problems first recognized in the earliest days of medical radiography has not yet been found. Each of the solutions proposed to date, while it might represent an improvement over prior proposals or may give adequate results for certain procedures, has not provided an overall solution.
A surgeon using any of the previous measurement techniques, whether involving using a regular ruler to measure objects directly (not through x-ray) or measuring objects on the image itself will experience the same limitations. Measuring objects directly is often problematic since access is limited to the objects measured and measuring on the image itself, besides requiring a calibration, can only provide measurements on the projection of the object and in the projection plane.
While x-ray images are two dimensional and prior art techniques allow reasonably accurate two dimensional measurements in the plane of the image itself, the surgeon would ideally like to have the ability to make three dimensional measurements and measure the objects at any direction he desires. In particular orthopedic surgeons would like to be able to accurately measure objects not in the image plane and to measure objects, without penetrating them, while retaining the measurement accuracy.
It is therefore a purpose of the present invention to provide a ruler which improves upon and overcomes the limitations of prior art rulers used for measuring distances in radiographic images.
It is another purpose of the present invention to provide a ruler which allows a surgeon to make three dimensional measurements and measure objects in a radiographic image at any direction he desires.
It is another purpose of the present invention to provide a ruler which allows a surgeon to accurately measure objects not in the image plane, while retaining the measurement accuracy.
It is another purpose of the present invention to provide a ruler which allows a surgeon to accurately measure objects without penetrating them, while retaining the measurement accuracy.
Further purposes and advantages of this invention will appear as the description proceeds.
SUMMARY OF THE INVENTION
In a first aspect, the invention is a system for measuring the true dimensions and orientation of objects in a two dimensional image. The system is comprised of a ruler comprising at least one set of features each comprised of two or more markers that are identifiable in the image and having a known spatial relationship between them and a software package comprising programs that allow extension of the ruler and other objects in the two dimensional image beyond their physical dimensions or shape.
In embodiments of the invention the markers in each set are arranged in one or more rows having a known spatial relationship between them. If there is more than one of the sets, at least some of the sets are aligned in a direction non-parallel to the measurement direction or to each other.
Embodiments of the system are adapted to measuring x-ray images. Embodiments of the system are adapted to enable it to be used for measuring the true dimensions and orientation of objects and for aiding in the identification and location of a surgery tool vs. anatomy in a radiographic image.
In a second aspect, the invention is an apparatus adapted to enable it to take x-ray images and to measure the true dimensions and orientation of objects and to aid in the identification and location of a surgery tool vs. anatomy in those x-ray images. The apparatus comprises:
  • a. a system comprising one or more rulers and a software package according to the first aspect of the invention;
  • b. radiographic imagery means;
  • c. processing means; and
  • d. display means
characterized in that the software package comprises programs that allow the processing means to recognize the features of the ruler on the radiographic image and to use the features to create a virtual extension of the at least one ruler and to draw the virtual extension of the at least one ruler on the radiographic image as an overlay, thereby enabling the user who is pointing the at least one ruler and looking at the radiographic image to accurately measure objects that appear in the radiographic image.
In embodiments of the invention the software package comprises a program that allows the zero scale on the virtual extension of the ruler to be dragged and moved around at will. In other embodiments, if a three dimensional ruler is used to determine a measuring plane and a feature known to be on the measuring plane, then the software package comprises a program that allows the processing means to measure the angle between two lines projected on the measuring plane.
In embodiments of the invention the software package comprises a program that allows the processing and display means to provide real time visualization by using either a one or a three dimensional ruler in order to draw how at least how a part of the result of the operation will look given the positioning of the ruler or some other surgical tool visible in the image.
In embodiments of the invention the software package comprises a program that allows the processing and display means to find markers in the image and place templates of implants or other objects on the image.
In embodiments of the invention the software package comprises a program that allows the processing means to automatically determine the location of a surgical tool in the image and to apply an image enhancement algorithm that automatically concentrates on the specific area of interest to the surgeon.
In embodiments of the invention the software package comprises a program that allows the processing and display means to synchronize AP and axial images.
In a third aspect the invention is a ruler for use in the system of the first and second aspects. The ruler has at least one set of features each comprised of two or more markers that are identifiable in the image having a known spatial relationship between them. In embodiments of the invention the markers in each set are arranged in one or more rows having a known spatial relationship between them and, if there is more than one of the sets, at least some of the sets are aligned in a direction non-parallel to the measurement direction or to each other.
The ruler can be a hand-held ruler used to “point and “measure”. The ruler may comprise means for slideably attaching it to a tool. The ruler may be an integral part of a tool, made by making at least part of the tool from a translucent material and embedding opaque markers into it. The ruler may be comprised of small radiopaque markers, with a known spatial relationship between them, embedded in a radiolucent envelope.
In a fourth aspect the invention is a method of drawing and displaying on a two dimensional x-ray image measurements of objects visible in said image, graphical information, or templates of surgical devices. The method comprises the steps of:
  • a. identifying the location and orientation of at least one known object; and
  • b. drawing and displaying the measurements, graphical information, or templates on the x-ray image on the basis of the location and the orientation of the known object.
The method is characterized in that the measurements, graphical information, or templates are not a part of the known object. The known object can be a ruler according to the third aspect of the invention, a surgical tool, or an anatomical feature.
All the above and other characteristics and advantages of the invention will be further understood through the following illustrative and non-limitative description of preferred embodiments thereof, with reference to the appended drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1A and FIG. 1B illustrate the technical problem that is addressed by the present invention;
FIG. 2 shows a compression hip plate assembly;
FIG. 3 illustrates the tip-apex distance (TAD);
FIGS. 4, 5A and 5B illustrate two embodiments of one dimensional rulers of the invention;
FIG. 6 illustrates an embodiment of a three dimensional ruler of the invention;
FIG. 7 and FIG. 8 schematically show respectively how one and two dimensional virtual extensions of the ruler of the invention are created overlaying the x-ray image of the object of interest;
FIG. 9A to FIG. 9C show a handle comprising a ruler of the invention to be used by a surgeon to correctly align a drill guide;
FIG. 10A to FIG. 15 illustrate some of the modes of operation of the system of the invention;
FIG. 16 symbolically shows how the system of the invention is integrated with an imaging system; and
FIG. 17 is a flow chart outlining the main stages in processing and displaying the images using the system of the invention.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The invention is a system that can be used for measuring the true dimensions in a specific orientation of objects in two and three dimensional images. In order to illustrate the invention and in preferred embodiments thereof, the images considered herein are radiographic images, in particular x-ray images, wherein by x-ray images are meant radiographic images, fluoroscopic images, digital fluoroscopy images, or images taken using any other type that uses x-rays to obtain them. However it is to be understood that the device and methods of the invention can be used in any imaging situation. In the case of x-ray radiography, the device and system of the invention are used to measure the true dimensions and orientation of objects that appear in the image and to aid the surgeon in the identification and location of surgery tools vs. anatomy in the radiographic image.
FIG. 16 symbolically shows how the system of the invention is integrated with an imaging system to improve the users understanding of the images produced with the imaging system. The essential components of imaging system 200 are the source of radiation 202 and the detector 204. The imaging system 200 is connected to a computer 206. When an at least partially opaque object 210 is placed in the space between the source 202 and detector 204 and system 200 is activated, object 202 blocks some of the radiation causing a shadow to appear on the detector. The output signals from detector 204 are sent to computer 206 where they are processed to produce images that can be stored in the memory of computer 206 and/or displayed on display device 208.
The system of the invention comprises two components: a calibration device 70, which is called a “ruler” herein and a computer software package 216. Radiolucent ruler 70 comprises radiopaque markers 76. It is placed in the space between source 202 and detector 204 such that at least some of the markers 76 will be visible in the images gathered by imaging system 200. Computer software package 216 is loaded into computer 206 in order to provide the computer with advanced capabilities for processing and displaying the images as a graphical overlay, displayed over the x-ray image on the display 206, thereby providing the user with information not previously available. Illustrative embodiments of the ruler and of the software as well as descriptions of the new types of visual information that can be provided to the user will be described herein below.
Herein the word “markers” is used to mean features that are visible in the image, by virtue of their color, luminance or intensity. In the case of x-ray images, markers have a different radio-opacity than their immediate surrounding, or comprise different radio-opacity levels. Markers are regarded as a singular point in space, e.g. the center of a ball or a corner of a cubical shape, which is well defined and can be noticed in the image. Herein the words “marker” and “feature” are used interchangeably.
In one embodiment, the ruler comprises two or more features having a known spatial relationship between them that are visible and recognizable in a radiographic image. For the purpose of the measurement the two or more features are aligned parallel to the measurement direction. The associated software allows, amongst many other modes of operation to be described herein, the automatic recognition of features of the ruler in the radiographic image and the use of these features to create a virtual extension of the ruler, i.e. to extend the ruler beyond its physical dimensions, and drawing the virtual extension on the image as an overlay. The invention enables the surgeon who is pointing the ruler and looking at the image to accurately measure dimensions of objects that appear in the radiographic image. The invention is especially useful and convenient for use with x-ray imaging in which frequently it is desired to measure the internal organs, bones, etc. of a body. However, as mentioned above, in principal the invention can be used with any technique of producing two dimensional images, e.g. regular photography.
All prior art methods known to the inventors use the physical scales on a ruler to measure the dimensions of or distances between objects of interest either directly or to take a picture and make the measurements directly on that picture in two dimensions. These methods are generally not accurate for the reasons mentioned hereinabove and do not enable easily measuring objects in different three dimensional orientations. The approach taken to the problem of making accurate measurements by the inventors is fundamentally different than that of the prior art since it makes use of control of both the tool, i.e. the ruler, and the display, i.e. the visual image including graphic overlay thereof. The measurement method is dependent on the combination of the ruler, which cannot be used to achieve the desired result when used alone and the software, which cannot, be used to make the measurements without the ruler. Only through the combination of ruler and software, as described hereinbelow can the desired result be obtained.
The invention, in its various embodiments, can be used to assist the operator in any procedure in which it is desirable or necessary to measure distances or dimensions of objects in radiographic images. Such procedures range from common chest x-rays, that are analyzed “off-line”, to orthopedic and other surgical procedures that can only be carried out “on-line”, i.e. with the aid of inter-surgery radiographic imagery using, for example, a mobile C-arm x-ray unit. Typical non-limitative examples of on-line procedures that can be performed with the aid of the invention are:
    • Spinal fusion/lumbar spine fixation—insertion of pedicle vertebral screws;
    • Vertebroplastia—injecting cement to a vertebral body via the pedicles;
    • Bone biopsy—inserting a long needle through bone, to reach a tumor or lesion;
    • Dynamic hip screw (DHS) placement procedures for per-trochanteric and intertrochanteric hip fractures;
    • Three Cannulated Screws placement procedures for sub-capital fractures;
    • Proximal Femur Nail (PFN) placement procedures for oblique-reversed and for sub-troch hip fractures; and
    • Trochanteric fixation nail (TFN) fixation.
For purposes of illustrating the invention, its use in relation to dynamic hip screw (DHS) placement procedures for hip trauma procedure under fluoroscopy will now be described. It is emphasized that the invention is not limited to use in any particular procedure and is expected to be useful for a wide range of applications. According to statistics made available by the American Association of Orthopaedic Surgeons, about 450,000 procedures for treatment of hip trauma were carried out in 2004. Nearly 90% of the procedures were carried out on persons aged 65 or older who had suffered breaks in the proximal end of the femur as a result of a fall. The surgical procedures for treating the fractures are well known and documented, including descriptions in textbooks, scientific journals, and even complete protocols that can be found on the internet. Generally speaking, depending on the exact nature of the break, the procedure involves attaching one of a number of different styles of commercially available compression hip plates to the femur by means of pins or screws inserted into holes drilled into the bone. A good review of the state of the art can be found in “Intertrochanteric Fractures” by Dr. Kenneth J. Koval and Dr. Robert V. Conto, which is a chapter in the book: Rockwood and Green's Fractures in Adults; Authors: Robert W. Bucholz, MD; James D. Heckman, MD; Publisher: Lippincott Williams & Wilkins; 6th edition, 2005.
A specific protocol for carrying out the surgical procedure can be downloaded from the web site of Smith & Nephew at [http://www.smithnephew.com/Downloads/71180375.pdf]
FIG. 2 shows a compression hip plate assembly 50 manufactured by Smith & Nephew. The assembly comprises a plate 54 that fits against the outer surface of the femur with an attached barrel 52 that fits into a hole bored into the femur. After reduction and fixation of the fracture a hole is bored into the bone through the neck and into the head of the femur in order to attach lag screw 56. After lag screw 56 has been screwed into the head of the femur, the barrel is inserted into the hole, the plate is positioned on the side of the femur, and compression screw 60 is screwed in to attach the plate 54 to the lag screw and tightened to bring the broken pieces of bone together. Self tapping bone screws 58 are used to attach the plate firmly to the shaft of the femur and if necessary, depending on the type of break, cannulated or cancellous screw 62 can be inserted into the bone to capture medial fragments. There are hip plate kits available to the surgeon having many variations of the basic design. The variations include, for example, the length of lag screw 56, the angle between screw 56 and plate 54, and the number of cortical screws 58.
The most demanding part of the procedure is creating the hole into which the lag screw is inserted. For a successful procedure, the hole must pass through the bone in a path following the central axis of the neck of the femur towards the apex of the femoral head. The surgeon, assisted by a series of x-ray images taken during the course of the proceeding, uses a small diameter guide drill to make an initial guide hole. The first problem is to determine the neck angle to select an appropriate angle plate, which is used to help determine the proper entry point and to aim the guide drill. The surgeon, referring to the x-ray images, estimates the correct angle and entry point and begins to drill with the guide drill. After drilling a short distance into the bone, he stops and takes at least two x-rays at right angles to each other to ascertain that he is indeed drilling in the correct direction and along the center of the neck. In order to do this he must mentally project the image of the drill forward through the anatomical features, a task that is complicated, especially given the required precision and the challenging image quality. In addition, a typical C-arm equipped with an image intensifier tube for generating the images creates a distortion to the image usually causing straight lines to appear curved in the images: It is noted that if the surgeon has only to extend the line from the drill theoretically he is not influenced by the scale and a line in three dimensional world will still appear to be a line in the two dimensional projection image; however this theoretical extension is not an easy task, especially when precision is so important. If the drill path appears to be correct, then the surgeon drills a bit further before stopping to check again by repeated x ray imaging. If, at any stage, the path appears to be incorrect, then the surgeon must withdraw the guide drill and begin drilling again using a different angle and/or entry point. Another difficulty is ascertaining exactly where to stop drilling. It is essential that the lag screw be attached to as much of the bone as possible; however sufficient bone must remain at the apex of the head to prevent the lag screw from breaking through into the hip joint when the screw is inserted in the hole. This issue involves not only measurement of drilling orientation but also of drilling depth.
A typical procedure of this type carried out by an experienced surgeon takes a considerable amount of time, most of which is consumed by trial and error attempts to obtain the proper alignment. Additionally between 100-150 x-ray images are typically required, which, despite all precautions, represents a serious health hazard for both the patient and, to a greater extent, for the operating room staff that can be present for several similar operations each day.
The reason that so much time and care is taken to insure proper alignment of the guide hole is that failure of fixation of intertrochanteric fractures that have been treated with a fixed-angle sliding hip-screw device is frequently related to incorrect position of the lag screw in the femoral head. To insure success of the procedure and prevent mechanical failure, i.e. bone cut-out, an accuracy of ±2-3 mm of screw location is crucial. A simple measurement called the tip-apex distance (TAD) is used to describe the position of the screw. This measurement is illustrated in FIG. 3. The dashed lines represent the desired direction of the lateral axis of the lag screw in the radiographic images. Xap and Dap mark the distances from the tip of the lag screw to the apex of the femoral head and the measured diameter of the lag screw measured on an anteroposterior (AP) radiograph, respectively. Xlat and Dlat mark the same parameters measured on a lateral radiograph, and Dtrue is the actual diameter of the lag screw. Then the TAD is given by the formula:
TAD=(X ap ×D true /D ap)+(X lat ×D true /D lat)
The results of many studies show that the failure rate approaches zero if the TAD is less than 25 mm and the chances of failure increase rapidly as the TAD increases above 25 mm [M R Baumgaertner, S L Curtin, D M Lindskog and J M Keggi, “The value of the tip-apex distance in predicting failure of fixation of peritrochanteric fractures of the hip”, The Journal of Bone and Joint Surgery, Vol 77, Issue 7, 1058-1064, 1995]. Using present techniques, the DHS can only be determined after the procedure has been completed. Using the present invention the surgeon will be able to estimate the DHS at the preplanning stage before beginning to drill the guide hole and will be able to know the expected value at any stage of the procedure.
FIGS. 4, 5A, and 5B illustrate two embodiments of a one-dimensional ruler of the invention. In the embodiment shown in FIG. 4, ruler 70 is comprised of a cylinder 72 of radiolucent material. A slot 74 is created lengthwise in cylinder 72 so that the ruler can be slipped over the surgical tool, e.g. a guide, i.e. a thin bone drill sometimes known as a guide wire, without the necessity of releasing the guide from the power drill. The dimensions of the slot are such that the longitudinal axis of the guide and cylinder 72 coincide when ruler 70 is attached to the guide. The guide fits tightly in the slot so that the ruler will not slide freely but can be shifted easily by the surgeon to a new position when desired. Some embodiments of the ruler will rotate with the guide and other embodiments of the ruler can be attached so that the guide may rotate without rotating the attached ruler. Metal balls 76 are embedded into cylinder 72 in rows that are parallel to the direction of slot 74. Metal balls “floating” in a plastic cylinder are preferably used so that the x-ray signature of the ruler will be dark circles that are easily detectable in the image. One row of balls 76 is theoretically sufficient; however it is preferred that at least three rows of balls 76, equally radially spaced around the circumference of the base of cylinder 72, be used to insure that at any position of the ruler on the guide at least one row of balls will not be overlaid by the radiopaque guide or another row of balls, and will be visible on the x-ray image.
The exact distance between balls 76 is known so that when their shadows are detected on the x-ray image the dedicated software of the invention can identify them and measure the apparent distance between them directly from the image and use this measurement together with the known actual distance to calculate the scale that is used to create the overlays that allow the surgeon to determine the exact position of the guide relative to the anatomical structure, dimensions, and other related information displayed on a screen in “real time”. As a minimum, only two balls 76 in one row are needed to be visible in the image in order to create an acceptable approximation of the C-arm magnification factor and the sizes of organs and tools for most common cases. However, since increased accuracy is obtainable by using the averages of several apparent measurements and also since some balls may be hard to see in the image it is preferred to use a minimum of three or four balls in each row to get a more accurate mathematical extension of the ruler. Also, if the angle between the ruler and the image plane is large, the scale change along the ruler extension, in the image, is not negligible. It is therefore preferred to use more than one measurement, at different heights, so that an approximation of this effect can be calculated.
Another way of explaining the problem of crating an accurate scale for the images and the solution to the problem is the following: It is known that the magnification increases linearly with the distance from the x-ray source. Therefore, if there are only two markers, the distance between them can be measured, however, it is impossible to determine if this distance is accurate because the ruler may not lie in a plane parallel to the image. Therefore, the measured distance between markers can not be counted on to provide an accurate scale for creating virtual extensions, overlays and other advanced features provided by the present invention. To overcome this problem a ruler with several markers, having a known distance between them, is used. If the ruler is parallel to the image plane, then the scale is correct and a true 2D calibration is obtained. If, however, the ruler is not parallel to the image plane, the distance between markers, i.e. the scale, will grow smaller to one direction and larger in the other direction, changing with the distance from the x-ray source. In this case, if there are three markers or more, not only the distance between markers but also the rate of change of the distance can be measured and therefore an accurate scale in both directions can be calculated.
FIG. 5A shows another embodiment of a ruler 70′ of the invention. In this embodiment the radiolucent body 80 of the ruler is roughly a prism having an isosceles triangle as its base. The sides of the prism are cut away to leave a Y-shaped cross section. A row of metal balls 76 (seen in FIG. 5B, which is a cross-sectional view of ruler 70′) is embedded at the apex of each of the arms of the “Y”. A slot 74 is created along the longitudinal symmetry axis of body 80 of ruler 70′. Body 80 is slipped over guide 78 and then a clip 82 is attached to body 80 to hold guide 78 in slot 74. This can be done with the guide attached to the drill. In this embodiment the width of slot 74 need not necessarily be essentially equal to the diameter of the guide but it can be wide enough to allow the ruler to be attached to guides having a wide range of diameters. Clip 82 comprises a spring loaded brake (not shown) that locks ruler 70′ in place, preventing it from sliding along guide 78.
Pressing downward on clip 82 in the direction of arrow 84 releases the brake allowing ruler 70′ to be moved and repositioned along the guide. Repositioning can be easily accomplished by the surgeon using one hand, at any time during the procedure.
FIG. 6 illustrates an embodiment of a three dimensional ruler 70″ of the invention. In this embodiment the radiolucent body 86 of the ruler has an “L” shaped cross section. Rows of radiopaque balls 76 are embedded in the walls of body 86. A suitable arrangement, e.g. a slit and/or a clip such as described above, are provided to slidingly hold ruler 70″ in place on guide 78.
Many different arrangements of markers are described herein with regard to specific illustrative examples of the ruler. In principal the minimal requirement of the invention for the number and arrangement of markers is one of the following:
    • Two markers aligned in the direction of the measurement—This will enable determining a scale with not very good accuracy because of the other degree of freedom described herein above.
    • Three markers aligned in the direction of measurement—This will enable higher accuracy.
    • A set of at least three markers, not on the same line, is sufficient in order to create an accurate three dimensional orientation and thereby enable measurement of an object in every orientation.
    • In all cases, the markers do not have to be equally spaced but must be in a known spatial arrangement.
    • In the figures herein several rows of equally spaced markers have been included so that they will not occlude each other and therefore allow a better chance of detecting them. There is, however, no minimal requirement of the number of rows of markers that must be used.
In another embodiment, the triangular sleeve with handle that is used by orthopedic surgeons to aid them in maintaining the alignment of the drill in a DHS placement procedure, as known to persons skilled in the art, can be modified by embedding a three dimensional ruler of the invention inside it, in which case, the modified sleeve itself can be used to fulfill the functions of the ruler of the invention that are described herein. The sleeve is made of radiolucent material and comprises a set of metal balls, arranged in a known spatial arrangement, such that the 3D orientation of the ruler may be calculated using the balls that appear in the image.
FIG. 9A to FIG. 9C respectively show front and back perspective views and a cross-sectional view of a handle 90 comprising a ruler of the invention that can replace the traditional triangular sleeve used by surgeons to aid in aligning a guide drill. As seen in the Figures, handle 90 has a “T” shape with a crosspiece 92 at the top of shaft 93 that allows the user to easily and firmly grip handle 90 with one hand. At the bottom of shaft 93 is a foot 94. The bottom surface of foot 94 comprises means, e.g. cleats 96, to prevent the device from sliding on the surface of the skin. In FIG. 9B the exit hole 98 of slot 74 (FIG. 9C) through which the guide drill passes can be seen on the bottom of foot 94. At least the foot 94 and the lower portion of shaft 93 (through which slot 74 passes) of handle 90 are made of a radiolucent material. In the illustrative example shown, embedded in this material are two rows comprised of five of radiopaque markers 76 each, a horizontal row embedded in the foot 94 and a vertical row embedded in the lower part of shaft 93. Notice that the markers in each row are not equally spaced and that neither of the rows of markers is aligned in parallel to the direction of the drilling. However, the software of the system can identify the markers 76 and from them determine the location and orientation of the handle 90, from this the exact orientation of slot 74, and can create a virtual extension of the guide that is inserted into slot 74, in the direction of drilling, beyond its physical dimension. Using this handle, a ruler need not be attached to the drill and the system of the invention will recognize the handle and can extrapolate it in both directions and can also display the implant template, i.e., a graphic overlay of where the implant would be, including all its parts, at the current position of the triangle (see, for example, FIG. 14 and FIG. 15). This approach allows an “intra-operative real time” visualization and measurement ability using the tools that are familiar to the surgeon.
In accordance with the discussion herein above, preferred embodiments of three dimensional rulers can be constructed comprising two sets of non-parallel rows of markers in order to provide a device for which the markers will be identified even when the ruler is partially occluded by other objects, e.g. bones or tools in the image. Using such a ruler, a three dimensional grid can be projected onto the image.
As discussed hereinabove, embodiments of the ruler of the invention comprise an elongated radiolucent body in which rows of radiopaque markers of known size and distance apart are symmetrically embedded. In its different embodiments, the ruler of the invention can be: a hand-held ruler used to “point: and “measure”; the ruler can comprise means for slideably attaching it to a surgical tool, e.g. handle 90 shown in FIGS. 9A to 9C; or the ruler can be an integral part of a surgical tool, possibly made by making at least part of the tool from a translucent material and embedding radiopaque markers into it. The ruler can be a one dimensional ruler in which the rows of radiopaque markers are parallel to the measuring direction or a three dimensional ruler in which a non parallel rows of markers are embedded. In some embodiments the ruler could comprise a metal comb or a metal jig, with no translucent material. The radiopaque markers would then be either characteristic features of the ruler, e.g. the teeth of the comb, or could be, e.g. metal balls attached to the body of the ruler.
Generally, when the ruler is attached to a surgical tool as will be demonstrated by example hereinbelow, during a medical procedure the ruler stays in a fixed position, e.g. at a location on the surface of the body or an organ within the body of a patient, while the tool is advanced into or withdrawn from the body or organ during the course of a diagnostic or surgical procedure.
In some preferred embodiments the ruler is made of bio-compatible USP class 6 materials and is reusable after sterilization using, for example, ETO. In a preferred embodiment, the entire ruler, except for the metal balls, is made of plastic. Under x-ray the ruler is seen as semi transparent and the metal balls are seen “floating” around the guide/drill. Based on these fundamentals and the examples of the embodiments described herein, skilled persons should have no trouble designing a ruler suitable for use with any diagnostic or surgical tool.
FIG. 7 and FIG. 8 schematically show respectively how one and two dimensional virtual extensions of the ruler of the invention are created overlaying the x-ray image of the object of interest. In FIG. 7, object 20 and radiopaque balls 76 embedded in a ruler of the invention, that is attached to guide drill 78, are shown positioned in the path of a beam of x-rays emitted by source 10. The dashed lines represent the shadows of the radiopaque objects that form images 40 on the electronic camera. The digital signals from the camera are processed using the software package of the invention to determine the distance between the images of the balls of the ruler. From the measured and known distances a scale factor is determined and a virtual extension 88 of the ruler is constructed. The virtual extension can be added as an overlay on the displayed x-ray image in a number of ways that can be selected by the operator. In the case of the orthopedic procedures described herein, the suggested display mode is to place the graphic presentation of the virtual extension exactly on top of the longitudinal axis of the guide drill with the origin at the distal tip of the drill, as seen in the x ray image. This is shown in FIG. 7 on the image plane representing the displayed image in the actual system. In this way, the surgeon can, using both forward distance scales and rearward distance scales, determine respectively how much farther the drill must be advanced and how far into the object the drill has penetrated.
Other display features are possible, e.g. color coding to easily distinguish between forward and rearward distances, the addition of transverse scales at locations selected by the operator to enable measurement of the distance from the center of the drill to the sides of the object for example to confirm that the hole is being drilled exactly through the center of the object, and the addition of color coded markings to indicate when the drill is approaching and/or has arrived at the location that drilling should cease.
FIG. 8 is similar to FIG. 7 with the exception that use of the three dimensional ruler provides sufficient information for the software to construct a two dimensional grid that can be displayed on the screen as an overlay on top of the x-ray image. In fact, since the three dimensional ruler can provide a complete three dimensional orientation, the grid could be drawn in any orientation, and not just the original orientation of the ruler (as shown in the Figure).
The system of the invention is used with a C-arm X-ray unit or some other imaging system. It comprises a ruler, and software that enables display of the virtual extension and allows display of the overlays and other features described herein, e.g. the software may include computer vision and recognition algorithms that are used to identify implants, surgical tools and anatomical features and to draw their counterparts or extensions during the operation as an overlay on the x-ray image (see FIG. 11). In some embodiments, the software works in semi-automatic mode wherein it allows the user to mark on the balls on the computer screen, e.g. by pointing to and clicking on them using a computer mouse, and then calculates the scale and draws the virtual extension. In other embodiments it is not necessary to mark all or some of the balls in an image or to mark the balls in successive images. The process may be started with a user click and then the software automatically searches for the markers and for the guide in the next image.
Skilled persons will recognize that the system can be given the ability to display the images in many different formats to assist the surgeon, e.g. different colors can be used to differentiate how far the drill has penetrated into the bone from the remaining distance. In addition, other types of information, can be provided by audible signal, e.g. signifying the remaining distance or when to stop drilling.
In addition, for imaging systems equipped with an image intensifier, some embodiments provide an anti-distortion system for extra accuracy. The anti-distortion system is a conventional one, as known to persons skilled in the art, comprises a grid placed on the image intensifier (the receiving end of the C-arm) and software that uses the image of the grid to correct the image obtained from the C-arm. Anti-distortion systems suitable for use with the present invention are described in: [Gronenschild E., “Correction for geometric image distortion in the x-ray imaging chain: local technique versus global technique” Med Phys. 1999, December; 26(12):2602-16]. In cases in which an anti-distortion system is used, the detection of the ruler markers using the software of the present invention has to be done on the image after the anti-distortion process.
FIG. 17 is a flow chart outlining the main stages in processing and displaying the images using the system of the invention. In the first stage, 501, the x-ray image obtained using the imaging system 200 (see FIG. 16) undergoes an image distortion process. This phase is not mandatory, and depends on the imaging system. Some imaging systems do not create significant distortions and for these systems this phase can be skipped. Image distortion correction is done in any one of the standard ways, known in the art.
The next stage 502 is marker identification in the image. The marker, identification can be done either manually, where the user points at the location of the markers using a pointing device, such as a computer mouse; can be done in a semi-automatic manner, where some user input is required and some of the marker identification is done automatically; or can be done in a fully automatic manner, where an image processing algorithm, provided in the software of the system, is used to detect the markers in the image.
In the next stage 503, the software of the system calculates the scale, using the markers in the image identified in stage 502. If a one dimensional ruler has been used, then the markers are co-linear and the only scale that can be deduced is in the direction of the markers. Since the magnification of an object depends on its distance from the x-ray source, if only two markers are used, the exact position and orientation of the ruler cannot be determined, since a rotation of the ruler may have the same effect, as a change of distance from the x-ray source, on the distance between the markers on the image (see FIGS. 1A and 1B). Since the orientation of the object is not determined, ruler extrapolation cannot be achieved with high accuracy because, if the measurement direction is at an acute angle to the x-rays, scaling changes rapidly along the direction of measurement. In order to be able to extrapolate the ruler accurately, it is necessary to have at least three markers on the line, in which case the scale as well as the orientation of the measurement direction can be calculated with respect to the x-ray image, since the scale linearly increases with the distance from the x-ray source. If the user is willing to ignore this magnification problem, a less accurate approximation may be obtained using only two markers.
When using a three dimensional ruler objects can be measured at any orientation. The minimal requirement in the three dimensional case is at least 3 markers that are not co-linear.
In the next step 504 the system draws an overlay over the x-ray image. The overlay may include any type of graphical or other information, drawn or printed over the image. Amongst other things, it may include a virtual extension of a drill, an implant image, taken from a pre-stored library of implants, or a virtual drawing of a measurement ruler, aligned with the device. The overlay can make use of the location and orientation of the device in the image. Preferred embodiments may include a GUI that enables the user to easily select and customize the overlay shown over the images.
The use of the invention and its advantages will now be demonstrated with reference a dynamic hip screw (DHS) placement procedure. The entire procedure is carried out in the operating room with the aid of a C-arm x-ray system. After completing the fracture reduction the surgeon begins the pre-operative planning. This stage is carried out before sterilization and cutting the skin to expose the bone. The common practice is to take one image from approximately an anterior/posterior (AP) angle, and do the entire operation planning on a single image while ignoring the three dimensional aspects of the bone. Since embodiments of the invention can be used to identify the surgeon's tools and draw their virtual extension, e.g. the track that a drill will follow, such embodiments can be used during the planning stage. The surgeon can attach a ruler, e.g. ruler 70 (FIG. 4) to the distal end of the guide drill or slide the guide drill into the slot of a handle, e.g. handle 90 (FIG. 9A), place the distal end of the guide drill against the outside surface of the skin, and point the guide in the direction he wishes to drill. The software of the system will then draw the virtual extension of the ruler and overlay it on the x-ray image thereby helping the surgeon to optimize the determination of penetration point and drilling angle and measure how deep he should drill. In some embodiments the software package of the invention enables the surgeon to apply templates of the tools and lag screws of different dimensions and to determine accurate measurements of the anatomical features to plan exactly the operation, including screw selection, and to visualize the end result. FIG. 15 shows this feature of the operation planning stage.
FIG. 12 shows the display during operation, after the skin was already cut and some of the surgical tools were inserted to the body. The drill 78 is about to enter the femur and the surgeon uses a triangular sleeve to enter at the correct angle (135 degrees). On top of this image a two dimensional grid has been drawn to illustrate how the ruler of the invention and its virtual extension 104 would appear.
FIG. 13 shows the situation after drilling with the guide drill 78. The virtual ruler 104 displayed on the screen overlaying the guide and the bone allows the surgeon to see exactly how far the drill has penetrated the bone and to confirm that the path is correct. In order to achieve maximum accuracy a three dimensional ruler is used to determine the plane on which to draw the line perpendicular to the drilling direction, i.e. to correct for the change of scale of the ruler on the drill caused by the fact that the drill is tilted at an angle relative to the plane of the image. In most cases a one dimensional ruler could be just as useful; but in either case, the surgeon can see how far the guide tip is from the hip joint. This is useful for determining the expected distance from the joint. Note that this is not exactly the tip apex distance, but rather a more accurate 3D measurement, that is similar in concept to the TAD.
After the screw has been installed in the bone, the virtual ruler allows the surgeon to accurately measure the tip-apex distance and verify that the surgery has been performed properly.
As is apparent from the description hereinabove, embodiments of the invention are very versatile when applied to orthopedic surgery and the software package may have the capability of allowing the operator to choose from many different operating modes, depending on the requirements or stage of the procedure. A list of some prominent modes of operation, some of which are shown schematically in FIG. 10A to FIG. 15, will now be presented:
1. Virtual extension of a tool or object in an image - This mode of operation can be carried out by the system of the invention using an image recognition program included in the software package without the use of the ruler or any other sensors. FIG. 10A is a drawing showing the guide drill 78 brought close to the femur 100. FIG. 10B shows guide 78 in contact with femur 100. The software of the system of the invention, at a command from the operator, recognizes the guide in the x-ray image and draws its virtual extension (thin line 102) through the bone. This allows the surgeon to easily see the path that the drill will follow through the bone and correct it, if necessary, before starting to drill.
2. Virtual extension of the ruler—The pointing aspect of the ruler of the invention is essentially different from image calibration or normal rulers. The system extends the ruler so that the operator only needs to look at the image, which also shows the ruler, and to point the ruler in the direction he wants to measure in order to get the measurement. The zero scale on the ruler of the virtual extension can be dragged and moved around on the image at will, thereby making it easy for the operator to make any measurement that he feels is necessary. Note that in prior art calibration techniques the points the operator wishes to measure must be marked on the image and the calibration device moved to measure between the points.
The pointing aspect is especially important in measuring objects in live video since in this case the operator can't take the time to mark the points of interest. An example of such a measurement is to measure the size of the heart under x-ray while injecting a contrast liquid to the blood.
FIG. 11 shows how a surgeon would use the virtual extension 104 of a one dimensional ruler 76, mounted on a guide 78, to measure how deep he wants to drill. FIG. 12 shows how a surgeon would use the virtual extension of a three dimensional ruler 76, mounted on a guide 78, to measure the distance from the insertion point of the drill, in the direction of drilling.
3. Using one or three-dimensional rulers to project accurate grids on the image. FIG. 13 shows how a surgeon would use the virtual extension 104 of a three dimensional ruler 76, mounted on a guide 78, to measure the distance from the hip joint, both in the direction of drilling, and in the direction perpendicular to it. This is not exactly the tip-apex distance, but a more accurate 3D measurement that was not possible in the prior art, and is similar to the TAD.
4. Projecting approximate grids on the image. For example, working with a one dimensional ruler the software simply assumes that the other axes have a similar scale.
5. Real time visualization—This has two aspects: Use either a one or a three dimensional ruler in order to draw how the result of the operation (or part of it) will look given the positioning of the ruler or some other surgical tool. For example, if it is decided to drill in a particular direction, the system of the invention can show how the DHS will be positioned. The other aspect, based on mode 1, is to simply use an approximate dimensional scale based on the known or approximate dimensions of the objects seen in the image to create the grids. This may be inaccurate and spatially wrong, but can sometimes be good enough. For example, it is enough to see a guide drill in the image to know the approximate scale of the image and draw the DHS screw or the entire DHS implant around it.
Real time visualization takes place after the planning stage, during the actual procedure itself. FIG. 14 illustrates this mode of operation. After fracture reduction the surgeon cuts the skin and brings the tip of the guide drill 78 into contact with the bone. He then takes an x-ray image and asks the system of the invention to draw a virtual extension 102 of the guide on the image. As a result of the pre-operation planning step (described herein below) he knows which DHS assembly to use. He now requests that the system of the invention retrieve the template 106 of the selected DHS assembly and draw it around the extension 102 of the guide 78. Note that in FIG. 14, the guide has been deliberately placed in a wrong direction of drilling and a wrong entry point in order to demonstrate how drawing the template on the guide can be helpful for the surgeon, i.e. having the template drawn on the image makes it very easy for the surgeon to see that he/she is/or is not drilling in the right place/direction.
6. Pre-operative planning—FIG. 15 illustrates this mode of operation. This mode is carried out on an image taken after the fracture reduction, using a calibration and a template library. Here the surgeon chooses different templates and has them drawn, i.e. overlaid, on the image of the bone to determine exactly which DHS assembly has the proper parameters to use with the specific bone and how to place it. Note that this is very different from the instant visualization, although sometimes the images look similar. Also, although operation planning is not new, the inventors are not aware of any other computerized system that enables the planning to be done inside the operating room. In trauma cases, the planning has to be done in the operating room since only after fracture reduction can the operation be planned.
7. Image enhancement—The processing means of the system automatically determines the location of the guide in the image, therefore an image enhancement algorithm can be applied that automatically concentrates on the specific area of interest to the surgeon.
8. Synchronizing AP/axial images—This is one of the most demanding tasks facing surgeons performing surgical procedures under guidance of a c-arm system. Consider a dynamic hip screw (DHS) placement procedure and suppose that the surgeon, using the system of the invention, first takes an image I from an axial angle, with a ruler on a guide. Then, without moving the guide, he takes another image J from AP angle. If afterwards he drills a bit more and then takes a third image K, also from an AP angle, then the system can calculate how deep the drill got in image I. This is only possible since the ruler is visible on all the images I, J, and K and is done by measuring the true distance of drilling between J and K, and virtually extending the drill by that distance in image I.
This is a very important feature that can save the surgeon the difficulty of going back to the axial angle and taking another image. This means less radiation and less operating time, and instant feedback.
It is to be noted that in certain applications the known shape and dimensions of surgical tools or even anatomical features that are visible in the x-ray image can be used in place of a ruler. In these cases the methods described above can be used to produce the same visual effects described hereinabove; e.g. virtual extension of the tool or placement of a template on a bone.
Although embodiments of the invention have been described by way of illustration, it will be understood that the invention may be carried out with many variations, modifications, and adaptations, without exceeding the scope of the claims.

Claims (24)

The invention claimed is:
1. A system for measuring the true dimension and orientation of objects in a two dimensional(2D) medical image, said system comprising:
a set of markers visible in the 2D medical images, which markers are located upon a surgical tool and have known spatial relationships between them;
receiving circuitry adapted to receive a given 2D medical image, which given 2D medical image includes the surgical tool and an organ of a subject;
image processing circuitry adapted to calculate distance within the given 2D image based on the appearance of said markers in the 2D image, characterized in that said processing circuitry include programs adapted to:
(a) identify said markers in the given 2D medical image and determine their location;
(b) calculate from the determined locations of the identified markers in the given medical image a three dimensional position and orientation of the surgical tool, in relation to the organ, thereby providing 3D positional information of the tool from the appearance of the markers in the given 2D medical image; and
(c) calculate a dimension of a spatial relationship between the surgical tool, or a point on the surgical tool, and the organ, based on the locations of the identified markers in the given medical image and the calculated relative 3D position and orientation of the surgical tool.
2. The system according to claim 1, wherein the organ is a femur.
3. The system according to claim 1, wherein the given 2D medical image is a radiographic image.
4. The system according to claim 1, wherein the dimension is a tip-apex distance.
5. The system according to claim 1, wherein the image processing circuitry is further adapted to identify a contour of the organ in the given 2D medical image.
6. The system according to claim 2, wherein the image processing circuitry is further adapted to identify a contour of a head of the femur in the given medical image.
7. The system according to claim 5, wherein the dimension is a distance between a point on the surgical tool and a point on the identified contour of the organ.
8. The system according to claim 1, further comprising a rendering module adapted to render upon the given medical image an overlay of an implant, positioned in relation to the organ based on a prediction of an expected location of the implant considering the current determined 3D position and orientation of the surgical tool.
9. A system for measuring the true dimensions and orientation of objects in a two dimensional (2D) medical image, said system comprising:
a set of markers visible in the medical images and having known spatial relationships between them, which markers are located upon a penetrating surgical tool, wherein the penetrating surgical tool has a penetrating tip for penetrating human tissue;
receiving circuitry adapted to receive a given 2D medical image, which given 2D medical image includes the surgical tool and an organ of a subject;
image processing circuitry adapted to render an extension of the penetrating tip upon the given 2D medical image;
characterized in that said image processing circuitry comprises image processing logic that allows said image processing circuitry to identify the markers in the given 2D medical image and use said identified markers to create a virtual extension of the penetrating tip of the penetrating surgical tool, thereby enabling a user to accurately predict a trajectory of the penetrating tip and to draw the virtual extension of the penetrating tip, on the 2D medical image, as an overlay.
10. The system according to claim 9, wherein the organ is a femur.
11. The system according to claim 9, wherein said image processing circuitry is further adapted to determine a distance between the penetrating point and a point on the organ.
12. The system according to claim 11, wherein the distance is a tip-apex distance.
13. The system according to claim 9, further comprising automatically identifying, by the processing circuitry, a contour of the organ in the given 2D medical image.
14. The system according to claim 10, further comprising automatically identifying, by the processing circuitry, a contour of a head of the femur in the given 2D medical image.
15. The system according to claim 13, wherein said image processing circuitry is further adapted to determine a distance between the penetrating point and a point on the identified contour of the organ.
16. The system according to claim 9, wherein said image processing circuitry is further adapted to render upon the given 2D medical image an overlay of an implant, positioned in relation to the organ based on a prediction of an expected location of the implant considering the current determined 3D position and orientation of the surgical tool.
17. A system for measuring the true dimension and orientation of objects in a two dimensional (2D) medical image, said system comprising:
a set of markers visible in the 2D medical images and having known spatial relationships between them;
receiving circuitry adapted to receive a given 2D medical image, which 2D medical image includes the markers, a surgical tool and an organ of a subject;
image processing circuitry adapted to calculate distance within the given 2D image based on the appearances of said markers in the 2D image;
characterized in that said processing circuitry includes programs adapted to:
(a) identify said markers in the given 2D medical image and determine their location;
(b) calculate from the determined location of the identified markers in the given medical image a three dimensional position and orientation of the surgical tool, in relation to the organ, thereby providing 3D positional information of the tool from the appearance of the markers in the given 2D medical image; and
(c) calculate a dimension of a spatial relationship between the surgical tool, or a point on the surgical tool, and the organ, based on the locations of the identified markers in the given medical image and the calculated relative 3D position and orientation of the surgical tool.
18. The system according to claim 17, wherein said image processing circuitry is further adapted to determine a trajectory of the surgical tool and render the trajectory upon the given 2D medical image.
19. The system according to claim 17, wherein the dimension is a tip-apex distance.
20. The system according to claim 17, further comprising a rendering module adapted to render upon the given 2D medical image an overlay of an implant, positioned in relation to the organ based on a prediction of an expected location of the implant considering the current determined 3D position and orientation of the surgical tool.
21. A system for measuring the true dimensions and orientation of objects in a two dimensional (2D) medical image, said system comprising:
a set of markers visible in the 2D medical images, which markers are located upon a surgical tool and have known spatial relationships between them;
receiving circuitry adapted to receive a given 2D medical images, which given 2D medical image includes the markers and an organ of a subject;
image processing circuitry adapted to calculate distances with the given 2D image based on the appearances of said markers in the 2D image; characterized in that said processing circuitry includes programs adapted to:
(a) identify said markers in the given 2D medical image and determine their location;
(b) calculate from the determined location of the identified markers in the given medical image a three dimensional position and orientation of the surgical too, in relation to the organ, thereby providing 3D positional information of the tool from the appearance of the markers in the given 2D medical image; and
(c) calculate a dimension of a spatial relationship between two points on the organ, based on the locations of the identified markers in the given 2D medical image.
22. The system according to claim 21, further comprising a rendering module adapted to render upon the given 2D medical image an overlay of an implant, positioned in relation to the organ based on a prediction of an expected location of the implant considering the current determined 3D position and orientation of the surgical tool.
23. The system according to claim 21, wherein the given 2D medical image is a radiographic image.
24. The system according to claim 21, further comprising a rendering module adapted to render, intra-operatively, upon a display, the given 2D medical image along with the calculated dimension, wherein the given 2D medical image was acquired intra-operatively.
US14/106,771 2007-06-21 2013-12-15 System for measuring the true dimensions and orientation of objects in a two dimensional image Active 2028-07-16 US9433390B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US14/106,771 US9433390B2 (en) 2007-06-21 2013-12-15 System for measuring the true dimensions and orientation of objects in a two dimensional image
US15/256,642 US20170128027A1 (en) 2007-06-21 2016-09-05 System for measuring the true dimensions and orientation of objects in a two dimensional image
US16/946,665 US20210038176A1 (en) 2007-06-21 2020-06-30 System for measuring the true dimensions and orientation of objects in a two dimensional image

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
IL184151A IL184151A0 (en) 2007-06-21 2007-06-21 X-ray measurement method
IL184151 2007-06-21
PCT/IL2008/000841 WO2008155772A1 (en) 2007-06-21 2008-06-19 A system for measuring the true dimensions and orientation of objects in a two dimensional image
US66573110A 2010-06-01 2010-06-01
US14/106,771 US9433390B2 (en) 2007-06-21 2013-12-15 System for measuring the true dimensions and orientation of objects in a two dimensional image

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
PCT/IL2008/000841 Continuation WO2008155772A1 (en) 2007-06-21 2008-06-19 A system for measuring the true dimensions and orientation of objects in a two dimensional image
US12/665,731 Continuation US8611697B2 (en) 2007-06-21 2008-06-19 System for measuring the true dimensions and orientation of objects in a two dimensional image

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/256,642 Continuation US20170128027A1 (en) 2007-06-21 2016-09-05 System for measuring the true dimensions and orientation of objects in a two dimensional image

Publications (2)

Publication Number Publication Date
US20140180064A1 US20140180064A1 (en) 2014-06-26
US9433390B2 true US9433390B2 (en) 2016-09-06

Family

ID=39846950

Family Applications (4)

Application Number Title Priority Date Filing Date
US12/665,731 Active 2030-04-28 US8611697B2 (en) 2007-06-21 2008-06-19 System for measuring the true dimensions and orientation of objects in a two dimensional image
US14/106,771 Active 2028-07-16 US9433390B2 (en) 2007-06-21 2013-12-15 System for measuring the true dimensions and orientation of objects in a two dimensional image
US15/256,642 Abandoned US20170128027A1 (en) 2007-06-21 2016-09-05 System for measuring the true dimensions and orientation of objects in a two dimensional image
US16/946,665 Abandoned US20210038176A1 (en) 2007-06-21 2020-06-30 System for measuring the true dimensions and orientation of objects in a two dimensional image

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/665,731 Active 2030-04-28 US8611697B2 (en) 2007-06-21 2008-06-19 System for measuring the true dimensions and orientation of objects in a two dimensional image

Family Applications After (2)

Application Number Title Priority Date Filing Date
US15/256,642 Abandoned US20170128027A1 (en) 2007-06-21 2016-09-05 System for measuring the true dimensions and orientation of objects in a two dimensional image
US16/946,665 Abandoned US20210038176A1 (en) 2007-06-21 2020-06-30 System for measuring the true dimensions and orientation of objects in a two dimensional image

Country Status (5)

Country Link
US (4) US8611697B2 (en)
EP (2) EP2779096A1 (en)
CN (1) CN101779223B (en)
IL (1) IL184151A0 (en)
WO (1) WO2008155772A1 (en)

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10010372B1 (en) * 2016-01-06 2018-07-03 Paul Beck Marker Positioning Apparatus
US10052170B2 (en) 2015-12-18 2018-08-21 MediLux Capitol Holdings, S.A.R.L. Mixed reality imaging system, apparatus and surgical suite
US10070903B2 (en) 2008-01-09 2018-09-11 Stryker European Holdings I, Llc Stereotactic computer assisted surgery method and system
US10201320B2 (en) 2015-12-18 2019-02-12 OrthoGrid Systems, Inc Deformed grid based intra-operative system and method of use
WO2019118501A3 (en) * 2017-12-11 2019-08-15 Hologic, Inc. Ultrasound localization system with advanced biopsy site markers
US10588647B2 (en) 2010-03-01 2020-03-17 Stryker European Holdings I, Llc Computer assisted surgery system
US10610325B2 (en) 2017-02-16 2020-04-07 Canon U.S.A., Inc. Medical guidance apparatus
US10675099B2 (en) 2017-09-22 2020-06-09 Canon U.S.A., Inc. Needle insertion guide device and system, and method of providing control guidance for needle insertion guide device
US10973590B2 (en) 2018-09-12 2021-04-13 OrthoGrid Systems, Inc Artificial intelligence intra-operative surgical guidance system and method of use
US11197723B2 (en) 2017-10-09 2021-12-14 Canon U.S.A., Inc. Medical guidance system and method using localized insertion plane
US11386556B2 (en) 2015-12-18 2022-07-12 Orthogrid Systems Holdings, Llc Deformed grid based intra-operative system and method of use
US11464576B2 (en) 2018-02-09 2022-10-11 Covidien Lp System and method for displaying an alignment CT
US11484276B2 (en) 2014-07-02 2022-11-01 Covidien Lp Alignment CT
US11540794B2 (en) 2018-09-12 2023-01-03 Orthogrid Systesm Holdings, LLC Artificial intelligence intra-operative surgical guidance system and method of use
US11547377B2 (en) 2015-08-06 2023-01-10 Covidien Lp System and method for navigating to target and performing procedure on target utilizing fluoroscopic-based local three dimensional volume reconstruction
US11559266B2 (en) 2015-08-06 2023-01-24 Covidien Lp System and method for local three dimensional volume reconstruction using a standard fluoroscope
US11564649B2 (en) 2017-10-10 2023-01-31 Covidien Lp System and method for identifying and marking a target in a fluoroscopic three-dimensional reconstruction
US11617621B2 (en) 2018-08-03 2023-04-04 Canon U.S.A., Inc. System and method for multi-probe guidance
US11631174B2 (en) 2006-11-10 2023-04-18 Covidien Lp Adaptive navigation technique for navigating a catheter through a body channel or cavity
US11642159B2 (en) 2018-08-15 2023-05-09 Canon U.S.A., Inc. Medical tool guidance apparatus
US11707241B2 (en) 2015-08-06 2023-07-25 Covidien Lp System and method for local three dimensional volume reconstruction using a standard fluoroscope
US11712213B2 (en) 2018-02-08 2023-08-01 Covidien Lp System and method for pose estimation of an imaging device and for determining the location of a medical device with respect to a target
US11783498B2 (en) 2008-06-03 2023-10-10 Covidien Lp Feature-based registration method
US11798178B2 (en) 2014-07-02 2023-10-24 Covidien Lp Fluoroscopic pose estimation
US11847730B2 (en) 2020-01-24 2023-12-19 Covidien Lp Orientation detection in fluoroscopic images
US11864935B2 (en) 2019-09-09 2024-01-09 Covidien Lp Systems and methods for pose estimation of a fluoroscopic imaging device and for three-dimensional imaging of body structures
US11871913B2 (en) 2014-10-31 2024-01-16 Covidien Lp Computed tomography enhanced fluoroscopic system, device, and method of utilizing the same
US11925333B2 (en) 2019-02-01 2024-03-12 Covidien Lp System for fluoroscopic tracking of a catheter to update the relative position of a target and the catheter in a 3D model of a luminal network
US11928834B2 (en) 2021-05-24 2024-03-12 Stryker Corporation Systems and methods for generating three-dimensional measurements using endoscopic video data
US11931111B2 (en) 2019-09-09 2024-03-19 Covidien Lp Systems and methods for providing surgical guidance
US11931141B2 (en) 2008-06-06 2024-03-19 Covidien Lp Hybrid registration method
US11950951B2 (en) 2022-01-13 2024-04-09 Covidien Lp Systems and methods for C-arm fluoroscope camera pose refinement with secondary movement compensation

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8090166B2 (en) 2006-09-21 2012-01-03 Surgix Ltd. Medical image analysis
IL184151A0 (en) 2007-06-21 2007-10-31 Diagnostica Imaging Software Ltd X-ray measurement method
EP2310839A4 (en) * 2008-06-18 2011-08-03 Surgix Ltd A method and system for stitching multiple images into a panoramic image
FR2937530B1 (en) 2008-10-24 2012-02-24 Biospace Med MEASURING INTRINSIC GEOMETRIC SIZES WITH AN ANATOMIC SYSTEM
US8908995B2 (en) * 2009-01-12 2014-12-09 Intermec Ip Corp. Semi-automatic dimensioning with imager on a portable device
KR20120104580A (en) 2009-11-20 2012-09-21 니 크리에이션스, 엘엘씨 Navigation and positioning instruments for joint repair
WO2011063240A1 (en) 2009-11-20 2011-05-26 Knee Creations, Llc Implantable devices for subchondral treatment of joint pain
CN102740789A (en) 2009-11-20 2012-10-17 膝部创造物有限责任公司 Instruments for targeting a joint defect
US8801800B2 (en) 2009-11-20 2014-08-12 Zimmer Knee Creations, Inc. Bone-derived implantable devices and tool for subchondral treatment of joint pain
AU2010321743A1 (en) 2009-11-20 2012-07-12 Knee Creations, Llc Coordinate mapping system for joint treatment
JP2013511356A (en) 2009-11-20 2013-04-04 ニー・クリエイションズ・リミテッド・ライアビリティ・カンパニー Device for variable angle approach to joints
US8821504B2 (en) 2009-11-20 2014-09-02 Zimmer Knee Creations, Inc. Method for treating joint pain and associated instruments
US8951261B2 (en) 2009-11-20 2015-02-10 Zimmer Knee Creations, Inc. Subchondral treatment of joint pain
US8702713B2 (en) 2011-01-26 2014-04-22 Warsaw Orthopedic, Inc. Instruments and techniques for adjusting relative positioning of bones or bony tissues
DE102011075435A1 (en) * 2011-05-06 2012-11-08 Siemens Aktiengesellschaft display unit
US8468705B2 (en) 2011-07-08 2013-06-25 John Schneider Electronic scaling ruler
US8886449B2 (en) 2012-01-13 2014-11-11 Qualcomm Incorporated Calibrated hardware sensors for estimating real-world distances
US11419523B2 (en) 2012-03-22 2022-08-23 Sizer Llc Blood vessel sizing device and method for sizing blood vessel
US8971995B2 (en) 2012-03-22 2015-03-03 Sizer Llc Blood vessel sizing device
US9375167B2 (en) 2012-03-22 2016-06-28 Sizer Llc Blood vessel sizing device
KR101608869B1 (en) * 2012-09-07 2016-04-04 삼성전자주식회사 Method for indicating a virtual ruler on separated image or medical image of object, medical image obtaining apparatus, and apparatus and method for displaying separated image or medical image with a virtual ruler
WO2014048447A1 (en) 2012-09-27 2014-04-03 Stryker Trauma Gmbh Rotational position determination
US10743945B2 (en) 2012-10-02 2020-08-18 Radlink, Inc. Surgical method and workflow
CN104837434A (en) * 2012-12-10 2015-08-12 皇家飞利浦有限公司 Digital ruler and reticule for renal denervation
US10105151B2 (en) 2012-12-12 2018-10-23 Wright Medical Technology, Inc. Instrument for intra-operative implant templating using fluoroscopy
EP2956046B1 (en) 2013-02-18 2018-05-09 OrthoGrid Systems S.a.r.l. Computer system to digitally quantify alignment and placement parameters in a musculoskeletal application
US10526232B2 (en) * 2013-05-30 2020-01-07 Ppg Industries Ohio, Inc. Microwave heating glass bending process
EP3025304B1 (en) * 2013-07-23 2021-09-08 Koninklijke Philips N.V. Registration system for registering an imaging device with a tracking device
US9402660B2 (en) 2013-09-05 2016-08-02 Warsaw Orthopedic, Inc. Surgical instrument and method
US9911203B2 (en) 2013-10-02 2018-03-06 Given Imaging Ltd. System and method for size estimation of in-vivo objects
US20150157197A1 (en) * 2013-12-09 2015-06-11 Omer Aslam Ilahi Endoscopic image overlay
US11382816B2 (en) 2015-06-05 2022-07-12 Stryker Corporation Surgical table and accessories to facilitate hip arthroscopy
US10098707B2 (en) 2015-08-17 2018-10-16 Orthogrid Systems Inc. Surgical positioning system, apparatus and method of use
US11234768B1 (en) 2015-10-15 2022-02-01 Dartmouth-Hitchcock Clinic Screen-mounted trajectory and aiming guide for use with fluoroscopy
JP6698392B2 (en) * 2016-03-22 2020-05-27 富士フイルム株式会社 Image processing apparatus, radiation image capturing system, image processing method, and image processing program
US11051859B2 (en) 2016-04-27 2021-07-06 Warsaw Orthopedic, Inc. Spinal correction system and method
US10194958B2 (en) 2016-04-27 2019-02-05 Warsaw Othopedic, Inc. Spinal correction system and method
US10390862B2 (en) 2016-04-27 2019-08-27 Warsaw Orthopedic, Inc. Spinal correction system and method
USD842479S1 (en) 2016-04-27 2019-03-05 Warsaw Orthopedic, Inc. Spinal implant
US10650561B2 (en) 2016-09-19 2020-05-12 Radlink, Inc. Composite radiographic image that corrects effects of parallax distortion
US10748319B1 (en) 2016-09-19 2020-08-18 Radlink, Inc. Composite radiographic image that corrects effects of parallax distortion
US10143533B2 (en) 2016-10-06 2018-12-04 Sizer Llc Blood vessel sizing device
US10543022B2 (en) 2016-10-11 2020-01-28 Warsaw Orthopedic, Inc. Spinal implant system and method
EP3541270A4 (en) 2016-11-18 2020-06-10 Stryker Corp. Method and apparatus for treating a joint, including the treatment of cam-type femoroacetabular impingement in a hip joint and pincer-type femoroacetabular impingement in a hip joint
WO2018145108A1 (en) 2017-02-06 2018-08-09 Stryker Corp. Distraction frame for effecting hip distraction
US11510805B2 (en) 2017-02-06 2022-11-29 Stryker Corp. Anatomical gripping system for gripping the leg and foot of a patient when effecting hip distraction and/or when effecting leg positioning
AU2018214679A1 (en) 2017-02-06 2019-08-29 Stryker Corp. Method and apparatus for supporting and stabilizing a patient during hip distraction
EP4008258B8 (en) * 2017-03-09 2023-08-23 Smith & Nephew, Inc. Sagittal rotation determination
US20180314797A1 (en) * 2017-05-01 2018-11-01 Rohit Madan Cephalometric analysis and patient management software application for mobile devices
USD878836S1 (en) 2017-08-17 2020-03-24 Stryker Corp. Table extender
US11464569B2 (en) 2018-01-29 2022-10-11 Stryker Corporation Systems and methods for pre-operative visualization of a joint
US10646261B2 (en) 2018-07-24 2020-05-12 Warsaw Orthopedic, Inc. Multi-purpose screwdriver and method of use
LU101007B1 (en) 2018-11-26 2020-05-26 Metamorphosis Gmbh Artificial-intelligence based reduction support
LU101009B1 (en) 2018-11-26 2020-05-26 Metamorphosis Gmbh Artificial-intelligence-based determination of relative positions of objects in medical images
JP7266543B2 (en) * 2020-02-07 2023-04-28 富士フイルム株式会社 Radiation image processing apparatus, method and program
US11564855B2 (en) 2020-09-28 2023-01-31 Stryker Corporation Systems and methods for supporting and stabilizing a patient during hip distraction
US20220397670A1 (en) 2021-06-09 2022-12-15 Wright Medical Technology, Inc. Alignment systems and methods
CN113674841A (en) * 2021-08-23 2021-11-19 东成西就教育科技有限公司 Template measuring system for preoperative image

Citations (100)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US581540A (en) 1897-04-27 dennis
US1396920A (en) 1921-11-15 bbostboih
US2819526A (en) 1956-03-01 1958-01-14 Rca Corp Calculator
US3706883A (en) 1969-11-21 1972-12-19 Kevin M Mcintyre Radiological apparatus for measuring length which comprises two relatively movable radio opaque marks
US3770956A (en) 1971-12-30 1973-11-06 Buckbee Mears Co X-ray measuring grid
US3848136A (en) 1973-04-20 1974-11-12 L Seldin Application of dimension indicia to x-ray exposure
US4005527A (en) 1975-12-22 1977-02-01 Wilson Ralph S Depth gauge
US4096634A (en) * 1975-07-22 1978-06-27 Guedel Alfred Method and device for the measurement of angles on space planes
US4736399A (en) 1984-08-08 1988-04-05 Kabushiki Kaisha Toshiba X-ray imaging apparatus
US4890311A (en) 1987-06-30 1989-12-26 Siemens Aktiengesellschaft Biopsy means for an x-ray examination apparatus
US4915112A (en) 1986-09-30 1990-04-10 The Children's Medical Center Corporation Radiographic measurement device
US4918715A (en) 1989-05-01 1990-04-17 Webb Research Ii Corporation Image location marking devices for radiographs, method of making and methods of use
US5052035A (en) 1989-11-02 1991-09-24 Webb Research Ii Corporation Image location marking devices for radiographs, method of making and methods of use
US5123056A (en) 1990-02-02 1992-06-16 Siemens Medical Systems, Inc. Whole-leg x-ray image processing and display techniques
US5216700A (en) * 1992-02-18 1993-06-01 George Cherian Tape having graduated scale providing location indicia during x-ray processes
US5262856A (en) 1992-06-04 1993-11-16 Massachusetts Institute Of Technology Video image compositing techniques
US5285785A (en) 1991-10-30 1994-02-15 Meyer Seymour W Apparatus and method for locating foreign bodies in humans and animals
US5400513A (en) 1993-03-10 1995-03-28 Duffield; Christopher Image size measuring device
US5409004A (en) 1993-06-11 1995-04-25 Cook Incorporated Localization device with radiopaque markings
EP0655861A1 (en) 1993-11-26 1995-05-31 Koninklijke Philips Electronics N.V. Image composition method and imaging apparatus for performing said method
US5551160A (en) 1994-08-24 1996-09-03 Ferris; Byron S. Calculating graphic scaler
US5640436A (en) 1995-01-26 1997-06-17 Hitachi Medical Corporation Method and apparatus for X-ray computed tomography
US5649032A (en) 1994-11-14 1997-07-15 David Sarnoff Research Center, Inc. System for automatically aligning images to form a mosaic image
US5687331A (en) 1995-08-03 1997-11-11 Microsoft Corporation Method and system for displaying an animated focus item
US5801385A (en) 1995-10-06 1998-09-01 Canon Kabushiki Kaisha X-ray image pickup device
US5832422A (en) * 1995-04-11 1998-11-03 Wiedenhoefer; Curt Measuring device
US5833607A (en) 1996-03-25 1998-11-10 Siemens Corporate Research, Inc. Automatic full-leg mosaic and display for peripheral angiography
US5841833A (en) 1991-02-13 1998-11-24 Lunar Corporation Dual-energy x-ray detector providing spatial and temporal interpolation
US5970119A (en) 1997-11-18 1999-10-19 Douglas Holtz (Part Interest) Radiological scaling and alignment device
US6075879A (en) 1993-09-29 2000-06-13 R2 Technology, Inc. Method and system for computer-aided lesion detection using information from multiple images
US6097833A (en) 1993-11-26 2000-08-01 U.S. Philips Corporation Image composition method and imaging apparatus for performing said method
US6101238A (en) 1998-11-25 2000-08-08 Siemens Corporate Research, Inc. System for generating a compound x-ray image for diagnosis
US6196715B1 (en) 1959-04-28 2001-03-06 Kabushiki Kaisha Toshiba X-ray diagnostic system preferable to two dimensional x-ray detection
US6206566B1 (en) 1998-11-02 2001-03-27 Siemens Aktiengesellschaft X-ray apparatus for producing a 3D image from a set of 2D projections
US6243439B1 (en) 1998-03-11 2001-06-05 Kabushiki Kaisha Morita Seisakusho CT scanning apparatus
US6356621B1 (en) 1999-07-14 2002-03-12 Nitto Denko Corporation Pressure-sensitive adhesive sheet for radiography
US6396903B1 (en) 2000-05-05 2002-05-28 Dakota David Wenstrup Reference grid for security equipment
US20020077540A1 (en) 2000-11-17 2002-06-20 Kienzle Thomas C. Enhanced graphic features for computer assisted surgery system
EP1255403A2 (en) 2001-04-30 2002-11-06 Eastman Kodak Company Collimation device and method for acquiring a radiation image of a long body part using direct digital x-ray detectors
US20030014034A1 (en) 2001-03-22 2003-01-16 Norbert Strobel Method for detecting the three-dimensional position of a medical examination instrument introduced into a body region, particularly of a catheter introduced into a vessel
US6618494B1 (en) 1998-11-27 2003-09-09 Wuestec Medical, Inc. Optical distortion correction in digital imaging
US6666579B2 (en) 2000-12-28 2003-12-23 Ge Medical Systems Global Technology Company, Llc Method and apparatus for obtaining and displaying computed tomography images using a fluoroscopy imaging system
US20040034298A1 (en) 2002-08-13 2004-02-19 Scimed Life Systems, Inc. Radiographic sizing tool
US20040086082A1 (en) 2002-11-05 2004-05-06 Eastman Kodak Company Method for automatically producing true size radiographic image
US20040111024A1 (en) 2001-02-07 2004-06-10 Guoyan Zheng Method for establishing a three-dimensional representation of a bone from image data
US6792071B2 (en) 2002-03-27 2004-09-14 Agfa-Gevaert Method of performing geometric measurements on digital radiological images
EP1498849A2 (en) 2003-07-07 2005-01-19 Canon Kabushiki Kaisha Image display apparatus, image display method, and program
US20050032028A1 (en) 2003-07-15 2005-02-10 Edna Chosack Surgical simulation device, system and method
US20050104018A1 (en) 2000-12-21 2005-05-19 Chang Yun C. Method and system for acquiring full spine and full leg images using flat panel digital radiography
US6925200B2 (en) 2000-11-22 2005-08-02 R2 Technology, Inc. Graphical user interface for display of anatomical information
US20050213849A1 (en) 2001-07-30 2005-09-29 Accuimage Diagnostics Corp. Methods and systems for intensity matching of a plurality of radiographic images
US6990229B2 (en) 2000-10-24 2006-01-24 Kabushiki Kaisha Toshiba Image processing device and image processing method
US7015906B2 (en) 2001-02-21 2006-03-21 Leica Microsystems Cms Gmbh Method and arrangement for imaging and measuring microscopic three-dimensional structures
US20060120583A1 (en) 2004-11-10 2006-06-08 Agfa-Gevaert Method of performing measurements on digital images
US20060154198A1 (en) 2005-01-11 2006-07-13 Duane Durbin 3D dental scanner
US20060177150A1 (en) 2005-02-01 2006-08-10 Microsoft Corporation Method and system for combining multiple exposure images having scene and camera motion
WO2006114721A2 (en) 2005-04-26 2006-11-02 Koninklijke Philips Electronics N.V. Medical viewing system and method for detecting and enhancing static structures in noisy images using motion of the image acquisition means
US20070041508A1 (en) 2005-08-18 2007-02-22 General Electric Company Method and apparatus to detect and correct alignment errors in X-ray systems used to generate 3D volumetric images
US20070134637A1 (en) 2005-12-08 2007-06-14 Simbionix Ltd. Medical simulation device with motion detector
EP1632181B1 (en) 2004-09-04 2007-11-07 Universitätsspital Basel, Carcas Group Marker-based mosaicing of X-ray images to generate a long-leg radiograph
US20080056547A1 (en) 2004-03-19 2008-03-06 Hiroto Kokubun Image Data Collection Control Method and Image Data Collection System
US20080111831A1 (en) 2006-11-15 2008-05-15 Jay Son Efficient Panoramic Image Generation
US20080118023A1 (en) 2005-02-11 2008-05-22 Besson Guy M Method And System For Dynamic Low Dose X-ray Imaging
US7396161B2 (en) 2005-09-29 2008-07-08 Siemens Aktiengesellschaft Method for generating an X-ray image of an extremity of a patient with a scale of length
US20080242971A1 (en) 2007-03-22 2008-10-02 Siemens Aktiengesellschaft Image system for supporting the navigation of interventional tools
US7453977B2 (en) 2006-02-07 2008-11-18 University Of Tennessee Research Foundation Variable resolution x-ray CT detector with target imaging capability
US7458977B2 (en) * 2003-02-04 2008-12-02 Zimmer Technology, Inc. Surgical navigation instrument useful in marking anatomical structures
US20090018808A1 (en) 2007-01-16 2009-01-15 Simbionix Ltd. Preoperative Surgical Simulation
WO2009022266A1 (en) 2007-08-10 2009-02-19 Crc S.R.L. Supporting structure for machinery, in particular accumulation apparatus, of comlpex production lines.
US7499579B2 (en) 2004-05-03 2009-03-03 Carestream Health, Inc. Method and program for comparing the size of a feature in sequential x-ray images
US20090059018A1 (en) 2007-09-05 2009-03-05 Micron Technology, Inc. Navigation assisted mosaic photography
US20090221908A1 (en) 2008-03-01 2009-09-03 Neil David Glossop System and Method for Alignment of Instrumentation in Image-Guided Intervention
US7611466B2 (en) 2002-06-07 2009-11-03 Verathon Inc. Ultrasound system and method for measuring bladder wall thickness and mass
US20090310845A1 (en) 2005-10-21 2009-12-17 Koichi Ogawa Panoramic imaging apparatus and image processing method for panoramic imaging
US7664298B2 (en) 2003-03-25 2010-02-16 Imaging Therapeutics, Inc. Methods for the compensation of imaging technique in the processing of radiographic images
US7702380B1 (en) 1999-11-03 2010-04-20 Case Western Reserve University System and method for producing a three-dimensional model
US20100135467A1 (en) 2008-11-26 2010-06-03 Richard King X-ray calibration
US20100178644A1 (en) 2009-01-15 2010-07-15 Simquest Llc Interactive simulation of biological tissue
US7773829B1 (en) 2006-02-10 2010-08-10 Adobe Systems Incorporated Image-centric rulers
US7797030B2 (en) 2003-11-13 2010-09-14 Medtronic, Inc. Clinical tool for structure localization
US20100232670A1 (en) 2006-07-27 2010-09-16 Axs Ingenierie Computerized imaging method for a three-dimensional reconstruction from two-dimensional radiological images; implementation device
US7871406B2 (en) 2006-08-04 2011-01-18 INTIO, Inc. Methods for planning and performing thermal ablation
US7877128B2 (en) 2005-08-02 2011-01-25 Biosense Webster, Inc. Simulation of invasive procedures
US20110019884A1 (en) 2008-01-09 2011-01-27 Stryker Leibinger Gmbh & Co. Kg Stereotactic Computer Assisted Surgery Based On Three-Dimensional Visualization
US7905924B2 (en) 2003-09-03 2011-03-15 Ralph Richard White Extracapsular surgical procedure
WO2011042832A1 (en) 2009-10-06 2011-04-14 Koninklijke Philips Electronics N.V. Patient table comprising a positioning system and method of using such a patent table.
US20110102461A1 (en) 2006-08-30 2011-05-05 Stephen Schultz Mosaic oblique images and methods of making and using same
US20110188726A1 (en) 2008-06-18 2011-08-04 Ram Nathaniel Method and system for stitching multiple images into a panoramic image
US8090166B2 (en) 2006-09-21 2012-01-03 Surgix Ltd. Medical image analysis
US8104958B2 (en) 2008-08-22 2012-01-31 Brainlab Ag Assigning X-ray markers to image markers imaged in the X-ray image
US20120059248A1 (en) 2010-08-20 2012-03-08 Troy Holsing Apparatus and method for airway registration and navigation
USRE43282E1 (en) 1998-09-14 2012-03-27 The Board Of Trustees Of The Leland Stanford Junior University Assessing the condition of a joint and devising treatment
US8311791B1 (en) 2009-10-19 2012-11-13 Surgical Theater LLC Method and system for simulating surgical procedures
US8463006B2 (en) 2007-04-17 2013-06-11 Francine J. Prokoski System and method for using three dimensional infrared imaging to provide detailed anatomical structure maps
US20130211244A1 (en) 2012-01-25 2013-08-15 Surgix Ltd. Methods, Devices, Systems, Circuits and Associated Computer Executable Code for Detecting and Predicting the Position, Orientation and Trajectory of Surgical Tools
US20130322726A1 (en) 2011-02-15 2013-12-05 Surgix Ltd. Methods, apparatuses, assemblies, circuits and systems for assessing, estimating and/or determining relative positions, alignments, orientations and angles of rotation of a portion of a bone and between two or more portions of a bone or bones
US8611697B2 (en) 2007-06-21 2013-12-17 Surgix Ltd. System for measuring the true dimensions and orientation of objects in a two dimensional image
US8657781B2 (en) 2008-11-20 2014-02-25 Hansen Medical, Inc. Automated alignment
US8855390B2 (en) 2010-04-02 2014-10-07 General Electric Company Method for processing radiological images
US9063635B2 (en) 2012-05-14 2015-06-23 Heartflow, Inc. Method and system for providing information from a patient-specific model of blood flow

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7343195B2 (en) * 1999-05-18 2008-03-11 Mediguide Ltd. Method and apparatus for real time quantitative three-dimensional image reconstruction of a moving organ and intra-body navigation

Patent Citations (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1396920A (en) 1921-11-15 bbostboih
US581540A (en) 1897-04-27 dennis
US2819526A (en) 1956-03-01 1958-01-14 Rca Corp Calculator
US6196715B1 (en) 1959-04-28 2001-03-06 Kabushiki Kaisha Toshiba X-ray diagnostic system preferable to two dimensional x-ray detection
US3706883A (en) 1969-11-21 1972-12-19 Kevin M Mcintyre Radiological apparatus for measuring length which comprises two relatively movable radio opaque marks
US3770956A (en) 1971-12-30 1973-11-06 Buckbee Mears Co X-ray measuring grid
US3848136A (en) 1973-04-20 1974-11-12 L Seldin Application of dimension indicia to x-ray exposure
US4096634A (en) * 1975-07-22 1978-06-27 Guedel Alfred Method and device for the measurement of angles on space planes
US4005527A (en) 1975-12-22 1977-02-01 Wilson Ralph S Depth gauge
US4736399A (en) 1984-08-08 1988-04-05 Kabushiki Kaisha Toshiba X-ray imaging apparatus
US4915112A (en) 1986-09-30 1990-04-10 The Children's Medical Center Corporation Radiographic measurement device
US4890311A (en) 1987-06-30 1989-12-26 Siemens Aktiengesellschaft Biopsy means for an x-ray examination apparatus
US4918715A (en) 1989-05-01 1990-04-17 Webb Research Ii Corporation Image location marking devices for radiographs, method of making and methods of use
US5052035A (en) 1989-11-02 1991-09-24 Webb Research Ii Corporation Image location marking devices for radiographs, method of making and methods of use
US5123056A (en) 1990-02-02 1992-06-16 Siemens Medical Systems, Inc. Whole-leg x-ray image processing and display techniques
US5841833A (en) 1991-02-13 1998-11-24 Lunar Corporation Dual-energy x-ray detector providing spatial and temporal interpolation
US5285785A (en) 1991-10-30 1994-02-15 Meyer Seymour W Apparatus and method for locating foreign bodies in humans and animals
US5216700A (en) * 1992-02-18 1993-06-01 George Cherian Tape having graduated scale providing location indicia during x-ray processes
US5262856A (en) 1992-06-04 1993-11-16 Massachusetts Institute Of Technology Video image compositing techniques
US5400513A (en) 1993-03-10 1995-03-28 Duffield; Christopher Image size measuring device
US5409004A (en) 1993-06-11 1995-04-25 Cook Incorporated Localization device with radiopaque markings
US6075879A (en) 1993-09-29 2000-06-13 R2 Technology, Inc. Method and system for computer-aided lesion detection using information from multiple images
EP0655861A1 (en) 1993-11-26 1995-05-31 Koninklijke Philips Electronics N.V. Image composition method and imaging apparatus for performing said method
US6097833A (en) 1993-11-26 2000-08-01 U.S. Philips Corporation Image composition method and imaging apparatus for performing said method
US5551160A (en) 1994-08-24 1996-09-03 Ferris; Byron S. Calculating graphic scaler
US5649032A (en) 1994-11-14 1997-07-15 David Sarnoff Research Center, Inc. System for automatically aligning images to form a mosaic image
US5640436A (en) 1995-01-26 1997-06-17 Hitachi Medical Corporation Method and apparatus for X-ray computed tomography
US5832422A (en) * 1995-04-11 1998-11-03 Wiedenhoefer; Curt Measuring device
US5687331A (en) 1995-08-03 1997-11-11 Microsoft Corporation Method and system for displaying an animated focus item
US5801385A (en) 1995-10-06 1998-09-01 Canon Kabushiki Kaisha X-ray image pickup device
US5833607A (en) 1996-03-25 1998-11-10 Siemens Corporate Research, Inc. Automatic full-leg mosaic and display for peripheral angiography
US5970119A (en) 1997-11-18 1999-10-19 Douglas Holtz (Part Interest) Radiological scaling and alignment device
US6243439B1 (en) 1998-03-11 2001-06-05 Kabushiki Kaisha Morita Seisakusho CT scanning apparatus
USRE43282E1 (en) 1998-09-14 2012-03-27 The Board Of Trustees Of The Leland Stanford Junior University Assessing the condition of a joint and devising treatment
US6206566B1 (en) 1998-11-02 2001-03-27 Siemens Aktiengesellschaft X-ray apparatus for producing a 3D image from a set of 2D projections
US6101238A (en) 1998-11-25 2000-08-08 Siemens Corporate Research, Inc. System for generating a compound x-ray image for diagnosis
US6618494B1 (en) 1998-11-27 2003-09-09 Wuestec Medical, Inc. Optical distortion correction in digital imaging
US6356621B1 (en) 1999-07-14 2002-03-12 Nitto Denko Corporation Pressure-sensitive adhesive sheet for radiography
US7702380B1 (en) 1999-11-03 2010-04-20 Case Western Reserve University System and method for producing a three-dimensional model
US6396903B1 (en) 2000-05-05 2002-05-28 Dakota David Wenstrup Reference grid for security equipment
US6990229B2 (en) 2000-10-24 2006-01-24 Kabushiki Kaisha Toshiba Image processing device and image processing method
US20020077540A1 (en) 2000-11-17 2002-06-20 Kienzle Thomas C. Enhanced graphic features for computer assisted surgery system
US6925200B2 (en) 2000-11-22 2005-08-02 R2 Technology, Inc. Graphical user interface for display of anatomical information
US20050104018A1 (en) 2000-12-21 2005-05-19 Chang Yun C. Method and system for acquiring full spine and full leg images using flat panel digital radiography
US6666579B2 (en) 2000-12-28 2003-12-23 Ge Medical Systems Global Technology Company, Llc Method and apparatus for obtaining and displaying computed tomography images using a fluoroscopy imaging system
US20040111024A1 (en) 2001-02-07 2004-06-10 Guoyan Zheng Method for establishing a three-dimensional representation of a bone from image data
US7015906B2 (en) 2001-02-21 2006-03-21 Leica Microsystems Cms Gmbh Method and arrangement for imaging and measuring microscopic three-dimensional structures
US20030014034A1 (en) 2001-03-22 2003-01-16 Norbert Strobel Method for detecting the three-dimensional position of a medical examination instrument introduced into a body region, particularly of a catheter introduced into a vessel
EP1255403A2 (en) 2001-04-30 2002-11-06 Eastman Kodak Company Collimation device and method for acquiring a radiation image of a long body part using direct digital x-ray detectors
US20050213849A1 (en) 2001-07-30 2005-09-29 Accuimage Diagnostics Corp. Methods and systems for intensity matching of a plurality of radiographic images
US6792071B2 (en) 2002-03-27 2004-09-14 Agfa-Gevaert Method of performing geometric measurements on digital radiological images
US7611466B2 (en) 2002-06-07 2009-11-03 Verathon Inc. Ultrasound system and method for measuring bladder wall thickness and mass
US20040034298A1 (en) 2002-08-13 2004-02-19 Scimed Life Systems, Inc. Radiographic sizing tool
US20040086082A1 (en) 2002-11-05 2004-05-06 Eastman Kodak Company Method for automatically producing true size radiographic image
US7458977B2 (en) * 2003-02-04 2008-12-02 Zimmer Technology, Inc. Surgical navigation instrument useful in marking anatomical structures
US7995822B2 (en) 2003-03-25 2011-08-09 Imatx, Inc. Methods for the compensation of imaging technique in the processing of radiographic images
US7664298B2 (en) 2003-03-25 2010-02-16 Imaging Therapeutics, Inc. Methods for the compensation of imaging technique in the processing of radiographic images
EP1498849A2 (en) 2003-07-07 2005-01-19 Canon Kabushiki Kaisha Image display apparatus, image display method, and program
US20050032028A1 (en) 2003-07-15 2005-02-10 Edna Chosack Surgical simulation device, system and method
US7905924B2 (en) 2003-09-03 2011-03-15 Ralph Richard White Extracapsular surgical procedure
US7797030B2 (en) 2003-11-13 2010-09-14 Medtronic, Inc. Clinical tool for structure localization
US20080056547A1 (en) 2004-03-19 2008-03-06 Hiroto Kokubun Image Data Collection Control Method and Image Data Collection System
US7499579B2 (en) 2004-05-03 2009-03-03 Carestream Health, Inc. Method and program for comparing the size of a feature in sequential x-ray images
EP1632181B1 (en) 2004-09-04 2007-11-07 Universitätsspital Basel, Carcas Group Marker-based mosaicing of X-ray images to generate a long-leg radiograph
US20060120583A1 (en) 2004-11-10 2006-06-08 Agfa-Gevaert Method of performing measurements on digital images
US20060154198A1 (en) 2005-01-11 2006-07-13 Duane Durbin 3D dental scanner
US20060177150A1 (en) 2005-02-01 2006-08-10 Microsoft Corporation Method and system for combining multiple exposure images having scene and camera motion
US20080118023A1 (en) 2005-02-11 2008-05-22 Besson Guy M Method And System For Dynamic Low Dose X-ray Imaging
WO2006114721A2 (en) 2005-04-26 2006-11-02 Koninklijke Philips Electronics N.V. Medical viewing system and method for detecting and enhancing static structures in noisy images using motion of the image acquisition means
US7877128B2 (en) 2005-08-02 2011-01-25 Biosense Webster, Inc. Simulation of invasive procedures
US20070041508A1 (en) 2005-08-18 2007-02-22 General Electric Company Method and apparatus to detect and correct alignment errors in X-ray systems used to generate 3D volumetric images
US7396161B2 (en) 2005-09-29 2008-07-08 Siemens Aktiengesellschaft Method for generating an X-ray image of an extremity of a patient with a scale of length
US20090310845A1 (en) 2005-10-21 2009-12-17 Koichi Ogawa Panoramic imaging apparatus and image processing method for panoramic imaging
US20070134637A1 (en) 2005-12-08 2007-06-14 Simbionix Ltd. Medical simulation device with motion detector
US7453977B2 (en) 2006-02-07 2008-11-18 University Of Tennessee Research Foundation Variable resolution x-ray CT detector with target imaging capability
US7773829B1 (en) 2006-02-10 2010-08-10 Adobe Systems Incorporated Image-centric rulers
US20100232670A1 (en) 2006-07-27 2010-09-16 Axs Ingenierie Computerized imaging method for a three-dimensional reconstruction from two-dimensional radiological images; implementation device
US7871406B2 (en) 2006-08-04 2011-01-18 INTIO, Inc. Methods for planning and performing thermal ablation
US20110102461A1 (en) 2006-08-30 2011-05-05 Stephen Schultz Mosaic oblique images and methods of making and using same
US8090166B2 (en) 2006-09-21 2012-01-03 Surgix Ltd. Medical image analysis
US9111180B2 (en) 2006-09-21 2015-08-18 Orthopedic Navigation Ltd. Medical image analysis
US20080111831A1 (en) 2006-11-15 2008-05-15 Jay Son Efficient Panoramic Image Generation
US20090018808A1 (en) 2007-01-16 2009-01-15 Simbionix Ltd. Preoperative Surgical Simulation
US20080242971A1 (en) 2007-03-22 2008-10-02 Siemens Aktiengesellschaft Image system for supporting the navigation of interventional tools
US8463006B2 (en) 2007-04-17 2013-06-11 Francine J. Prokoski System and method for using three dimensional infrared imaging to provide detailed anatomical structure maps
US8611697B2 (en) 2007-06-21 2013-12-17 Surgix Ltd. System for measuring the true dimensions and orientation of objects in a two dimensional image
EP2179397B1 (en) 2007-06-21 2014-08-20 Surgix Ltd. A system for measuring the true dimensions and orientation of objects in a two dimensional image
WO2009022266A1 (en) 2007-08-10 2009-02-19 Crc S.R.L. Supporting structure for machinery, in particular accumulation apparatus, of comlpex production lines.
US20090059018A1 (en) 2007-09-05 2009-03-05 Micron Technology, Inc. Navigation assisted mosaic photography
US20110019884A1 (en) 2008-01-09 2011-01-27 Stryker Leibinger Gmbh & Co. Kg Stereotactic Computer Assisted Surgery Based On Three-Dimensional Visualization
US20090221908A1 (en) 2008-03-01 2009-09-03 Neil David Glossop System and Method for Alignment of Instrumentation in Image-Guided Intervention
US20110188726A1 (en) 2008-06-18 2011-08-04 Ram Nathaniel Method and system for stitching multiple images into a panoramic image
US9109998B2 (en) 2008-06-18 2015-08-18 Orthopedic Navigation Ltd. Method and system for stitching multiple images into a panoramic image
US8104958B2 (en) 2008-08-22 2012-01-31 Brainlab Ag Assigning X-ray markers to image markers imaged in the X-ray image
US8657781B2 (en) 2008-11-20 2014-02-25 Hansen Medical, Inc. Automated alignment
US20100135467A1 (en) 2008-11-26 2010-06-03 Richard King X-ray calibration
US20100178644A1 (en) 2009-01-15 2010-07-15 Simquest Llc Interactive simulation of biological tissue
WO2011042832A1 (en) 2009-10-06 2011-04-14 Koninklijke Philips Electronics N.V. Patient table comprising a positioning system and method of using such a patent table.
US8311791B1 (en) 2009-10-19 2012-11-13 Surgical Theater LLC Method and system for simulating surgical procedures
US8855390B2 (en) 2010-04-02 2014-10-07 General Electric Company Method for processing radiological images
US20120059248A1 (en) 2010-08-20 2012-03-08 Troy Holsing Apparatus and method for airway registration and navigation
US20130322726A1 (en) 2011-02-15 2013-12-05 Surgix Ltd. Methods, apparatuses, assemblies, circuits and systems for assessing, estimating and/or determining relative positions, alignments, orientations and angles of rotation of a portion of a bone and between two or more portions of a bone or bones
US20130211244A1 (en) 2012-01-25 2013-08-15 Surgix Ltd. Methods, Devices, Systems, Circuits and Associated Computer Executable Code for Detecting and Predicting the Position, Orientation and Trajectory of Surgical Tools
US9063635B2 (en) 2012-05-14 2015-06-23 Heartflow, Inc. Method and system for providing information from a patient-specific model of blood flow

Non-Patent Citations (28)

* Cited by examiner, † Cited by third party
Title
Amir Herman et al: "Computer-assisted surgery for dynamic hip screw, using Surgix, a novel intraoperative juiding system", The International Journal of Medical Robotics and Computer Assisted Surgery, vol. 5, No. 1, Mar. 1, 2009, pp. 45-50, XP055133701, ISSN: 1478-5951, DOI: 10.1002/rcs.231.
B.K.P. Horn and M.J. Brooks, "Shape from Shading" Mid Press, Cambridge Mass (1989).
Behiels, et al, "Evaluation of image features and search strategies for segmentation of bone structures in radiographs using Active Shape Models", 2002, pp. 47-62, Belgium.
Brodke D et al: "Image guidance for spinal surgery", Operative Techniques in Orthopaedics, Saunders, Philadelphia, PA, US, vol. 13, No. 3, Jul. 1, 2003, pp. 152-158, XP004677528, ISSN: 1048-6666, DOI: 10.10161S1048-6666(03)00020-X.
Chen, et al., "Automatic Extraction of Femur Contours from Hip X-ray Images", 2005, pp. 1-10, Singapore.
Chinese Patent Office Communication for corresponding Chinese Patent Application No. 200880103240.7, mailed Dec. 23, 2011 (5 pages.
Chinese Patent Office Communication for corresponding Chinese Patent Application No. 200880103240.7, mailed May 2, 2013 (3 pages).
Chinese Patent Office Communication for corresponding Chinese Patent Application No. 200880103240.7, mailed Nov. 16, 2012 (4 pages).
Cocosco, et al., "BrainWeb: Online Interface to a 3D MRI Simulated Brain Database", 1997, S425-27, Canada.
Dougherty, et al., "Lacunarity analysis of spatial pattern in CT images of vertebral trabecular bone for assessing Dsteoporosis", 2002, pp. 129-138, Kuwait.
European Search Report issued in European Application EP 14166253.6, mailed Aug. 18, 2014 (9 pages).
Foley et al: "Virtual fluoroscopy", Operative Techniques in Orthopaedics, Saunders, Philadelphia, PA, US, vol. 10, No. 1, Jan. 1, 2000, pp. 77-81, KP005183642, ISSN: 1048-6666, DOI:10.1016/S1048-6666(00)80046-4.
Geraets, et al., "Analysis of the radiographic trabecular pattern", 1991, pp. 575-581, The Netherlands.
Harris, J.H., "The normal cervical spine" (1987). (Web-link: http://rapidshare.comffiles/213791249/TheNormalCervicalSpine.pdf.html).
Joskowicz L et al: "Long Bone Panoramas From Fluoroscopic X-Ray Images", IEEE Transactions on Medical Imaging, IEEE Service Center, Piscataway, NJ, US, vol. 23, No. 1, Jan. 1, 2004, pp. 26-35, XP011104510, ISSN: 0278-0062, DOI: D01:10.1109/TMI.2003.819931.
Kass, et al., "Snakes: Active Contour Models", 1988, pp. 321-331. The Netherlands.
Lee, et al., "Image Morphing Using Deformation Techniques", 1996, pp. 3-23, Korea.
Long, et al., "Segmentation and feature extraction of cervical spine x-ray images", 1999, pp. 1037-1046, USA.
Lum, et al., "Cominging Classifiers for Bone Fracture Detection in X-ray Images", 2005, pp. 1149-1152, Singapore.
Maintz, et al.; "A Survey of Medical Image Registration"; 1998; pp. 1-37; pp. 1-3, 7-142; The Netherlands.
Maintz, et al.; "An Overview of Medical Image Registration Methods"; 1998; pp. 1-22; The Netherlands.
Parkinson, et al., "Methodological principles for factual analysis of trabecular bone", 2000, pp. 134-142, Australia.
PCT International Search Report issued in PCT Application PCT/IL2008/000841, dated Nov. 3, 2008 (3 pages).
Peter Messmer et al: "Image Fusion for Intraoperative Control of Axis in Long Bone Fracture Treatment", European Journal of Trauma, Urban & Vogel, MU, vol. 32, No. 6, Dec. 1, 2006, pp. 555-561, XP019462173, ISSN: 1615-3146, DOI: DOI:10.1007/S00068-006-5159-5.
Russakoff, et al., "Fast Intensity-based 2D-3D Image Registration of Clinical Data Using Light Fields", 2003, pp. 1-7, USA.
Segonne, Florent, "Segmentation of Medical Images underTopological Constraints", 2005, USA.
Seraets, et al., "The Radiographic Trabecular Pattern of Hips in Patients With Hip Fractures and in Elderly Control Subjects", 1998, pp. 165-173, The Netherlands.
Zitova, et al., "Image registration methods: a survey", 2003, pp. 977-1000, Czech Republic.

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11631174B2 (en) 2006-11-10 2023-04-18 Covidien Lp Adaptive navigation technique for navigating a catheter through a body channel or cavity
US10070903B2 (en) 2008-01-09 2018-09-11 Stryker European Holdings I, Llc Stereotactic computer assisted surgery method and system
US10105168B2 (en) 2008-01-09 2018-10-23 Stryker European Holdings I, Llc Stereotactic computer assisted surgery based on three-dimensional visualization
US11642155B2 (en) 2008-01-09 2023-05-09 Stryker European Operations Holdings Llc Stereotactic computer assisted surgery method and system
US11783498B2 (en) 2008-06-03 2023-10-10 Covidien Lp Feature-based registration method
US11931141B2 (en) 2008-06-06 2024-03-19 Covidien Lp Hybrid registration method
US10588647B2 (en) 2010-03-01 2020-03-17 Stryker European Holdings I, Llc Computer assisted surgery system
US11844635B2 (en) 2014-07-02 2023-12-19 Covidien Lp Alignment CT
US11484276B2 (en) 2014-07-02 2022-11-01 Covidien Lp Alignment CT
US11798178B2 (en) 2014-07-02 2023-10-24 Covidien Lp Fluoroscopic pose estimation
US11871913B2 (en) 2014-10-31 2024-01-16 Covidien Lp Computed tomography enhanced fluoroscopic system, device, and method of utilizing the same
US11559266B2 (en) 2015-08-06 2023-01-24 Covidien Lp System and method for local three dimensional volume reconstruction using a standard fluoroscope
US11547377B2 (en) 2015-08-06 2023-01-10 Covidien Lp System and method for navigating to target and performing procedure on target utilizing fluoroscopic-based local three dimensional volume reconstruction
US11707241B2 (en) 2015-08-06 2023-07-25 Covidien Lp System and method for local three dimensional volume reconstruction using a standard fluoroscope
US10201320B2 (en) 2015-12-18 2019-02-12 OrthoGrid Systems, Inc Deformed grid based intra-operative system and method of use
US11386556B2 (en) 2015-12-18 2022-07-12 Orthogrid Systems Holdings, Llc Deformed grid based intra-operative system and method of use
US10052170B2 (en) 2015-12-18 2018-08-21 MediLux Capitol Holdings, S.A.R.L. Mixed reality imaging system, apparatus and surgical suite
US10010372B1 (en) * 2016-01-06 2018-07-03 Paul Beck Marker Positioning Apparatus
US10149724B2 (en) 2016-01-06 2018-12-11 Paul Beck Accurate radiographic calibration using multiple images
US10610325B2 (en) 2017-02-16 2020-04-07 Canon U.S.A., Inc. Medical guidance apparatus
US10675099B2 (en) 2017-09-22 2020-06-09 Canon U.S.A., Inc. Needle insertion guide device and system, and method of providing control guidance for needle insertion guide device
US11197723B2 (en) 2017-10-09 2021-12-14 Canon U.S.A., Inc. Medical guidance system and method using localized insertion plane
US11564649B2 (en) 2017-10-10 2023-01-31 Covidien Lp System and method for identifying and marking a target in a fluoroscopic three-dimensional reconstruction
US11464585B2 (en) 2017-12-11 2022-10-11 Hologic, Inc. Ultrasound localization system with advanced biopsy site markers
US11432883B2 (en) 2017-12-11 2022-09-06 Hologic, Inc. Ultrasound localization system with advanced biopsy site markers
US11234772B2 (en) 2017-12-11 2022-02-01 Hologic, Inc. Ultrasound localization system with advanced biopsy site markers
US11937886B2 (en) 2017-12-11 2024-03-26 Hologic, Inc. Ultrasound localization system with advanced biopsy site markers
WO2019118501A3 (en) * 2017-12-11 2019-08-15 Hologic, Inc. Ultrasound localization system with advanced biopsy site markers
US11712213B2 (en) 2018-02-08 2023-08-01 Covidien Lp System and method for pose estimation of an imaging device and for determining the location of a medical device with respect to a target
US11857276B2 (en) 2018-02-09 2024-01-02 Covidien Lp System and method for displaying an alignment CT
US11464576B2 (en) 2018-02-09 2022-10-11 Covidien Lp System and method for displaying an alignment CT
US11617621B2 (en) 2018-08-03 2023-04-04 Canon U.S.A., Inc. System and method for multi-probe guidance
US11642159B2 (en) 2018-08-15 2023-05-09 Canon U.S.A., Inc. Medical tool guidance apparatus
US11883219B2 (en) 2018-09-12 2024-01-30 Orthogrid Systems Holdings, Llc Artificial intelligence intra-operative surgical guidance system and method of use
US11540794B2 (en) 2018-09-12 2023-01-03 Orthogrid Systesm Holdings, LLC Artificial intelligence intra-operative surgical guidance system and method of use
US11589928B2 (en) 2018-09-12 2023-02-28 Orthogrid Systems Holdings, Llc Artificial intelligence intra-operative surgical guidance system and method of use
US11937888B2 (en) 2018-09-12 2024-03-26 Orthogrid Systems Holding, LLC Artificial intelligence intra-operative surgical guidance system
US10973590B2 (en) 2018-09-12 2021-04-13 OrthoGrid Systems, Inc Artificial intelligence intra-operative surgical guidance system and method of use
US11925333B2 (en) 2019-02-01 2024-03-12 Covidien Lp System for fluoroscopic tracking of a catheter to update the relative position of a target and the catheter in a 3D model of a luminal network
US11864935B2 (en) 2019-09-09 2024-01-09 Covidien Lp Systems and methods for pose estimation of a fluoroscopic imaging device and for three-dimensional imaging of body structures
US11931111B2 (en) 2019-09-09 2024-03-19 Covidien Lp Systems and methods for providing surgical guidance
US11847730B2 (en) 2020-01-24 2023-12-19 Covidien Lp Orientation detection in fluoroscopic images
US11928834B2 (en) 2021-05-24 2024-03-12 Stryker Corporation Systems and methods for generating three-dimensional measurements using endoscopic video data
US11950951B2 (en) 2022-01-13 2024-04-09 Covidien Lp Systems and methods for C-arm fluoroscope camera pose refinement with secondary movement compensation

Also Published As

Publication number Publication date
CN101779223A (en) 2010-07-14
US20140180064A1 (en) 2014-06-26
EP2179397A1 (en) 2010-04-28
EP2179397B1 (en) 2014-08-20
US8611697B2 (en) 2013-12-17
CN101779223B (en) 2013-12-18
IL184151A0 (en) 2007-10-31
US20210038176A1 (en) 2021-02-11
WO2008155772A1 (en) 2008-12-24
EP2779096A1 (en) 2014-09-17
US20170128027A1 (en) 2017-05-11
US20100246923A1 (en) 2010-09-30

Similar Documents

Publication Publication Date Title
US20210038176A1 (en) System for measuring the true dimensions and orientation of objects in a two dimensional image
US6718194B2 (en) Computer assisted intramedullary rod surgery system with enhanced features
US9655682B2 (en) Visualization guided ACL localization system
US6477400B1 (en) Fluoroscopic image guided orthopaedic surgery system with intraoperative registration
US5772594A (en) Fluoroscopic image guided orthopaedic surgery system with intraoperative registration
JP5121401B2 (en) System for distance measurement of buried plant
US20020077540A1 (en) Enhanced graphic features for computer assisted surgery system
JP2023532066A (en) A system for assisting a user in placing a penetrating device within tissue
US20080281330A1 (en) Medical Securing Member Placement System
JP5564003B2 (en) Computer-assisted surgery system
JP4510415B2 (en) Computer-aided display method for 3D objects
ES2425378T3 (en) Computer-assisted surgical system
US20120281809A1 (en) Indicator unit
Santos-Munné et al. Fluorotactic Surgery using Coordinated Fluoroscopy

Legal Events

Date Code Title Description
AS Assignment

Owner name: SURGIX LTD., ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NATHANIEL, RAM;RAPPAPORT, DAN;DRORI, OREN;REEL/FRAME:033183/0169

Effective date: 20100525

AS Assignment

Owner name: ORTHOPEDIC NAVIGATION LTD., ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SURGIX LTD.;REEL/FRAME:033683/0618

Effective date: 20140703

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

FEPP Fee payment procedure

Free format text: SURCHARGE FOR LATE PAYMENT, SMALL ENTITY (ORIGINAL EVENT CODE: M2554); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4