WO2005073917A3 - Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images - Google Patents

Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images Download PDF

Info

Publication number
WO2005073917A3
WO2005073917A3 PCT/US2005/001357 US2005001357W WO2005073917A3 WO 2005073917 A3 WO2005073917 A3 WO 2005073917A3 US 2005001357 W US2005001357 W US 2005001357W WO 2005073917 A3 WO2005073917 A3 WO 2005073917A3
Authority
WO
WIPO (PCT)
Prior art keywords
operative
dimensional images
inter
target feature
skeletal
Prior art date
Application number
PCT/US2005/001357
Other languages
French (fr)
Other versions
WO2005073917A2 (en
Inventor
Hari Sundar
Chenyang Xu
Frank Sauer
Original Assignee
Siemens Corp Res Inc
Hari Sundar
Chenyang Xu
Frank Sauer
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Corp Res Inc, Hari Sundar, Chenyang Xu, Frank Sauer filed Critical Siemens Corp Res Inc
Priority to EP05705777A priority Critical patent/EP1709588A2/en
Priority to JP2006551180A priority patent/JP4490442B2/en
Publication of WO2005073917A2 publication Critical patent/WO2005073917A2/en
Publication of WO2005073917A3 publication Critical patent/WO2005073917A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38—Registration of image sequences
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G06T2207/10121—Fluoroscopy
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20072—Graph-based image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular

Abstract

A system and method for registering a sequence of inter-operative two dimensional (2D) medical images of a target feature with pre-operative three dimensional (3D) medical images of the target feature is disclosed. The 3D image of the target feature is converted to a first skeletal graph. The 2D image of the target feature is converted to a second skeletal graph. Graph matching of the first and second skeletal graphs is performed to obtain a rough alignment of the graphs, and the first and second skeletal graph registered.
PCT/US2005/001357 2004-01-21 2005-01-18 Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images WO2005073917A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP05705777A EP1709588A2 (en) 2004-01-21 2005-01-18 Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images
JP2006551180A JP4490442B2 (en) 2004-01-21 2005-01-18 Method and system for affine superposition of an intraoperative 2D image and a preoperative 3D image

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US53782004P 2004-01-21 2004-01-21
US60/537,820 2004-01-21
US11/036,528 US7450743B2 (en) 2004-01-21 2005-01-14 Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images
US11/036,528 2005-01-14

Publications (2)

Publication Number Publication Date
WO2005073917A2 WO2005073917A2 (en) 2005-08-11
WO2005073917A3 true WO2005073917A3 (en) 2006-04-27

Family

ID=34829722

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/001357 WO2005073917A2 (en) 2004-01-21 2005-01-18 Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images

Country Status (4)

Country Link
US (1) US7450743B2 (en)
EP (1) EP1709588A2 (en)
JP (1) JP4490442B2 (en)
WO (1) WO2005073917A2 (en)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8768446B2 (en) * 2004-11-02 2014-07-01 Medtronic, Inc. Clustering with combined physiological signals
US10201305B2 (en) * 2004-11-02 2019-02-12 Medtronic, Inc. Apparatus for data retention in an implantable medical device
US8024029B2 (en) * 2004-11-02 2011-09-20 Medtronic, Inc. Techniques for user-activated data retention in an implantable medical device
US7917199B2 (en) 2004-11-02 2011-03-29 Medtronic, Inc. Patient event marking in combination with physiological signals
JP2008520312A (en) * 2004-11-23 2008-06-19 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Image processing system and method for image display during intervention procedures
JP5270365B2 (en) * 2005-12-15 2013-08-21 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ System and method for cardiac morphology visualization during electrophysiological mapping and treatment
US7412023B2 (en) * 2006-02-28 2008-08-12 Toshiba Medical Systems Corporation X-ray diagnostic apparatus
US20100061603A1 (en) * 2006-06-28 2010-03-11 Koninklijke Philips Electronics N.V. Spatially varying 2d image processing based on 3d image data
US20080275467A1 (en) * 2007-05-02 2008-11-06 Siemens Corporate Research, Inc. Intraoperative guidance for endovascular interventions via three-dimensional path planning, x-ray fluoroscopy, and image overlay
WO2009045368A1 (en) * 2007-09-28 2009-04-09 Johns Hopkins University Combined multi-detector ct angiography and ct myocardial perfusion imaging for the diagnosis of coronary artery disease
DE102007052123A1 (en) * 2007-10-31 2009-05-14 Siemens Ag Fusion image producing method, involves making registration of two-dimensional and three-dimensional image acquisition together in dependence of center line determined for acquisitions in context of production of fusion image
US20090287066A1 (en) * 2008-05-19 2009-11-19 Oliver Meissner Method for minimally invasive medical intervention
RU2520369C2 (en) * 2008-06-25 2014-06-27 Конинклейке Филипс Электроникс Н.В. Device and method for localising object of interest in subject
KR100985035B1 (en) * 2008-10-14 2010-10-05 한국과학기술연구원 Motion Tracking Method Using Scanning Device
US8494243B2 (en) * 2009-07-29 2013-07-23 Siemens Aktiengesellschaft Deformable 2D-3D registration of structure
CN102713976B (en) * 2010-01-12 2017-05-24 皇家飞利浦电子股份有限公司 Navigating an interventional device
US8526700B2 (en) * 2010-10-06 2013-09-03 Robert E. Isaacs Imaging system and method for surgical and interventional medical procedures
US11231787B2 (en) 2010-10-06 2022-01-25 Nuvasive, Inc. Imaging system and method for use in surgical and interventional medical procedures
US8768029B2 (en) * 2010-10-20 2014-07-01 Medtronic Navigation, Inc. Selected image acquisition technique to optimize patient model construction
US9717478B2 (en) * 2010-12-27 2017-08-01 St. Jude Medical, Atrial Fibrillation Division, Inc. Refinement of an anatomical model using ultrasound
DE102011080588A1 (en) * 2011-08-08 2013-02-14 Siemens Aktiengesellschaft Method for registering three-dimensional image data set of e.g. abdominal aorta in medical imaging, involves performing fine registration of 3D image data set of aorta and overlaying model of aorta with non-aorta
US9582896B2 (en) 2011-09-02 2017-02-28 Qualcomm Incorporated Line tracking with automatic model initialization by graph matching and cycle detection
US8948487B2 (en) * 2011-09-28 2015-02-03 Siemens Aktiengesellschaft Non-rigid 2D/3D registration of coronary artery models with live fluoroscopy images
US9510771B1 (en) 2011-10-28 2016-12-06 Nuvasive, Inc. Systems and methods for performing spine surgery
KR101768526B1 (en) 2012-07-27 2017-08-17 삼성전자주식회사 Method and apparatus for creating model of patient specified target organ based on blood vessel structure
US10089744B2 (en) * 2013-04-03 2018-10-02 Koninklijke Philips N.V. Vessel segmentation
US11690676B2 (en) 2013-05-31 2023-07-04 Koninklijke Philips N.V. Assisting apparatus for assisting a user during an interventional procedure
US9848922B2 (en) 2013-10-09 2017-12-26 Nuvasive, Inc. Systems and methods for performing spine surgery
US10314656B2 (en) 2014-02-04 2019-06-11 Intuitive Surgical Operations, Inc. Systems and methods for non-rigid deformation of tissue for virtual navigation of interventional tools
JP6481269B2 (en) * 2014-07-01 2019-03-13 富士通株式会社 Output control method, image processing apparatus, output control program, and information processing apparatus
US9478048B2 (en) * 2014-07-02 2016-10-25 Siemens Medical Solutions Usa, Inc. Prior image based three dimensional imaging
US9521988B2 (en) * 2015-02-17 2016-12-20 Siemens Healthcare Gmbh Vessel tree tracking in angiography videos
US10349909B2 (en) * 2015-06-30 2019-07-16 General Electric Company Systems and methods for flow rate compensated acquisition parameters for medical imaging
EP3328280B1 (en) * 2015-07-27 2019-03-20 Koninklijke Philips N.V. Revascularisation localisation and pre and post quantitative coronary angiography
JP7118890B2 (en) 2016-02-12 2022-08-16 インテュイティブ サージカル オペレーションズ， インコーポレイテッド Systems and methods for using registered fluoroscopic images in image-guided surgery
CN108078628A (en) * 2016-12-02 2018-05-29 王健 The robot space-location method of view-based access control model error compensation
JP6885896B2 (en) * 2017-04-10 2021-06-16 富士フイルム株式会社 Automatic layout device and automatic layout method and automatic layout program
WO2018191648A1 (en) 2017-04-14 2018-10-18 Yang Liu System and apparatus for co-registration and correlation between multi-modal imagery and method for same
CN112912005A (en) 2018-10-24 2021-06-04 西门子医疗有限公司 Generating medical result images
US11710249B2 (en) 2019-12-20 2023-07-25 Unify Medical, Inc. Generation of three-dimensional scans for intraoperative imaging
KR102350998B1 (en) 2020-03-04 2022-01-14 숭실대학교 산학협력단 Method of non-rigid registration for multi-modality based on features of blood vessel, recording medium and device for performing the method
WO2021242932A1 (en) 2020-05-26 2021-12-02 Unify Medical Generation of three-dimensional images with digital magnification

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5930329A (en) * 1997-09-22 1999-07-27 Siemens Corporate Research, Inc. Apparatus and method for detection and localization of a biopsy needle or similar surgical tool in a radiographic image
US7646903B2 (en) * 2005-06-22 2010-01-12 Siemens Medical Solutions Usa, Inc. System and method for path based tree matching

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
BULLITT E ET AL: "Analysis of time-varying images using 3D vascular models", APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP, AIPR 2001 30TH WASHINGTON, DC, USA 10-12 OCT. 2001, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 10 October 2001 (2001-10-10), pages 9 - 14, XP010584335, ISBN: 0-7695-1245-3 *
CHALOPIN C ET AL: "Automatic labeling of the coronary tree using a three dimensional reference prior model", COMPUTERS IN CARDIOLOGY 1998 CLEVELAND, OH, USA 13-16 SEPT. 1998, NEW YORK, NY, USA,IEEE, US, 13 September 1998 (1998-09-13), pages 761 - 764, XP010314230, ISBN: 0-7803-5200-9 *
CHALOPIN C ET AL: "Modeling the 3D coronary tree for labeling purposes.", MEDICAL IMAGE ANALYSIS. DEC 2001, vol. 5, no. 4, December 2001 (2001-12-01), pages 301 - 315, XP002368657, ISSN: 1361-8415 *
HARIS K ET AL: "Model-based morphological segmentation and labeling of coronary angiograms", IEEE TRANSACTIONS ON MEDICAL IMAGING IEEE USA, vol. 18, no. 10, October 1999 (1999-10-01), pages 1003 - 1015, XP011035902, ISSN: 0278-0062 *
LIU A ET AL: "3D/2D registration via skeletal near projective invariance in tubular objects", MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI'98. FIRST INTERNATIONAL CONFERENCE. PROCEEDINGS SPRINGER-VERLAG BERLIN, GERMANY, 1998, pages 952 - 963, XP002368656, ISBN: 3-540-65136-5 *

Also Published As

Publication number Publication date
US20050203385A1 (en) 2005-09-15
WO2005073917A2 (en) 2005-08-11
JP2007520280A (en) 2007-07-26
US7450743B2 (en) 2008-11-11
EP1709588A2 (en) 2006-10-11
JP4490442B2 (en) 2010-06-23

Similar Documents

Publication Publication Date Title
WO2005073917A3 (en) Method and system of affine registration of inter-operative two dimensional images and pre-operative three dimensional images
CN106780618B (en) Three-dimensional information acquisition method and device based on heterogeneous depth camera
WO2011143073A3 (en) Method, system, and apparatus for pressure image registration
CN103810685B (en) A kind of super-resolution processing method of depth map
WO2008136966A3 (en) Registration of medical images using learned-based matching functions
EP1879148A3 (en) Fusion of sensor data and synthetic data to form an integrated image
WO2005122063A3 (en) Image registration system and method
WO2006064400A3 (en) Registration of multi-modality images
WO2002041780A3 (en) 3d planning target volume
US9824443B2 (en) Image processing device, image processing method, and program
WO2001069535A3 (en) Method and apparatus for performing geo-spatial registration of imagery
WO2008155770A3 (en) Distance-varying illumination and imaging techniques for depth mapping
WO2007032940A3 (en) System and methods for generating three-dimensional images from two-dimensional bioluminescence images and visualizing tumor shapes and locations
EP1241898A3 (en) Method for generating panoramic images from a plurality of images
WO2009081297A3 (en) Features-based 2d/3d image registration
WO2010133982A3 (en) Marker-free tracking registration and calibration for em-tracked endoscopic system
WO2007084267A3 (en) A method for rectifying stereoscopic display systems
WO2005086062A3 (en) Registration methods and apparatus
EP2660777A3 (en) Image registration of multimodal data using 3D geoarcs
WO2001004837A3 (en) Method and apparatus for detecting independent motion in three-dimensional scenes
WO2007037912A3 (en) Integrated spatial-temporal prediction
WO2005005381A3 (en) Multi-mode internal imaging
WO2005025402A3 (en) Systems and methods for tracking moving targets and monitoring object positions
WO2008063494A3 (en) Apparatus and methods of compensating for organ deformation, registration of internal structures to images, and applications of same
EP1453026A3 (en) Three dimensional images

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2005705777

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006551180

Country of ref document: JP

Ref document number: 200580002997.3

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

WWP Wipo information: published in national office

Ref document number: 2005705777

Country of ref document: EP