US9095315B2 - Method and apparatus integrating clinical data with the review of medical images - Google Patents

Method and apparatus integrating clinical data with the review of medical images Download PDF

Info

Publication number
US9095315B2
US9095315B2 US13/836,666 US201313836666A US9095315B2 US 9095315 B2 US9095315 B2 US 9095315B2 US 201313836666 A US201313836666 A US 201313836666A US 9095315 B2 US9095315 B2 US 9095315B2
Authority
US
United States
Prior art keywords
patient
medical images
findings
visual representation
risk profile
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US13/836,666
Other versions
US20140140591A1 (en
Inventor
Ohad Arazi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
PF2 IP LLC
Change Healthcare Holdings LLC
Original Assignee
McKesson Financial Holdings ULC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by McKesson Financial Holdings ULC filed Critical McKesson Financial Holdings ULC
Priority to US13/836,666 priority Critical patent/US9095315B2/en
Assigned to MCKESSON FINANCIAL HOLDINGS reassignment MCKESSON FINANCIAL HOLDINGS ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ARAZI, OHAD
Publication of US20140140591A1 publication Critical patent/US20140140591A1/en
Priority to US14/816,723 priority patent/US20150339457A1/en
Application granted granted Critical
Publication of US9095315B2 publication Critical patent/US9095315B2/en
Assigned to MCKESSON FINANCIAL HOLDINGS UNLIMITED COMPANY reassignment MCKESSON FINANCIAL HOLDINGS UNLIMITED COMPANY CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: MCKESSON FINANCIAL HOLDINGS
Assigned to MCKESSON CORPORATION reassignment MCKESSON CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MCKESSON FINANCIAL HOLDINGS UNLIMITED COMPANY
Assigned to BANK OF AMERICA, N.A., AS COLLATERAL AGENT reassignment BANK OF AMERICA, N.A., AS COLLATERAL AGENT SECURITY AGREEMENT Assignors: ALTEGRA HEALTH OPERATING COMPANY LLC, CHANGE HEALTHCARE HOLDINGS, INC., CHANGE HEALTHCARE HOLDINGS, LLC, CHANGE HEALTHCARE OPERATIONS, LLC, CHANGE HEALTHCARE SOLUTIONS, LLC, Change Healthcare, Inc., MCKESSON TECHNOLOGIES LLC
Assigned to PF2 IP LLC reassignment PF2 IP LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MCKESSON CORPORATION
Assigned to CHANGE HEALTHCARE LLC reassignment CHANGE HEALTHCARE LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PF2 IP LLC
Assigned to CHANGE HEALTHCARE LLC reassignment CHANGE HEALTHCARE LLC CHANGE OF ADDRESS Assignors: CHANGE HEALTHCARE LLC
Assigned to CHANGE HEALTHCARE HOLDINGS, LLC reassignment CHANGE HEALTHCARE HOLDINGS, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHANGE HEALTHCARE LLC
Assigned to CHANGE HEALTHCARE OPERATIONS, LLC, CHANGE HEALTHCARE SOLUTIONS, LLC, CHANGE HEALTHCARE HOLDINGS, INC., CHANGE HEALTHCARE HOLDINGS, LLC, CHANGE HEALTHCARE PERFORMANCE, INC. (FORMERLY KNOWN AS CHANGE HEALTHCARE, INC.), CHANGE HEALTHCARE RESOURCES, LLC (FORMERLY KNOWN AS ALTEGRA HEALTH OPERATING COMPANY LLC), CHANGE HEALTHCARE TECHNOLOGIES, LLC (FORMERLY KNOWN AS MCKESSON TECHNOLOGIES LLC) reassignment CHANGE HEALTHCARE OPERATIONS, LLC RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: BANK OF AMERICA, N.A.
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271Specific aspects of physiological measurement analysis
    • A61B5/7275Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/7425Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/52Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5294Devices using data or image processing specially adapted for radiation diagnosis involving using additional data, e.g. patient information, image labeling, acquisition parameters
    • G06F19/321
    • G06F19/3431
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/743Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/744Displaying an avatar, e.g. an animated cartoon character
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/46Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment with special arrangements for interfacing with the operator or the patient
    • A61B6/461Displaying means of special interest
    • A61B6/463Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images

Definitions

  • An example embodiment of the present invention relates generally to the presentation and review of medical images and, more particularly, to the concurrent presentation of both medical images of a patient and a visual representation of clinical data of the patient.
  • Medical imaging often includes creating images of regions of the human body for clinical purposes such as examination, diagnosis and/or treatment. These images may be acquired by a number of different imaging modalities including, for example, ultrasound (US), magnetic resonance (MR), positron emission tomography (PET), computed tomography (CT), mammograms (MG), digital radiology (DR), computed radiology (CR) or the like.
  • US ultrasound
  • MR magnetic resonance
  • PET positron emission tomography
  • CT computed tomography
  • MG mammograms
  • DR digital radiology
  • CR computed radiology
  • an image study for a patient may include one or more acquired images of the patient.
  • a radiologist or other health care provider may review the images for diagnostic or other purposes.
  • clinical data In addition to medical images, a wide variety of other clinical data may be associated with a patient. Typically, the other clinical data associated with the patient has not been provided to the radiologist reviewing the medical images and, instead, the radiologist just received an order requisition. In this regard, the clinical data was generally handwritten or otherwise documented in hard copy and was not readily accessible to a radiologist.
  • an electronic medical record including an electronic health summary report, often fails to include information that may be pertinent to the interpretation of the patient's medical images and/or presents the data in a text-based summary, which would require the radiologist who is reviewing the medical images of the patient to divert their attention from the medical images and to take time to parse and read the text-based summary.
  • data from an electronic medical record if available, may be presented by another system, outside of the PACS, so as to further distract the radiologist from the review of the patient's medical images.
  • the Caradigm Amalga system permits diagnostic users, such as radiologists, to correlate medical images with clinical data.
  • the Caradigm Amalga system may permit a patient's white blood cell count to be presented along with all PET CT medical images, but not to show the patient's hemoglobin levels in conjunction with x-rays of the patient's knee.
  • the Caradigm Amalga system presents clinical data in a text-based syntax-driven report in a system outside of the PACS, thereby creating inefficiencies for the radiologist who is studying the medical images of the patient and must divert their attention from the PACS in order to review the text-based report.
  • a method, apparatus and computer program product are provided in accordance with one embodiment of the present invention in order to integrate clinical data with the medical images reviewed by radiologists or other healthcare providers.
  • the method, apparatus, and computer program product of an example embodiment may provide information regarding one or more findings related to a respective risk profile of a patient, which may inform the interpretation of the medical images.
  • the method, apparatus and computer program product of an example embodiment may provide the clinical data in a manner that is easy to interpret and, in one embodiment, is presented by a PACS, thereby allowing a radiologist or other healthcare provider who is reviewing the medical images to consider the clinical data without diverting their attention from the review of the medical images.
  • the method, apparatus and computer program product of an example embodiment may improve the efficiency with which medical images are reviewed.
  • a method in one embodiment, includes identifying, with processing circuitry, one or more findings related to a respective risk profile of a patient.
  • the method of this embodiment also includes concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings.
  • the method also includes providing information regarding a respective finding upon selection of the visual indication associated with the respective finding.
  • an apparatus in another embodiment, includes processing circuitry configured to identify one or more findings related to a respective risk profile of a patient.
  • the processing circuitry of this embodiment is also configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings.
  • the processing circuitry is further configured in accordance with this embodiment to provide information regarding a respective finding upon selection of the visual indication associated with the respective finding.
  • a computer program product includes at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein.
  • the computer-executable program code instructions include program code instructions configured to identify one or more findings related to a respective risk profile of a patient.
  • the computer-executable program code instructions of this embodiment also include program code instructions configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings.
  • the computer-executable program code instructions of this embodiment also include program code instructions configured to provide information regarding a respective finding upon selection of the visual indication associated with the respective finding.
  • an apparatus in yet another embodiment, includes means for identifying one or more findings related to a respective risk profile of a patient.
  • the apparatus of this embodiment also includes means for concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respective visual indications of the one or more findings.
  • the apparatus also includes means for providing information regarding a respective finding upon selection of the visual indication associated with the respective finding.
  • FIG. 1 is a block diagram of an apparatus that may be specifically configured in accordance with an example embodiment of the present invention
  • FIG. 2 is a flow chart illustrating operations performed, such as by the apparatus of FIG. 1 , in accordance with an example embodiment of the present invention
  • FIG. 3 is an example of the concurrent presentation of a plurality of medical images of a patient and a visual representation of the patient's body with respective visual indications of a plurality of findings related to a respective risk profile of the patient in accordance with an example embodiment of the present invention
  • FIG. 4 is another example of the concurrent presentation of a plurality of medical images of a patient and a visual representation of the patient's body from a prior point in time with a visual indication of a finding related to a dermatology report of the patient in accordance with an example embodiment of the present invention.
  • a method, apparatus and computer program product are provided in accordance with an example embodiment of the present invention in order to provide clinical data to a radiologist or other healthcare provider (hereinafter generically referred to as a “radiologist”) who is reviewing one or more medical images of a patient in order to facilitate the review of the medical images or the establishment of a protocol associated with the review of the medical images.
  • the clinical data may include one or more findings related to a respective risk profile of a patient.
  • the clinical data that is provided to the radiologist who is reviewing the medical images of the patient may be of particular relevance in regards to the interpretation or protocoling of the medical images, thereby potentially improving the review of the medical images and/or increasing the efficiency with which those medical images are reviewed.
  • the method, apparatus and computer program product of an example embodiment of the present invention may provide the clinical data in a manner that is intuitive and readily reviewable by a radiologist who is reviewing the medical images and, in one embodiment, may be provided in such a manner that the radiologist need not divert their attention from the diagnostic imaging system, such as the PACS.
  • the method, apparatus and computer program product of an example embodiment of the present invention may be embodied by a computing device.
  • a diagnostic imaging system such as a PACS
  • PACS includes or is otherwise associated with the computing device that embodies the method, apparatus and computer program product of an example embodiment of the present invention.
  • other types of computing devices may embody the method, apparatus and computer program product of an embodiment of the present invention.
  • the computing device may include or otherwise be associated with an apparatus 10 that may, in turn, be specifically configured in order to perform one or more operations in associated with an embodiment of the present invention.
  • the apparatus of one embodiment may include various means for performing the various functions described herein. These means may include, for example, one or more of a processing circuitry 12 , memory 14 , communication interface 16 and/or user interface 18 for performing the various functions herein described.
  • the means of the apparatus as described herein may be embodied as, for example, circuitry, hardware elements (e.g., a suitably programmed processor, combinational logic circuit, and/or the like), a computer program product comprising computer-readable program instructions (e.g., software or firmware) stored on a computer-readable medium (e.g. memory) that is executable by a suitably configured processing device (e.g., the processing circuitry), or some combination thereof.
  • a suitably configured processing device e.g., the processing circuitry
  • the processing circuitry 12 may, for example, be embodied as various means including one or more microprocessors, one or more coprocessors, one or more multi-core processors, one or more controllers, one or more computers, various other processing elements including integrated circuits such as, for example, an ASIC (application specific integrated circuit) or FPGA (field programmable gate array), or some combination thereof. Accordingly, although illustrated in FIG. 1 as a single processing circuitry, in some embodiments the processor may comprise a plurality of processing circuits. The plurality of processing circuits may be embodied on a single computing device or may be distributed across a plurality of computing devices collectively configured to function as the apparatus.
  • the plurality of processing circuits may be in operative communication with each other and may be collectively configured to perform one or more functionalities of the apparatus as described herein.
  • the processing circuitry is configured to execute instructions stored in the memory 14 or otherwise accessible to the processing circuitry. These instructions, when executed by the processing circuitry, may cause the apparatus 10 to perform one or more of the functionalities of the apparatus as described herein.
  • the processing circuitry may comprise an entity capable of performing operations according to embodiments of the present invention while configured accordingly.
  • the processing circuitry when the processing circuitry is embodied as an ASIC, FPGA or the like, the processing circuitry may comprise specifically configured hardware for conducting one or more operations described herein.
  • the processing circuitry is embodied as an executor of instructions, such as may be stored in the memory, the instructions may specifically configure the processing circuitry to perform one or more algorithms and operations described herein.
  • the memory 14 may include, for example, volatile and/or non-volatile memory. Although illustrated in FIG. 1 as a single memory, the memory may comprise a plurality of memories. The plurality of memories may be embodied on a single computing device or distributed across a plurality of computing devices.
  • the memory may comprise, for example, a hard disk, random access memory, cache memory, flash memory, an optical disc (e.g., a compact disc read only memory (CD-ROM), digital versatile disc read only memory (DVD-ROM), or the like), circuitry configured to store information, or some combination thereof.
  • the memory may comprise any non-transitory computer readable storage medium.
  • the memory may be configured to store information, data, applications, instructions, or the like for enabling the apparatus 10 to carry out various functions in accordance with example embodiments of the present invention.
  • the memory is configured to buffer input data for processing by the processing circuitry 12 .
  • the memory is configured to store program instructions for execution by the processing device.
  • the communication interface 16 may be embodied as any device or means embodied in circuitry, hardware, a computer program product comprising computer readable program instructions stored on a computer readable medium (e.g., the memory 14 ) and executed by the processing circuitry 12 , or a combination thereof that is configured to receive and/or transmit data from/to another device, such as, for example, a data storage device or other archive for storing electronic medical records.
  • the communication interface is at least partially embodied as or otherwise controlled by the processing circuitry.
  • the communication interface may be in communication with the processing circuitry, such as via a bus.
  • the communication interface may provide for communications via a wireline connection or may support wireless communications in which the communication interface may include, for example, an antenna, a transmitter, a receiver, a transceiver and/or supporting hardware or software for enabling communications.
  • the communication interface may be configured to receive and/or transmit data using any protocol that may be used for communications between computing devices.
  • the communication interface may be configured to receive and/or transmit data using any protocol and/or communications technology that may be used for communicating with the other devices.
  • the communication interface may additionally be in communication with the memory and/or user interface 18 , such as via a bus.
  • the user interface 18 may be in communication with the processing circuitry 12 to receive an indication of a user input and/or to provide an audible, visual, mechanical, or other output to a user.
  • the user interface may include, for example, a keyboard, a mouse, a joystick, a display, a touch screen display, a microphone, a speaker, and/or other input/output mechanisms.
  • the user interface may be in communication with the memory 14 and/or communication interface 16 , such as via a bus.
  • the apparatus may include means, such as the processing circuit 12 , for identifying one or more findings related to a respective risk profile of a patient. See block 22 .
  • various risk profiles may be established.
  • a first risk profile may be the profile of a patient who is at risk of having cancer
  • a second risk profile may be the profile of a patient who is at risk of having HIV
  • a third risk profile may be the profile of a patient who is at risk of having diabetes.
  • risk profiles may be predefined with each risk profile being helpful to a radiologist who is reviewing the medical images of a patient in regards to the interpretation or protocoling of the medical images.
  • knowledge of a risk profile of a patient may facilitate the review of the medical images by the radiologist, thereby providing for a more accurate and/or efficient review of the medical images.
  • the plurality of risk profiles predefined, but the subset of risk profiles that are relevant for a particular type of medical image may also be predefined, thereby tailoring the review and presentation of the clinical data based upon the type of imaging study to be conducted.
  • the method, apparatus and computer program product may determine if the clinical data associated with the patient is related to, is associated with or otherwise supports any one or more of the respective risk profiles, such as the risk profile(s) that are predefined to be relevant for a particular type of medical image.
  • the apparatus 10 may include means, such as a processing circuitry 12 , for reviewing the clinical data associated with the patient, such as by reviewing the electronic medical record of the patient, and identifying one or more findings related to a respective risk profile of the patient.
  • the review of the data from an electronic medical record may include the review of metadata which may facilitate the classification of the data.
  • the apparatus may review the clinical data, such as the electronic medical record, associated with a patient in various manners.
  • the apparatus may include means, such as the processing circuitry, for semantically analyzing data from the electronic medical record of the patient and, based upon the semantic analysis, identifying one or more findings related to the respective risk profile of the patient. See block 20 of FIG. 2 .
  • the plurality of risk profiles may be predefined.
  • the findings that will be considered to be related to a respective risk profile, a type of medical image and/or a purpose of the study may also be predefined in order to facilitate the review of the clinical data, such as the semantic analysis of data from the electronic medical record, in conjunction with the identification of one or more findings related to the respective risk profile.
  • MRI magnetic resonance image
  • data from the electronic medical record that relates to known histories of breast cancer within the patient's family may be disregarded.
  • data regarding a familial history of breast cancer may be considered as a relevant finding with respect to a cancer risk profile in regards to the interpretation of mammograms.
  • the apparatus 10 may also include means, such as the processing circuitry 12 , the user interface 18 or the like, for concurrently presenting both one or more medical images and a visual representation of the patient's body with respective visual indications of the one or more findings.
  • the medical images may be presented upon the display screen(s) of the PACS and the visual representation of the patient's body with respective visual indications of the findings related to respective risk profiles may be presented either upon the same display screen(s) or upon an auxiliary screen of the PACS, thereby facilitating the review of both the medical images and the visual representation of the patient's body without diverting the attention of the radiologist who is reviewing the medical images from the PACS.
  • the medical images and the visual representation of the patient's body with respective visual indications of the one or more findings may be presented in other manners in conjunction with other embodiments.
  • the findings may be presented in a manner that is intuitive and may be quickly reviewed by a radiologist who is reviewing the medical images so as not to divert the attention of the radiologist from the review of the medical images, while still providing relevant information in regards to the interpretation of protocoling of the medical images.
  • FIG. 3 depicts the concurrent presentation of a plurality of medical images as well as a visual representation of the patient's body with visual indications of a plurality of findings related to a cancer risk profile.
  • an example workflow of a radiologist may involve the radiologist initially accessing a previously un-read thoracic CT study from the PACS study list.
  • the medical images for the thoracic CT study may be displayed by the PACS workstation along with relevant prior images and scanned documents with the original order script, that is, the referral written by the ordering physician.
  • the PACS may also display a visual representation of the patient's body.
  • the visual representation of the patient's body may be highlighted in order to indicate that the patient satisfies a respective risk profile, such as by highlighting the visual representation of the patient's body in red to indicate that the patient satisfies the cancer risk profile.
  • the visual representation of the patient's body includes visual indications of the findings related to the cancer risk profile.
  • the visual indications are icons, such as the two triangles on the visual representation of the patient's chest.
  • Each visual representation may be provided in a manner that indicates the relevance or severity of the respective finding to the particular risk profile.
  • a radiologist or a group of users may predefine the relevance of a respective finding by assigning a weight to the respective finding.
  • the visual indications may be color-coded based upon relevance or severity and, in the illustrated embodiment, one icon on the visual representation of the patient's chest that is associated with a pathology report may be red so as to indicate particular relevance or severity, while the other icon that is associated with a radiology report may be yellow to indicate lesser relevance or severity.
  • a visual indication may be associated with the visual representation of the patient's leg with the visual indication associated with the patient's leg being associated with a dermatology report and indicated to be of lesser relevance or severity.
  • the apparatus 10 may also include means, such as the processing circuitry 12 , the user interface 18 or the like, for providing information regarding a respective finding upon selection of the visual indication associated with the respective finding.
  • a radiologist may select one or more of the visual indications in order to cause information associated with the respective finding to be provided, such as by being presented upon the display.
  • selection of the icon associated with the pathology report may provide information indicating that the pathology report relates to a biopsy performed six months ago that indicated the presence of a malignant tumor.
  • selection of the icon associated with the radiology report may cause information to be provided that indicates that a prior chest x-ray was obtained nine months ago.
  • a link to the prior chest x-ray may be provided in order to permit the radiologist to efficiently access the prior chest x-ray.
  • the chest x-ray may be pulled up and displayed by the PACS workstation as a comparison study.
  • the chest x-ray may include annotations around a small nodule with the prior report associated with the prior chest x-ray including an impression of “possible pulmonary calcification, cannot rule out indications of small cell lung carcinoma-biopsy recommended.”
  • selection of the icon associated with the dermatology report may provide information indicating that the patient has an open referral to a dermatologist to comment upon a large sun spot.
  • the relevance or severity of a finding may be indicated by the color coding described above, the relevance or severity of a finding may be indicated in other manners, such as by the manner, e.g., the size, in which the information regarding a respective finding is presented. As shown in FIG. 3 , for example, the information relating to the dermatology report is shown to be smaller than the information relating to the other reports since the dermatology report may be of lesser relevance since the sun spot has not grown since the original report in 2009 such that the likelihood that the sun spot is evidence of melanoma has been materially decreased.
  • the radiologist who is reviewing the medical images of the patient may interpret the medical images in a more informed manner.
  • the radiologist may compare the annotated nodule from the prior chest x-ray to the newly acquired CT images that are presented by the PACS workstation and may report that the nodule does not appear to have grown in size or altered dimensions since the prior report.
  • the radiologist of this example workflow may also observe a very minute mass in close proximity to the annotated nodule and may report that “given known smoking history and previous pathological findings, recommend biopsy of otherwise unremarkable mass”.
  • the radiologist may recommend a biopsy of a very minute mass that is otherwise unremarkable and which may generally have not caused the radiologist to recommend any further action.
  • a radiologist reviewing a chest x-ray who has been made aware of the patient's history with colon cancer through the findings associated with the patient's risk profile may flag any minor mass in the lungs as a potential pulmonary nodule, instead of dismissing the minor mass as calcification as might otherwise have happened in the absence of the clinical data.
  • access to information regarding the findings related to the respective risk profile may improve the efficiency with which a radiologist may review the medical images by eliminating any need for the radiologist to contact the ordering physician.
  • the information associated with findings related to a respective risk profile may permit a radiologist who is reviewing the medical images of the patient to quickly navigate through the relevant clinical data of the patient, such as prior examination report.
  • the presentation of the visual representation of the patient's body with visual indications of one or more findings may be associated with a respective point in time.
  • the apparatus 10 of this embodiment may also include means, such as the processing circuitry 12 , the user interface 18 or the like, for receiving user input that identifies the point in time for which the visual representation of the patient's body with visual indications of one or more findings should be presented.
  • a representation of a timeline may be provided with a mechanism, such as the slider in the illustrated embodiment, to permit a user to select a point in time.
  • the resulting presentation of the visual representation of the patient's body may include visual indications for only those findings that existed as of the selected point in time with the relevance or severity being indicated in a manner consistent with the relevance or severity of the respective finding at the selected point in time.
  • FIG. 3 includes visual representations for three findings since all three findings were obtained prior to 2013 with the information associated with the dermatology report being indicated to be of lesser relevance or severity than the other reports since the sun spot has been determined not to have grown since its initial identification in 2009.
  • FIG. 4 includes a visual representation of only a single finding, that is, the pathology report, since the other two reports were not generated until after 2010. Additionally, the information associated with the dermatology report is indicated to be of greater relevance or severity in FIG.
  • FIG. 2 illustrates a flowchart of a system, method, and computer program product according to example embodiments of the invention. It will be understood that each block of the flowchart, and combinations of blocks in the flowchart, may be implemented by various means, such as hardware and/or a computer program product comprising one or more computer-readable mediums having computer readable program instructions stored thereon. For example, one or more of the procedures described herein may be embodied by computer program instructions of a computer program product.
  • the computer program product(s) which embody the procedures described herein may be stored by one or more memory devices of a computing device, e.g., a PACS, and executed by a processing circuitry 12 in the computing device.
  • the computer program instructions comprising the computer program product(s) which embody the procedures described above may be stored by memory devices of a plurality of computing devices.
  • any such computer program product may be loaded onto a computer or other programmable apparatus to produce a machine, such that the computer program product including the instructions which execute on the computer or other programmable apparatus creates means for implementing the functions specified in the flowchart block(s).
  • the computer program product may comprise one or more computer-readable memories on which the computer program instructions may be stored such that the one or more computer-readable memories can direct a computer or other programmable apparatus to function in a particular manner, such that the computer program product comprises an article of manufacture which implements the function specified in the flowchart block(s).
  • the computer program instructions of one or more computer program products may also be loaded onto a computer or other programmable apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus implement the functions specified in the flowchart block(s).
  • blocks or steps of the flowchart support combinations of means for performing the specified functions and combinations of steps for performing the specified functions. It will also be understood that one or more blocks of the flowchart, and combinations of blocks in the flowchart, may be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer program product(s).
  • a suitably configured processing circuitry 12 may provide all or a portion of the elements of the invention.
  • all or a portion of the elements of the invention may be configured by and operate under control of a computer program product.
  • the computer program product for performing the methods of embodiments of the invention includes a computer-readable storage medium, such as the non-volatile storage medium, and computer-readable program code portions, such as a series of computer instructions, embodied in the computer-readable storage medium.

Abstract

A method, apparatus and computer program product are provided in order to integrate clinical data with the medical images reviewed by radiologists or other healthcare providers. In the context of a method, one or more findings related to a respective risk profile of a patient are identified. The method also includes concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings. The method also includes providing information regarding a respective finding upon selection of the visual indication associated with the respective finding. A corresponding apparatus and computer program product are also provided.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
The present application claims priority from U.S. Provisional Patent Application No. 61/729,183 filed Nov. 21, 2012, the contents of which are incorporated herein in their entirety.
TECHNOLOGICAL FIELD
An example embodiment of the present invention relates generally to the presentation and review of medical images and, more particularly, to the concurrent presentation of both medical images of a patient and a visual representation of clinical data of the patient.
BACKGROUND
Medical imaging often includes creating images of regions of the human body for clinical purposes such as examination, diagnosis and/or treatment. These images may be acquired by a number of different imaging modalities including, for example, ultrasound (US), magnetic resonance (MR), positron emission tomography (PET), computed tomography (CT), mammograms (MG), digital radiology (DR), computed radiology (CR) or the like. In a number of example medical imaging workflows, such as in the case of a picture archiving and communication system (PACS), an image study for a patient may include one or more acquired images of the patient. A radiologist or other health care provider may review the images for diagnostic or other purposes.
In addition to medical images, a wide variety of other clinical data may be associated with a patient. Typically, the other clinical data associated with the patient has not been provided to the radiologist reviewing the medical images and, instead, the radiologist just received an order requisition. In this regard, the clinical data was generally handwritten or otherwise documented in hard copy and was not readily accessible to a radiologist.
Recently, electronic medical records have maintained clinical data in a digital form, but electronic medical records are not generally structured in a manner that is convenient for radiologists who are reviewing the medical images of a patient to review in parallel with the interpretation or protocoling of a patient's medical images. In this regard, an electronic medical record, including an electronic health summary report, often fails to include information that may be pertinent to the interpretation of the patient's medical images and/or presents the data in a text-based summary, which would require the radiologist who is reviewing the medical images of the patient to divert their attention from the medical images and to take time to parse and read the text-based summary. Additionally, data from an electronic medical record, if available, may be presented by another system, outside of the PACS, so as to further distract the radiologist from the review of the patient's medical images.
By way of example, the Caradigm Amalga system permits diagnostic users, such as radiologists, to correlate medical images with clinical data. The Caradigm Amalga system may permit a patient's white blood cell count to be presented along with all PET CT medical images, but not to show the patient's hemoglobin levels in conjunction with x-rays of the patient's knee. However, the Caradigm Amalga system presents clinical data in a text-based syntax-driven report in a system outside of the PACS, thereby creating inefficiencies for the radiologist who is studying the medical images of the patient and must divert their attention from the PACS in order to review the text-based report.
BRIEF SUMMARY
A method, apparatus and computer program product are provided in accordance with one embodiment of the present invention in order to integrate clinical data with the medical images reviewed by radiologists or other healthcare providers. In particular, the method, apparatus, and computer program product of an example embodiment may provide information regarding one or more findings related to a respective risk profile of a patient, which may inform the interpretation of the medical images. The method, apparatus and computer program product of an example embodiment may provide the clinical data in a manner that is easy to interpret and, in one embodiment, is presented by a PACS, thereby allowing a radiologist or other healthcare provider who is reviewing the medical images to consider the clinical data without diverting their attention from the review of the medical images. As such, the method, apparatus and computer program product of an example embodiment may improve the efficiency with which medical images are reviewed.
In one embodiment, a method is provided that includes identifying, with processing circuitry, one or more findings related to a respective risk profile of a patient. The method of this embodiment also includes concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings. In this embodiment, the method also includes providing information regarding a respective finding upon selection of the visual indication associated with the respective finding.
In another embodiment, an apparatus is provided that includes processing circuitry configured to identify one or more findings related to a respective risk profile of a patient. The processing circuitry of this embodiment is also configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings. The processing circuitry is further configured in accordance with this embodiment to provide information regarding a respective finding upon selection of the visual indication associated with the respective finding.
In a further embodiment, a computer program product is provided that includes at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein. The computer-executable program code instructions include program code instructions configured to identify one or more findings related to a respective risk profile of a patient. The computer-executable program code instructions of this embodiment also include program code instructions configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respect to visual indications of the one or more findings. The computer-executable program code instructions of this embodiment also include program code instructions configured to provide information regarding a respective finding upon selection of the visual indication associated with the respective finding.
In yet another embodiment, an apparatus is provided that includes means for identifying one or more findings related to a respective risk profile of a patient. The apparatus of this embodiment also includes means for concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body with respective visual indications of the one or more findings. In this embodiment, the apparatus also includes means for providing information regarding a respective finding upon selection of the visual indication associated with the respective finding.
BRIEF DESCRIPTION OF THE DRAWINGS
Having thus described embodiments of the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
FIG. 1 is a block diagram of an apparatus that may be specifically configured in accordance with an example embodiment of the present invention;
FIG. 2 is a flow chart illustrating operations performed, such as by the apparatus of FIG. 1, in accordance with an example embodiment of the present invention;
FIG. 3 is an example of the concurrent presentation of a plurality of medical images of a patient and a visual representation of the patient's body with respective visual indications of a plurality of findings related to a respective risk profile of the patient in accordance with an example embodiment of the present invention; and
FIG. 4 is another example of the concurrent presentation of a plurality of medical images of a patient and a visual representation of the patient's body from a prior point in time with a visual indication of a finding related to a dermatology report of the patient in accordance with an example embodiment of the present invention.
DETAILED DESCRIPTION
The present invention now will be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the inventions are shown. Indeed, these inventions may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Further, the apparatus and method of example embodiments of the present invention will be primarily described in conjunction with medical-imaging applications. It should be understood, however, that the apparatus and method may be utilized in conjunction with a variety of other applications, both in the medical industry and outside the medical industry. Like numbers refer to like elements throughout.
A method, apparatus and computer program product are provided in accordance with an example embodiment of the present invention in order to provide clinical data to a radiologist or other healthcare provider (hereinafter generically referred to as a “radiologist”) who is reviewing one or more medical images of a patient in order to facilitate the review of the medical images or the establishment of a protocol associated with the review of the medical images. In this regard, the clinical data may include one or more findings related to a respective risk profile of a patient. As such, the clinical data that is provided to the radiologist who is reviewing the medical images of the patient may be of particular relevance in regards to the interpretation or protocoling of the medical images, thereby potentially improving the review of the medical images and/or increasing the efficiency with which those medical images are reviewed. Additionally, the method, apparatus and computer program product of an example embodiment of the present invention may provide the clinical data in a manner that is intuitive and readily reviewable by a radiologist who is reviewing the medical images and, in one embodiment, may be provided in such a manner that the radiologist need not divert their attention from the diagnostic imaging system, such as the PACS.
The method, apparatus and computer program product of an example embodiment of the present invention may be embodied by a computing device. In one embodiment, a diagnostic imaging system, such as a PACS, includes or is otherwise associated with the computing device that embodies the method, apparatus and computer program product of an example embodiment of the present invention. However, other types of computing devices may embody the method, apparatus and computer program product of an embodiment of the present invention.
Regardless of the instantiation of the computing device, the computing device may include or otherwise be associated with an apparatus 10 that may, in turn, be specifically configured in order to perform one or more operations in associated with an embodiment of the present invention. As shown in FIG. 1, for example, the apparatus of one embodiment may include various means for performing the various functions described herein. These means may include, for example, one or more of a processing circuitry 12, memory 14, communication interface 16 and/or user interface 18 for performing the various functions herein described. The means of the apparatus as described herein may be embodied as, for example, circuitry, hardware elements (e.g., a suitably programmed processor, combinational logic circuit, and/or the like), a computer program product comprising computer-readable program instructions (e.g., software or firmware) stored on a computer-readable medium (e.g. memory) that is executable by a suitably configured processing device (e.g., the processing circuitry), or some combination thereof.
The processing circuitry 12 may, for example, be embodied as various means including one or more microprocessors, one or more coprocessors, one or more multi-core processors, one or more controllers, one or more computers, various other processing elements including integrated circuits such as, for example, an ASIC (application specific integrated circuit) or FPGA (field programmable gate array), or some combination thereof. Accordingly, although illustrated in FIG. 1 as a single processing circuitry, in some embodiments the processor may comprise a plurality of processing circuits. The plurality of processing circuits may be embodied on a single computing device or may be distributed across a plurality of computing devices collectively configured to function as the apparatus. The plurality of processing circuits may be in operative communication with each other and may be collectively configured to perform one or more functionalities of the apparatus as described herein. In some example embodiments, the processing circuitry is configured to execute instructions stored in the memory 14 or otherwise accessible to the processing circuitry. These instructions, when executed by the processing circuitry, may cause the apparatus 10 to perform one or more of the functionalities of the apparatus as described herein. As such, whether configured by hardware or software methods, or by a combination thereof, the processing circuitry may comprise an entity capable of performing operations according to embodiments of the present invention while configured accordingly. Thus, for example, when the processing circuitry is embodied as an ASIC, FPGA or the like, the processing circuitry may comprise specifically configured hardware for conducting one or more operations described herein. Alternatively, as another example, when the processing circuitry is embodied as an executor of instructions, such as may be stored in the memory, the instructions may specifically configure the processing circuitry to perform one or more algorithms and operations described herein.
The memory 14 may include, for example, volatile and/or non-volatile memory. Although illustrated in FIG. 1 as a single memory, the memory may comprise a plurality of memories. The plurality of memories may be embodied on a single computing device or distributed across a plurality of computing devices. The memory may comprise, for example, a hard disk, random access memory, cache memory, flash memory, an optical disc (e.g., a compact disc read only memory (CD-ROM), digital versatile disc read only memory (DVD-ROM), or the like), circuitry configured to store information, or some combination thereof. In this regard, the memory may comprise any non-transitory computer readable storage medium. The memory may be configured to store information, data, applications, instructions, or the like for enabling the apparatus 10 to carry out various functions in accordance with example embodiments of the present invention. For example, in some example embodiments, the memory is configured to buffer input data for processing by the processing circuitry 12. Additionally or alternatively, in some example embodiments, the memory is configured to store program instructions for execution by the processing device.
The communication interface 16 may be embodied as any device or means embodied in circuitry, hardware, a computer program product comprising computer readable program instructions stored on a computer readable medium (e.g., the memory 14) and executed by the processing circuitry 12, or a combination thereof that is configured to receive and/or transmit data from/to another device, such as, for example, a data storage device or other archive for storing electronic medical records. In some example embodiments, the communication interface is at least partially embodied as or otherwise controlled by the processing circuitry. In this regard, the communication interface may be in communication with the processing circuitry, such as via a bus. The communication interface may provide for communications via a wireline connection or may support wireless communications in which the communication interface may include, for example, an antenna, a transmitter, a receiver, a transceiver and/or supporting hardware or software for enabling communications. The communication interface may be configured to receive and/or transmit data using any protocol that may be used for communications between computing devices. As an example, the communication interface may be configured to receive and/or transmit data using any protocol and/or communications technology that may be used for communicating with the other devices. The communication interface may additionally be in communication with the memory and/or user interface 18, such as via a bus.
The user interface 18 may be in communication with the processing circuitry 12 to receive an indication of a user input and/or to provide an audible, visual, mechanical, or other output to a user. As such, the user interface may include, for example, a keyboard, a mouse, a joystick, a display, a touch screen display, a microphone, a speaker, and/or other input/output mechanisms. The user interface may be in communication with the memory 14 and/or communication interface 16, such as via a bus.
Referring now of FIG. 2, the operations performed, such as by the apparatus 10 of FIG. 1, in accordance with an example embodiment of the present invention are illustrated. In this regard, the apparatus may include means, such as the processing circuit 12, for identifying one or more findings related to a respective risk profile of a patient. See block 22. In this regard, various risk profiles may be established. For example, a first risk profile may be the profile of a patient who is at risk of having cancer, a second risk profile may be the profile of a patient who is at risk of having HIV and a third risk profile may be the profile of a patient who is at risk of having diabetes. As noted, a variety of risk profiles may be predefined with each risk profile being helpful to a radiologist who is reviewing the medical images of a patient in regards to the interpretation or protocoling of the medical images. In other words, knowledge of a risk profile of a patient may facilitate the review of the medical images by the radiologist, thereby providing for a more accurate and/or efficient review of the medical images. Not only are the plurality of risk profiles predefined, but the subset of risk profiles that are relevant for a particular type of medical image may also be predefined, thereby tailoring the review and presentation of the clinical data based upon the type of imaging study to be conducted.
In conjunction with the review of the medical images of a particular patient, the method, apparatus and computer program product may determine if the clinical data associated with the patient is related to, is associated with or otherwise supports any one or more of the respective risk profiles, such as the risk profile(s) that are predefined to be relevant for a particular type of medical image. In this regard, the apparatus 10 may include means, such as a processing circuitry 12, for reviewing the clinical data associated with the patient, such as by reviewing the electronic medical record of the patient, and identifying one or more findings related to a respective risk profile of the patient. The review of the data from an electronic medical record may include the review of metadata which may facilitate the classification of the data. The apparatus, such as the processing circuitry, may review the clinical data, such as the electronic medical record, associated with a patient in various manners. In one embodiment, however, the apparatus may include means, such as the processing circuitry, for semantically analyzing data from the electronic medical record of the patient and, based upon the semantic analysis, identifying one or more findings related to the respective risk profile of the patient. See block 20 of FIG. 2.
As noted above, the plurality of risk profiles may be predefined. Further, the findings that will be considered to be related to a respective risk profile, a type of medical image and/or a purpose of the study may also be predefined in order to facilitate the review of the clinical data, such as the semantic analysis of data from the electronic medical record, in conjunction with the identification of one or more findings related to the respective risk profile. By way of example, in conjunction with a magnetic resonance image (MRI) that is conducted to determine if a patient has prostate cancer, data from the electronic medical record that relates to known histories of breast cancer within the patient's family may be disregarded. However, data regarding a familial history of breast cancer may be considered as a relevant finding with respect to a cancer risk profile in regards to the interpretation of mammograms.
As shown in block 24 of FIG. 2, the apparatus 10 may also include means, such as the processing circuitry 12, the user interface 18 or the like, for concurrently presenting both one or more medical images and a visual representation of the patient's body with respective visual indications of the one or more findings. In one embodiment, the medical images may be presented upon the display screen(s) of the PACS and the visual representation of the patient's body with respective visual indications of the findings related to respective risk profiles may be presented either upon the same display screen(s) or upon an auxiliary screen of the PACS, thereby facilitating the review of both the medical images and the visual representation of the patient's body without diverting the attention of the radiologist who is reviewing the medical images from the PACS. However, the medical images and the visual representation of the patient's body with respective visual indications of the one or more findings may be presented in other manners in conjunction with other embodiments. By providing a visual representation of the patient's body with respective visual indications of the one or more findings related to a respective risk profile of the patient, the findings may be presented in a manner that is intuitive and may be quickly reviewed by a radiologist who is reviewing the medical images so as not to divert the attention of the radiologist from the review of the medical images, while still providing relevant information in regards to the interpretation of protocoling of the medical images.
By way of example, FIG. 3 depicts the concurrent presentation of a plurality of medical images as well as a visual representation of the patient's body with visual indications of a plurality of findings related to a cancer risk profile. In regards to the display of FIG. 3, an example workflow of a radiologist may involve the radiologist initially accessing a previously un-read thoracic CT study from the PACS study list. As shown in FIG. 3, the medical images for the thoracic CT study may be displayed by the PACS workstation along with relevant prior images and scanned documents with the original order script, that is, the referral written by the ordering physician. In accordance with an example embodiment of the present invention, the PACS may also display a visual representation of the patient's body. The visual representation of the patient's body may be highlighted in order to indicate that the patient satisfies a respective risk profile, such as by highlighting the visual representation of the patient's body in red to indicate that the patient satisfies the cancer risk profile. In this example workflow, the visual representation of the patient's body includes visual indications of the findings related to the cancer risk profile. In the illustrated embodiment, the visual indications are icons, such as the two triangles on the visual representation of the patient's chest. Each visual representation may be provided in a manner that indicates the relevance or severity of the respective finding to the particular risk profile. In one embodiment, a radiologist or a group of users may predefine the relevance of a respective finding by assigning a weight to the respective finding. For example, the visual indications may be color-coded based upon relevance or severity and, in the illustrated embodiment, one icon on the visual representation of the patient's chest that is associated with a pathology report may be red so as to indicate particular relevance or severity, while the other icon that is associated with a radiology report may be yellow to indicate lesser relevance or severity. Similarly, a visual indication may be associated with the visual representation of the patient's leg with the visual indication associated with the patient's leg being associated with a dermatology report and indicated to be of lesser relevance or severity.
As shown in block 26 of FIG. 2, the apparatus 10 may also include means, such as the processing circuitry 12, the user interface 18 or the like, for providing information regarding a respective finding upon selection of the visual indication associated with the respective finding. With respect to the example of FIG. 3, a radiologist may select one or more of the visual indications in order to cause information associated with the respective finding to be provided, such as by being presented upon the display. For example, selection of the icon associated with the pathology report may provide information indicating that the pathology report relates to a biopsy performed six months ago that indicated the presence of a malignant tumor. Additionally, selection of the icon associated with the radiology report may cause information to be provided that indicates that a prior chest x-ray was obtained nine months ago. In one embodiment, a link to the prior chest x-ray may be provided in order to permit the radiologist to efficiently access the prior chest x-ray. Upon selection of the link, for example, the chest x-ray may be pulled up and displayed by the PACS workstation as a comparison study. For example, the chest x-ray may include annotations around a small nodule with the prior report associated with the prior chest x-ray including an impression of “possible pulmonary calcification, cannot rule out indications of small cell lung carcinoma-biopsy recommended.” Further, selection of the icon associated with the dermatology report may provide information indicating that the patient has an open referral to a dermatologist to comment upon a large sun spot.
While the relevance or severity of a finding may be indicated by the color coding described above, the relevance or severity of a finding may be indicated in other manners, such as by the manner, e.g., the size, in which the information regarding a respective finding is presented. As shown in FIG. 3, for example, the information relating to the dermatology report is shown to be smaller than the information relating to the other reports since the dermatology report may be of lesser relevance since the sun spot has not grown since the original report in 2009 such that the likelihood that the sun spot is evidence of melanoma has been materially decreased.
By considering the information regarding the findings associated with the respective risk profile of the patient, the radiologist who is reviewing the medical images of the patient may interpret the medical images in a more informed manner. With respect to the foregoing example of FIG. 3, the radiologist may compare the annotated nodule from the prior chest x-ray to the newly acquired CT images that are presented by the PACS workstation and may report that the nodule does not appear to have grown in size or altered dimensions since the prior report. The radiologist of this example workflow may also observe a very minute mass in close proximity to the annotated nodule and may report that “given known smoking history and previous pathological findings, recommend biopsy of otherwise unremarkable mass”. Thus, in light of the information associated with findings related to a cancer risk profile of the patient, the radiologist may recommend a biopsy of a very minute mass that is otherwise unremarkable and which may generally have not caused the radiologist to recommend any further action. As another example, a radiologist reviewing a chest x-ray who has been made aware of the patient's history with colon cancer through the findings associated with the patient's risk profile may flag any minor mass in the lungs as a potential pulmonary nodule, instead of dismissing the minor mass as calcification as might otherwise have happened in the absence of the clinical data.
Additionally, access to information regarding the findings related to the respective risk profile, such as access to the pathology report in the foregoing example workflow, may improve the efficiency with which a radiologist may review the medical images by eliminating any need for the radiologist to contact the ordering physician. Further, the information associated with findings related to a respective risk profile may permit a radiologist who is reviewing the medical images of the patient to quickly navigate through the relevant clinical data of the patient, such as prior examination report.
In one embodiment, the presentation of the visual representation of the patient's body with visual indications of one or more findings may be associated with a respective point in time. In addition, the apparatus 10 of this embodiment may also include means, such as the processing circuitry 12, the user interface 18 or the like, for receiving user input that identifies the point in time for which the visual representation of the patient's body with visual indications of one or more findings should be presented. In the embodiment illustrated in FIGS. 3 and 4, for example, a representation of a timeline may be provided with a mechanism, such as the slider in the illustrated embodiment, to permit a user to select a point in time. Based upon the selected point in time, the resulting presentation of the visual representation of the patient's body may include visual indications for only those findings that existed as of the selected point in time with the relevance or severity being indicated in a manner consistent with the relevance or severity of the respective finding at the selected point in time. For example, in 2013, FIG. 3 includes visual representations for three findings since all three findings were obtained prior to 2013 with the information associated with the dermatology report being indicated to be of lesser relevance or severity than the other reports since the sun spot has been determined not to have grown since its initial identification in 2009. In contrast, in 2010, FIG. 4 includes a visual representation of only a single finding, that is, the pathology report, since the other two reports were not generated until after 2010. Additionally, the information associated with the dermatology report is indicated to be of greater relevance or severity in FIG. 4 than in FIG. 3 since the linkage, if any, between the sun spot and melanoma had not yet been determined in 2010. By reviewing the visual representation of the patient's body with visual indications of one or more findings at different points in time, particularly in conjunction with a review of a plurality of medical images of the patient provides a useful and intuitive mechanism for a radiologist to obtain additional information regarding the patient and to quickly discern changes in the risk factors and the relevance of the findings over time, thereby further informing the radiologist's conclusions regarding the patient.
As described above, FIG. 2 illustrates a flowchart of a system, method, and computer program product according to example embodiments of the invention. It will be understood that each block of the flowchart, and combinations of blocks in the flowchart, may be implemented by various means, such as hardware and/or a computer program product comprising one or more computer-readable mediums having computer readable program instructions stored thereon. For example, one or more of the procedures described herein may be embodied by computer program instructions of a computer program product. In this regard, the computer program product(s) which embody the procedures described herein may be stored by one or more memory devices of a computing device, e.g., a PACS, and executed by a processing circuitry 12 in the computing device. In some embodiments, the computer program instructions comprising the computer program product(s) which embody the procedures described above may be stored by memory devices of a plurality of computing devices. As will be appreciated, any such computer program product may be loaded onto a computer or other programmable apparatus to produce a machine, such that the computer program product including the instructions which execute on the computer or other programmable apparatus creates means for implementing the functions specified in the flowchart block(s). Further, the computer program product may comprise one or more computer-readable memories on which the computer program instructions may be stored such that the one or more computer-readable memories can direct a computer or other programmable apparatus to function in a particular manner, such that the computer program product comprises an article of manufacture which implements the function specified in the flowchart block(s). The computer program instructions of one or more computer program products may also be loaded onto a computer or other programmable apparatus to cause a series of operations to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus implement the functions specified in the flowchart block(s).
Accordingly, blocks or steps of the flowchart support combinations of means for performing the specified functions and combinations of steps for performing the specified functions. It will also be understood that one or more blocks of the flowchart, and combinations of blocks in the flowchart, may be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer program product(s).
The above described functions may be carried out in many ways. For example, any suitable means for carrying out each of the functions described above may be employed to carry out embodiments of the invention. In one embodiment, a suitably configured processing circuitry 12 may provide all or a portion of the elements of the invention. In another embodiment, all or a portion of the elements of the invention may be configured by and operate under control of a computer program product. The computer program product for performing the methods of embodiments of the invention includes a computer-readable storage medium, such as the non-volatile storage medium, and computer-readable program code portions, such as a series of computer instructions, embodied in the computer-readable storage medium.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the embodiments of the invention are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Moreover, although the foregoing descriptions and the associated drawings describe example embodiments in the context of certain example combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims (17)

What is claimed is:
1. A method comprising:
identifying, with processing circuitry, one or more findings related to a respective risk profile of a patient based upon a review of clinical data associated with the patient, wherein one or more risk profiles are relevant to a respective type of medical image, and wherein identifying one or more findings related to a respective risk profile of the patient comprises tailoring review of the clinical data based upon the respective type of medical image so as to identify one or more findings related to a risk profile that is relevant to the respective type of medical image;
concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body, distinct from the one or more medical images, with respective visual indications of the one or more findings being associated with the visual representation of at least a portion of the patient's body; and
providing information regarding a respective finding upon selection of the visual indication associated with the respective finding.
2. A method according to claim 1 wherein identifying one or more findings related to a respective risk profile comprises semantically analyzing data from an electronic medical record of the patient to identify the one or more findings.
3. A method according to claim 1 wherein concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprises concurrently presenting both one or more medical images of the patient and the visual representation of at least a portion of the patient's body on the same display screen.
4. A method according to claim 1 wherein concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprises highlighting the representation of at least a portion of the patient's body to indicate that the patient satisfies a respective risk profile.
5. A method according to claim 1 wherein concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprises causing an indication of the relevance or severity of the one or more findings to be provided.
6. A method according to claim 1 wherein concurrently presenting both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprises concurrently presenting one or more prior images of the patient and an original order script.
7. An apparatus comprising processing circuitry configured to:
identify one or more findings related to a respective risk profile of a patient based upon a review of clinical data associated with the patient, wherein one or more risk profiles are relevant to a respective type of medical image, and wherein the processing circuitry is configured to identify one or more findings related to a respective risk profile of the patient by tailoring review of the clinical data based upon the respective type of medical image so as to identify one or more findings related to a risk profile that is relevant to the respective type of medical image;
concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body, distinct from the one or more medical images, with respective visual indications of the one or more findings being associated with the visual representation of at least a portion of the patient's body; and
provide information regarding a respective finding upon selection of the visual indication associated with the respective finding.
8. An apparatus according to claim 7 wherein the processing circuitry is configured to identify one or more findings related to a respective risk profile by semantically analyzing data from an electronic medical record of the patient to identify the one or more findings.
9. An apparatus according to claim 7 wherein the processing circuitry is configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body by concurrently presenting both one or more medical images of the patient and the visual representation of at least a portion of the patient's body on the same display screen.
10. An apparatus according to claim 7 wherein the processing circuitry is configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body by highlighting the representation of at least a portion of the patient's body to indicate that the patient satisfies a respective risk profile.
11. An apparatus according to claim 7 wherein the processing circuitry is configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body by causing an indication of the relevance or severity of the one or more findings to be provided.
12. An apparatus according to claim 7 wherein the processing circuitry is configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body by concurrently presenting one or more prior images of the patient and an original order script.
13. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising program code instructions configured to:
identify one or more findings related to a respective risk profile of a patient based upon a review of clinical data associated with the patient, wherein one or more risk profiles are relevant to a respective type of medical image, and wherein the program code instructions configured to identify one or more findings related to a respective risk profile of the patient comprise program code instructions configured to tailor review of the clinical data based upon the respective type of medical image so as to identify one or more findings related to a risk profile that is relevant to the respective type of medical image;
concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body, distinct from the one or more medical images, with respective visual indications of the one or more findings being associated with the visual representation of at least a portion of the patient's body; and
provide information regarding a respective finding upon selection of the visual indication associated with the respective finding.
14. A computer program product according to claim 13 wherein the program code instructions configured to identify one or more findings related to a respective risk profile comprise program code instructions configured to semantically analyze data from an electronic medical record of the patient to identify the one or more findings.
15. A computer program product according to claim 13 wherein the program code instructions configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprise program code instructions configured to concurrently present both one or more medical images of the patient and the visual representation of at least a portion of the patient's body on the same display screen.
16. A computer program product according to claim 13 wherein the program code instructions configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprise program code instructions configured to highlight the representation of at least a portion of the patient's body to indicate that the patient satisfies a respective risk profile.
17. A computer program product according to claim 13 wherein the program code instructions configured to concurrently present both one or more medical images of the patient and a visual representation of at least a portion of the patient's body comprise program code instructions configured to cause an indication of the relevance or severity of the one or more findings to be provided.
US13/836,666 2012-11-21 2013-03-15 Method and apparatus integrating clinical data with the review of medical images Active 2033-06-09 US9095315B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/836,666 US9095315B2 (en) 2012-11-21 2013-03-15 Method and apparatus integrating clinical data with the review of medical images
US14/816,723 US20150339457A1 (en) 2012-11-21 2015-08-03 Method and apparatus for integrating clinical data with the review of medical images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261729183P 2012-11-21 2012-11-21
US13/836,666 US9095315B2 (en) 2012-11-21 2013-03-15 Method and apparatus integrating clinical data with the review of medical images

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/816,723 Continuation US20150339457A1 (en) 2012-11-21 2015-08-03 Method and apparatus for integrating clinical data with the review of medical images

Publications (2)

Publication Number Publication Date
US20140140591A1 US20140140591A1 (en) 2014-05-22
US9095315B2 true US9095315B2 (en) 2015-08-04

Family

ID=50728002

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/836,666 Active 2033-06-09 US9095315B2 (en) 2012-11-21 2013-03-15 Method and apparatus integrating clinical data with the review of medical images
US14/816,723 Abandoned US20150339457A1 (en) 2012-11-21 2015-08-03 Method and apparatus for integrating clinical data with the review of medical images

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/816,723 Abandoned US20150339457A1 (en) 2012-11-21 2015-08-03 Method and apparatus for integrating clinical data with the review of medical images

Country Status (1)

Country Link
US (2) US9095315B2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9610449B2 (en) * 2013-05-16 2017-04-04 Nuvectra Corporation Method and apparatus for displaying a graphical impedance history for output channels of a lead
US9292655B2 (en) * 2013-07-29 2016-03-22 Mckesson Financial Holdings Method and computing system for providing an interface between an imaging system and a reporting system
US10025479B2 (en) * 2013-09-25 2018-07-17 Terarecon, Inc. Advanced medical image processing wizard
US20190021677A1 (en) * 2017-07-18 2019-01-24 Siemens Healthcare Gmbh Methods and systems for classification and assessment using machine learning

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5807256A (en) * 1993-03-01 1998-09-15 Kabushiki Kaisha Toshiba Medical information processing system for supporting diagnosis
US20030072477A1 (en) * 2001-10-12 2003-04-17 Ashwin Kotwaliwale Karyotype processing methods and devices
US20030095147A1 (en) * 2001-11-21 2003-05-22 Confirma, Incorporated User interface having analysis status indicators
US20030229278A1 (en) * 2002-06-06 2003-12-11 Usha Sinha Method and system for knowledge extraction from image data
US20040013292A1 (en) * 2002-05-17 2004-01-22 Pfizer, Inc. Apparatus and method for statistical image analysis
US20050245803A1 (en) * 2002-03-14 2005-11-03 Glenn Jr William V System and method for analyzing and displaying computed tomography data
US20060159325A1 (en) * 2005-01-18 2006-07-20 Trestle Corporation System and method for review in studies including toxicity and risk assessment studies
US7200858B1 (en) * 1996-10-30 2007-04-03 Algotec Systems Ltd. Data distribution system
US20070237375A1 (en) * 2006-03-23 2007-10-11 Hiromasa Yamagishi Apparatus and method of displaying image scanning report
US20080117230A1 (en) * 2006-11-22 2008-05-22 Rainer Wegenkittl Hanging Protocol Display System and Method
US20080123917A1 (en) * 2006-11-29 2008-05-29 Siemens Medical Solutions Usa, Inc. An Imaging Study Completion Processing System
US20080184168A1 (en) * 2006-11-09 2008-07-31 Olympus Medical Systems Corp. Image display apparatus
US20090150184A1 (en) * 2007-12-05 2009-06-11 Siemens Medical Solutions Usa, Inc. Medical user interface and workflow management system
US20100114608A1 (en) * 2007-03-23 2010-05-06 Konica Minolta Medical & Graphic, Inc. Medical image display system
US20100142774A1 (en) * 2006-12-20 2010-06-10 Spectrum Dynamics Llc method, a system, and an apparatus for using and processing multidimensional data
US20110225530A1 (en) * 2010-03-11 2011-09-15 Virtual Radiologic Corporation Anatomy Labeling
US20120253845A1 (en) * 2011-03-30 2012-10-04 Mckesson Financial Holdings Apparatus, method and computer-readable storage mediums for browsing and selecting a multimedia object
US20120254794A1 (en) * 2011-03-30 2012-10-04 Mckesson Financial Holdings Apparatus, method and computer-readable storage mediums for acknowledging receipt of a higher-priority multimedia object
US20130152020A1 (en) * 2011-03-30 2013-06-13 Olympus Medical Systems Corp. Image management apparatus, method, and computer-readable recording medium and capsule endoscope system
US20130326386A1 (en) * 2012-05-31 2013-12-05 Michael J. Vendrell Image based medical reference systems and processes
US20140143710A1 (en) * 2012-11-21 2014-05-22 Qi Zhao Systems and methods to capture and save criteria for changing a display configuration

Patent Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5807256A (en) * 1993-03-01 1998-09-15 Kabushiki Kaisha Toshiba Medical information processing system for supporting diagnosis
US7200858B1 (en) * 1996-10-30 2007-04-03 Algotec Systems Ltd. Data distribution system
US20030072477A1 (en) * 2001-10-12 2003-04-17 Ashwin Kotwaliwale Karyotype processing methods and devices
US20030095147A1 (en) * 2001-11-21 2003-05-22 Confirma, Incorporated User interface having analysis status indicators
US20050245803A1 (en) * 2002-03-14 2005-11-03 Glenn Jr William V System and method for analyzing and displaying computed tomography data
US20040013292A1 (en) * 2002-05-17 2004-01-22 Pfizer, Inc. Apparatus and method for statistical image analysis
US20030229278A1 (en) * 2002-06-06 2003-12-11 Usha Sinha Method and system for knowledge extraction from image data
US20060159325A1 (en) * 2005-01-18 2006-07-20 Trestle Corporation System and method for review in studies including toxicity and risk assessment studies
US20070237375A1 (en) * 2006-03-23 2007-10-11 Hiromasa Yamagishi Apparatus and method of displaying image scanning report
US20080184168A1 (en) * 2006-11-09 2008-07-31 Olympus Medical Systems Corp. Image display apparatus
US20080117230A1 (en) * 2006-11-22 2008-05-22 Rainer Wegenkittl Hanging Protocol Display System and Method
US20080123917A1 (en) * 2006-11-29 2008-05-29 Siemens Medical Solutions Usa, Inc. An Imaging Study Completion Processing System
US20100142774A1 (en) * 2006-12-20 2010-06-10 Spectrum Dynamics Llc method, a system, and an apparatus for using and processing multidimensional data
US20100114608A1 (en) * 2007-03-23 2010-05-06 Konica Minolta Medical & Graphic, Inc. Medical image display system
US20090150184A1 (en) * 2007-12-05 2009-06-11 Siemens Medical Solutions Usa, Inc. Medical user interface and workflow management system
US20110225530A1 (en) * 2010-03-11 2011-09-15 Virtual Radiologic Corporation Anatomy Labeling
US20120253845A1 (en) * 2011-03-30 2012-10-04 Mckesson Financial Holdings Apparatus, method and computer-readable storage mediums for browsing and selecting a multimedia object
US20120254794A1 (en) * 2011-03-30 2012-10-04 Mckesson Financial Holdings Apparatus, method and computer-readable storage mediums for acknowledging receipt of a higher-priority multimedia object
US20130152020A1 (en) * 2011-03-30 2013-06-13 Olympus Medical Systems Corp. Image management apparatus, method, and computer-readable recording medium and capsule endoscope system
US20130326386A1 (en) * 2012-05-31 2013-12-05 Michael J. Vendrell Image based medical reference systems and processes
US20140143710A1 (en) * 2012-11-21 2014-05-22 Qi Zhao Systems and methods to capture and save criteria for changing a display configuration

Also Published As

Publication number Publication date
US20150339457A1 (en) 2015-11-26
US20140140591A1 (en) 2014-05-22

Similar Documents

Publication Publication Date Title
JP6585772B2 (en) Methods and systems for analyzing, prioritizing, visualizing, and reporting medical images
US10275877B2 (en) Methods and systems for automatically determining diagnosis discrepancies for clinical images
JP6438395B2 (en) Automatic detection and retrieval of previous annotations associated with image material for effective display and reporting
US9734285B2 (en) Anatomy map navigator systems and methods of use
US11195610B2 (en) Priority alerts based on medical information
CN103460213B (en) Image acquisition and/or image-related parameter recommender
US20080025583A1 (en) System and method for on-demand visual enhancement of clinical conitions in images
JP6796060B2 (en) Image report annotation identification
JP6731480B2 (en) Long-term healthy patient profile for incidental findings
US20190348156A1 (en) Customized presentation of data
Kapoor et al. Workflow applications of artificial intelligence in radiology and an overview of available tools
Lee et al. The current state of artificial intelligence in medical imaging and nuclear medicine
US20100082365A1 (en) Navigation and Visualization of Multi-Dimensional Image Data
US9292655B2 (en) Method and computing system for providing an interface between an imaging system and a reporting system
US20230011031A1 (en) Automatically determining a medical recommendation for a patient based on multiple medical images from multiple different medical imaging modalities
US20230368893A1 (en) Image context aware medical recommendation engine
US20150339457A1 (en) Method and apparatus for integrating clinical data with the review of medical images
US9798857B2 (en) Method and apparatus for providing an integrated display of clinical data
Lokaj et al. Barriers and facilitators of artificial intelligence conception and implementation for breast imaging diagnosis in clinical practice: a scoping review
WO2019068499A1 (en) System and method to automatically prepare an attention list for improving radiology workflow
US11094062B2 (en) Auto comparison layout based on image similarity
US20200118659A1 (en) Method and apparatus for displaying values of current and previous studies simultaneously

Legal Events

Date Code Title Description
AS Assignment

Owner name: MCKESSON FINANCIAL HOLDINGS, BERMUDA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ARAZI, OHAD;REEL/FRAME:030015/0720

Effective date: 20130314

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
AS Assignment

Owner name: MCKESSON FINANCIAL HOLDINGS UNLIMITED COMPANY, BERMUDA

Free format text: CHANGE OF NAME;ASSIGNOR:MCKESSON FINANCIAL HOLDINGS;REEL/FRAME:041329/0879

Effective date: 20161130

Owner name: MCKESSON FINANCIAL HOLDINGS UNLIMITED COMPANY, BER

Free format text: CHANGE OF NAME;ASSIGNOR:MCKESSON FINANCIAL HOLDINGS;REEL/FRAME:041329/0879

Effective date: 20161130

AS Assignment

Owner name: MCKESSON CORPORATION, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MCKESSON FINANCIAL HOLDINGS UNLIMITED COMPANY;REEL/FRAME:041355/0408

Effective date: 20161219

AS Assignment

Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA

Free format text: SECURITY AGREEMENT;ASSIGNORS:CHANGE HEALTHCARE HOLDINGS, LLC;CHANGE HEALTHCARE, INC.;CHANGE HEALTHCARE HOLDINGS, INC.;AND OTHERS;REEL/FRAME:041858/0482

Effective date: 20170301

Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH

Free format text: SECURITY AGREEMENT;ASSIGNORS:CHANGE HEALTHCARE HOLDINGS, LLC;CHANGE HEALTHCARE, INC.;CHANGE HEALTHCARE HOLDINGS, INC.;AND OTHERS;REEL/FRAME:041858/0482

Effective date: 20170301

AS Assignment

Owner name: PF2 IP LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MCKESSON CORPORATION;REEL/FRAME:041938/0501

Effective date: 20170301

AS Assignment

Owner name: CHANGE HEALTHCARE LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PF2 IP LLC;REEL/FRAME:041966/0356

Effective date: 20170301

AS Assignment

Owner name: CHANGE HEALTHCARE LLC, GEORGIA

Free format text: CHANGE OF ADDRESS;ASSIGNOR:CHANGE HEALTHCARE LLC;REEL/FRAME:042082/0061

Effective date: 20170323

AS Assignment

Owner name: CHANGE HEALTHCARE HOLDINGS, LLC, TENNESSEE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHANGE HEALTHCARE LLC;REEL/FRAME:046449/0899

Effective date: 20180414

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: CHANGE HEALTHCARE HOLDINGS, LLC, MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

Owner name: CHANGE HEALTHCARE TECHNOLOGIES, LLC (FORMERLY KNOWN AS MCKESSON TECHNOLOGIES LLC), MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

Owner name: CHANGE HEALTHCARE HOLDINGS, INC., MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

Owner name: CHANGE HEALTHCARE OPERATIONS, LLC, MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

Owner name: CHANGE HEALTHCARE PERFORMANCE, INC. (FORMERLY KNOWN AS CHANGE HEALTHCARE, INC.), MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

Owner name: CHANGE HEALTHCARE SOLUTIONS, LLC, MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

Owner name: CHANGE HEALTHCARE RESOURCES, LLC (FORMERLY KNOWN AS ALTEGRA HEALTH OPERATING COMPANY LLC), MINNESOTA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK OF AMERICA, N.A.;REEL/FRAME:061620/0054

Effective date: 20221003

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8