US20120310538A1 - System and Method for Diagnosing a Biological Sample - Google Patents

System and Method for Diagnosing a Biological Sample Download PDF

Info

Publication number
US20120310538A1
US20120310538A1 US13/450,579 US201213450579A US2012310538A1 US 20120310538 A1 US20120310538 A1 US 20120310538A1 US 201213450579 A US201213450579 A US 201213450579A US 2012310538 A1 US2012310538 A1 US 2012310538A1
Authority
US
United States
Prior art keywords
sample
data set
biological sample
test data
combinations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/450,579
Inventor
Shona Stewart
Arny Drauch
Jeffrey Cohen
John Maier
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ChemImage Technologies LLC
Original Assignee
ChemImage Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ChemImage Corp filed Critical ChemImage Corp
Priority to US13/450,579 priority Critical patent/US20120310538A1/en
Assigned to CHEMIMAGE CORPORATION reassignment CHEMIMAGE CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: STEWART, SHONA, MAIER, JOHN, COHEN, JEFFREY, DRAUCH, AMY
Publication of US20120310538A1 publication Critical patent/US20120310538A1/en
Assigned to CHEMIMAGE CORPORATION reassignment CHEMIMAGE CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHEMIMAGE CORPORATION
Assigned to CHEMIMAGE TECHNOLOGIES LLC reassignment CHEMIMAGE TECHNOLOGIES LLC CORRECTIVE ASSIGNMENT TO CORRECT THE CHANGE ASSIGNEE FROM CHEMIMAGE CORPORATION TO CHEMIMAGE TECHNOLOGIES LLC PREVIOUSLY RECORDED ON REEL 030134 FRAME 0096. ASSIGNOR(S) HEREBY CONFIRMS THE CHEMIMAGE CORP TO CHEMIMAGE TECHNOLOGIES LLC. Assignors: CHEMIMAGE CORPORATION
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts

Definitions

  • the biochemical composition of a cell is a complex mix of biological molecules including, but not limited to, proteins, nucleic acids, lipids, and carbohydrates.
  • the composition and interaction of the biological molecules determines the metabolic state of a cell.
  • the metabolic state of the cell will dictate the type of cell and its function (i.e., red blood cell, epithelial cell, etc.).
  • Tissue is generally understood to mean a group of cells that work together to perform a function.
  • Spectroscopic techniques provide information about the biological molecules contained in cells and tissues and therefore provide information about the metabolic state. As the cell's or tissue's metabolic state changes from the normal state to a diseased state, spectroscopic techniques can provide information to indicate the metabolic change and therefore serve to diagnose and predict the outcome of a disease. Cancer is a prevalent disease, so physicians are very concerned with being able to accurately diagnose cancer and to determine the best course of treatment.
  • Spectroscopic imaging combines digital imaging and molecular spectroscopy techniques, which can include Raman scattering, fluorescence, photoluminescence, ultraviolet, visible, short wave infrared (SWIR), and infrared absorption spectroscopies.
  • spectroscopic imaging is commonly referred to as chemical imaging.
  • Instruments for performing spectroscopic (i.e. chemical) imaging typically comprise an illumination source, image gathering optics, focal plane array imaging detectors and imaging spectrometers.
  • the sample size determines the choice of image gathering optic.
  • a microscope is typically employed for the analysis of sub micron to millimeter spatial dimension samples.
  • macro lens optics are appropriate.
  • flexible fiberscope or rigid borescopes can be employed.
  • telescopes are appropriate image gathering optics.
  • FPA detectors For detection of images formed by the various optical systems, two-dimensional, imaging focal plane array (FPA) detectors are typically employed.
  • the choice of FPA detector is governed by the spectroscopic technique employed to characterize the sample of interest.
  • silicon (Si) charge-coupled device (CCD) detectors or CMOS detectors are typically employed with visible wavelength fluorescence and Raman spectroscopic imaging systems
  • indium gallium arsenide (InGaAs) FPA detectors are typically employed with near-infrared spectroscopic imaging systems.
  • Spectroscopic imaging of a sample can be implemented by one of two methods.
  • a point-source illumination can be provided on the sample to measure the spectra at each point of the illuminated area.
  • spectra can be collected over the an entire area encompassing the sample simultaneously using an electronically tunable optical imaging filter such as an acousto-optic tunable filter (AOTF), a multi-conjugate tunable filter (MCF), or a liquid crystal tunable filter (LCTF).
  • AOTF acousto-optic tunable filter
  • MCF multi-conjugate tunable filter
  • LCTF liquid crystal tunable filter
  • the organic material in such optical filters are actively aligned by applied voltages to produce the desired bandpass and transmission function.
  • the spectra obtained for each pixel of such an image thereby forms a complex data set referred to as a hyperspectral image which contains the intensity values at numerous wavelengths or the wavelength dependence of each pixel element in this image.
  • UV Ultraviolet
  • VIS visible
  • NIR near infrared
  • SWIR short wave infrared
  • MIR mid infrared
  • Raman spectroscopy is based on irradiation of a sample and detection of scattered radiation, and it can be employed non-invasively to analyze biological samples in situ. Thus, little or no sample preparation is required. Raman spectroscopy techniques can be readily performed in aqueous environments because water exhibits very little, but predictable, Raman scattering. It is particularly amenable to in vivo measurements as the powers and excitation wavelengths used are non-destructive to the tissue and have a relatively large penetration depth.
  • Chemical imaging is a reagentless tissue imaging approach based on the interaction of laser light with tissue samples.
  • the approach yields an image of a sample wherein each pixel of the image is the spectrum of the sample at the corresponding location.
  • the spectrum carries information about the local chemical environment of the sample at each location.
  • Raman chemical imaging RCI
  • RCI Raman chemical imaging
  • the present disclosure provides for a system and method for assessing biological samples. More specifically, the invention of the present disclosure provides for the use of SWIR and/or visible spectroscopic and imaging techniques to diagnose biological samples. This diagnosis may include, but is not limited to, determining at least one of: a disease state, a metabolic state, a clinical outcome, a disease progression, and combinations thereof.
  • FIG. 1 is a schematic representation of an exemplary system of the present disclosure.
  • FIGS. 2A and 2B are schematic representations of an exemplary spectroscopy module of the present disclosure.
  • FIG. 3 is a schematic representation of an exemplary system of the present disclosure.
  • FIG. 4 is illustrative of a method of the present disclosure.
  • FIG. 5 is illustrative of a method of the present disclosure.
  • FIG. 6A is illustrative of the detection capabilities of the system and method of the present disclosure.
  • FIG. 6B is illustrative of the detection capabilities of the system and method of the present disclosure.
  • FIG. 6C is illustrative of the detection capabilities of the system and method of the present disclosure.
  • FIG. 1 illustrates an exemplary system 100 according to one embodiment of the present disclosure.
  • System 100 includes a spectroscopy module 110 in communication with a processing module 120 .
  • Processing module 120 may include a processor 122 , databases 123 , 124 , 125 and 126 , and machine readable program code 128 .
  • the machine readable program code 128 may contain executable program instructions, and the processor 122 may be configured to execute the machine readable program code 128 so as to perform the methods of the present disclosure.
  • the program code 128 may contain the ChemImage XpertTM software marketed by ChemImage Corporation of Pittsburgh, Pa.
  • the XpertTM software may be used to process spectroscopic data and information received from the spectroscopy module 110 to obtain various spectral plots and images, and to also carry out various multivariate image analysis methods discussed later herein below.
  • FIG. 2A illustrates an exemplary schematic layout of the spectroscopy module 110 shown in FIG. 1 .
  • the layout in FIG. 2A may relate to a chemical imaging system marketed by ChemImage Corporation of Pittsburgh, Pa.
  • the spectroscopy module 110 may include a microscope module 140 containing optics for microscope applications.
  • An illumination source 142 e.g., a laser illumination source
  • photons transmitted, reflected, emitted, or scattered from the illuminated sample (not shown) may pass through the microscope module (as illustrated by exemplary blocks 146 , 148 in FIG.
  • visible imaging 154 and SWIR imaging 152 are illustrated as standard. In other embodiments, the modes of Raman imaging 158 , fluorescence imaging 156 , NIR imaging 151 , and video imaging 150 may also be implemented.
  • the spectroscopy module 110 may also include a control unit 160 to control operational aspects (e.g., focusing, sample placement, laser beam transmission, etc.) of various system components including, for example, the microscope module 140 and the sample positioning unit 144 as illustrated in FIG. 2A .
  • control unit 160 to control operational aspects (e.g., focusing, sample placement, laser beam transmission, etc.) of various system components including, for example, the microscope module 140 and the sample positioning unit 144 as illustrated in FIG. 2A .
  • operation of various components (including the control unit 160 ) in the spectroscopy module 110 may be fully automated or partially automated, under user control.
  • the terms “illumination,” “illuminating,” “irradiation,” and “excitation” are used interchangeably as can be evident from the context.
  • the terms “illumination source,” “light source,” and “excitation source” are used interchangeably.
  • the terms “illuminating photons” and “excitation photons” are also used interchangeably.
  • the discussion hereinbelow focuses more on visible and SWIR spectroscopy and imaging, various methodologies discussed herein may be adapted to be used in conjunction with other types of spectroscopy applications as can be evident to one skilled in the art based on the discussion provided herein.
  • FIG. 2B illustrates exemplary details of the spectroscopy module 110 in FIG. 2A according to one embodiment of the present disclosure.
  • Spectroscopy module 110 may operate in several experimental modes of operation including bright field reflectance and transmission imaging, polarized light imaging, differential interference contrast (DIC) imaging, UV induced autofluorescence imaging, NIR imaging, wide field illumination whole field Raman spectroscopy, wide field spectral fluorescence imaging, wide field visible imaging, wide field SWIR imaging, wide field visible imaging, and wide field spectral Raman imaging.
  • DIC differential interference contrast
  • Module 110 may include collection optics 203 , light sources 202 and 204 , and a plurality of spectral information processing devices including, for example: a tunable fluorescence filter 222 , a tunable Raman filter 218 , a dispersive spectrometer 214 , a plurality of detectors including a fluorescence detector 224 , and Raman detectors 216 and 220 , a fiber array spectral translator (“FAST”) device 212 , filters 208 and 210 , and a polarized beam splitter (PBS) 219 .
  • FAST fiber array spectral translator
  • a FAST device may comprise a two-dimensional array of optical fibers drawn into a one-dimensional fiber stack so as to effectively convert a two-dimensional field of view into a curvilinear field of view, and wherein said two-dimensional array of optical fibers is configured to receive said photons and transfer said photons out of said fiber array spectral translator device and to at least one of: a spectrometer, a filter, a detector, and combinations thereof.
  • the FAST device can provide faster real-time analysis for rapid detection, classification, identification, and visualization of, for example, explosive materials, hazardous agents, biological warfare agents, chemical warfare agents, and pathogenic microorganisms, as well as non-threatening objects, elements, and compounds.
  • FAST technology can acquire a few to thousands of full spectral range, spatially resolved spectra simultaneously, This may be done by focusing a spectroscopic image onto a two-dimensional array of optical fibers that are drawn into a one-dimensional distal array with, for example, serpentine ordering.
  • the one-dimensional fiber stack may be coupled to an imaging spectrometer, a detector, a filter, and combinations thereof.
  • Software may be used to extract the spectral/spatial information that is embedded in a single CCD image frame.
  • a complete spectroscopic imaging data set can be acquired in the amount of time it takes to generate a single spectrum from a given material.
  • FAST can be implemented with multiple detectors. Color-coded FAST spectroscopic images can be superimposed on other high-spatial resolution gray-scale images to provide significant insight into the morphology and chemistry of the sample.
  • a FAST fiber bundle may feed optical information from is two-dimensional non-linear imaging end (which can be in any non-linear configuration, e.g., circular, square, rectangular, etc.) to its one-dimensional linear distal end.
  • the distal end feeds the optical information into associated detector rows.
  • the detector may be a CCD detector having a fixed number of rows with each row having a predetermined number of pixels. For example, in a 1024-width square detector, there will be 1024 pixels (related to, for example, 1024 spectral wavelengths) per each of the 1024 rows.
  • the construction of the FAST array requires knowledge of the position of each fiber at both the imaging end and the distal end of the array.
  • Each fiber collects light from a fixed position in the two-dimensional array (imaging end) and transmits this light onto a fixed position on the detector (through that fiber's distal end).
  • Each fiber may span more than one detector row, allowing higher resolution than one pixel per fiber in the reconstructed image.
  • this super-resolution combined with interpolation between fiber pixels (i.e., pixels in the detector associated with the respective fiber), achieves much higher spatial resolution than is otherwise possible.
  • spatial calibration may involve not only the knowledge of fiber geometry (i.e., fiber correspondence) at the imaging end and the distal end, but also the knowledge of which detector rows are associated with a given fiber.
  • a system of the present disclosure may comprise FAST technology available from ChemImage Corporation, Pittsburgh, Pa. This technology is more fully described in the following U.S. Patents, hereby incorporated by reference in their entireties: U.S. Pat. No. 7,764,371, filed on Feb. 15, 2007, entitled “System And Method For Super Resolution Of A Sample In A Fiber Array Spectral Translator System”; U.S. Pat. No. 7,440,096, filed on Mar. 3, 2006, entitled “Method And Apparatus For Compact Spectrometer For Fiber Array Spectral Translator”; U.S. Pat. No. 7,474,395, filed on Feb. 13, 2007, entitled “System And Method For Image Reconstruction In A Fiber Array Spectral Translator System”; and U.S. Pat. No. 7,480,033, filed on Feb. 9, 2006, entitled “System And Method For The Deposition, Detection And Identification Of Threat Agents Using A Fiber Array Spectral Translator”.
  • the system of FIG. 2B may be configured to operate in a visible and/or SWIR configuration.
  • fluorescence CCD 224 , Raman dispersive CCD 216 , and/or Raman imaging CCD 220 may be replaced with at least one of a visible CCD, a SWIR CCD and combinations thereof.
  • detectors may be used including, but not limited to: ICCD detectors, CMOS detectors, geranium detectors, InGaAs detectors, and combinations thereof.
  • the FILCTF 222 and/or Raman LCTF 218 may be replaced with at least one of a visible LCTF, a SWIR LCTF, and combinations thereof.
  • tunable filters may also be used, including but not limited to: a liquid crystal tunable filter, a multi-conjugate tunable filter, an acousto-optical tunable filter, a Lyot liquid crystal tunable filter, an Evans split-element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a ferroelectric liquid crystal tunable filter, a Fabry Perot liquid crystal tunable filter, and combinations thereof.
  • the processor 122 may be operatively coupled to light sources 202 and 204 , and the plurality of spectral information processing devices 214 , 218 and 222 .
  • the processor 122 when suitably programmed, can configure various functional parts of the spectroscopy module in FIG. 1 and may also control their operation at run time.
  • the processor when suitably programmed, may also facilitate various remote data transfer and analysis operations discussed in conjunction with FIG. 3 .
  • Module 110 may optionally include a video camera 205 for video imaging applications.
  • spectroscopy module 110 may include many additional optical and electrical components to carry out various spectroscopy and imaging applications supported thereby.
  • a sample 201 may be placed at a focusing location (e.g., by using the sample positioning unit 144 in FIG. 2A ) to receive illuminating photons and to also provide reflected, emitted, scattered, or transmitted photons from the sample 201 to the collection optics 203 .
  • Sample 201 may include a variety of biological samples.
  • the sample 201 includes at least one cell or a tissue containing a plurality of cells.
  • the sample may contain normal (non-diseased or benign) cells, diseased cells (e.g., cancerous tissues with or without a progressive cancer state or malignant cells with or without a progressive cancer state) or a combination of normal and diseased cells.
  • the cell/tissue is a mammalian cell/tissue.
  • biological samples may include prostate cells, kidney cells, lung cells, colon cells, bone marrow cells, brain cells, red blood cells, and cardiac muscle cells.
  • the biological sample may include prostate cells.
  • the biological sample may include Gleason 6 prostate cells:
  • the biological sample may include Gleason 7 prostate cells.
  • the biological sample may include a renal sample.
  • the biological sample may include renal oncocytoma cells.
  • the biological sample may include chromophobe renal carcinoma.
  • the sample 201 may include cells of plants, non-mammalian animals, fungi, protists, and monera.
  • the sample 201 may include a test sample (e.g., a biological sample under test to determine its metabolic state or its disease status or to determine whether it is cancerous state would progress to the next level).
  • a test sample e.g., a biological sample under test to determine its metabolic state or its disease status or to determine whether it is cancerous state would progress to the next level.
  • target sample e.g., a biological sample under test to determine its metabolic state or its disease status or to determine whether it is cancerous state would progress to the next level.
  • a progressive cancer state is a cancer that will go on to become aggressive and acquire subsequent treatment by more aggressive means in order for the patient to survive.
  • An example of progressive cancer is a Gleason score 7 cancer found in a prostate which has been surgically removed, where the patient, subsequent to the removal of the prostate, develops metastatic cancer. In this example the cancer progressed even after the removal of the source organ. Progressive cancers can be detected and identified in other organs and different types of cancer.
  • a non-progressive cancer is a cancer that does not progress to more advanced disease, requiring aggressive treatment.
  • Many prostate cancers are non-progressive by this definition because though they are cancer by standard histopathological definition, they do not impact the life of the patient in a way that requires significant treatment. In many cases such cancers are observed and treated only if they show evidence of becoming progressive. Again, this is not a state particular to prostate cancer. Cancer cells are present in tissues of many health people. Because these do not ever transition to a state where they become progressive in terms of growth, danger to the patient, or inconvenience to the patient they would be considered non-progressive as the term is used herein.
  • progressive vs. non progressive can also be extended to other disease or metabolic states.
  • diabetes can be clinically described as “stable”, “well managed” by a clinician and would fall into the non-progressive class.
  • diabetes can be progressing through the common course of the disease with all of the effects on kidneys, skin, nerves, heart and other organs which are part of the disease.
  • multiple sclerosis is a disease which exists in many people is a stable, non-progressive state. In some people the disease rapidly progresses through historically observed pattern of physical characteristics with clinical manifestations.
  • the cells can be isolated cells, such as individual blood cells or cells of a solid tissue that have been separated from other cells of the tissue (e.g., by degradation of the intracellular matrix).
  • the cells can also be cells present in a mass, such as a bacterial colony grown on a semi-solid medium or an intact or physically disrupted tissue.
  • blood drawn from a human can be smeared on the surface of a suitable substrate (e.g., an aluminum-coated glass slide) and individual cells in the sample can be separately imaged by light microscopy and SWIR and/or visible analysis using the spectroscopy module 110 of FIG. 2B .
  • a slice of a solid tissue e.g., a piece of fresh tissue or a paraffin-embedded thin section of a tissue
  • a suitable surface e.g., a piece of fresh tissue or a paraffin-embedded thin section of a tissue
  • the cells can be cells obtained from a subject (e.g., cells obtained from a human blood or urine sample, semen sample, tissue biopsy, or surgical procedure). Cells can also be studied where they naturally occur, such as cells in an accessible location (e.g., a location on or within a human body), cells in a remote location using a suitable probe, or by revealing cells (e.g., surgically) that are not normally accessible.
  • a subject e.g., cells obtained from a human blood or urine sample, semen sample, tissue biopsy, or surgical procedure.
  • Cells can also be studied where they naturally occur, such as cells in an accessible location (e.g., a location on or within a human body), cells in a remote location using a suitable probe, or by revealing cells (e.g., surgically) that are not normally accessible.
  • light source 202 may be used to irradiate the sample 201 with substantially monochromatic light.
  • Light source 202 can include any conventional photon source, including, for example, a laser, an LED (light emitting diode), or other IR (infrared) or near IR (NIR) devices.
  • the substantially monochromatic radiation reaching sample 201 illuminates the sample 201 , and may produce photons scattered from different locations on or within the illuminated sample 201 .
  • a portion of the Raman scattered photons from the sample 201 may be collected by the collection optics 203 and directed to dispersive spectrometer 214 or Raman tunable filter 218 for further processing discussed later herein below.
  • light source 202 includes a laser light source producing light at 532.1 nm.
  • the laser excitation signal is focused on the sample 201 through combined operation of reflecting mirrors M 1 , M 2 , M 3 , the filter 208 , and the collection optics 203 as illustrated by an exemplary optical path in the embodiment of FIG. 2B .
  • the filter 208 may be tilted at a specific angle from the vertical (e.g., at 6.5.sup.0) to reflect laser illumination onto the mirror M 3 , but not to reflect Raman-scattered photons received from the sample 201 .
  • the other filter 210 may not be tilted (i.e., it remains at 0.sup.0 from the vertical).
  • Filters 208 and 210 may function as laser line rejection filters to reject light at the wavelength of laser light source 202 .
  • the second light source 204 may be used to irradiate the sample 201 with ultraviolet light or visible light.
  • the light source 204 includes a mercury arc (Hg arc) lamp that produces ultraviolet radiation (UV) having wavelength at 365 nm for fluorescence spectroscopy applications.
  • the light source 204 may produce visible light at 546 nm for visible light imaging applications.
  • a polarizer or neutral density (ND) filter with or without a beam splitter (BS) may he provided in front of the light source 204 to obtain desired illumination light intensity and polarization.
  • test data set in one embodiment, may correspond to one or more of the following: a plurality of Raman spectra of the sample; and a plurality of spatially accurate wavelength resolved Raman images of the sample.
  • the plurality of Raman spectra is generated by dispersive spectral measurements of individual cells.
  • the illumination of the individual cell may cover the entire area of the cell so the dispersive Raman spectrum is an integrated measure of spectral response from all the locations within the cell.
  • the Raman data set corresponds to a three dimensional block of Raman data (e.g., a spectral hypercube or a Raman image) having spatial dimensional data represented in the x and y dimensions and wavelength data represented in the z dimension.
  • Each Raman image has a plurality of pixels where each has a corresponding x and y position in the Raman image.
  • the Raman image may have one or more regions of interest. The regions of interest may be identified by the size and shape of one or more pixels and is selected where the pixels are located within the regions of interest. A single Raman spectrum is then extracted from each pixel located in the region of interest, leading to a plurality of Raman spectra for each of the regions of interest.
  • the extracted plurality of Raman spectra are then designated as the Raman data set.
  • the plurality of Raman spectra and the plurality of spatially accurate wavelength resolved Raman images are generated, as components of the hypercube, by a combination of the Raman tunable filter 218 and Raman imaging detector 220 or by a combination of the FAST device 212 , the dispersive spectrometer 214 , and the Raman detector 216 .
  • a test data set may correspond to one or more of the following: a plurality of visible spectra of the sample, a plurality of SWIR spectra of the sample, a plurality of spatially accurate wavelength resolved visible images of the sample, a plurality of spatially accurate wavelength resolved SWIR images of the sample, and combinations thereof.
  • a plurality of spectra may be generated by dispersive spectral measurements of individual cells.
  • the illumination of the individual cell may cover the entire area of the cell so the dispersive spectrum is an integrated measure of spectral response from all the locations within the cell.
  • the test data set corresponds to a three dimensional block of data (e.g., a spectral hypercube or a visible or SWIR image) having spatial dimensional data represented in the x and y dimensions and wavelength data represented in the z dimension.
  • a three dimensional block of data e.g., a spectral hypercube or a visible or SWIR image
  • Each visible or SWIR image has a plurality of pixels where each has a corresponding x and y position in the image.
  • the visible or SWIR image may have one or more regions of interest.
  • the regions of interest may be identified by the size and shape of one or more pixels and is selected where the pixels are located within the regions of interest.
  • a single spectrum is then extracted from each pixel located in the region of interest, leading to a plurality of spectra for each of the regions of interest.
  • the extracted plurality of spectra is then designated as the test data set.
  • the plurality of spectra and the plurality of spatially accurate wavelength resolved images are generated, as components of the hypercube, by a combination of a tunable filter and imaging detector or by a combination of the FAST device, a dispersive spectrometer, and a detector.
  • a Raman dataset is generated using a Raman image to identify one or more regions of interest of the sample 201 .
  • the one or more regions of interest contain at least one of the following: an epithelium area, a stroma area, epithelial-stromal junction (ESJ) area and/or nuclei area.
  • a plurality of Raman spectra may be obtained from the one or more of regions of interest of the sample 201 .
  • the Raman spectrum generated by selecting a region of interest in a Raman image is the average spectrum of all the spectra at each pixel within the region of interest. The standard deviation between of all the spectra in the region of interest may be displayed along with the average Raman spectrum of the region of interest.
  • all of the spectra associated with pixels within a region can be considered as a plurality of spectra, without the step of reducing them to a mean and standard deviation.
  • the fluorescence tunable filter 222 may function to produce fluorescence data sets of the photons emitted from the sample 201 under suitable illumination (e.g., UV illumination).
  • the fluorescence data set includes a plurality of fluorescence spectra of sample 201 and/or a plurality of spatially accurate wavelength resolved fluorescence images of sample 201 .
  • a fluorescence spectrum of sample 210 may contain a fluorescence emission signature of the sample 201 .
  • the emission signature may be indicative of a fluorescent probe (e.g., fluorescein isothiocyanate) within the sample 201 .
  • the fluorescence data sets may be detected by fluorescence CCD detector 224 .
  • a portion of the fluorescence emitted photons or visible light reflected photons from the sample 201 may be directed to the video imaging camera 205 via a mirror M 4 and appropriate optical signal focusing mechanism.
  • a microscope objective (including the collection optics 203 ) may be automatically or manually zoomed in or out to obtain proper focusing of the sample.
  • the entrance slit (not shown) of the spectrometer 214 may be optically coupled to the output end of the fiber array spectral translator device 212 to disperse the Raman scattered photons received from the FAST device 212 and to generate a plurality of spatially resolved Raman spectra from the wavelength-dispersed photons.
  • the FAST device 212 may receive Raman scattered photons from the beam splitter 219 , which may split and appropriately polarize the Raman scattered photons received from the sample 201 and transmit corresponding portions to the input end of the FAST device 212 and the input end of the Raman tunable filter 218 .
  • each of the fluorescence filter 222 and the Raman filter 218 may be used to individually tune specific photon wavelengths of interest and to thereby generate a plurality of spatially accurate wavelength resolved spectroscopic fluorescence images and Raman images, respectively, in conjunction with corresponding detectors 224 and 220 .
  • each of the fluorescence filter 222 and the Raman filter 218 includes a two-dimensional tunable filter, such as, for example, an electro-optical tunable filter, a liquid crystal tunable filter (LCTF), or an acousto-optical tunable filter (AOTF).
  • LCTF liquid crystal tunable filter
  • AOTF acousto-optical tunable filter
  • a tunable filter may be a band-pass or narrow band filter that can sequentially pass or “tune” fluorescence emitted photons or Raman scattered photons into a plurality of predetermined wavelength bands.
  • the plurality of predetermined wavelength bands may include specific wavelengths or ranges of wavelengths.
  • the predetermined wavelength bands may include wavelengths characteristic of the sample undergoing analysis.
  • the wavelengths that can be passed through the fluorescence filter 222 and Raman filter 218 may range from 200 nm (ultraviolet) to 2000 nm (i.e., the far infrared).
  • the choice of a tunable filter depends on the desired optical region and/or the nature of the sample being analyzed.
  • a two-dimensional tunable filter may include a Fabry Perot angle tuned filter, a Lyot filter, an Evans split element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a spectral diversity filter, a photonic crystal filter, a fixed wavelength Fabry Perot tunable filter, an air-tuned Fabry Perot tunable filter, a mechanically-tuned Fabry Perot tunable filter, and a liquid crystal Fabry Perot tunable filter.
  • the tunable filters 218 , 222 may be selected to operate in one or more of the following spectral ranges: the ultraviolet (UV), visible, and near infrared.
  • the tunable filters 218 , 222 may be selected to operate in spectra ranges of 900-1155 cm ⁇ .sup.1 and 15-30-1850 cm ⁇ .sup.1 Raman shift values.
  • a multi-conjugate filter may be used instead of a simple LCTF (e.g., the LCTF 218 or 222 ) to provide more precise wavelength tuning of photons received from the sample 201 .
  • MCF multi-conjugate filter
  • Some exemplary multi-conjugate filters are discussed, for example, in U.S. Pat. No. 6,992,809, titled “Multi-Conjugate Liquid Crystal Tunable Filter;” and in the United States Published Patent Application Number US2007/0070260A1, titled “Liquid Crystal Filter with Tunable Rejection Band,” the disclosures of both of these publications are incorporated herein by reference in their entireties.
  • the fluorescence spectral data sets (output from the tunable filter 222 ) may be detected by the detector 224
  • the Raman spectral data sets (output from the spectrometer 214 and the tunable filter 218 ) may be detected by detectors 216 and 220 .
  • the detectors 216 , 220 , and 224 may detect received photons in a spatially accurate manner.
  • Detectors 216 , 220 and 224 may include an optical signal (or photon) collection device such as, for example, an image focal plane array (FPA) detector, a charge coupled device (CCD) detector, or a CMOS (Complementary Metal Oxide Semiconductor) array sensor.
  • FPA image focal plane array
  • CCD charge coupled device
  • CMOS Complementary Metal Oxide Semiconductor
  • Detectors 216 , 220 and 224 may measure the intensity of scattered, transmitted or reflected light incident upon their sensing surfaces (not shown) at multiple discrete locations or pixels, and transfer the spectral information received to the processor module 120 for storage and analysis.
  • the optical region employed to characterize the sample of interest governs the choice of two-dimensional array detector.
  • a two-dimensional array of silicon charge-coupled device (CCD) detection elements can be employed with visible wavelength emitted or reflected photons, or with Raman scatter photons
  • gallium arsenide (GaAs) and gallium indium arsenide (InGaAs) FPA detectors can be employed for image analyses at near infrared wavelengths. The choice of such devices may also depend on the type of sample being analyzed.
  • a display unit may be provided to display spectral data collected by various detectors 216 , 220 , 224 in a predefined or user-selected format.
  • the display unit may be a computer display screen, a display monitor, an LCD (liquid crystal display) screen, or any other type of electronic display device.
  • the databases 123 - 126 may store various reference spectral data sets including, for example, a reference SWIR data set, a reference visible data set, a reference Raman data set, a reference fluorescence data set, a reference NIR data set, etc.
  • the reference data sets may be collected from different samples and may be used to detect or identify the sample 201 from comparison of its spectral data set with the reference data sets.
  • the test data sets of the sample 201 also may be stored in one or more of the databases (e.g., database 123 ) of the processing module 120 .
  • database 123 may be used to store a plurality of reference data sets from reference cells having a known diagnosis, such as metabolic state or disease state.
  • the reference data sets may correspond to a plurality of reference spectra.
  • the Raman data sets may correspond to a plurality of reference spatially accurate wavelength resolved images.
  • the database 124 may be used to store a first plurality of reference data sets from reference normal (non-diseased) cells.
  • the first reference set of data sets may include a plurality of first reference spectra.
  • a first reference spectrum may correspond to a dispersive spectrum.
  • the first reference set of data sets may include a plurality of first reference spatially accurate wavelength resolved images obtained from corresponding reference normal cells.
  • the database 125 may store a second plurality of reference data sets from different types of reference diseased cells.
  • the reference diseased cells correspond to chromophobe renal carcinoma cells.
  • the second reference set of data sets includes a plurality of second reference spectra.
  • the second reference spectrum may correspond to a dispersive spectrum.
  • the second reference set of data sets may include a plurality of second reference spatially accurate wavelength resolved images obtained from corresponding reference diseased cells.
  • database 126 may store a plurality of reference SWIR and/or visible spectra and/or a plurality of reference spatially accurate wavelength resolved SWIR and/or visible spectroscopic images obtained from reference biological samples (e.g., cancerous human tissues).
  • reference biological samples e.g., cancerous human tissues
  • One or more of the reference biological samples may include probe molecules (e.g., fluorescein isothiocyanate).
  • probe molecules e.g., fluorescein isothiocyanate
  • a single database may be used to store all types of spectra.
  • the reference data sets may be associated with a reference image.
  • the reference image may include at least one of: a SWIR image, a visible image, a brightfield image; a polarized light image; and a UV-induced autofluorescence image.
  • FIG. 3 depicts an exemplary setup to remotely perform spectroscopic analysis of test samples according to one embodiment of the present disclosure.
  • Spectroscopic data from a test sample or a test sample may be collected at a data generation site 260 using a spectroscopy module 265 .
  • the spectroscopy module may be functionally similar to the spectroscopy module 110 discussed hereinbefore with reference to FIGS. 2A-2B .
  • the spectroscopic data collected at the data generation site 260 may be transferred to a data analysis site 270 via a communication network 272 .
  • the communication network 272 may be any data communication network such as an Ethernet LAN (local area network) connecting all the data processing and computing units within a facility, e.g., a university research laboratory, or a corporate research center.
  • the data generation site 260 and the data analysis site 270 may be physically located within the same facility, e.g., a university research laboratory or a corporate research center.
  • the communication network 272 may include, independently or in combination, any of the present or future wireline or wireless data communication networks such as, for example, the Internet, the PSTN (public switched telephone network), a cellular telephone network, a WAN (wide area network), a satellite-based communication link, a MAN (metropolitan area network), etc.
  • the data generation site 260 and the data analysis site 270 may be physically located in different facilities.
  • the data generation site 260 and the data analysis site 270 that are linked by the communication network 272 may be owned or operated by different entities.
  • the data analysis site 270 may include a processing module 275 to process the spectroscopic data received from the data generation site 260 .
  • the processing module 275 may be similar to the processing module 120 and may also include a number of different databases (not shown) storing different reference spectroscopic data sets (e.g., a first plurality of reference data sets for non-progressive cancer tissues, a second plurality of reference data sets for progressive cancer tissues, a third plurality of reference data sets for normal or non-diseased tissues; a fourth plurality of reference data set for renal oncocytomas samples and chromophobe renal cell carcinoma samples, etc.).
  • the processing module 275 may include a processor (similar to the processor 122 of the processing module 120 in FIG.
  • the machine-readable program code containing executable program instructions may be initially stored on a portable data storage medium, e.g., a floppy diskette 294 , a compact disc or a DVD 295 , a data cartridge tape (not shown), or any other suitable digital data storage medium.
  • the processing module 275 may include appropriate disk drives to receive the portable data storage medium and may be configured to read the program code stored thereon, thereby facilitating execution of the program code by its processor.
  • the program code upon execution by the processor of the processing module 275 , may cause the processor to perform a variety of data processing and display tasks including, for example, initiate transfer of spectral data set from the data generation site 260 to the data analysis site 270 via the communication network 272 , compare the received spectral data set to various reference data sets stored in the databases of the processing module 275 , classify or identify the test sample based on the comparison (e.g., whether the test sample has a progressive cancer or non-progressive cancer state or whether the test sample has renal oncocytomas disease or chromophobe renal cell carcinoma disease), transfer the classification or identification results to the data generation site 260 via the communication network 272 , etc.
  • the data analysis site 270 may include one or more computer terminals 286 A- 286 C communicatively connected to the processing module 275 via corresponding data communication links 290 A- 290 C, which can be serial, parallel, or wireless communication links, or a suitable combination thereof.
  • users may utilize functionalities of the processing module 275 via their computer terminals 286 A- 286 C, which may also be used to display spectroscopic data received from the data generation site 260 and the results of the spectroscopic data processing by the processing module 275 , among other applications. It is evident that in a practical application, there may be many more computer terminals 286 than just three terminals shown in FIG. 3 .
  • the computer terminals 286 A- 286 C may be, e.g., a personal computer (PC), a graphics workstation, a multiprocessor computer system, a distributed network of computers, or a computer chip embedded as part of a machine or mechanism.
  • the data generation site 260 may include one or more of such computers (not shown) for viewing the results of the spectroscopic analysis received from the data analysis site 270 .
  • Each computer terminal, whether at the data generation site 260 or at the data analysis site 270 may include requisite data storage capability in the form of one or more volatile and non-volatile memory modules.
  • the memory modules may include RAM (random access memory), ROM (read only memory) and HDD (hard disk drive) storage.
  • the arrangement depicted in FIG. 3 may be used to provide a commercial, network-based spectroscopic data processing service that may perform customer-requested processing of spectroscopic data in real time or near real time.
  • the processing module 275 at the data analysis site 270 may be configured to identify a test sample from the spectroscopic data remotely submitted to it over the communication network 272 (e.g., the Internet) from the spectroscopy module 265 automatically or through an operator at the data generation site 260 .
  • the client site (data generation site) 260 may be, for example, a government laboratory or a medical facility or pathological laboratory.
  • the results of spectroscopic data analysis may be transmitted back to the client site 260 for review and further analysis.
  • the whole data submission, analysis, and reporting process can be automated.
  • the owner or operator of the data analysis site 270 may commercially offer a network-based spectroscopic data content analysis service, as illustrated by the arrangement in FIG. 3 , to various individuals, corporations, governmental entities, laboratories, or other facilities on a fixed-fee basis, on a per-operation basis or on any other payment plan mutually convenient to the service provider and the service recipient.
  • Processing module 120 may also include a test database associated with a test biological sample having an unknown metabolic state.
  • the test data set may correspond to a plurality of SWIR and/or visible spectra of the test biological sample.
  • the test data set may correspond to a plurality of spatially accurate wavelength resolved SWIR and/or visible images of the test biological sample.
  • each of the test SWIR and/or visible data sets may be associated with least one of the following: a corresponding test SWIR image; a corresponding test visible image; and another corresponding test image.
  • this other test image may include at least one of the following: a brightfield image; a polarized light image; and a UV-induced autofluorescence image.
  • processing module 120 may also include a test database associated with a test biological sample having an unknown diagnosis.
  • the test data set may correspond to a plurality of SWIR and/or visible spectra of the test biological sample.
  • the test data set may correspond to a plurality of spatially accurate wavelength resolved SWIR images of the test biological sample.
  • the test data set may correspond to a plurality of spatially accurate wavelength resolved visible images.
  • each of the test data sets may be associated with least one of the following: a corresponding test SWIR image; a corresponding test visible image; and another corresponding image.
  • the other image may include at least one of the following: a brightfield image; a polarized light image; and a UV-induced autofluorescence image.
  • the test spectra are generated using a test image to identify one or more regions of interest of the test biological sample.
  • the one or more regions of interest contain at least one of the following: an epithelium area, a stroma area, epithelial-stromal junction (ESJ) area, and/or nuclei area.
  • EJ epithelial-stromal junction
  • a plurality of test spectra may be obtained from the one or more of regions of interest of the test biological sample.
  • a diagnosis of a test sample as diseased or non-diseased or a prediction of the metabolic state of a test sample may be made by comparing a test data set to reference data sets using a chemometric technique.
  • the chemometric technique may be spectral unmixing. The application of spectral unmixing to determine the identity of components of a mixture is described in U.S. Pat. No. 7,072,770, entitled “Method for Identifying Components of a Mixture via Spectral Analysis, issued on Jul. 4, 2006, which is incorporated herein by reference in it entirety.
  • Spectral unmixing requires a library of spectra which include possible components of the test sample.
  • the library can in principle be in the form of a single spectrum for each component, a set of spectra for each component, a single SWIR and/or visible image for each component, a set of SWIR and/or visible images for each component, or any of the above as recorded after a dimension reduction procedure such as Principle Component Analysis.
  • the library used as the basis for application of spectral unmixing is the reference data sets.
  • a set of measurements made on a sample of unknown state is assessed using the methods of U.S. Pat. No. 7,072,770 to determine the most likely groups of components which are present in the sample.
  • the components are actually disease states of interest and/or clinical outcome.
  • the result is a set of disease state groups and/or clinical outcome groups with a ranking of which are most likely to be represented by the test data set.
  • spectral mixture resolution Given a set of reference spectra, such as those described above, a piece or set of test data can be evaluated by a process called spectral mixture resolution.
  • the test spectrum is approximated with a linear combination of reference spectra with a goal of minimizing the deviation of the approximation from the test spectrum. This process results in a set of relative weights for the reference spectra.
  • the chemometric technique may be Principal Component Analysis.
  • Principal Component Analysis results in a set of mathematical vectors defined based on established methods used in multivariate analysis.
  • the vectors form an orthogonal basis, meaning that they are linearly independent vectors.
  • the vectors are determined based on a set of input data by first choosing a vector which describes the most variance within the input data. This first “principal component” or PC is subtracted from each of the members of the input set.
  • the input set after this subtraction is then evaluated in the same fashion (a vector describing the most variance in this set is determined and subtracted) to yield a second vector—the second principal component.
  • the process is iterated until either a chosen number of linearly independent vectors (PCs) are determined, or a chosen amount of the variance within the input data is accounted for.
  • PCs linearly independent vectors
  • the Principal Component Analysis may include a series of steps.
  • a pre-determined vector space is selected that mathematically describes a plurality of reference data sets.
  • Each reference data set may be associated with a known biological sample having an associated metabolic state.
  • the test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may be analyzed in the pre-determined vector space to generate a diagnosis.
  • the Principal Component Analysis may include a series of steps.
  • a pre-determined vector space is selected that mathematically describes a first plurality of reference data sets associated with a known biological sample having an associated diseased state and a second plurality of reference data sets associated with a known biological sample having an associated non-diseased state.
  • the test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may be analyzed in the pre-determined vector space to generate a diagnosis.
  • the Principal Component Analysis may include a series of steps.
  • a pre-determined vector space is selected that mathematically describes a first plurality of reference data sets associated with a known biological sample having an associated progressive state and a second plurality of reference data sets associated with a known biological sample having an associated non-progressive state.
  • the test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may be analyzed in the pre-determined vector space to generate a diagnosis.
  • the Principal Component Analysis may include a series of steps.
  • a pre-determined vector space may be selected that mathematically describes a first plurality of reference data sets associated with a known diagnosis.
  • the test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may he analyzed in the pre-determined vector space.
  • the analysis of the distribution of the transformed data may be performed using a classification scheme.
  • the classification scheme may include: Mahalanobis distance, Adaptive subspace detector, Band target entropy method, Neural network, and support vector machine as an incomplete list of classification schemes known to those skilled in the art.
  • the classification scheme is Mahalanobis distance.
  • the Mahalanobis distance is an established measure of the distance between two sets of points in a multidimensional space that takes into account both the distance between the centers of two groups, but also the spread around each centroid.
  • a Mahalanobis distance model of the data is represented by plots of the distribution of the spectra in the principal component space.
  • the Mahalanobis distance calculation is a general approach to calculating the distance between a single point and a group of points. It is useful because rather than taking the simple distance between the single point and the mean of the group of points, Mahalanobis distance takes into account the distribution of the points in space as part of the distance calculation.
  • the Mahalanobis distance is calculated using the distances between the points in all dimensions of the principal component space.
  • the test data is analyzed relative to the pre-determined vector space. This may be performed by calculating a Mahalanobis distance between the test data set transformed into the pre-determined vector space and the data sets in the pre-determined vector space to generate a diagnosis.
  • the exemplary systems of FIGS. 1 and 2 may be used to perform methods to predict the clinical outcome of patients or diagnose a disease state of patients.
  • Processor 122 is configured to execute program instructions to carry out these methods.
  • the exemplary system of FIG. 3 may be used to carry out methods to predict the clinical outcome of patients.
  • data obtained at a data generation site is transmitted to an analysis site to obtain a prediction of the metabolic state of a test biological sample.
  • the prediction is then transmitted back to the data generation site.
  • the transmission may be performed over a data communication network such as the Internet.
  • a biological sample may be illuminated to thereby generate a first plurality of interacted photons.
  • this illumination may be accomplished using wide-field illumination.
  • a first plurality of interacted photons may be selected from the group consisting of: photons scattered by said biological sample, photons reflected by said biological sample, photons absorbed by said biological sample, photons emitted by said biological sample, and combinations thereof.
  • said first plurality of interacted photons may be filtered. In one embodiment, this filtering may further comprise filtering said first plurality of interacted photons into a plurality of predetermined wavelength bands.
  • this filtering may be achieved using a filter selected from the group consisting of: a liquid crystal tunable filter, a multi-conjugate tunable filter, an acousto-optical tunable filter, a Lyot liquid crystal tunable filter, an Evans split-element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a ferroelectric liquid crystal tunable filter, a Fabry Perot liquid crystal tunable filter, and combinations thereof.
  • a filter selected from the group consisting of: a liquid crystal tunable filter, a multi-conjugate tunable filter, an acousto-optical tunable filter, a Lyot liquid crystal tunable filter, an Evans split-element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a ferroelectric liquid crystal tunable filter, a Fabry Perot liquid crystal tunable filter, and combinations thereof.
  • a first plurality of interacted photons may be detected in step 430 to thereby generate a test data set representative of said biological sample.
  • this test data set may comprise at least one of: a visible test data set, a SWIR test data set, and combinations thereof.
  • a test data set may comprise a hyperspectral image.
  • a test data set may comprise at least one of: a spatially accurate wavelength resolved image, a spectra, and combinations thereof.
  • a test data set may be analyzed in step 440 to thereby diagnose said biological sample.
  • this diagnosis may comprise at least one of: a disease state of said biological sample, a metabolic state of said biological sample, a clinical outcome of said biological sample, a disease progression of said biological sample, and combinations thereof.
  • diagnosing a biological sample may further comprise assigning a Gleason score to said biological sample.
  • the method 400 may further comprise selecting a pre-determined vector space that mathematically describes said test data set, transforming said test data set into said pre-determined vector space, and analyzing a distribution of said transformed test data set in the pre-determined vector space to thereby diagnose said biological sample.
  • the method 400 may further comprise providing a database wherein said database comprises at least one reference data set, each reference data set associated with a known diagnosis.
  • each reference data set may be associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof.
  • the analyzing of step 440 may further comprise comparing said test data set to at least one reference data set. This comparison may be accomplished using a chemometric technique.
  • This chemometric technique may be selected from the group consisting of: principle components analysis, partial least squares discriminate analysis, cosine correlation analysis, Euclidian distance analysis, k-means clustering, multivariate curve resolution, band t. entropy method, mahalanobis distance, adaptive subspace detector, spectral mixture resolution, and combinations thereof.
  • the present disclosure provides for a method 500 for diagnosing a biological sample.
  • a biological sample may be illuminated to thereby generate a first plurality of interacted photons.
  • said first plurality of interacted photons may be filtered.
  • These first plurality of interacted photons may be detected in step 530 to thereby generate a test data set representative of said biological sample.
  • this test data set may comprise at least one of: a visible test data set, a SWIR test data set, and combinations thereof.
  • said test data set may be analyzed to thereby diagnose said biological sample, wherein said analyzing further comprises comparing said test data set to at least one reference data set using a chemometric technique.
  • a biological sample may comprise a tissue sample, an organ sample, and combinations thereof.
  • a biological sample may comprise at least one cell.
  • a biological sample may comprise at least one of: a kidney sample, a prostate sample, a breast sample, a pancreatic sample, a brain sample, a skin sample, an intestinal sample, a colon sample, a liver sample, a cardiac sample, a lung sample, an esophageal sample, a bladder sample, a blood sample, a urethral sample, an ovarian sample, a uterine sample, a testicular sample, a bone sample, a stomach sample, a tracheal sample, a tongue sample, a diaphragm sample, a nerve sample, a rectal sample, and combinations thereof.
  • the present disclosure also provides for a storage medium containing machine readable program code, which when executed by a processor, causes the processor to perform the following: illuminate a biological sample to thereby generate a first plurality of interacted photons, filter said first plurality of interacted photons to thereby separate said first plurality of interacted photons into a plurality of predetermined wavelength bands, detect said first plurality of interacted photons to thereby generate a test data set representative of said biological sample, wherein said test data set comprises at least one of: a test SWIR data set, a test visible data set, and combinations thereof, and analyze said test data set to thereby determine at least one of: a disease state of said biological sample, a metabolic sate of said biological sample, a clinical outcome of said biological sample, a disease progression of said biological sample, and combinations thereof.
  • machine readable program code when executed by a processor to analyze said test data, may further case said processor to: compare said test data set to at least one reference data set in a reference database, wherein each said reference data set is associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof.
  • machine readable program code when executed by a processor to compare said test data set to at least one reference data set, may further cause said processor to perform said comparison by applying at least one chemometric technique.
  • said test data set may be compared to at least one reference data set to thereby assign a Gleason score to said biological sample.
  • FIGS. 6A-6C are illustrative of the detection capabilities of the system and method of the present disclosure.
  • FIG. 6A is a NIR chemical image (1450 nm) which shows contrast based on absorption. Regions of interest (ROIs) are indicated on the image, labeled as ROIs 1 - 5 .
  • FIG. 6B is a digital photograph of the tissue sample under analysis.
  • FIG. 6C is illustrative of spectra corresponding to the various ROIs of FIG. 6A . Normalized image spectra from regions drawn on the image illustrate correlation between spectral features and image contrast. These Figures illustrate the potential of the system and method of the present disclosure for tissue analysis.

Abstract

The present disclosure provides for a system and method for analyzing biological samples to thereby provide a diagnosis. A system may comprise an illumination source, a filter and a detector configured to generate at least one of: a visible data set representative of a biological sample, a SWIR data set representative of a biological sample, and combinations thereof. A method may comprise illuminating a biological sample to generate a plurality of photons, filtering a said plurality of interacted photons, detecting

Description

    RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 13/225,005, filed on Sep. 2, 2011, entitled “System and Method for Diagnosing a Biological Sample.” This Application is also a continuation-in-part to pending U.S. patent application Ser. No. 12/188,796, filed on Aug. 8, 2008, entitled “Raman Difference Spectra Based Disease Classification,” which itself claims priority under 35 U.S.C. §119(e) to U.S. Provisional Patent Application No. 60/954,607, filed on Aug. 8, 2007, entitled “Gleason Score Based Cancer Tissue Analysis.” These patent applications are hereby incorporated by reference in their entireties.
  • BACKGROUND
  • The biochemical composition of a cell is a complex mix of biological molecules including, but not limited to, proteins, nucleic acids, lipids, and carbohydrates. The composition and interaction of the biological molecules determines the metabolic state of a cell. The metabolic state of the cell will dictate the type of cell and its function (i.e., red blood cell, epithelial cell, etc.). Tissue is generally understood to mean a group of cells that work together to perform a function. Spectroscopic techniques provide information about the biological molecules contained in cells and tissues and therefore provide information about the metabolic state. As the cell's or tissue's metabolic state changes from the normal state to a diseased state, spectroscopic techniques can provide information to indicate the metabolic change and therefore serve to diagnose and predict the outcome of a disease. Cancer is a prevalent disease, so physicians are very concerned with being able to accurately diagnose cancer and to determine the best course of treatment.
  • Spectroscopic imaging combines digital imaging and molecular spectroscopy techniques, which can include Raman scattering, fluorescence, photoluminescence, ultraviolet, visible, short wave infrared (SWIR), and infrared absorption spectroscopies. When applied to the chemical analysis of materials, spectroscopic imaging is commonly referred to as chemical imaging. Instruments for performing spectroscopic (i.e. chemical) imaging typically comprise an illumination source, image gathering optics, focal plane array imaging detectors and imaging spectrometers.
  • In general, the sample size determines the choice of image gathering optic. For example, a microscope is typically employed for the analysis of sub micron to millimeter spatial dimension samples. For larger objects, in the range of millimeter to meter dimensions, macro lens optics are appropriate. For samples located within relatively inaccessible environments, flexible fiberscope or rigid borescopes can be employed. For very large scale objects, such as planetary objects, telescopes are appropriate image gathering optics.
  • For detection of images formed by the various optical systems, two-dimensional, imaging focal plane array (FPA) detectors are typically employed. The choice of FPA detector is governed by the spectroscopic technique employed to characterize the sample of interest. For example, silicon (Si) charge-coupled device (CCD) detectors or CMOS detectors are typically employed with visible wavelength fluorescence and Raman spectroscopic imaging systems, while indium gallium arsenide (InGaAs) FPA detectors are typically employed with near-infrared spectroscopic imaging systems.
  • Spectroscopic imaging of a sample can be implemented by one of two methods. First, a point-source illumination can be provided on the sample to measure the spectra at each point of the illuminated area. Second, spectra can be collected over the an entire area encompassing the sample simultaneously using an electronically tunable optical imaging filter such as an acousto-optic tunable filter (AOTF), a multi-conjugate tunable filter (MCF), or a liquid crystal tunable filter (LCTF). Here, the organic material in such optical filters are actively aligned by applied voltages to produce the desired bandpass and transmission function. The spectra obtained for each pixel of such an image thereby forms a complex data set referred to as a hyperspectral image which contains the intensity values at numerous wavelengths or the wavelength dependence of each pixel element in this image.
  • The ability to determine a disease state is critical to histological analysis. Such testing often requires obtaining the spectrum of a sample at different wavelengths. Conventional spectroscopic devices operate over a limited range of wavelengths due to the operation ranges of the detectors or tunable filters possible. This enables analysis in the Ultraviolet (UV), visible (VIS), near infrared (NIR), short wave infrared (SWIR) mid infrared (MIR) wavelengths and to some overlapping ranges. These correspond to wavelengths of about 180-380 nm (UV), 380-700 nm (VIS), 700-2500 nm (NIR), 850-1700 nm (SWIR) and 2500-25000 nm (MIR).
  • Various types of spectroscopy and imaging may be explored for detection of various types of diseases in particular cancers. Raman spectroscopy is based on irradiation of a sample and detection of scattered radiation, and it can be employed non-invasively to analyze biological samples in situ. Thus, little or no sample preparation is required. Raman spectroscopy techniques can be readily performed in aqueous environments because water exhibits very little, but predictable, Raman scattering. It is particularly amenable to in vivo measurements as the powers and excitation wavelengths used are non-destructive to the tissue and have a relatively large penetration depth.
  • Chemical imaging is a reagentless tissue imaging approach based on the interaction of laser light with tissue samples. The approach yields an image of a sample wherein each pixel of the image is the spectrum of the sample at the corresponding location. The spectrum carries information about the local chemical environment of the sample at each location. For example, Raman chemical imaging (RCI) has a spatial resolving power of approximately 250 nm and can potentially provide qualitative and quantitative image information based on molecular composition and morphology.
  • The vast majority of diseases, in particular cancer cases, are pathologically diagnosed using tissue from a biopsy specimen. Therefore it is desirable to devise systems and methodologies that use spectroscopic techniques to diagnose biological samples.
  • SUMMARY OF THE INVENTION
  • The present disclosure provides for a system and method for assessing biological samples. More specifically, the invention of the present disclosure provides for the use of SWIR and/or visible spectroscopic and imaging techniques to diagnose biological samples. This diagnosis may include, but is not limited to, determining at least one of: a disease state, a metabolic state, a clinical outcome, a disease progression, and combinations thereof.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a schematic representation of an exemplary system of the present disclosure.
  • FIGS. 2A and 2B are schematic representations of an exemplary spectroscopy module of the present disclosure.
  • FIG. 3 is a schematic representation of an exemplary system of the present disclosure.
  • FIG. 4 is illustrative of a method of the present disclosure.
  • FIG. 5 is illustrative of a method of the present disclosure.
  • FIG. 6A is illustrative of the detection capabilities of the system and method of the present disclosure.
  • FIG. 6B is illustrative of the detection capabilities of the system and method of the present disclosure.
  • FIG. 6C is illustrative of the detection capabilities of the system and method of the present disclosure.
  • DETAILED DESCRIPTION
  • Reference will now be made in detail to the preferred embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the specification to refer to same or like parts.
  • FIG. 1 illustrates an exemplary system 100 according to one embodiment of the present disclosure. System 100 includes a spectroscopy module 110 in communication with a processing module 120. Processing module 120 may include a processor 122, databases 123, 124, 125 and 126, and machine readable program code 128. The machine readable program code 128 may contain executable program instructions, and the processor 122 may be configured to execute the machine readable program code 128 so as to perform the methods of the present disclosure. In one embodiment, the program code 128 may contain the ChemImage Xpert™ software marketed by ChemImage Corporation of Pittsburgh, Pa. The Xpert™ software may be used to process spectroscopic data and information received from the spectroscopy module 110 to obtain various spectral plots and images, and to also carry out various multivariate image analysis methods discussed later herein below.
  • FIG. 2A illustrates an exemplary schematic layout of the spectroscopy module 110 shown in FIG. 1. The layout in FIG. 2A may relate to a chemical imaging system marketed by ChemImage Corporation of Pittsburgh, Pa. In one embodiment, the spectroscopy module 110 may include a microscope module 140 containing optics for microscope applications. An illumination source 142 (e.g., a laser illumination source) may provide illuminating photons to a sample (not shown) handled by a sample positioning unit 144 via the microscope module 140. In one embodiment, photons transmitted, reflected, emitted, or scattered from the illuminated sample (not shown) may pass through the microscope module (as illustrated by exemplary blocks 146, 148 in FIG. 2A) before being directed to one or more of spectroscopy or imaging optics in the spectroscopy module 110. In the embodiment of FIG. 2A, visible imaging 154 and SWIR imaging 152 are illustrated as standard. In other embodiments, the modes of Raman imaging 158, fluorescence imaging 156, NIR imaging 151, and video imaging 150 may also be implemented.
  • The spectroscopy module 110 may also include a control unit 160 to control operational aspects (e.g., focusing, sample placement, laser beam transmission, etc.) of various system components including, for example, the microscope module 140 and the sample positioning unit 144 as illustrated in FIG. 2A. In one embodiment, operation of various components (including the control unit 160) in the spectroscopy module 110 may be fully automated or partially automated, under user control.
  • It is noted here that in the discussion herein the terms “illumination,” “illuminating,” “irradiation,” and “excitation” are used interchangeably as can be evident from the context. For example, the terms “illumination source,” “light source,” and “excitation source” are used interchangeably. Similarly, the terms “illuminating photons” and “excitation photons” are also used interchangeably. Furthermore, although the discussion hereinbelow focuses more on visible and SWIR spectroscopy and imaging, various methodologies discussed herein may be adapted to be used in conjunction with other types of spectroscopy applications as can be evident to one skilled in the art based on the discussion provided herein.
  • FIG. 2B illustrates exemplary details of the spectroscopy module 110 in FIG. 2A according to one embodiment of the present disclosure. Spectroscopy module 110 may operate in several experimental modes of operation including bright field reflectance and transmission imaging, polarized light imaging, differential interference contrast (DIC) imaging, UV induced autofluorescence imaging, NIR imaging, wide field illumination whole field Raman spectroscopy, wide field spectral fluorescence imaging, wide field visible imaging, wide field SWIR imaging, wide field visible imaging, and wide field spectral Raman imaging. Module 110 may include collection optics 203, light sources 202 and 204, and a plurality of spectral information processing devices including, for example: a tunable fluorescence filter 222, a tunable Raman filter 218, a dispersive spectrometer 214, a plurality of detectors including a fluorescence detector 224, and Raman detectors 216 and 220, a fiber array spectral translator (“FAST”) device 212, filters 208 and 210, and a polarized beam splitter (PBS) 219.
  • A FAST device may comprise a two-dimensional array of optical fibers drawn into a one-dimensional fiber stack so as to effectively convert a two-dimensional field of view into a curvilinear field of view, and wherein said two-dimensional array of optical fibers is configured to receive said photons and transfer said photons out of said fiber array spectral translator device and to at least one of: a spectrometer, a filter, a detector, and combinations thereof.
  • The FAST device can provide faster real-time analysis for rapid detection, classification, identification, and visualization of, for example, explosive materials, hazardous agents, biological warfare agents, chemical warfare agents, and pathogenic microorganisms, as well as non-threatening objects, elements, and compounds. FAST technology can acquire a few to thousands of full spectral range, spatially resolved spectra simultaneously, This may be done by focusing a spectroscopic image onto a two-dimensional array of optical fibers that are drawn into a one-dimensional distal array with, for example, serpentine ordering. The one-dimensional fiber stack may be coupled to an imaging spectrometer, a detector, a filter, and combinations thereof. Software may be used to extract the spectral/spatial information that is embedded in a single CCD image frame.
  • One of the fundamental advantages of this method over other spectroscopic methods is speed of analysis. A complete spectroscopic imaging data set can be acquired in the amount of time it takes to generate a single spectrum from a given material. FAST can be implemented with multiple detectors. Color-coded FAST spectroscopic images can be superimposed on other high-spatial resolution gray-scale images to provide significant insight into the morphology and chemistry of the sample.
  • The FAST system allows for massively parallel acquisition of full-spectral images. A FAST fiber bundle may feed optical information from is two-dimensional non-linear imaging end (which can be in any non-linear configuration, e.g., circular, square, rectangular, etc.) to its one-dimensional linear distal end. The distal end feeds the optical information into associated detector rows. The detector may be a CCD detector having a fixed number of rows with each row having a predetermined number of pixels. For example, in a 1024-width square detector, there will be 1024 pixels (related to, for example, 1024 spectral wavelengths) per each of the 1024 rows.
  • The construction of the FAST array requires knowledge of the position of each fiber at both the imaging end and the distal end of the array. Each fiber collects light from a fixed position in the two-dimensional array (imaging end) and transmits this light onto a fixed position on the detector (through that fiber's distal end).
  • Each fiber may span more than one detector row, allowing higher resolution than one pixel per fiber in the reconstructed image. In fact, this super-resolution, combined with interpolation between fiber pixels (i.e., pixels in the detector associated with the respective fiber), achieves much higher spatial resolution than is otherwise possible. Thus, spatial calibration may involve not only the knowledge of fiber geometry (i.e., fiber correspondence) at the imaging end and the distal end, but also the knowledge of which detector rows are associated with a given fiber.
  • In one embodiment, a system of the present disclosure may comprise FAST technology available from ChemImage Corporation, Pittsburgh, Pa. This technology is more fully described in the following U.S. Patents, hereby incorporated by reference in their entireties: U.S. Pat. No. 7,764,371, filed on Feb. 15, 2007, entitled “System And Method For Super Resolution Of A Sample In A Fiber Array Spectral Translator System”; U.S. Pat. No. 7,440,096, filed on Mar. 3, 2006, entitled “Method And Apparatus For Compact Spectrometer For Fiber Array Spectral Translator”; U.S. Pat. No. 7,474,395, filed on Feb. 13, 2007, entitled “System And Method For Image Reconstruction In A Fiber Array Spectral Translator System”; and U.S. Pat. No. 7,480,033, filed on Feb. 9, 2006, entitled “System And Method For The Deposition, Detection And Identification Of Threat Agents Using A Fiber Array Spectral Translator”.
  • In another embodiment, the system of FIG. 2B may be configured to operate in a visible and/or SWIR configuration. In such an embodiment, fluorescence CCD 224, Raman dispersive CCD 216, and/or Raman imaging CCD 220 may be replaced with at least one of a visible CCD, a SWIR CCD and combinations thereof. The present disclosure contemplates that other detectors may be used including, but not limited to: ICCD detectors, CMOS detectors, geranium detectors, InGaAs detectors, and combinations thereof. In such a visible and/or SWIR configuration, the FILCTF 222 and/or Raman LCTF 218 may be replaced with at least one of a visible LCTF, a SWIR LCTF, and combinations thereof. The present disclosure also contemplates that other tunable filters may also be used, including but not limited to: a liquid crystal tunable filter, a multi-conjugate tunable filter, an acousto-optical tunable filter, a Lyot liquid crystal tunable filter, an Evans split-element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a ferroelectric liquid crystal tunable filter, a Fabry Perot liquid crystal tunable filter, and combinations thereof.
  • In one embodiment, the processor 122 (FIG. 1) may be operatively coupled to light sources 202 and 204, and the plurality of spectral information processing devices 214, 218 and 222. In another embodiment, the processor 122 (FIG. 1), when suitably programmed, can configure various functional parts of the spectroscopy module in FIG. 1 and may also control their operation at run time. The processor, when suitably programmed, may also facilitate various remote data transfer and analysis operations discussed in conjunction with FIG. 3. Module 110 may optionally include a video camera 205 for video imaging applications. Although not shown in FIG. 2B, spectroscopy module 110 may include many additional optical and electrical components to carry out various spectroscopy and imaging applications supported thereby.
  • A sample 201 may be placed at a focusing location (e.g., by using the sample positioning unit 144 in FIG. 2A) to receive illuminating photons and to also provide reflected, emitted, scattered, or transmitted photons from the sample 201 to the collection optics 203. Sample 201 may include a variety of biological samples. In one embodiment, the sample 201 includes at least one cell or a tissue containing a plurality of cells. The sample may contain normal (non-diseased or benign) cells, diseased cells (e.g., cancerous tissues with or without a progressive cancer state or malignant cells with or without a progressive cancer state) or a combination of normal and diseased cells. In one embodiment, the cell/tissue is a mammalian cell/tissue. Some examples of biological samples may include prostate cells, kidney cells, lung cells, colon cells, bone marrow cells, brain cells, red blood cells, and cardiac muscle cells. In one embodiment, the biological sample may include prostate cells. In one such embodiment, the biological sample may include Gleason 6 prostate cells: In another such embodiment, the biological sample may include Gleason 7 prostate cells. In another embodiment the biological sample may include a renal sample. In one such embodiment, the biological sample may include renal oncocytoma cells. In another such embodiment, the biological sample may include chromophobe renal carcinoma. In another embodiment, the sample 201 may include cells of plants, non-mammalian animals, fungi, protists, and monera. In yet another embodiment, the sample 201 may include a test sample (e.g., a biological sample under test to determine its metabolic state or its disease status or to determine whether it is cancerous state would progress to the next level). The “test sample,” “target sample” or unknown sample are used interchangeably herein to refer to a biological sample or renal sample under investigation, wherein such interchange use may be without reference to such biological sample's metabolic state or disease status.
  • A progressive cancer state is a cancer that will go on to become aggressive and acquire subsequent treatment by more aggressive means in order for the patient to survive. An example of progressive cancer is a Gleason score 7 cancer found in a prostate which has been surgically removed, where the patient, subsequent to the removal of the prostate, develops metastatic cancer. In this example the cancer progressed even after the removal of the source organ. Progressive cancers can be detected and identified in other organs and different types of cancer.
  • A non-progressive cancer is a cancer that does not progress to more advanced disease, requiring aggressive treatment. Many prostate cancers are non-progressive by this definition because though they are cancer by standard histopathological definition, they do not impact the life of the patient in a way that requires significant treatment. In many cases such cancers are observed and treated only if they show evidence of becoming progressive. Again, this is not a state particular to prostate cancer. Cancer cells are present in tissues of many health people. Because these do not ever transition to a state where they become progressive in terms of growth, danger to the patient, or inconvenience to the patient they would be considered non-progressive as the term is used herein.
  • The designation of progressive vs. non progressive can also be extended to other disease or metabolic states. As an example, diabetes can be clinically described as “stable”, “well managed” by a clinician and would fall into the non-progressive class. In contrast diabetes can be progressing through the common course of the disease with all of the effects on kidneys, skin, nerves, heart and other organs which are part of the disease. As a second example multiple sclerosis is a disease which exists in many people is a stable, non-progressive state. In some people the disease rapidly progresses through historically observed pattern of physical characteristics with clinical manifestations.
  • The cells can be isolated cells, such as individual blood cells or cells of a solid tissue that have been separated from other cells of the tissue (e.g., by degradation of the intracellular matrix). The cells can also be cells present in a mass, such as a bacterial colony grown on a semi-solid medium or an intact or physically disrupted tissue. By way of example, blood drawn from a human can be smeared on the surface of a suitable substrate (e.g., an aluminum-coated glass slide) and individual cells in the sample can be separately imaged by light microscopy and SWIR and/or visible analysis using the spectroscopy module 110 of FIG. 2B. Similarly a slice of a solid tissue (e.g., a piece of fresh tissue or a paraffin-embedded thin section of a tissue) can be imaged on a suitable surface.
  • The cells can be cells obtained from a subject (e.g., cells obtained from a human blood or urine sample, semen sample, tissue biopsy, or surgical procedure). Cells can also be studied where they naturally occur, such as cells in an accessible location (e.g., a location on or within a human body), cells in a remote location using a suitable probe, or by revealing cells (e.g., surgically) that are not normally accessible.
  • Referring again to FIG. 2B, light source 202 may be used to irradiate the sample 201 with substantially monochromatic light. Light source 202 can include any conventional photon source, including, for example, a laser, an LED (light emitting diode), or other IR (infrared) or near IR (NIR) devices. The substantially monochromatic radiation reaching sample 201 illuminates the sample 201, and may produce photons scattered from different locations on or within the illuminated sample 201. A portion of the Raman scattered photons from the sample 201 may be collected by the collection optics 203 and directed to dispersive spectrometer 214 or Raman tunable filter 218 for further processing discussed later herein below. In one embodiment, light source 202 includes a laser light source producing light at 532.1 nm. The laser excitation signal is focused on the sample 201 through combined operation of reflecting mirrors M1, M2, M3, the filter 208, and the collection optics 203 as illustrated by an exemplary optical path in the embodiment of FIG. 2B. The filter 208 may be tilted at a specific angle from the vertical (e.g., at 6.5.sup.0) to reflect laser illumination onto the mirror M3, but not to reflect Raman-scattered photons received from the sample 201. The other filter 210 may not be tilted (i.e., it remains at 0.sup.0 from the vertical). Filters 208 and 210 may function as laser line rejection filters to reject light at the wavelength of laser light source 202.
  • In the spectroscopy module 110 in the embodiment of FIG. 2B, the second light source 204 may be used to irradiate the sample 201 with ultraviolet light or visible light. In one embodiment, the light source 204 includes a mercury arc (Hg arc) lamp that produces ultraviolet radiation (UV) having wavelength at 365 nm for fluorescence spectroscopy applications. In yet another embodiment, the light source 204 may produce visible light at 546 nm for visible light imaging applications. A polarizer or neutral density (ND) filter with or without a beam splitter (BS) may he provided in front of the light source 204 to obtain desired illumination light intensity and polarization.
  • In the embodiment of FIG. 2B, the dispersive spectrometer 214 and the Raman tunable filter 218 function to produce test data sets of sample 201. A test data set, in one embodiment, may correspond to one or more of the following: a plurality of Raman spectra of the sample; and a plurality of spatially accurate wavelength resolved Raman images of the sample. In one embodiment, the plurality of Raman spectra is generated by dispersive spectral measurements of individual cells. In this embodiment, the illumination of the individual cell may cover the entire area of the cell so the dispersive Raman spectrum is an integrated measure of spectral response from all the locations within the cell.
  • In another embodiment, the Raman data set corresponds to a three dimensional block of Raman data (e.g., a spectral hypercube or a Raman image) having spatial dimensional data represented in the x and y dimensions and wavelength data represented in the z dimension. Each Raman image has a plurality of pixels where each has a corresponding x and y position in the Raman image. The Raman image may have one or more regions of interest. The regions of interest may be identified by the size and shape of one or more pixels and is selected where the pixels are located within the regions of interest. A single Raman spectrum is then extracted from each pixel located in the region of interest, leading to a plurality of Raman spectra for each of the regions of interest. The extracted plurality of Raman spectra are then designated as the Raman data set. In this embodiment, the plurality of Raman spectra and the plurality of spatially accurate wavelength resolved Raman images are generated, as components of the hypercube, by a combination of the Raman tunable filter 218 and Raman imaging detector 220 or by a combination of the FAST device 212, the dispersive spectrometer 214, and the Raman detector 216.
  • In another embodiment, configured for visible and/or SWIR analysis of a biological sample, a test data set may correspond to one or more of the following: a plurality of visible spectra of the sample, a plurality of SWIR spectra of the sample, a plurality of spatially accurate wavelength resolved visible images of the sample, a plurality of spatially accurate wavelength resolved SWIR images of the sample, and combinations thereof. In one embodiment, a plurality of spectra may be generated by dispersive spectral measurements of individual cells. In this embodiment, the illumination of the individual cell may cover the entire area of the cell so the dispersive spectrum is an integrated measure of spectral response from all the locations within the cell.
  • In another embodiment, the test data set corresponds to a three dimensional block of data (e.g., a spectral hypercube or a visible or SWIR image) having spatial dimensional data represented in the x and y dimensions and wavelength data represented in the z dimension. Each visible or SWIR image has a plurality of pixels where each has a corresponding x and y position in the image. The visible or SWIR image may have one or more regions of interest. The regions of interest may be identified by the size and shape of one or more pixels and is selected where the pixels are located within the regions of interest. A single spectrum is then extracted from each pixel located in the region of interest, leading to a plurality of spectra for each of the regions of interest. The extracted plurality of spectra is then designated as the test data set. In this embodiment, the plurality of spectra and the plurality of spatially accurate wavelength resolved images are generated, as components of the hypercube, by a combination of a tunable filter and imaging detector or by a combination of the FAST device, a dispersive spectrometer, and a detector.
  • In yet another embodiment, a Raman dataset is generated using a Raman image to identify one or more regions of interest of the sample 201. In one such embodiment, the one or more regions of interest contain at least one of the following: an epithelium area, a stroma area, epithelial-stromal junction (ESJ) area and/or nuclei area. A plurality of Raman spectra may be obtained from the one or more of regions of interest of the sample 201. In standard operation the Raman spectrum generated by selecting a region of interest in a Raman image is the average spectrum of all the spectra at each pixel within the region of interest. The standard deviation between of all the spectra in the region of interest may be displayed along with the average Raman spectrum of the region of interest. Alternatively, all of the spectra associated with pixels within a region can be considered as a plurality of spectra, without the step of reducing them to a mean and standard deviation.
  • With further reference to FIG. 2B, the fluorescence tunable filter 222 may function to produce fluorescence data sets of the photons emitted from the sample 201 under suitable illumination (e.g., UV illumination). In one embodiment, the fluorescence data set includes a plurality of fluorescence spectra of sample 201 and/or a plurality of spatially accurate wavelength resolved fluorescence images of sample 201. A fluorescence spectrum of sample 210 may contain a fluorescence emission signature of the sample 201. In one embodiment, the emission signature may be indicative of a fluorescent probe (e.g., fluorescein isothiocyanate) within the sample 201. The fluorescence data sets may be detected by fluorescence CCD detector 224. A portion of the fluorescence emitted photons or visible light reflected photons from the sample 201 may be directed to the video imaging camera 205 via a mirror M4 and appropriate optical signal focusing mechanism.
  • In one embodiment, a microscope objective (including the collection optics 203) may be automatically or manually zoomed in or out to obtain proper focusing of the sample.
  • The entrance slit (not shown) of the spectrometer 214 may be optically coupled to the output end of the fiber array spectral translator device 212 to disperse the Raman scattered photons received from the FAST device 212 and to generate a plurality of spatially resolved Raman spectra from the wavelength-dispersed photons. The FAST device 212 may receive Raman scattered photons from the beam splitter 219, which may split and appropriately polarize the Raman scattered photons received from the sample 201 and transmit corresponding portions to the input end of the FAST device 212 and the input end of the Raman tunable filter 218.
  • Referring again to FIG. 2B, the tunable fluorescence filter 222 and the tunable Raman filter 218 may be used to individually tune specific photon wavelengths of interest and to thereby generate a plurality of spatially accurate wavelength resolved spectroscopic fluorescence images and Raman images, respectively, in conjunction with corresponding detectors 224 and 220. In one embodiment, each of the fluorescence filter 222 and the Raman filter 218 includes a two-dimensional tunable filter, such as, for example, an electro-optical tunable filter, a liquid crystal tunable filter (LCTF), or an acousto-optical tunable filter (AOTF). A tunable filter may be a band-pass or narrow band filter that can sequentially pass or “tune” fluorescence emitted photons or Raman scattered photons into a plurality of predetermined wavelength bands. The plurality of predetermined wavelength bands may include specific wavelengths or ranges of wavelengths. In one embodiment, the predetermined wavelength bands may include wavelengths characteristic of the sample undergoing analysis. The wavelengths that can be passed through the fluorescence filter 222 and Raman filter 218 may range from 200 nm (ultraviolet) to 2000 nm (i.e., the far infrared). The choice of a tunable filter depends on the desired optical region and/or the nature of the sample being analyzed. Additional examples of a two-dimensional tunable filter may include a Fabry Perot angle tuned filter, a Lyot filter, an Evans split element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a spectral diversity filter, a photonic crystal filter, a fixed wavelength Fabry Perot tunable filter, an air-tuned Fabry Perot tunable filter, a mechanically-tuned Fabry Perot tunable filter, and a liquid crystal Fabry Perot tunable filter. As noted before, the tunable filters 218, 222 may be selected to operate in one or more of the following spectral ranges: the ultraviolet (UV), visible, and near infrared. In one such embodiment, the tunable filters 218, 222 may be selected to operate in spectra ranges of 900-1155 cm−.sup.1 and 15-30-1850 cm−.sup.1 Raman shift values.
  • In one embodiment, a multi-conjugate filter (MCF) may be used instead of a simple LCTF (e.g., the LCTF 218 or 222) to provide more precise wavelength tuning of photons received from the sample 201. Some exemplary multi-conjugate filters are discussed, for example, in U.S. Pat. No. 6,992,809, titled “Multi-Conjugate Liquid Crystal Tunable Filter;” and in the United States Published Patent Application Number US2007/0070260A1, titled “Liquid Crystal Filter with Tunable Rejection Band,” the disclosures of both of these publications are incorporated herein by reference in their entireties.
  • In the embodiment of FIG. 2B, the fluorescence spectral data sets (output from the tunable filter 222) may be detected by the detector 224, and the Raman spectral data sets (output from the spectrometer 214 and the tunable filter 218) may be detected by detectors 216 and 220. The detectors 216, 220, and 224 may detect received photons in a spatially accurate manner. Detectors 216, 220 and 224 may include an optical signal (or photon) collection device such as, for example, an image focal plane array (FPA) detector, a charge coupled device (CCD) detector, or a CMOS (Complementary Metal Oxide Semiconductor) array sensor. Detectors 216, 220 and 224 may measure the intensity of scattered, transmitted or reflected light incident upon their sensing surfaces (not shown) at multiple discrete locations or pixels, and transfer the spectral information received to the processor module 120 for storage and analysis. The optical region employed to characterize the sample of interest governs the choice of two-dimensional array detector. For example, a two-dimensional array of silicon charge-coupled device (CCD) detection elements can be employed with visible wavelength emitted or reflected photons, or with Raman scatter photons, while gallium arsenide (GaAs) and gallium indium arsenide (InGaAs) FPA detectors can be employed for image analyses at near infrared wavelengths. The choice of such devices may also depend on the type of sample being analyzed.
  • In one embodiment, a display unit (not shown) may be provided to display spectral data collected by various detectors 216, 220, 224 in a predefined or user-selected format. The display unit may be a computer display screen, a display monitor, an LCD (liquid crystal display) screen, or any other type of electronic display device.
  • Referring again to FIG. 1, the databases 123-126 may store various reference spectral data sets including, for example, a reference SWIR data set, a reference visible data set, a reference Raman data set, a reference fluorescence data set, a reference NIR data set, etc. The reference data sets may be collected from different samples and may be used to detect or identify the sample 201 from comparison of its spectral data set with the reference data sets. In one embodiment, during operation, the test data sets of the sample 201 also may be stored in one or more of the databases (e.g., database 123) of the processing module 120.
  • For example, in one embodiment, database 123 may be used to store a plurality of reference data sets from reference cells having a known diagnosis, such as metabolic state or disease state. In one such embodiment, the reference data sets may correspond to a plurality of reference spectra. In another such embodiment, the Raman data sets may correspond to a plurality of reference spatially accurate wavelength resolved images.
  • In another embodiment, the database 124 may be used to store a first plurality of reference data sets from reference normal (non-diseased) cells. In one embodiment, the first reference set of data sets may include a plurality of first reference spectra. In another embodiment, a first reference spectrum may correspond to a dispersive spectrum. In a further embodiment, the first reference set of data sets may include a plurality of first reference spatially accurate wavelength resolved images obtained from corresponding reference normal cells.
  • In yet another embodiment, the database 125 may store a second plurality of reference data sets from different types of reference diseased cells. In one such embodiment, the reference diseased cells correspond to chromophobe renal carcinoma cells. In one embodiment, the second reference set of data sets includes a plurality of second reference spectra. In one embodiment, the second reference spectrum may correspond to a dispersive spectrum. In another embodiment, the second reference set of data sets may include a plurality of second reference spatially accurate wavelength resolved images obtained from corresponding reference diseased cells.
  • Similarly, database 126 may store a plurality of reference SWIR and/or visible spectra and/or a plurality of reference spatially accurate wavelength resolved SWIR and/or visible spectroscopic images obtained from reference biological samples (e.g., cancerous human tissues). One or more of the reference biological samples may include probe molecules (e.g., fluorescein isothiocyanate). In one embodiment, a single database may be used to store all types of spectra.
  • The reference data sets may be associated with a reference image. In one such embodiment, the reference image may include at least one of: a SWIR image, a visible image, a brightfield image; a polarized light image; and a UV-induced autofluorescence image.
  • FIG. 3 depicts an exemplary setup to remotely perform spectroscopic analysis of test samples according to one embodiment of the present disclosure. Spectroscopic data from a test sample or a test sample may be collected at a data generation site 260 using a spectroscopy module 265. In one embodiment, the spectroscopy module may be functionally similar to the spectroscopy module 110 discussed hereinbefore with reference to FIGS. 2A-2B. The spectroscopic data collected at the data generation site 260 may be transferred to a data analysis site 270 via a communication network 272. In one embodiment, the communication network 272 may be any data communication network such as an Ethernet LAN (local area network) connecting all the data processing and computing units within a facility, e.g., a university research laboratory, or a corporate research center. In that case, the data generation site 260 and the data analysis site 270 may be physically located within the same facility, e.g., a university research laboratory or a corporate research center. In alternative embodiments, the communication network 272 may include, independently or in combination, any of the present or future wireline or wireless data communication networks such as, for example, the Internet, the PSTN (public switched telephone network), a cellular telephone network, a WAN (wide area network), a satellite-based communication link, a MAN (metropolitan area network), etc. In this case, the data generation site 260 and the data analysis site 270 may be physically located in different facilities. In some embodiments, the data generation site 260 and the data analysis site 270 that are linked by the communication network 272 may be owned or operated by different entities.
  • The data analysis site 270 may include a processing module 275 to process the spectroscopic data received from the data generation site 260. In one embodiment, the processing module 275 may be similar to the processing module 120 and may also include a number of different databases (not shown) storing different reference spectroscopic data sets (e.g., a first plurality of reference data sets for non-progressive cancer tissues, a second plurality of reference data sets for progressive cancer tissues, a third plurality of reference data sets for normal or non-diseased tissues; a fourth plurality of reference data set for renal oncocytomas samples and chromophobe renal cell carcinoma samples, etc.). The processing module 275 may include a processor (similar to the processor 122 of the processing module 120 in FIG. 1) that is configured to execute program code or software to perform various spectral data processing tasks according to the teachings of the present disclosure. The machine-readable program code containing executable program instructions may be initially stored on a portable data storage medium, e.g., a floppy diskette 294, a compact disc or a DVD 295, a data cartridge tape (not shown), or any other suitable digital data storage medium. The processing module 275 may include appropriate disk drives to receive the portable data storage medium and may be configured to read the program code stored thereon, thereby facilitating execution of the program code by its processor. The program code, upon execution by the processor of the processing module 275, may cause the processor to perform a variety of data processing and display tasks including, for example, initiate transfer of spectral data set from the data generation site 260 to the data analysis site 270 via the communication network 272, compare the received spectral data set to various reference data sets stored in the databases of the processing module 275, classify or identify the test sample based on the comparison (e.g., whether the test sample has a progressive cancer or non-progressive cancer state or whether the test sample has renal oncocytomas disease or chromophobe renal cell carcinoma disease), transfer the classification or identification results to the data generation site 260 via the communication network 272, etc.
  • In one embodiment, the data analysis site 270 may include one or more computer terminals 286A-286C communicatively connected to the processing module 275 via corresponding data communication links 290A-290C, which can be serial, parallel, or wireless communication links, or a suitable combination thereof. Thus, users may utilize functionalities of the processing module 275 via their computer terminals 286A-286C, which may also be used to display spectroscopic data received from the data generation site 260 and the results of the spectroscopic data processing by the processing module 275, among other applications. It is evident that in a practical application, there may be many more computer terminals 286 than just three terminals shown in FIG. 3.
  • The computer terminals 286A-286C may be, e.g., a personal computer (PC), a graphics workstation, a multiprocessor computer system, a distributed network of computers, or a computer chip embedded as part of a machine or mechanism. Similarly, the data generation site 260 may include one or more of such computers (not shown) for viewing the results of the spectroscopic analysis received from the data analysis site 270. Each computer terminal, whether at the data generation site 260 or at the data analysis site 270, may include requisite data storage capability in the form of one or more volatile and non-volatile memory modules. The memory modules may include RAM (random access memory), ROM (read only memory) and HDD (hard disk drive) storage.
  • It is noted that the arrangement depicted in FIG. 3 may be used to provide a commercial, network-based spectroscopic data processing service that may perform customer-requested processing of spectroscopic data in real time or near real time. For example, the processing module 275 at the data analysis site 270 may be configured to identify a test sample from the spectroscopic data remotely submitted to it over the communication network 272 (e.g., the Internet) from the spectroscopy module 265 automatically or through an operator at the data generation site 260. The client site (data generation site) 260 may be, for example, a government laboratory or a medical facility or pathological laboratory. The results of spectroscopic data analysis may be transmitted back to the client site 260 for review and further analysis. In one embodiment, the whole data submission, analysis, and reporting process can be automated.
  • It is further noted that the owner or operator of the data analysis site 270 may commercially offer a network-based spectroscopic data content analysis service, as illustrated by the arrangement in FIG. 3, to various individuals, corporations, governmental entities, laboratories, or other facilities on a fixed-fee basis, on a per-operation basis or on any other payment plan mutually convenient to the service provider and the service recipient.
  • Processing module 120 may also include a test database associated with a test biological sample having an unknown metabolic state. In one such embodiment, the test data set may correspond to a plurality of SWIR and/or visible spectra of the test biological sample. In another such embodiment, the test data set may correspond to a plurality of spatially accurate wavelength resolved SWIR and/or visible images of the test biological sample. In another embodiment, each of the test SWIR and/or visible data sets may be associated with least one of the following: a corresponding test SWIR image; a corresponding test visible image; and another corresponding test image. In one such embodiment, this other test image may include at least one of the following: a brightfield image; a polarized light image; and a UV-induced autofluorescence image.
  • In one such embodiment, processing module 120 may also include a test database associated with a test biological sample having an unknown diagnosis. In one such embodiment, the test data set may correspond to a plurality of SWIR and/or visible spectra of the test biological sample. In another such embodiment, the test data set may correspond to a plurality of spatially accurate wavelength resolved SWIR images of the test biological sample. In another embodiment, the test data set may correspond to a plurality of spatially accurate wavelength resolved visible images. In another embodiment, each of the test data sets may be associated with least one of the following: a corresponding test SWIR image; a corresponding test visible image; and another corresponding image. In one such embodiment, the other image may include at least one of the following: a brightfield image; a polarized light image; and a UV-induced autofluorescence image.
  • In one embodiment, the test spectra are generated using a test image to identify one or more regions of interest of the test biological sample. In one such embodiment, the one or more regions of interest contain at least one of the following: an epithelium area, a stroma area, epithelial-stromal junction (ESJ) area, and/or nuclei area. A plurality of test spectra may be obtained from the one or more of regions of interest of the test biological sample.
  • A diagnosis of a test sample as diseased or non-diseased or a prediction of the metabolic state of a test sample may be made by comparing a test data set to reference data sets using a chemometric technique. In one embodiment, the chemometric technique may be spectral unmixing. The application of spectral unmixing to determine the identity of components of a mixture is described in U.S. Pat. No. 7,072,770, entitled “Method for Identifying Components of a Mixture via Spectral Analysis, issued on Jul. 4, 2006, which is incorporated herein by reference in it entirety. Spectral unmixing as described in the above referenced patent can be applied as follows: Spectral unmixing requires a library of spectra which include possible components of the test sample. The library can in principle be in the form of a single spectrum for each component, a set of spectra for each component, a single SWIR and/or visible image for each component, a set of SWIR and/or visible images for each component, or any of the above as recorded after a dimension reduction procedure such as Principle Component Analysis. In the methods discussed herein, the library used as the basis for application of spectral unmixing is the reference data sets.
  • With this as the library, a set of measurements made on a sample of unknown state, described herein as a test SWIR and/or visible data set, is assessed using the methods of U.S. Pat. No. 7,072,770 to determine the most likely groups of components which are present in the sample. In this instance the components are actually disease states of interest and/or clinical outcome. The result is a set of disease state groups and/or clinical outcome groups with a ranking of which are most likely to be represented by the test data set.
  • Given a set of reference spectra, such as those described above, a piece or set of test data can be evaluated by a process called spectral mixture resolution. In this process, the test spectrum is approximated with a linear combination of reference spectra with a goal of minimizing the deviation of the approximation from the test spectrum. This process results in a set of relative weights for the reference spectra.
  • In one embodiment, the chemometric technique may be Principal Component Analysis. Using Principal Component Analysis results in a set of mathematical vectors defined based on established methods used in multivariate analysis. The vectors form an orthogonal basis, meaning that they are linearly independent vectors. The vectors are determined based on a set of input data by first choosing a vector which describes the most variance within the input data. This first “principal component” or PC is subtracted from each of the members of the input set. The input set after this subtraction is then evaluated in the same fashion (a vector describing the most variance in this set is determined and subtracted) to yield a second vector—the second principal component. The process is iterated until either a chosen number of linearly independent vectors (PCs) are determined, or a chosen amount of the variance within the input data is accounted for.
  • In one embodiment, the Principal Component Analysis may include a series of steps. A pre-determined vector space is selected that mathematically describes a plurality of reference data sets. Each reference data set may be associated with a known biological sample having an associated metabolic state. The test data set, may be transformed into the pre-determined vector space, and then a distribution of transformed data may be analyzed in the pre-determined vector space to generate a diagnosis.
  • In another embodiment, the Principal Component Analysis may include a series of steps. A pre-determined vector space is selected that mathematically describes a first plurality of reference data sets associated with a known biological sample having an associated diseased state and a second plurality of reference data sets associated with a known biological sample having an associated non-diseased state. The test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may be analyzed in the pre-determined vector space to generate a diagnosis.
  • In yet another embodiment, the Principal Component Analysis may include a series of steps. A pre-determined vector space is selected that mathematically describes a first plurality of reference data sets associated with a known biological sample having an associated progressive state and a second plurality of reference data sets associated with a known biological sample having an associated non-progressive state. The test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may be analyzed in the pre-determined vector space to generate a diagnosis.
  • In still yet another embodiment, the Principal Component Analysis may include a series of steps. A pre-determined vector space may be selected that mathematically describes a first plurality of reference data sets associated with a known diagnosis. The test data set may be transformed into the pre-determined vector space, and then a distribution of transformed data may he analyzed in the pre-determined vector space.
  • The analysis of the distribution of the transformed data may be performed using a classification scheme. Some examples of the classification scheme may include: Mahalanobis distance, Adaptive subspace detector, Band target entropy method, Neural network, and support vector machine as an incomplete list of classification schemes known to those skilled in the art.
  • In one such embodiment, the classification scheme is Mahalanobis distance. The Mahalanobis distance is an established measure of the distance between two sets of points in a multidimensional space that takes into account both the distance between the centers of two groups, but also the spread around each centroid. A Mahalanobis distance model of the data is represented by plots of the distribution of the spectra in the principal component space. The Mahalanobis distance calculation is a general approach to calculating the distance between a single point and a group of points. It is useful because rather than taking the simple distance between the single point and the mean of the group of points, Mahalanobis distance takes into account the distribution of the points in space as part of the distance calculation. The Mahalanobis distance is calculated using the distances between the points in all dimensions of the principal component space.
  • In one such embodiment, once the test data is transformed into the space defined by the predetermined PC vector space, the test data is analyzed relative to the pre-determined vector space. This may be performed by calculating a Mahalanobis distance between the test data set transformed into the pre-determined vector space and the data sets in the pre-determined vector space to generate a diagnosis.
  • The exemplary systems of FIGS. 1 and 2 may be used to perform methods to predict the clinical outcome of patients or diagnose a disease state of patients. Processor 122 is configured to execute program instructions to carry out these methods. In another embodiment of the present disclosure, the exemplary system of FIG. 3 may be used to carry out methods to predict the clinical outcome of patients. In this method, data obtained at a data generation site is transmitted to an analysis site to obtain a prediction of the metabolic state of a test biological sample. The prediction is then transmitted back to the data generation site. The transmission may be performed over a data communication network such as the Internet.
  • One embodiment of the present disclosure, illustrated by FIG. 4, provides for a method 400 for diagnosing a biological sample. In step 410 a biological sample may be illuminated to thereby generate a first plurality of interacted photons. In one embodiment, this illumination may be accomplished using wide-field illumination. In one embodiment, a first plurality of interacted photons may be selected from the group consisting of: photons scattered by said biological sample, photons reflected by said biological sample, photons absorbed by said biological sample, photons emitted by said biological sample, and combinations thereof. In step 420 said first plurality of interacted photons may be filtered. In one embodiment, this filtering may further comprise filtering said first plurality of interacted photons into a plurality of predetermined wavelength bands. In one embodiment, this filtering may be achieved using a filter selected from the group consisting of: a liquid crystal tunable filter, a multi-conjugate tunable filter, an acousto-optical tunable filter, a Lyot liquid crystal tunable filter, an Evans split-element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a ferroelectric liquid crystal tunable filter, a Fabry Perot liquid crystal tunable filter, and combinations thereof.
  • A first plurality of interacted photons may be detected in step 430 to thereby generate a test data set representative of said biological sample. In one embodiment, this test data set may comprise at least one of: a visible test data set, a SWIR test data set, and combinations thereof.
  • In one embodiment, a test data set may comprise a hyperspectral image. In another embodiment, a test data set may comprise at least one of: a spatially accurate wavelength resolved image, a spectra, and combinations thereof.
  • A test data set may be analyzed in step 440 to thereby diagnose said biological sample. In one embodiment, this diagnosis may comprise at least one of: a disease state of said biological sample, a metabolic state of said biological sample, a clinical outcome of said biological sample, a disease progression of said biological sample, and combinations thereof. In one embodiment, diagnosing a biological sample may further comprise assigning a Gleason score to said biological sample.
  • In another embodiment, the method 400 may further comprise selecting a pre-determined vector space that mathematically describes said test data set, transforming said test data set into said pre-determined vector space, and analyzing a distribution of said transformed test data set in the pre-determined vector space to thereby diagnose said biological sample.
  • In one embodiment, the method 400 may further comprise providing a database wherein said database comprises at least one reference data set, each reference data set associated with a known diagnosis. In one embodiment, each reference data set may be associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof. In such an embodiment, the analyzing of step 440 may further comprise comparing said test data set to at least one reference data set. This comparison may be accomplished using a chemometric technique. This chemometric technique may be selected from the group consisting of: principle components analysis, partial least squares discriminate analysis, cosine correlation analysis, Euclidian distance analysis, k-means clustering, multivariate curve resolution, band t. entropy method, mahalanobis distance, adaptive subspace detector, spectral mixture resolution, and combinations thereof.
  • In another embodiment, illustrated by FIG. 5, the present disclosure provides for a method 500 for diagnosing a biological sample. In step 510 a biological sample may be illuminated to thereby generate a first plurality of interacted photons. In step 520 said first plurality of interacted photons may be filtered. These first plurality of interacted photons may be detected in step 530 to thereby generate a test data set representative of said biological sample. In one embodiment, this test data set may comprise at least one of: a visible test data set, a SWIR test data set, and combinations thereof. In step 540, said test data set may be analyzed to thereby diagnose said biological sample, wherein said analyzing further comprises comparing said test data set to at least one reference data set using a chemometric technique.
  • The present disclosure contemplates the system and method disclosed herein may be used to analyze a variety of different types of biological samples. In one embodiment, a biological sample may comprise a tissue sample, an organ sample, and combinations thereof. In another embodiment, a biological sample may comprise at least one cell. In one embodiment, a biological sample may comprise at least one of: a kidney sample, a prostate sample, a breast sample, a pancreatic sample, a brain sample, a skin sample, an intestinal sample, a colon sample, a liver sample, a cardiac sample, a lung sample, an esophageal sample, a bladder sample, a blood sample, a urethral sample, an ovarian sample, a uterine sample, a testicular sample, a bone sample, a stomach sample, a tracheal sample, a tongue sample, a diaphragm sample, a nerve sample, a rectal sample, and combinations thereof.
  • The present disclosure also provides for a storage medium containing machine readable program code, which when executed by a processor, causes the processor to perform the following: illuminate a biological sample to thereby generate a first plurality of interacted photons, filter said first plurality of interacted photons to thereby separate said first plurality of interacted photons into a plurality of predetermined wavelength bands, detect said first plurality of interacted photons to thereby generate a test data set representative of said biological sample, wherein said test data set comprises at least one of: a test SWIR data set, a test visible data set, and combinations thereof, and analyze said test data set to thereby determine at least one of: a disease state of said biological sample, a metabolic sate of said biological sample, a clinical outcome of said biological sample, a disease progression of said biological sample, and combinations thereof.
  • In one embodiment, machine readable program code, when executed by a processor to analyze said test data, may further case said processor to: compare said test data set to at least one reference data set in a reference database, wherein each said reference data set is associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof.
  • In one embodiment, machine readable program code, when executed by a processor to compare said test data set to at least one reference data set, may further cause said processor to perform said comparison by applying at least one chemometric technique. In another embodiment, said test data set may be compared to at least one reference data set to thereby assign a Gleason score to said biological sample.
  • FIGS. 6A-6C are illustrative of the detection capabilities of the system and method of the present disclosure. FIG. 6A is a NIR chemical image (1450 nm) which shows contrast based on absorption. Regions of interest (ROIs) are indicated on the image, labeled as ROIs 1-5. FIG. 6B is a digital photograph of the tissue sample under analysis. FIG. 6C is illustrative of spectra corresponding to the various ROIs of FIG. 6A. Normalized image spectra from regions drawn on the image illustrate correlation between spectral features and image contrast. These Figures illustrate the potential of the system and method of the present disclosure for tissue analysis.
  • The present disclosure may be embodied in other specific forms without departing from the spirit or essential attributes of the disclosure. Accordingly, reference should be made to the appended claims, rather than the foregoing specification, as indicating the scope of the disclosure. Although the foregoing description is directed to the preferred embodiments of the disclosure, it is noted that other variations and modification will be apparent to those skilled in the art, and may be made without departing from the spirit or scope of the disclosure.

Claims (31)

1. A method comprising:
illuminating a biological sample to thereby generate a first plurality of interacted photons;
filtering said first plurality of interacted photons;
detecting said first plurality of interacted photons to thereby generate a test data set representative of said biological sample, wherein said test data set comprises at least one of: a test SWIR data set, a test visible data set, and combinations thereof; and
analyzing said test data set to thereby diagnose at least one of: a disease state of said biological sample, a metabolic state of said biological sample, a clinical outcome of said biological sample, a disease progression of said biological sample, and combinations thereof.
2. The method of claim 1 wherein said first plurality of interacted photons are selected from the group consisting of: photons scattered by said biological sample, photons reflected by said biological sample photons absorbed by said biological sample, photons emitted by said biological sample, and combinations thereof.
3. The method of claim 1 wherein said biological sample comprises a tissue sample.
4. The method of claim 1 wherein said biological sample comprises an organ sample.
5. The method of claim 1 wherein said biological sample comprises at least one cell.
6. The method of claim 1 wherein said biological sample comprises at least one of: a kidney sample, a prostate sample, a breast sample, a pancreatic sample, a brain sample, a skin sample, an intestinal sample, a colon sample, a liver sample, a cardiac sample, a lung sample, an esophageal sample, a bladder sample, a blood sample, a urethral sample, an ovarian sample, a uterine sample, a testicular sample, a bone sample, a stomach sample, a tracheal sample, a tongue sample, a diaphragm sample, a nerve sample, a rectal sample, and combinations thereof.
7. The method of claim 1 wherein said test data set comprises at least one hyperspectral SWIR image representative of said biological sample.
8. The method of claim 1 wherein said test data set comprises at least one hyperspectral visible image representative of said biological sample.
9. The method of claim 1 wherein said test data set comprises at least one of: a spatially accurate wavelength resolved SWIR image, a SWIR spectrum, and combinations thereof.
10. The method of claim 1 wherein said test data set comprises at least one of: a spatially accurate wavelength resolved visible image, a visible spectrum, and combinations thereof.
11. The method of claim 1 further comprising providing a reference database comprising a plurality of reference data sets, each reference data set associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof.
12. The method of claim 1 wherein said analyzing further comprises comparing said test data set to at least one reference data set.
13. The method of claim 12 wherein said comparing is achieved by applying at least one chemometric technique.
14. The method of claim 13 wherein said chemometric technique is selected from the group consisting of: principle components analysis, partial least squares discriminate analysis, cosine correlation analysis, Euclidian distance analysis, k-means clustering, multivariate curve resolution, band t. entropy method, mahalanobis distance, adaptive subspace detector, spectral mixture resolution, and combinations thereof.
15. The method of claim 1 wherein said illuminating comprises wide-field illumination.
16. The method of claim 1 wherein said diagnosing further comprises assigning a Gleason score to said biological sample.
17. The method of claim 1 further comprising selecting a pre-determined vector space that mathematically describes said test data set;
transforming said test data set into said pre-determined vector space; and
analyzing a distribution of said transformed test data set in the pre-determined vector space to thereby diagnose said biological sample.
18. A system for analyzing a biological sample comprising:
an illumination source, configured so as to illuminate a biological sample to thereby generate a first plurality of interacted photons;
a filter for filtering said first plurality of interacted photons into a plurality of predetermined wavelength bands;
a detector for detecting said first plurality of interacted photons and generating a test data set representative of said sample.
19. The system of claim 18 wherein said detector comprises a focal plane array detector.
20. The system of claim 19 wherein said focal plane array detector comprises at least one of: a CMOS detector, a CCD detector, an ICCD detector, a germanium detector, a InGaAs detector, and combinations thereof.
21. The system of claim 18 wherein said filter comprises a tunable filter.
22. The system of claim 21 wherein said tunable filter is selected from the group consisting of: a liquid crystal tunable filter, a multi-conjugate tunable filter, an acousto-optical tunable filter, a Lyot liquid crystal tunable filter, an Evans split-element liquid crystal tunable filter, a Solc liquid crystal tunable filter, a ferroelectric liquid crystal tunable filter, a Fabry Perot liquid crystal tunable filter, and combinations thereof.
23. The system of claim 18 further comprising a fiber array spectral translator device.
24. The system of claim 23 wherein said fiber array spectral translator device comprises a two-dimensional array of optical fibers drawn into a one-dimensional fiber stack so as to effectively convert a two-dimensional field of view into a curvilinear field of view, and wherein said two-dimensional array of optical fibers is configured to receive said photons and transfer said photons out of said fiber array spectral translator device and to at least one of: a filter, a detector, and combinations thereof.
25. The system of claim 18 further comprising a reference database comprising a plurality of reference data sets, each reference data set associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof.
26. The system of claim 18 further comprising a means for comparing said test data set to at least one reference data set in said reference database.
27. The system of claim 18 wherein said illumination source is configured for wide-field illumination.
28. A storage medium containing machine readable program code, which when executed by a processor, causes the processor to perform the following:
illuminate a biological sample to thereby generate a first plurality of interacted photons;
filter said first plurality of interacted photons to thereby separate said first plurality of interacted photons into a plurality of predetermined wavelength bands;
detect said first plurality of interacted photons to thereby generate a test data set representative of said biological sample, wherein said test data set comprises at least one of: a test SWIR data set, a test visible data set, and combinations thereof; and
analyze said test data set to thereby determine at least one of: a disease state of said biological sample, a metabolic state of said biological sample, a clinical outcome of said biological sample, a disease progression of said biological sample, and combinations thereof.
29. The storage medium of claim 28 wherein said machine readable program code, when executed by a processor to analyze said test data, further causes said processor to: compare said test data set to at least one reference data set in a reference database, wherein each said reference data set is associated with at least one of: a known disease state, a known metabolic state, a known clinical outcome, a known disease progression, and combinations thereof.
30. The storage medium of claim 29 wherein said machine readable program code, when executed by a processor to compare said test data set to at least one reference data set further causes said processor to perform said comparison by applying at least one chemometric technique.
31. The storage medium of claim 28 wherein said machine readable program code, when executed by a processor further causes said processor to: compare said test data set to at least one reference data set in a reference database to thereby assign a Gleason score to said biological sample.
US13/450,579 2007-08-08 2012-04-19 System and Method for Diagnosing a Biological Sample Abandoned US20120310538A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/450,579 US20120310538A1 (en) 2007-08-08 2012-04-19 System and Method for Diagnosing a Biological Sample

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US95460707P 2007-08-08 2007-08-08
US12/188,796 US8013991B2 (en) 2007-08-08 2008-08-08 Raman difference spectra based disease classification
US201113225005A 2011-09-02 2011-09-02
US13/450,579 US20120310538A1 (en) 2007-08-08 2012-04-19 System and Method for Diagnosing a Biological Sample

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US201113225005A Continuation 2007-08-08 2011-09-02

Publications (1)

Publication Number Publication Date
US20120310538A1 true US20120310538A1 (en) 2012-12-06

Family

ID=40341763

Family Applications (2)

Application Number Title Priority Date Filing Date
US12/188,796 Active 2029-08-05 US8013991B2 (en) 2007-08-08 2008-08-08 Raman difference spectra based disease classification
US13/450,579 Abandoned US20120310538A1 (en) 2007-08-08 2012-04-19 System and Method for Diagnosing a Biological Sample

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US12/188,796 Active 2029-08-05 US8013991B2 (en) 2007-08-08 2008-08-08 Raman difference spectra based disease classification

Country Status (3)

Country Link
US (2) US8013991B2 (en)
EP (1) EP2183382A1 (en)
WO (1) WO2009021178A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120062888A1 (en) * 2010-09-10 2012-03-15 Chemimage Corporation Method for operating an optical filter in multiple modes
US20170138849A1 (en) * 2015-11-12 2017-05-18 Massachusetts Institute Of Technology System for wide field-of-view, highly oblique illumination microscopy for scatter-based discrimination of cells
US20170199120A1 (en) * 2014-06-24 2017-07-13 Nikon Corporation Image analysis apparatus, imaging system, surgery support system, image analysis method, and storage medium
US10324041B2 (en) * 2016-12-21 2019-06-18 Abbott Japan Co., Ltd. Optical imaging system using lateral illumination for digital assays
IT202000012610A1 (en) * 2020-05-27 2021-11-27 Univ Degli Studi Di Firenze DEVICE AND PROCEDURE FOR THE ANALYSIS OF BODY FLUID SAMPLES

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7956996B2 (en) * 2007-02-14 2011-06-07 Chemimage Corporation Distinguishing between invasive ductal carcinoma and invasive lobular carcinoma using raman molecular imaging
US7697576B2 (en) * 2004-05-05 2010-04-13 Chem Image Corporation Cytological analysis by raman spectroscopic imaging
US8379197B2 (en) * 2006-01-05 2013-02-19 Chemimage Corporation Spectroscopic systems and methods for classifying and pharmaceutically treating cells
US8614419B2 (en) 2008-03-28 2013-12-24 The Ohio State University Rapid diagnosis of a disease condition using infrared spectroscopy
CN102046070A (en) * 2008-03-28 2011-05-04 俄亥俄州立大学 Rapid diagnosis of a disease condition using infrared spectroscopy
GB2466442A (en) * 2008-12-18 2010-06-23 Dublin Inst Of Technology A system to analyze a sample on a slide using Raman spectroscopy on an identified area of interest
JP5193937B2 (en) * 2009-05-08 2013-05-08 株式会社日立ハイテクノロジーズ Automatic analyzer and analysis method
JP5193940B2 (en) * 2009-05-11 2013-05-08 株式会社日立ハイテクノロジーズ Automatic analyzer
JP5649835B2 (en) * 2010-02-25 2015-01-07 オリンパス株式会社 Vibration spectrum analysis method
US8988680B2 (en) 2010-04-30 2015-03-24 Chemimage Technologies Llc Dual polarization with liquid crystal tunable filters
US10006922B2 (en) 2011-12-22 2018-06-26 Massachusetts Institute Of Technology Raman spectroscopy for detection of glycated analytes
US8834376B2 (en) * 2012-02-28 2014-09-16 Her Majesty The Queen In Right Of Canada As Represented By The Minister Of Health Dispersive ultrasound technology as a diagnostic device for traumatic brain injuries
WO2014118601A1 (en) 2013-01-31 2014-08-07 Universidade Do Minho Optical system for parameter characterization of an element of body fluid or tissue
WO2014162744A1 (en) * 2013-04-05 2014-10-09 株式会社ニコン Cell observation method, cell observation device, cell observation program, cell-sheet manufacturing method, and cell-sheet manufacturing device
TN2016000137A1 (en) 2013-10-18 2017-10-06 Deutsches Krebsforsch Labeled inhibitors of prostate specific membrane antigen (psma), their use as imaging agents and pharmaceutical agents for the treatment of prostate cancer.
DE102014206576B4 (en) 2014-04-04 2015-12-03 Celltool Gmbh Apparatus and method for detecting a prostate tumor
CN105139283B (en) * 2015-08-25 2020-06-16 四川大学 220kV urban ring network partition scheme evaluation method
CN105203210A (en) * 2015-10-23 2015-12-30 国网山西省电力公司大同供电公司 Fault detection device and detection method of ultra-high voltage (UHV) substation transformer based on 360-degree infrared panoramic view and support vector machine (SVM)
JP6811874B2 (en) * 2017-10-12 2021-01-13 富士フイルム株式会社 Image creation device, image creation method, image creation program
JP7232771B2 (en) * 2017-12-13 2023-03-03 株式会社堀場製作所 Discrimination method, learning method, discrimination device and computer program
CN112136036B (en) * 2018-05-18 2023-11-24 艾索波特株式会社 Lung cancer diagnosis method and system based on expiration
KR102291105B1 (en) * 2019-03-04 2021-08-23 주식회사 엑소퍼트 Method and System of Providing Cancer Diagnosis Information Using Artificial Intelligence-Based Liquid Biopsy by Exosomes
US11885788B2 (en) * 2019-03-19 2024-01-30 Safety Spect, Inc Apparatus and method for multimode analytical sensing of items such as food
US11614408B2 (en) * 2020-05-19 2023-03-28 Jiangnan University Method for improving identification accuracy of mixture components by using known mixture Raman spectrum

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1989002718A1 (en) * 1987-09-24 1989-04-06 Massachusetts Institute Of Technology Catheter system for imaging
US5991028A (en) * 1991-02-22 1999-11-23 Applied Spectral Imaging Ltd. Spectral bio-imaging methods for cell classification
US20050240107A1 (en) * 2003-04-17 2005-10-27 Research Foundation Of The City University Of New York Detecting human cancer through spectral optical imaging using key water absorption wavelengths

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031232A (en) 1995-11-13 2000-02-29 Bio-Rad Laboratories, Inc. Method for the detection of malignant and premalignant stages of cervical cancer
US6018713A (en) 1997-04-09 2000-01-25 Coli; Robert D. Integrated system and method for ordering and cumulative results reporting of medical tests
US6002476A (en) 1998-04-22 1999-12-14 Chemicon Inc. Chemical imaging system
AU4970499A (en) * 1998-07-07 2000-01-24 Lightouch Medical, Inc. Tissue modulation process for quantitative noninvasive in vivo spectroscopic analysis of tissues
CA2356623C (en) 1998-12-23 2005-10-18 Medispectra, Inc. Systems and methods for optical examination of samples
US6162604A (en) * 1999-04-01 2000-12-19 Jacob; Chaim O. Methods for determining genetic predisposition to autoimmune diseases by genotyping apoptotic genes
US6569684B2 (en) * 2000-01-06 2003-05-27 University Of Central Florida Method of identifying and treating invasive carcinomas
US7596404B2 (en) 2001-06-28 2009-09-29 Chemimage Corporation Method of chemical imaging to determine tissue margins during surgery
US7755757B2 (en) * 2007-02-14 2010-07-13 Chemimage Corporation Distinguishing between renal oncocytoma and chromophobe renal cell carcinoma using raman molecular imaging
US6949342B2 (en) 2001-12-21 2005-09-27 Whitehead Institute For Biomedical Research Prostate cancer diagnosis and outcome prediction by expression analysis
EP1463926A4 (en) 2002-01-10 2010-09-08 Chemimage Corp Method for detection of pathogenic microorganisms
US20050250091A1 (en) 2004-05-05 2005-11-10 Chemlmage Corporation Raman molecular imaging for detection of bladder cancer
US20060253261A1 (en) 2004-05-05 2006-11-09 Chem Image Corporation Digitizing biology
US20060281068A1 (en) * 2005-06-09 2006-12-14 Chemimage Corp. Cytological methods for detecting a disease condition such as malignancy by Raman spectroscopic imaging
US7697576B2 (en) 2004-05-05 2010-04-13 Chem Image Corporation Cytological analysis by raman spectroscopic imaging
EP1766349A4 (en) 2004-06-30 2010-01-20 Chemimage Corp Dynamic chemical imaging of biological cells and other subjects
US7394546B2 (en) * 2005-05-23 2008-07-01 Southwest Sciences Incorporated Method and apparatus for full phase interferometry
WO2006130728A2 (en) * 2005-05-31 2006-12-07 The Regents Of The University Of California Single-cell raman spectroscopy for the non-destructive, non-invasive analysis of cells and cellular components
US7330747B2 (en) 2005-06-07 2008-02-12 Chemimage Corporation Invasive chemometry
WO2007038679A2 (en) 2005-09-27 2007-04-05 Chemimage Corporation Method for correlating spectroscopic measurements with digital images of contrast enhanced tissue
EP1945794A2 (en) 2005-11-09 2008-07-23 Chemimage Corporation System and method for cytological analysis by raman spectroscopic imaging
US7570356B2 (en) 2006-01-05 2009-08-04 Chemimage Corporation System and method for classifying cells and the pharmaceutical treatment of such cells using Raman spectroscopy

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1989002718A1 (en) * 1987-09-24 1989-04-06 Massachusetts Institute Of Technology Catheter system for imaging
US5991028A (en) * 1991-02-22 1999-11-23 Applied Spectral Imaging Ltd. Spectral bio-imaging methods for cell classification
US20050240107A1 (en) * 2003-04-17 2005-10-27 Research Foundation Of The City University Of New York Detecting human cancer through spectral optical imaging using key water absorption wavelengths

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Ma, "Rapid Micro-Raman Imaging Using Fiber-Bundle Image Compression," Appl. Spectr., vol. 51, pp1845-1848, 1997 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120062888A1 (en) * 2010-09-10 2012-03-15 Chemimage Corporation Method for operating an optical filter in multiple modes
US8525987B2 (en) * 2010-09-10 2013-09-03 Chemimage Technologies Llc Method for operating an optical filter in multiple modes
US20170199120A1 (en) * 2014-06-24 2017-07-13 Nikon Corporation Image analysis apparatus, imaging system, surgery support system, image analysis method, and storage medium
US10156518B2 (en) * 2014-06-24 2018-12-18 Nikon Corporation Image analysis apparatus, imaging system, surgery support system, image analysis method, and storage medium
US20170138849A1 (en) * 2015-11-12 2017-05-18 Massachusetts Institute Of Technology System for wide field-of-view, highly oblique illumination microscopy for scatter-based discrimination of cells
US9772282B2 (en) * 2015-11-12 2017-09-26 Massachusetts Institute Of Technology System for wide field-of-view, highly oblique illumination microscopy for scatter-based discrimination of cells
US10324041B2 (en) * 2016-12-21 2019-06-18 Abbott Japan Co., Ltd. Optical imaging system using lateral illumination for digital assays
US20190376902A1 (en) * 2016-12-21 2019-12-12 Abbott Japan Co., Ltd Optical imaging system using lateral illumination for digital assays
US11073481B2 (en) * 2016-12-21 2021-07-27 Abbott Japan Llc Optical imaging system using lateral illumination for digital assays
IT202000012610A1 (en) * 2020-05-27 2021-11-27 Univ Degli Studi Di Firenze DEVICE AND PROCEDURE FOR THE ANALYSIS OF BODY FLUID SAMPLES
WO2021240565A1 (en) * 2020-05-27 2021-12-02 Universita' Degli Studi Di Firenze Method to analyze samples of body fluids and related analysis device

Also Published As

Publication number Publication date
EP2183382A1 (en) 2010-05-12
US8013991B2 (en) 2011-09-06
US20090040517A1 (en) 2009-02-12
WO2009021178A1 (en) 2009-02-12

Similar Documents

Publication Publication Date Title
US20120310538A1 (en) System and Method for Diagnosing a Biological Sample
US7755757B2 (en) Distinguishing between renal oncocytoma and chromophobe renal cell carcinoma using raman molecular imaging
US7808633B2 (en) Spectroscopic system and method for predicting outcome of disease
US20120078524A1 (en) System and method for diagnosis tissue samples using fluorescence and raman techniques
US7956996B2 (en) Distinguishing between invasive ductal carcinoma and invasive lobular carcinoma using raman molecular imaging
US20120083678A1 (en) System and method for raman chemical analysis of lung cancer with digital staining
US8253936B2 (en) Raman characterization of transplant tissue
CN102266219B (en) Spectral imaging of deep tissue
US7701573B2 (en) Method for correlating spectroscopic measurements with digital images of contrast enhanced tissue
US6954667B2 (en) Method for Raman chemical imaging and characterization of calcification in tissue
US7570356B2 (en) System and method for classifying cells and the pharmaceutical treatment of such cells using Raman spectroscopy
US7564546B2 (en) Dynamic imaging of biological cells and other subjects
US7420679B2 (en) Method and apparatus for extended hyperspectral imaging
US20080272312A1 (en) Hyperspectral fluorescence and absorption bioimaging
JP2016503499A (en) System and method for serum-based cancer detection
US20120062873A1 (en) System and method for diagnosing the disease state of breast tissue using swir
Kontsek et al. Mid-infrared imaging is able to characterize and separate cancer cell lines
WO2006078980A2 (en) Method for raman computer tomography imaging spectroscopy
US8289503B2 (en) System and method for classifying a disease state using representative data sets
Pozhar et al. Application of Acousto-Optical Hyperspectral Imaging for Skin Cancer Diagnostics
Taylor-Williams et al. Targeted multispectral filter array design for the optimization of endoscopic cancer detection in the gastrointestinal tract
Balagopal Advanced methods for enhanced sensing in biomedical Raman spectroscopy
Schaeberle Raman chemical imaging: Development and applications
Kidder et al. Advances in FT-IR spectroscopic imaging microscopy of biological tissue using infrared focal-plane array detectors

Legal Events

Date Code Title Description
AS Assignment

Owner name: CHEMIMAGE CORPORATION, PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:STEWART, SHONA;MAIER, JOHN;DRAUCH, AMY;AND OTHERS;SIGNING DATES FROM 20120130 TO 20120821;REEL/FRAME:028817/0285

AS Assignment

Owner name: CHEMIMAGE CORPORATION, PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEMIMAGE CORPORATION;REEL/FRAME:030134/0096

Effective date: 20130402

AS Assignment

Owner name: CHEMIMAGE TECHNOLOGIES LLC, PENNSYLVANIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE CHANGE ASSIGNEE FROM CHEMIMAGE CORPORATION TO CHEMIMAGE TECHNOLOGIES LLC PREVIOUSLY RECORDED ON REEL 030134 FRAME 0096. ASSIGNOR(S) HEREBY CONFIRMS THE CHEMIMAGE CORP TO CHEMIMAGE TECHNOLOGIES LLC;ASSIGNOR:CHEMIMAGE CORPORATION;REEL/FRAME:030583/0143

Effective date: 20130402

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION