WO2011047053A2 - Holographically illuminated imaging devices - Google Patents

Holographically illuminated imaging devices Download PDF

Info

Publication number
WO2011047053A2
WO2011047053A2 PCT/US2010/052512 US2010052512W WO2011047053A2 WO 2011047053 A2 WO2011047053 A2 WO 2011047053A2 US 2010052512 W US2010052512 W US 2010052512W WO 2011047053 A2 WO2011047053 A2 WO 2011047053A2
Authority
WO
WIPO (PCT)
Prior art keywords
light
focal
array
fluid channel
spots
Prior art date
Application number
PCT/US2010/052512
Other languages
French (fr)
Other versions
WO2011047053A3 (en
Inventor
Changhuei Yang
Original Assignee
California Institute Of Technology
Wu, Jigang
PANG, Shuo
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by California Institute Of Technology, Wu, Jigang, PANG, Shuo filed Critical California Institute Of Technology
Publication of WO2011047053A2 publication Critical patent/WO2011047053A2/en
Publication of WO2011047053A3 publication Critical patent/WO2011047053A3/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/106Beam splitting or combining systems for splitting or combining a plurality of identical beams or images, e.g. image replication
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/004Optical devices or arrangements for the control of light using movable or deformable optical elements based on a displacement or a deformation of a fluid
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/08Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
    • G02B26/10Scanning systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/1086Beam splitting or combining systems operating by diffraction only
    • G02B27/1093Beam splitting or combining systems operating by diffraction only for use with monochromatic radiation only, e.g. devices for splitting a single laser source
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/14Beam splitting or combining systems operating by reflection only
    • G02B27/141Beam splitting or combining systems operating by reflection only using dichroic mirrors
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/32Holograms used as optical elements

Definitions

  • Embodiments of the present invention generally relate to sensing and imaging devices. More specifically, certain embodiments relate to holographic ally illuminated imaging devices used in microscopy and photography.
  • Microscopes and other optical microscopy devices are used extensively in modern biomedicine and bioscience.
  • conventional microscopes include an objective lens, a platform for supporting a specimen, and an eyepiece containing lenses for focusing images.
  • These conventional microscope designs have bulky optics, and have proven to be expensive and difficult to miniaturize. Further, since high resolution objective lenses have a limited field of view, the specimen stage must be moved to increase the scope of the view, which can be time-consuming.
  • a conventional confocal laser scanning microscope uses a laser beam to provide light which is focused by an objective lens into a small focal volume at the specimen. Scattered and reflected laser light as well as any fluorescence light from the illuminated spot on the specimen is collected by the objective lens. The collected light is transmitted to a beam splitter which separates out the light of interest and transmits it to a detection apparatus. As the laser scans, an image can be obtained of the specimen. This technique can be time- consuming.
  • Embodiments of the present invention relate to holographic illumination in sensing and imaging devices. More specifically, certain embodiments relate to
  • holographically illuminated imaging devices having a holographic element to transform a planar wavefront from an illumination beam into at least one focal array of light spots in a fluid channel.
  • a fluid flow moves an object through the light spots in the fluid channel.
  • the object alters the light (e.g., fluorophores absorb light and emit light of a different light property).
  • a light detector detects the altered light (e.g., emissions) and generates time varying data which can be used to produce an image of the object.
  • One embodiment includes an HIID with a plurality of focal arrays along the fluid channel at different depths, forming a three-dimensional focal array. This configuration can be used to generate sectional images or three-dimensional images of the object moving through the fluid channel.
  • One embodiment is directed to a HIID comprising a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots.
  • the HIID further comprises a scanning mechanism configured to move an object across one or more light spots in the focal array of light spots.
  • the HIID further comprises a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
  • a HIID comprising a body defining a fluid channel.
  • the HIID further comprises a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots.
  • the HIID further comprises a beam splitter configured to reflect the focal array of light spots into the fluid channel wherein a flow in the channel moves an object across one or more light spots in the focal array of light spots.
  • the beam splitter is further configured to transmit light altered by the object.
  • the HIID further comprises a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
  • a HIID comprising a holographic element configured to transform an illumination beam into a plurality of focal arrays of light spots at different focal planes.
  • the HIID further comprises a scanning mechanism configured to move an object across one or more light spots in the plurality of focal arrays of light spots.
  • the HIID further comprises a light detector configured to receive light associated with the plurality of focal arrays of light spots, and generate light data associated with the received light.
  • the HIID includes a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots.
  • the HIID also includes a scanning mechanism configured to move an object across one or more light spots in the focal array of light spots.
  • the HIID also includes a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
  • the HIID also includes a processor in communication with the light detector. The processor is configured to receive a signal with light data and generate an image of the object based on the light data.
  • FIG. 1 is a block diagram of components of an HIID system, in accordance with embodiments of the disclosure.
  • FIG. 2(a) is a schematic drawing of a cross sectional view of components of an HIID employing a microfluidic flow, according to embodiments of the invention.
  • FIG. 2(b) is a schematic drawing of a partial top view of components of the
  • FIG. 3 is a schematic drawing of components of an HIID having a collection component, according to embodiments of the invention.
  • FIG. 4 is a schematic drawing of components of an HIID having a collection component including a diffraction optical element (DOE) and a beam block, according to embodiments of the invention.
  • DOE diffraction optical element
  • FIG. 5 is a schematic drawing of components of an HIID having a reflective design, according to embodiments of the invention.
  • FIG. 6 is a schematic drawing of components of an HIID having multiple focal arrays in series at different depths for sectional imaging or three-dimensional imaging, according to embodiments of the invention.
  • FIG. 7 is a schematic drawing of components of an HIID having multiple focal arrays in series with different differentiating elements for multi-spectral fluorescence or phosphorescence imaging, according to embodiments of the invention.
  • FIG. 8(a) is a schematic drawing of a setup for off axis recording a holographic element, according to embodiments of the invention.
  • FIG. 8(b) is a schematic drawing of a setup for inline recording a holographic element, according to embodiments of the invention.
  • FIG. 9 is a block diagram of subsystems that may be present in computer devices that are used in an HIID system, according to embodiments of the invention. DETAILED DESCRIPTION OF THE INVENTION
  • One embodiment includes an HIID having a holographic element for illuminating a fluid channel carrying an object being imaged.
  • the holographic element transforms a planar wavelength of an illumination beam into an array of spherical wavefront or approximately spherical wavefront to form a focal array of tightly confined light spots diagonally extending across the fluid channel.
  • the light is altered (e.g., fluorophores absorb light and emit light of a different property).
  • a differentiating element transmits the altered light (e.g., emissions) to a light detector which generates time varying data, which is used to generate images (e.g., fluorescent images) of the object.
  • Some conventional imaging systems use a lens array to channel uniform light into light spots.
  • the spacing between the light spots is restricted by the diameter of the lens.
  • each lens would have about a 30 micron diameter.
  • the numerical aperture of each lens is also limited by the lens diameter.
  • the HIID of embodiments does not have these restrictions because it uses a holographic element.
  • a holographic element can represent a series of overlapping effective 'lenses.' The effective 'lenses' can channel an illumination beam into overlapping focal cones and into light spots. Since the focal cones overlap, the spacing between the light spots is not dependent on the diameter of the effective 'lens.' The holographic element can also have a much higher achievable numerical aperture than a lens array and may be capable of generating higher resolution images.
  • holographic elements that generate light spots can be found in Wu, Jigang, Cui, Xiquan, Zheng, Guoan, Wang, Ying Min, Lee, Lap Man, Yang, Changhuei, "Wide field-of-view microscope based on holographic focus grid illumination," Optics Letters, Vol. 35, No. 13, July 1, 2010, which is hereby incorporated by reference in their entirety for all purposes.
  • HIIDs of embodiments of the invention provide one or more advantages.
  • the HIID provides more localized illumination which can improve image resolution. Since the holographic element does not have the same physical restrictions of a lens array, the holographic element may be able to generate tighter focused light spots in a shorter focal length, which can allow for higher resolution images. In a microfluidic flow application (e.g., an optofluidic microscope), a holographic element may provide tightly focused lights spots within the short width of a fluid channel, which can provide better illumination than conventional systems. This improved illumination can result in higher resolution images. In some embodiments, image resolution of less than 0.6 micron can be achieved. Another advantage is that the HIID has more effective usage of a given illumination beam (e.g., excitation light) than conventional imaging devices.
  • a given illumination beam e.g., excitation light
  • a holographic element of an HIID allows for effective channeling of the light power in an illumination beam into tightly confined light spots.
  • a holographic element of an HIID may be able to channel up to 47% of an illumination beam into the light spots.
  • Some embodiments may be able to provide a local light intensity at the light spots of values of about 3xl0 4 W/cm 2 .
  • Another advantage is that the HIID has few components in a simple multi-layered structure that can be fabricated in an on-chip design. Since the HIID can be designed in a multilayered structure, the device can be an on-chip design inexpensively fabricated using standard semiconductor and micro/nanofabrication procedures. A multi- layered on-chip design can also be easily miniaturized.
  • the HIID can employ microfluidic flow for high throughput analyses and imaging. These microfluidic flow methods can also be highly automated.
  • an HIID has the flexibility of being designed with a focal plane away from the surface a fluid channel in a microfluidic flow application. The HIID can be designed to locate the focal plane of the light spots at any arbitrary height within the fluid channel so that the high resolution images can be generated any arbitrary height. This flexibility is useful as it frees the restriction of having to flow specimens with the objects close to either the channel floor or ceiling for good image acquisition.
  • FIG. 1 is a block diagram of components of an exemplary HIID system 10, in accordance with embodiments of the disclosure.
  • the HIID system 10 includes an HIID 100 communicatively coupled to a host computer 200.
  • a host computer 200 includes a single HIID 100 and a single host computer 200, other embodiments may include two or more HIIDs 100 and/or host computers 200.
  • the HIID 100 includes an illumination source 110, a holographic element 120, a scanning mechanism 130 and a light detector 140.
  • the holographic element 120 transforms a wavefront of an illumination beam (shown in FIG. 2(a)) by the illumination source 110 into an array of converging spherical wavefront to form a focal array of light spots 114 (shown in FIG. 2(b)) to illuminate an object 150 (shown in FIG. 2(a)) being imaged by the HIID 100.
  • FIG. 2(b) an array of converging spherical wavefront
  • the scanning mechanism 130 moves the focal array of light spots relative to the object 150 or move the object 150 relative to the focal array of light spots.
  • the light detector 140 light altered (e.g., blocked, reduced intensity, and/or modified wavelength or other light property) by the object 150.
  • the light detector 140 generates light data associated with light received by the light detector 140.
  • the illustrated embodiment includes a single illumination source 110, a single holographic element 120, a single scanning mechanism 130 and a single light detector 140, other embodiments may include any suitable number of these components.
  • the host computer 200 comprises a processor 210 (e.g., a microprocessor) communicatively coupled to the light detector 140, a computer readable medium (CRM) 210, and a display 230.
  • the processor 200 receives signals with light data from the light detector 140.
  • the processor 210 executes code stored on the CRM 210 to generate images or otherwise analyze the object 150 using the light data.
  • the images and other output can be shown on the display 230. Any suitable images can be generated such as photoluminescence images, intensity images, phase images, differential interference contrast (DIC) images, etc.
  • a photoluminescence image can refer to a fluorescence image or a phosphorescence image.
  • the illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100.
  • the illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available.
  • the illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120.
  • the illumination source 110 may provide an illumination beam of any suitable wavelength, intensity, phase, polarization, spin angular momentum or other light property, and any suitable spatial distribution. In exemplary embodiments, the illumination source 110 provides an illumination beam with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • LED light-emitting diodes
  • broadband source e.g., mercury lamp, halogen lamp, etc.
  • Suitable illumination sources are commercial
  • the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged.
  • the fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second
  • excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
  • a holographic element 120 refers to a suitable holographic film/plate/crystal capable of converting an illumination beam 111 (shown in FIG. 2(a)) from an illumination source 110 into a focal array of light spots 114 (shown in FIG 2(b)).
  • the holographic element 120 transforms a wavefront of the illumination beam 111 from the illumination source 110 into an array of spherical wavefront to form a focal array of light spots 114.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • the holographic element 120 can be made of any suitable materials. Some examples of suitable holographic materials include photographic emulsions, dichromated gelatin, and photoresists.
  • the holographic element 120 can have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.).
  • the holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. Some examples of suitable holographic recording techniques include in-line (Gabor) and off-axis (Leith-Upatnieks).
  • the holographic element 120 can be illuminated by an illumination beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • Use of a holographic element 120 can allow for effective channeling of light power from the illumination source 110 into the light spots 115.
  • the focal array of light spots 114 can have any suitable number of light spots (e.g., 1, 10, 100, 200, etc.) and can be any suitable array or combination of arrays.
  • suitable arrays include a one-dimensional array, a two- dimensional array, a three-dimensional array, and a multiplicity of one-dimensional, two- dimensional, and/or three-dimensional arrays.
  • the arrays can have any suitable orientation or combination of orientations.
  • a three-dimensional array can be used to image at different depth positions of the specimen having the object 150 being imaged. For example, FIG.
  • FIG. 6 is an illustration of an embodiment of an HIID 100 having a holographic element 120 generating a three-dimensional focal array of light spots 600 along the longitudinal axis of the fluid channel 132 and at different focal planes through the depth of the fluid channel 132.
  • the three-dimensional array 600 is comprised of a plurality of n one-dimensional focal arrays of light spots 114(l)-114(n) at n different focal planes 116(l)-116(n) at different depths of the fluid channel 132.
  • the light spots illuminate the object 150 at different focal planes and the object 150 alters the light.
  • the light data can be used to generate sectional images of the object 150 at different depths and/or generate three-dimensional images of the object 150.
  • Each light spot 115 can be of any suitable size.
  • suitable diameters are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc.
  • the light spot diameter is 0.6 microns (FWHM).
  • Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
  • the holographic element 120 can be replaced by a diffractive optical element (DOE) in the HIID 100.
  • DOE refers to any suitable structure capable of diffracting light to generate a desired light pattern such as a focal array of light spots.
  • suitable DOEs include a Fresnel Zone plate, diffraction grating, photon sieve, etc.
  • the DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.). In some cases, using DOEs may be advantageous because they have a comparatively high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
  • the scanning mechanism 130 refers to a suitable device(s) capable of moving the object 150 being imaged relative to the light spots or the light spots relative the object 150 to substantially illuminate the object 150.
  • the scanning mechanism 130 can be based on any suitable method including, for example, microfluidic flow methods, optical tweezing methods, and scanning methods (raster scanning, linear scanning, etc.).
  • An example of a scanning mechanism 130 employing a microfluidic flow method includes a fluid channel 132 having a fluid flow with the object 150 being imaged.
  • the scanning mechanism 130 may include a raster scanning device for raster scanning the object 150 or specimen stage with the object 150 through the light spots or raster scanning the light spots over the object 150.
  • the scanning mechanism 130 can be in any suitable location that does not block the light from the illumination source 110.
  • a light detector 140 refers to any suitable device capable of detecting light and generating signals with light data.
  • the signals may be in the form of electrical current that results from the photoelectric effect.
  • the light detector can be a single detector, a one-dimensional detector array, or a two-dimensional detector array.
  • Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT).
  • PD photo-diode
  • APD avalanche photo-diode
  • PMT photomultiplier tubes
  • Some examples of one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide- semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc.
  • CCD charge coupled device
  • CMOS complementary metal-oxide- semiconductor
  • the light detector 140 includes one or more discrete light detecting elements
  • CMOS or CCD light detecting element 140(a) may be 1-10 microns and an APD or PMT light detecting element 140(a) may be as large as 1-4 mm.
  • the light detecting elements 140(a) can be arranged in any suitable form such as a one- dimensional array, a two-dimensional array, or a multiplicity of one-dimensional and/or two- dimensional arrays.
  • the arrays can be in any suitable orientation or combination of orientations.
  • the light detecting elements 140(a) can be arranged to correspond to the focal array of light spots 114 (shown in FIG. 2(b)).
  • the light detecting elements 140(a) can have the same form as the focal array of light spots 114 so that one or more light detecting elements 140(a) corresponds to a light spot.
  • the light detecting elements 140(a) can detect any suitable light data.
  • Light data refers to any suitable information related to the light detected by the light detecting elements 140(a).
  • Light data may include, for example, information about the properties of the light detected such as the intensity of the light, the wavelength(s) of the light, the frequency or frequencies of the light, the polarization(s) of the light, the phase(s) of the light, the spin angular momentum(s) of the light, and/or other light properties associated with the light detected by the light detecting elements 140(a).
  • Light data may also include the location of the light detecting element 140(a) associated with the light data and the time that the light was detected by the light detecting element 140(a).
  • the light data may be data based on a single time, based on multiple times, or on a time varying basis. In some embodiments such as the microfluidic flow embodiments, the light data may be time varying data.
  • the system 10 also includes a host computer 200 communicatively coupled to the light detector 140.
  • the host computer 200 comprises a processor 210 (e.g., a processor 210 ) e.g., a processor 210 .
  • microprocessor coupled to a computer readable medium (CRM) 210 and a display 230.
  • CCM computer readable medium
  • display 230 Alternatively, one or more components of the host computer 200 can be part of the HIID 100.
  • the processor 210 receives signals with light data from the light detector 140 associated with the light received by the light detecting elements 140(a).
  • the processor 210 executes code stored on the CRM 220 to perform some of the functions of system 10 such as interpreting the light data from the light detector 142, performing analyses from the light data and/or generating images from the light data.
  • the CRM 220 (e.g., memory) stores code for performing some functions of system 10.
  • the code is executable by the processor 210.
  • the CRM 220 comprises: a) code for interpreting the light data received from the light detector 142, b) code for performing analyses based on the light data, c) code for generating one or more images from the light data, d) code for displaying one or more images, and e) any other code for performing the functions of system 10.
  • the display 230 is communicatively coupled to the processor 210 to receive output data such as image data. Any suitable display may be used. In one embodiment, the display 230 may be part of the HIID 100. The display 230 may provide output such as images to a user of the HIID 100.
  • HIID system 10 may not include a display 230.
  • the components of system 10 may be integrated or separated according to particular needs.
  • the processor 210 may be integrated into the light detector 140 so that the light detector 140 performs all the functions of the processor 210 in some embodiments.
  • the first configuration includes an HIID 100 using a microfluidic flow method as a scanning mechanism 130.
  • the second configuration adds a collection component 170 for collecting light for detection by the light detector 140.
  • the third configuration is a reflective design including a beam splitter.
  • the fourth configuration uses a three-dimensional focal array of light spots to sectionally image the object 150 at different depths.
  • FIG. 2(a) is a schematic drawing of cross sectional view of components of an
  • FIG. 2(b) is a drawing of a partial top view of components of the HIID 100 shown in FIG. 2(a) taken at the focal plane 116, according to embodiments of the invention.
  • the drawing in FIG. 2(a) is a cross-section A-A of the HIID 100 in FIG. 2(b) through a focal array of light spots 114.
  • the HIID 100 includes a multi-layered body 131 with a holographic element 120 and an illumination source 110 providing an illumination beam 111 at the holographic element 120.
  • the multi-layered body 131 also defines or includes a fluid channel 132 having a fluid flow with the object 150 being imaged.
  • the fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132.
  • the body 131 also includes an optional differentiating element 160 located outside the second surface 136 of the fluid channel 132 and a light detector 140 located outside the differentiating element 160.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117.
  • the array of spherical wavefront forms the focal array of light spots 114.
  • the focal array of light spots 114 includes light spots 115 collectively extending across the fluid channel 132 or across a portion of the fluid channel 132.
  • An object 150 moving through the fluid channel 132 can alter (e.g., block, reduce intensity, change wavelength, or otherwise modify a light property) the light.
  • the altered light spreads into an altered light volume 118.
  • the differentiating element 160 transmits light altered by the object 150.
  • the light detector 140 receives light and generates time varying light data based on the received light as the object 150 moves through the fluid channel 132.
  • a processor 210 (shown in FIG. 1) can use the time varying light data to generate images or otherwise analyze the object 150.
  • the HIID 100 also includes an x-axis, a y-axis, and a z-axis.
  • the x-axis and a y-axis lie in the plane of the second surface 136 of the fluid channel 132.
  • the x-axis lies along a longitudinal axis of the fluid channel 132.
  • the z-axis is orthogonal to the x-axis and the y-axis.
  • the body 131 is a multi-layered structure. In other embodiments, the body 131 may be a single, monolithic structure.
  • the layers of the body 131 may include any suitable material or combination of materials having any suitable thickness.
  • the layers of the body 131 may also include any suitable devices (e.g., holographic element 120, light detector 140).
  • FIGS. 2(a) and 2(b) have certain layers, other embodiments of the invention may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131.
  • the body 131 may also include a collection component 170 (shown in FIG.
  • the body 131 may also include a layer (e.g., a protective layer) made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
  • a layer e.g., a protective layer
  • opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
  • the fluid channel 132 may have any suitable dimensions.
  • the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases.
  • the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100.
  • the height of the fluid channel may be sized to be about the diameter of the object 150.
  • the fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132.
  • Any suitable technique may be used for providing fluid flow and particulate transport of the objects 100 in the fluid channel 132 of these embodiments. Some convention techniques include pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, or thermocapilarity techniques. Other techniques may include gravity drive flow, hydrodynamic focusing, dielectrophoresis, and optical tweezing.
  • Any suitable control device(s) may be used to control the flow of fluid and/or movement of the object 150 through the fluid channel 132. Some examples of suitable control devices include micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, and/or hydrodynamic focusing channels.
  • DC direct current
  • the illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100.
  • the illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available.
  • the illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged.
  • the fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength).
  • suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront to form a focal array of light spots 114 at the focal plane 116.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • the holographic element 120 can be made of any suitable materials.
  • the holographic element 120 can have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.).
  • the holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 can be illuminated by a beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the focal array of light spots 114 includes a one- dimensional array of light spots 115 located at an angle, a with respect to the x-axis.
  • the angle, a can be any suitable angle (e.g., 5 degrees, 10 degrees,...90 degrees, ...170 degrees, etc. ).
  • the light spots 115 collectively extend diagonally across the fluid channel 132.
  • the light spots 115 may collectively extend in a direction parallel to the y-axis and across the fluid channel 132. Any suitable number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.).
  • the number of light spots 115 may be determined by the number of light spots 115 needed to collectively extend across a width of the fluid channel 132 where the objects 150 being examined flow.
  • FIGS. 2(a) and 2(b) show the HIID 100 having a single one-dimensional focal array of light spots 114, other embodiments may have a two-dimensional array, a three-dimensional array, or a combination of one, two, and/or three-dimensional arrays.
  • Each light spot 115 can be of any suitable size.
  • suitable diameters are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc.
  • the light spot diameter is 0.6 microns (FWHM).
  • Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
  • the scanning mechanism 130 employs a microfluidic flow method.
  • the scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132.
  • the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments.
  • one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
  • a scanning device e.g., raster scanner, linear scanner, etc.
  • the light detector 140 detects light and generates signals with time varying light data about the properties of the light detected.
  • Some examples of light properties that can be detected include intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc.
  • the light detector can be a single detector, a one-dimensional detector array, or a two-dimensional detector array.
  • Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT).
  • PD photo-diode
  • APD avalanche photo-diode
  • PMT photomultiplier tubes
  • one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide- semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc.
  • the light detector 140 may be a monochromatic or a color detector.
  • the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
  • the light detector 140 includes an array of discrete light detecting elements
  • the array of light detecting elements 140(a) may be a one-dimensional array or a two-dimensional array.
  • the array or arrays can be in any suitable orientation or combination of orientations.
  • the array is a two-dimensional array of light detecting elements 140(a) located at an angle, a with respect to the x-axis. Any suitable angle can be used.
  • each light detecting element 140(a) detects light associated with a single light spot 115. In other cases, each light detecting element 140(a) may detect light from more than one light spot 115.
  • Other embodiments may also have a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) from the two-dimensional array of light detecting elements 140(a) that detects light from a single light spot 115.
  • a plurality e.g., 2 x 2 grid, 4 x 4 grid, etc.
  • suitable objects include biological and inorganic entities.
  • biological entities include whole cells, cell components, microorganisms such as bacteria or viruses, cell components such as proteins, etc. Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
  • the body 131 of the HIID 100 may optionally include a differentiating element 160 located outside the second surface 136.
  • a differentiating element 160 refers to any suitable device(s) (e.g., optical filters) capable of selectively transmitting light having select light properties (e.g., polarization, wavelength, frequency, intensity, phase, spin angular momentum, etc.) while substantially removing light the remaining light by any suitable method such as reflection, absorption or interference.
  • suitable devices include filters (e.g., interference filters, absorption filters, etc.). Any type of filter can be used such as dichroic filters, monochromatic filters, etc. In one embodiment, a polarization filter may be used.
  • the differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b).
  • the interference filter 160(a) transmits the altered light and removes remaining light from the illumination source 110 by interference.
  • the absorption filter absorbs remaining light from the illumination source 110. In fluorescence and phosphorescence applications, the
  • differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially removes excitation light.
  • the illumination source 110 provides an illumination beam 111 at the holographic element 120.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117.
  • the array of spherical wavefront forms the focal array of light spots 114.
  • the focal array of light spots 114 is formed at the focal plane 116 in the fluid channel 132.
  • the differentiating element 160 transmits the altered light (e.g., reduced intensity, altered wavelength, etc.) to the light detecting elements 140(a). Light that does not interact with the object 150 is at least partially removed by the differentiating element 160.
  • each light detecting element 140(a) receives light associated a single corresponding light spot 115 in the focal array 114. In other embodiments, each light detecting element 140(a) may receive light associated with other light spots 115.
  • the light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through the fluid channel 132.
  • the processor 210 receives a signal with time varying light data.
  • the processor 210 uses the time varying light data to generate line scans associated with the y- locations of the light detecting elements 140(a). Each line scan is associated with a light spot 115.
  • the time varying light data from the light detecting elements 140(a) is dependent on the profile of the object 150 as well as its optical properties.
  • the processor 210 can reconstruct an image of the object 150 by appropriately shifting and assembling the line scans, and optionally other data such as rotation, velocity of the object 150, and changes in shape of the object 150, etc.
  • the HIID 100 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc.
  • the images can be black and white images, grey tone images, color images, etc.
  • the HIID 100 can be used in fluorescence or phosphorescence imaging (collectively, photoluminescence imaging).
  • the specimen with one or more objects 150 may be prepared by mixing a reagent with the specimen.
  • the reagent may be suitable chemical for attaching (tagging) portions (e.g., molecules of a cell nucleus) of the objects 150 with fluorophores.
  • a fluorophore refers to a component of a molecule which causes the molecule to be fluorescent or phosphorescent.
  • the resulting fluid is introduced into the fluid channel 132 of the HIID 100.
  • the illumination source 110 provides an illumination beam 111 of excitation light having a first light property (e.g., first wavelength, first polarization, etc.) that can excite the fluorophores in the object 150.
  • the holographic element 120 transforms the wavefront of the illumination source 110 of excitation light into an array of converging spherical wavefront, nearly spherical wavefront, or other wavefront having a well separated structure to form a focal array of light spots 114 of excitation light.
  • the fluorophores absorb the excitation light and emit light (emissions) having a second light property (e.g., a second wavelength, a second polarization, etc.).
  • the emissions spread from site of the light spot 115 in the form of an altered light volume 118.
  • the differentiating element 160 transmits emissions and substantially removes remaining light.
  • the light detector 140 detects light and generates time varying light data associated with the received light as the object 150 flows through the flow channel 132.
  • the processor 210 receives a signal from the light detector 140 having time varying data and generates one or more fluorescence or phosphorescence images of the object 150 based on the time varying data.
  • the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111.
  • DOE diffractive optical elements
  • the DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114.
  • the DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
  • the HIID 100 includes a collection component 170 for collecting light for detection by the light detector 140.
  • FIG. 3 is a schematic drawing of components of an HIID 100 having a collection component 170, according to embodiments of the invention. The drawing in FIG. 3 is a cross sectional view of components HIID 100 at a line through a focal array of light spots 114.
  • an illumination source 110 provides an illumination beam 111 to a holographic element 120.
  • the HIID 100 has a multi-layered body 131 including the holographic element 120.
  • the multi-layered body 131 also defines or includes a fluid channel 132 having a fluid flow with an object 150 being imaged.
  • the fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132.
  • the body 131 also includes a collection component 170 outside the second surface 136 of the fluid channel 132, an optional differentiating element 160 located outside the collection component 170, and a light detector 140 located outside the differentiating element 160.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117.
  • the array of spherical wavefront forms the focal array of light spots 114.
  • the focal array 114 includes light spots 115 that collectively extend across the fluid channel 132 or across a portion of the fluid channel 132.
  • An object 150 moving through the fluid channel 132 can alter (e.g., block, reduce intensity, change wavelength, or otherwise modify a light property) light.
  • the altered light spreads in an altered light volume 118.
  • the collecting component 170 refocuses light transmitted through the second surface 136 into an array of collections spots 119 at an outside surface of the collection component 170.
  • the differentiating element 160 transmits light altered by the object 150.
  • the light detector 140 receives light and generates time varying light data based on the received light as the object 150 moves through the fluid channel 132.
  • a processor 210 shown in FIG.
  • a collection component 170 can be advantageous in improving the quality of the light data collected at the light detector 140 which can improve the quality of the images and other analyses performed by the HIID 100. In fluorescence and phosphorescence applications, a collection component 170 can be advantageous to collect emissions that may be highly scattered and weak.
  • the HIID 100 also includes an x-axis and a z-axis.
  • the x-axis lies along a longitudinal axis of the fluid channel 132.
  • the z-axis is orthogonal to the x-axis.
  • the body 131 is a multi-layer structure.
  • the layers of the body 131 may include any suitable material or combination of materials having any suitable thickness.
  • the layers of the body 131 may also include any suitable devices (e.g., holographic element 120, light detector 140). Other embodiments may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131.
  • the collection component 170 may be omitted in some embodiments.
  • the body 131 may also include a protective layer made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
  • the fluid channel 132 may have any suitable dimensions.
  • the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases.
  • the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100.
  • the height of the fluid channel may be sized to be about the diameter of the object 150.
  • the fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132.
  • Any suitable technique e.g., pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, thermocapilarity techniques, gravity drive flow, hydrodynamic focusing, dielectrocphoresis, optical tweezing, etc.
  • Any suitable control device(s) e.g., micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, hydrodynamic focusing channels, etc.
  • DC direct current
  • the illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100.
  • the illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available.
  • the illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged.
  • the fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength).
  • suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 to an array of converging spherical wavefront to form a focal array of light spots 114 at the focal plane 116.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • the holographic element 120 can be made of any suitable materials and have any suitable dimensions (e.g., 1 mm x lmm, 2 mm x 2mm, ...,10 mm x 10 mm, etc.).
  • the holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 can be illuminated by a beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the focal array of light spots 114 includes a one-dimensional array of light spots 115 located at an angle, a (shown in FIG. 2(b)) with respect to the x-axis.
  • the angle, a can be any suitable angle (e.g., 5 degrees, 10 degrees, ...90 degrees, ...170 degrees, etc.). Any suitable number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.).
  • FIG. 3 has a single one-dimensional focal array of light spots 114, other embodiments may have a two-dimensional array, a three-dimensional array, or a combination of one, two, and/or three-dimensional arrays.
  • Each light spot 115 can be of any suitable size.
  • suitable diameters are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc.
  • the light spot diameter is 0.6 microns (FWHM).
  • Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
  • the scanning mechanism 130 employs a microfluidic flow method.
  • the scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132.
  • the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments.
  • one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
  • a scanning device e.g., raster scanner, linear scanner, etc.
  • the light detector 140 detects light and generates signals with time varying light data about the properties of the light detected.
  • Some examples of light properties that can be detected include intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc.
  • the light detector 140 can be a single detector, a one-dimensional detector array, or a two-dimensional detector array of light detecting elements 140(a).
  • Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT).
  • PD photo-diode
  • APD avalanche photo-diode
  • PMT photomultiplier tubes
  • one- dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide-semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc.
  • the light detector 140 may be a monochromatic or a color detector.
  • the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
  • the light detector 140 includes an array of discrete light detecting elements
  • the array of light detecting elements 140(a) may be a one-dimensional array or a two-dimensional array.
  • the array or arrays can be in any suitable orientation or combination of orientations.
  • the array is a two-dimensional array of light detecting elements 140(a) located at an angle, a with respect to the x-axis. Any suitable angle can be used.
  • each light detecting element 140(a) detects light associated with a single light spot 115. In other cases, each light detecting element 140(a) may detect light from more than one light spot 115.
  • Other embodiments may also have a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) from the two-dimensional array of light detecting elements 140(a) that detects light from a single light spot 115.
  • a plurality e.g., 2 x 2 grid, 4 x 4 grid, etc.
  • the object 150 is shown as a cell, other embodiments may include other suitable object(s) (e.g. biological and inorganic entities). Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
  • the body 131 of the HIID 100 may optionally include a differentiating element 160 located outside the second surface 136.
  • the differentiating element 160 selectively transmits altered light while substantially removing the remaining light.
  • the differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b).
  • the interference filter 160(a) transmits the altered light and removes remaining light from the illumination source 110 by interference.
  • the absorption filter absorbs remaining light from the illumination source 110.
  • a differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially remove excitation light.
  • the collection component 170 refers to a device(s) capable of refocusing light passing through the second surface 136 and associated with each light spot 115 to one or more light detecting elements 140(a). By refocusing the altered light, the detection efficiency may be increased.
  • the collection component 170 can include any suitable device or combination of suitable devices. Some examples of suitable devices include a refractive lens or other diffractive elements (e.g., Fresnel zone plate).
  • the collection component 170 can refocus light into any suitable light distribution at any suitable plane(s).
  • the light distribution may be a tightly confined collection spot 119.
  • the light distribution may be a wider distribution that can be detected by one or more light detecting elements 140(a).
  • the collection component 170 may be in any suitable location.
  • the collection component 170 may be located between the differentiating element 160 and the light detector 140 of the HIID 100 shown in FIG. 2(a).
  • the collection component 170 can be located between the second surface 136 of the fluid channel 132 and the
  • the collection component 170 refocuses light associated with each light spot 115 into an array of collection spots 119 at the outside surface of the collection component 170.
  • Light transmitted through the second surface 136 continues spreading until the mid portion of the collection component 170. At the mid portion, the light no longer spreads and focuses to an array of collection spots 119 on the outer surface of the collection component 170.
  • Any suitable device or devices e.g., refractive lenses may be used to provide for this collection.
  • FIG. 4 is a schematic drawing of components of an HIID 100 having a collection component 170 including a DOE (e.g., Fresnel zone plate, diffraction grating, photon sieve, etc.) 172 and a beam block 174, according to embodiments of the invention.
  • the drawing is a cross sectional view through a portion of the HIID 100 having a light spot 115 of the focal array of light spots 114.
  • the diffractive element 172 refers to a device capable of modifying light passing through the second surface 136 into collection spots 119(a) and 119(b).
  • a beam block 174 can refer to a suitable device capable of blocking all light. In an exemplary fluorescence or phosphorescence operation, a beam block 174 can be designed to remove the unscattered excitation light.
  • the HIID 100 includes a multi-layered body 131 and an illumination source 110 providing an illumination beam 111.
  • the body 131 includes a holographic element 120 and defines or includes a fluid channel 132 having a fluid flow with an object 150 being imaged.
  • the fluid channel 132 has a first surface 134 and an opposing second surface 136.
  • the body 131 also includes the collection component 170 having a DOE 172 and beam block 174, an optional differentiating element 160, a light detector 140, an x- axis, and a z-axis.
  • the differentiating element 160 in the HIID 100 can be less powerful and potentially smaller so that the HIID 100 having a beam block 174 can be more compact.
  • the addition of a collection component 170 with a beam block 174 can allow for a more compact HIID 100 and a more compact system 10.
  • the collection component 170 refocuses the light passing through the second surface 136.
  • the DOE 172 or holographic elements or a refractive lens focuses the unscattered light (e.g., excitation light) passing through the second surface 136 from the spreading volume 117 to a plane where the beam block 174 is located.
  • the beam block 174 blocks the light focused at the beam block 174.
  • the DOE 172 focuses the light altered by the object 150 (e.g., emissions) that pass through the second surface 136 from altered light volume 118 into a second collection spot 119(b) at the detector plane at the outer surface of the collection component 170.
  • the illumination source 110 provides the illumination beam 111.
  • the holographic element 120 transforms the wavefront, planar or otherwise, of the illumination source 110 into an array of spherical wavefront, nearly spherical wavefront, or other wavefront having a well separated structure to form a focal array of light spots 114 at the focal plane 116 in the fluid channel 132.
  • the altered light spreads from each site of the light spot 115 in the form of an altered light volume 118.
  • altered light may also originate from other areas (e.g., focal cones 112) in other embodiments.
  • the collection component 170 refocuses light passing through the second surface 136 into an array of collection spots 119.
  • the collection component may have devices such as a beam block 174 that block light that did not interact with the object 150.
  • the differentiating element 160 removes any light that did not interact with the object 150 and that transmits through the outer surface of the collection component 170.
  • the differentiating element 160 transmits light altered by the object 150 to the light detecting elements 140(a).
  • each light detecting element 140(a) receives light associated with a single corresponding light spot 115 in the focal array 114. In other embodiments, each light detecting element 140(a) may receive light associated with other light spots 115.
  • the light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through the fluid channel 132.
  • the processor 210 receives a signal with time varying light data and uses the time varying light data to generate line scans associated with the y-locations of the light detecting elements 140(a). Each line scan is associated with a light spot 115.
  • the time varying light data from the light detecting elements 140(a) is dependent on the profile of the object 150 as well as its optical properties.
  • the processor 210 can reconstruct an image of the object 150 by appropriately shifting and assembling the line scans, and optionally other data such as rotation, velocity of the object 150, and changes in shape of the object 150, etc.
  • the HIID 100 including a collection component 170 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc.
  • the HIID 100 with a collection component 170 can be used in fluorescence or phosphorescence imaging.
  • the illumination source 110 provides an illumination beam 111 of excitation light having a first light property that can excite fluorophores in the object 150.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 of excitation light into an array of converging spherical wavefront.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • the spherical wavefront are in the form of focal cones 112 converging to a focal array of light spots 114 of excitation light.
  • the fluorophores absorb the excitation light and emit light (emissions) having a second light property.
  • the emissions spread from site of the light spot 115 in the form of an altered light volume 118.
  • the collection component 170 refocuses light passing through the second surface 136 into an array of collection spots 119.
  • the differentiating element 160 transmits emissions and substantially removes remaining light.
  • the light detector 140 detects light and generates time varying light data associated with the received light as the object 150 flows through the flow channel 132.
  • the processor 210 receives a signal from the light detector 140 having time varying data and generates one or more fluorescence or phosphorescence images of the object 150 based on the time varying data.
  • the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111.
  • DOE diffractive optical elements
  • the DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114.
  • the DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
  • the HIID 100 has a reflective design configuration with a beam splitter 190.
  • a beam splitter 190 refers to an optical device capable of splitting a single beam of light of a particular type into two or more beams of light of different types (e.g., different wavelengths, different polarizations, etc.). In a fluorescence or
  • the beam splitter 190 can be designed to reflect excitation light and transmit emitted light (emissions) from fluorophores.
  • the beam splitter 190 can be in any suitable form (e.g., cube, half-silvered mirror, etc.).
  • FIG. 5 is a schematic drawing of components of a reflective design configuration of an HIID 100 having a beam splitter 190 in the form of a cube, according to embodiments of the invention.
  • the drawing in FIG. 5 is a cross sectional view of the HIID 100 at a line through the focal array of light spots 114.
  • the HIID 100 includes a multi-layered body 131 defining or including a fluid channel 132 having a fluid flow carrying an object 150 being imaged or otherwise analyzed.
  • the fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132.
  • the HIID 100 also includes an x-axis along a longitudinal axis of the fluid channel 132 and a z-axis orthogonal to the x-axis.
  • the HIID 100 also includes a beam splitter 190 coupled at a first outer surface to the fluid channel 132, a holographic element 120 coupled to a second outer surface of the beam splitter 190, an illumination source 110 providing an illumination beam 111 to the holographic element 120, and an optional differentiating element 160 outside a third outer surface of the beam splitter 190.
  • the first and third surfaces are opposing surfaces of the cube of the beam splitter 190.
  • the beam splitter 190 splits light at a splitting plane 192 located at a 45 degree angle with respect to the x-axis of the fluid channel 132.
  • the beam splitter 190 reflects light with properties of the illumination beam 111 and transmits light having other properties.
  • the HIID 100 also includes a collection component 170 coupled to the outside of the differential element 160 and a light detector 140 coupled to the outside of the collection component 170.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117.
  • the array of spherical wavefront forms the focal array of light spots 114.
  • Light from the illumination beam 111 is reflected at the splitting plane 192 of the beam splitter 190 and transmitted through the second surface 136 of the fluid channel 132 to form the focal array of light spots 114 in the fluid channel 132.
  • a fluid with the suspended object 150 flows through the fluid channel 132.
  • the object 150 alters light from each light spot 115.
  • the altered light (e.g., fluorescent emissions) from the site of the light spot 115 is transmitted through the splitting plane 192 of the beam splitter 190.
  • the altered light is in the form of an altered light volume 118.
  • the differentiating element 160 transmits the altered light and the collection component 170 refocuses light into a collection spot 119 at light detector 140.
  • the body 131 is a multi-layer structure having layers of suitable material or combination of materials having any suitable thickness.
  • the layers of the body 131 may also include suitable devices.
  • the body 131 defines or includes a fluid channel 132 having any suitable dimensions.
  • the body 131 also includes the beam splitter 190, the differentiating element 160, the collection component 170, and the light detector 140.
  • Other embodiments may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131.
  • the body 131 may also include a layer made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
  • the fluid channel 132 may have any suitable dimensions.
  • the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases.
  • the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100.
  • the height of the fluid channel may be sized to be about the diameter of the object 150.
  • the fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132.
  • Any suitable technique e.g., pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, thermocapilarity techniques, gravity drive flow, hydrodynamic focusing, dielectrocphoresis, optical tweezing, etc.
  • Any suitable control device(s) e.g., micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, hydrodynamic focusing channels, etc.
  • DC direct current
  • the illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100.
  • the illumination source 110 may be provided by any suitable device(s).
  • the illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120.
  • the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the illumination source 110 provides suitable excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged.
  • a first light property e.g., first wavelength
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront to form a focal array of light spots 114 at the focal plane 116.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • the holographic element 120 can be made of any suitable materials and have any suitable dimensions (e.g., 1 mm x lmm, 2 mm x 2mm, ...,10 mm x 10 mm, etc.).
  • the holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots.
  • the holographic element 120 is illuminated by an illumination beam 111 having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the focal array of light spots 114 includes a one-dimensional array of light spots 115 located at an angle, a (shown in FIG. 2(b)) with respect to the x-axis.
  • the angle, a can be any suitable angle (e.g., 5 degrees, 10 degrees, 45, degrees,...,170 degrees, etc.).
  • Any suitable number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.).
  • Each light spot 115 can be of any suitable size.
  • suitable diameters (FWHM) are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc.
  • the light spot diameter is 0.6 microns (FWHM).
  • Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
  • the scanning mechanism 130 employs a microfluidic flow method.
  • the scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132.
  • the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments.
  • one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
  • a scanning device e.g., raster scanner, linear scanner, etc.
  • the light detector 140 detects light and generates signals with time varying light data about the light properties (e.g., intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc.) of the light detected.
  • the light detector 140 can be a single detector, a one-dimensional detector array, or a two-dimensional detector array of light detecting elements 140(a) (shown in FIG. 2(a)).
  • Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT).
  • one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide-semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc.
  • CCD charge coupled device
  • CMOS complementary metal-oxide-semiconductor
  • each light detecting element 140(a) detects light associated with a single light spot 115.
  • each light detecting element 140(a) may detect light from more than one light spot 115.
  • a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) from the two-dimensional array of light detecting elements 140(a) detects light from a single light spot 115.
  • the light detector 140 may be a monochromatic or a color detector.
  • the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
  • the object 150 is shown as a cell, other embodiments may include other suitable object(s) (e.g. biological and inorganic entities). Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
  • the body 131 of the HIID 100 may optionally include a differentiating element 160 outside a third outer surface of the beam splitter 190.
  • the differentiating element 160 selectively transmits light altered by the object 150 while substantially removing other remaining light.
  • a differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially remove excitation light.
  • the collection component 170 refers to a device(s) capable of refocusing light associated with each light spot 115 that is transmitted through the differentiating element 160, into a collection spot 119 at one or more light detecting elements 140(a) of the light detector 140.
  • the collection component 170 can include any suitable device or combination of suitable devices (e.g., refractive lens or other diffractive elements).
  • the collection component 170 can refocus light into any suitable light distribution at any suitable plane(s). In the illustrated example, the light distribution is a tightly confined collection spot 119. In other embodiments, the light distribution may be a wider distribution that can be detected by a single light detecting element 140(a) or by a grid of corresponding light detecting elements 140(a).
  • the beam splitter 190 splits a light beam of a particular type into two or more beams of light of different types (e.g., different wavelengths, different polarizations, etc.).
  • the beam splitter 190 can be designed to reflect excitation light and transmit emissions.
  • the beam splitter 190 can be of any suitable design form (e.g., cube, half-silvered mirror, dichroic mirrored prism, etc.) including any suitable device(s).
  • the beam splitter 190 is a cube including two triangular portions.
  • the beam splitter 190 includes a splitting plane 192 at the interface between two triangular portions.
  • the splitting plane 192 within the beam splitter 190 may be coated with a dichroic layer which reflects the light of the same type as the illumination beam (e.g., excitation light) and transmit light of other types (e.g., fluorescent emissions).
  • a dichroic layer which reflects the light of the same type as the illumination beam (e.g., excitation light) and transmit light of other types (e.g., fluorescent emissions).
  • the beam splitter 190 can be a polarized beam splitter.
  • the illumination beam 111 can be excitation light that is linearly polarized and can be reflected by the polarized beam splitter to form the focal array 114. In this example, about 50% of the emission may pass through the polarized beam splitter.
  • the illumination source 120 provides an illumination beam 111.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 into an array of spherical wavefront to form a focal array of light spots 114.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • the light is reflected at the splitting plane 192 located at a 45 degree angle with respect to the x-axis of the fluid channel 132 so that the light spots 115 are formed in the fluid channel 132.
  • the differentiating element 160 transmits the altered light and removes other light.
  • the collection component 170 refocuses light altered by the object 150 at a single collection spot 119 at light detector 140.
  • the light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through the fluid channel 132.
  • the processor 210 receives a signal with time varying light data and uses the time varying light data to generate line scans associated with the y-locations of the light detecting elements 140(a). Each line scan is associated with a light spot 115.
  • the time varying light data from the light detecting elements 140(a) is dependent on the profile of the object 150 as well as its optical properties.
  • the processor 210 can reconstruct an image of the object 150 by appropriately shifting and assembling the line scans, and optionally other data such as rotation, velocity of the object 150, and changes in shape of the object 150, etc.
  • the HIID 100 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc.
  • the HIID 100 provides an illumination beam 111 of excitation light having a first light property that can excite fluorophores in the object 150.
  • the holographic element 120 transforms the wavefront of the illumination source 120 of excitation light into an array of spherical wavefront, approximately spherical wavefront or other wavefront having a well separated structure to form a focal array of light spots 114 of excitation light.
  • the excitation light is reflected by the splitting plane 192 to form the focal array of light spots 114 in the fluid channel 132.
  • the fluid channel 132 has a fluid flow with the object 150 being imaged.
  • the fluorophores absorb excitation light and emit light (emissions) having a second light property different from the first light property.
  • an object 150 alters the light from a single light spots 115 as illustrated in FIG. 5.
  • the emissions spread from site of the light spot 115 in the form of an altered light volume 118. In some cases, emissions also spread from the site of the focal cones 112.
  • the splitting plane 192 transmits the emissions and the collection component 170 refocuses the emissions into a collection spot 119 associated with a light spot 115.
  • the light detector 140 detects light and generates time varying light data associated with the received light.
  • the processor 210 receives a signal from the light detector 140 having time varying data and generates one or more fluorescence or phosphorescence images of the object 150 based on the time varying data.
  • the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111.
  • DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114.
  • the DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
  • FIG. 2(a) into a single HIID 100 with multiple focal arrays 114 can be relatively minor in many cases. Having multiple focal arrays 114 in a single HIID 100 may provide one or more advantages. HIID 100 with multiple focal arrays 114 multiplexed in parallel can be used in parallel processing to boost throughput. Other HIID 100 can have focal arrays in series to perform more detailed analysis of the same specimen. For example, an HIID 100 with a series of focal arrays each having a differentiating element 160 that passes a different emission light (e.g., light of a different wavelength) can be used to perform multi- spectral fluorescence imaging. As another example, an HIID 100 with a series of focal arrays at different focal planes 116 can be used to generate sectional images and three dimensional images of an object 150 as shown in FIG 6.
  • a differentiating element 160 e.g., light of a different wavelength
  • One design approach for combining multiple HIID 100 into a single HIID 100 with multiple focal arrays 114 in series is to employ a long fluid channel 132 through which can flow a specimen with object(s) 150.
  • the focal arrays 114 can be located separately along the fluid channel 132 to separately image the same specimens. Any suitable spacing between the focal arrays can be used (e.g., 10 microns, 20 microns, etc.).
  • FIG. 6 is an illustrated example of an HIID 100 with multiple focal arrays 114 that can be designed by combining multiple HIIDs 100 of FIG. 2(a) in series into a single HIID 100 employing a long fluid channel 132.
  • FIG. 6 is a schematic drawing of components of an HIID 100 having multiple focal arrays 114 in series at different depths for sectional imaging and/or three-dimensional imaging, according to embodiments of the invention.
  • the HIID 100 includes a three-dimensional focal array of light spots
  • the HIID 100 can be used to take sectional images of an object 150 at different depths associated with the n focal planes 116(1) ,...,116(n) during a single pass through the fluid channel 132.
  • the HIID 100 includes a multi-layered body 131 with a holographic element 120 and an illumination source 110 providing an illumination beam 111 at the holographic element 120.
  • the multi-layered body 131 also defines or includes a fluid channel 132 having a fluid flow with the object 150 being imaged.
  • the fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132.
  • the body 131 also includes an optional differentiating element 160 located outside the second surface 136 of the fluid channel 132 and a light detector 140 located outside the
  • the differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b) for removing light having the same light properties as the illumination beam 111.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into n arrays of converging spherical wavefront. Any suitable number can be used for n (e.g., 1, 5, 10, 100, 200, etc.). In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • each volume is hour-glass shaped, forming a focal cone 112 converging into a light spot 115 and spreading into a spreading volume 117.
  • the n arrays of spherical wavefront form n focal arrays of light spots 114(1), ...,114(n) at corresponding focal planes 116(1),...,116(n).
  • Each of the focal arrays 114(1), ...,114(n) includes light spots 115 collectively extending across the fluid channel 132 or across a substantial portion of the fluid channel 132.
  • Each focal array is located at a different focal plane 116(1),...,116(n) at different depths through the fluid channel 132.
  • An object 150 moving through the fluid channel 132 can alter (e.g., block, reduce intensity, change wavelength, or otherwise modify a light property) the light in the fluid channel 132.
  • the altered light is in the form of altered light volumes 118 (shown in FIG. 2(a)).
  • the differentiating element 160 transmits light altered by the object 150.
  • the light detector 140 receives light and generates time varying light data based on the received light as the object 150 moves through the fluid channel 132.
  • a processor 210 (shown in FIG. 1) can use the time varying light data to generate sectional images of the object(s) 150 at different depths associated with the focal planes 116(1)...116(n). Any type of sectional image can be generated such as a fluorescence or phosphorescence image, intensity image, phase image, differential interference contrast (DIC) image, etc.
  • DIC differential interference contrast
  • the HIID 100 also includes an x-axis, a y-axis, and a z-axis.
  • the x-axis and a y-axis lie in the plane of the second surface 136 of the fluid channel 132.
  • the x-axis lies along a longitudinal axis of the fluid channel 132.
  • the z-axis is orthogonal to the x-axis and the y-axis.
  • the body 131 is a multi-layered structure. In other embodiments, the body 131 may be a single, monolithic structure.
  • the layers of the body 131 may include any suitable material or combination of materials having any suitable thickness.
  • the layers of the body 131 may also include suitable devices (e.g., holographic element 120, light detector 140).
  • FIG. 6 has certain layers at certain locations, other embodiments of the invention may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131.
  • the body 131 may also include a collection component 170 (shown in FIG. 3) between the fluid channel 132 and the differentiating element 160 or between the differentiating element 160 and the light detector 140 in some embodiments.
  • the body 131 may also include a layer (e.g., a protective layer) made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
  • a layer e.g., a protective layer
  • opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
  • the fluid channel 132 may have any suitable dimensions.
  • the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases.
  • the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100.
  • the height of the fluid channel may be sized to be about the diameter of the object 150.
  • the fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132.
  • Any suitable technique e.g., pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, thermocapilarity techniques, gravity drive flow, hydrodynamic focusing, dielectrocphoresis, optical tweezing, etc.
  • Any suitable control device(s) e.g., micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, hydrodynamic focusing channels, etc.
  • DC direct current
  • the illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100.
  • the illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available.
  • the illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged.
  • the fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength).
  • suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into n arrays of converging spherical wavefront to form n focal arrays of light spots 114(1),. ,.,114(n) at corresponding focal planes 116(1),...,116(n) at different depth through the fluid channel 132.
  • the holographic element 120 can be made of any suitable material(s).
  • the holographic element 120 can have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.).
  • the holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 can be illuminated by a beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
  • the holographic element forms n one-dimensional focal arrays of light spots 114(1),. ,.,114(n) at different depths through the fluid channel 132 and at different x locations along the fluid channel 132.
  • the n one-dimensional focal arrays of light spots 114(1),. ,.,114(n) form the three-dimensional array of light spots 600. Any suitable number (e.g., 2, 3, 5, 10, 20, 50, 100, etc.) of one-dimensional focal arrays, n can be used.
  • the angle, ⁇ 3 ⁇ 4 may be any suitable angle (e.g., 5 degrees, 10 degrees,...90 degrees, ...170 degrees, etc. ). In many cases, all the focal arrays 114(1),. ,.,114(n) will be located at the same angle, a angle. In some cases, the light spots 115 collectively extend diagonally across the fluid channel 132. In other cases, the light spots 115 may collectively extend in a direction parallel to the y-axis and across the fluid channel 132. Although the focal arrays
  • the number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.) in other embodiments. In some cases, the number of light spots 115 may be determined by the number of light spots 115 needed to collectively extend across a width of the fluid channel 132 where the object(s) 150 being examined flow.
  • Each light spot 115 can be of any suitable size.
  • suitable diameters are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc.
  • the light spot diameter is 0.6 microns (FWHM).
  • Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
  • the scanning mechanism 130 employs a microfluidic flow method.
  • the scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132.
  • the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments.
  • one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
  • a scanning device e.g., raster scanner, linear scanner, etc.
  • the light detector 140 detects light and generates signals with time varying light data about the light properties of the detected. Some examples of light properties that can be detected include intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc.
  • the light detector 140 can be a single detector, a one-dimensional detector array, or a two-dimensional detector array. Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT).
  • PD photo-diode
  • APD avalanche photo-diode
  • PMT photomultiplier tubes
  • one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide-semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc.
  • the light detector 140 may be a monochromatic or a color detector.
  • the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
  • the light detector 140 includes a two-dimensional array of discrete light detecting elements 140(a) (shown in FIG. 2(a)) of any suitable size (e.g., 1-10 microns) and any suitable shape (e.g., circular or square). The array is located at an angle, a with respect to the x-axis. Any suitable angle can be used. Any suitable number of light detecting elements 140(a) may correspond to a light spot 115. In FIG. 6, each light detecting element 140(a) detects light from a single corresponding light spot 115. In another example, each light detecting element 140(a) may detect light from more than one light spot 115. In another example, a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) may detects light from a single light spot 115.
  • a plurality e.g., 2 x 2 grid, 4 x 4 grid, etc.
  • the object 150 is shown as a cell, other embodiments may include other suitable object(s) such as biological entities (e.g., whole cells, cell components, microorganisms such as bacteria or viruses, cell components such as proteins, etc.) and inorganic entities. Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
  • the body 131 of the HIID 100 may optionally include a differentiating element 160 located outside the second surface 136.
  • the differentiating element 160 selectively transmits altered light while substantially removing the remaining light.
  • the differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b).
  • the interference filter 160(a) transmits the altered light and removes remaining light from the illumination source 110 by interference.
  • the absorption filter absorbs remaining light from the illumination source 110.
  • a differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially remove excitation light.
  • the illumination source 110 provides an illumination beam 111.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into n arrays of converging spherical wavefront.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117.
  • the n arrays of converging spherical wavefront forms n focal arrays of light spots 114(1),. ,.,114(n) at different focal planes 116(1),...,116(n) at different depths of the fluid channel 132 and at different x locations along the fluid channel 132.
  • the n focal arrays of light spots 114(1),. ,.,114(n) form the three-dimensional focal array of light spots 600.
  • a fluid within which the object 150 is suspended, flows through the fluid channel 132.
  • the object 150 alters (blocks, reduces intensity, modifies wavelength or other light property or spatial distribution) light in the fluid channel 132 as it passes through one or more of the focal arrays 114(1)...114(n) located at different depths of the fluid channel 132.
  • differentiating element 160 transmits the altered light and removes light having the same properties as the illumination beam 111.
  • the light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through focal arrays at different depths of the fluid channel 132.
  • the processor 210 receives a signal with time varying light data associated with each of the focal arrays.
  • the processor 210 uses the time varying light data to generate line scans associated with the y-locations of the light detecting elements 140(a) for each of the focal arrays.
  • the time varying light data is dependent on the profile of the object 150 as well as its optical properties.
  • the processor 210 can reconstruct a sectional image of the object 150 at a specific depth by appropriately shifting and assembling line scans from time varying data taken by light detecting elements associated with a focal array 114(i) having a focal plane 116(i) located at the specific depth.
  • other data e.g., rotation, velocity of the object 150, and changes in shape of the object 150, etc.
  • the processor 210 can also construct a three- dimensional image of the object 150 based on the sectional images or the time varying data.
  • the HIID 100 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc.
  • a fluorescence image phosphorescence image
  • intensity images phosphorescence image
  • phase image phosphorescence image
  • DIC differential interference contrast
  • the HIID 100 can be used in fluorescence or phosphorescence imaging.
  • the specimen with one or more objects 150 may be prepared by mixing a reagent with the specimen.
  • the resulting fluid is introduced into the fluid channel 132 of the HIID 100.
  • the illumination source 110 provides an illumination beam 111 of excitation light having a first light property (e.g., first wavelength, first polarization, etc.) that can excite the fluorophores in the object 150.
  • the holographic element 120 transforms the planar wavefront of the illumination beam 111 of excitation light into n arrays of converging spherical wavefront to form n focal array of light spots 114(1),.
  • the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
  • fluorophores in the object 150 absorb excitation light from a proximal light spot 115 at a particular depth. The fluorophores then emit light (emissions) having a second light property (e.g., a second wavelength, a second polarization, etc.).
  • the fluorophores may also absorb excitation light from the focal cone 112 and the spreading volume 117. In this case, the fluorophores from these areas may emit light as well.
  • the differentiating element 160 transmits emissions and substantially removes excitation light.
  • the light detector 140 detects light and generates time varying light data associated with the received light as the object 150 flows through the flow channel 132.
  • the processor 210 receives a signal from the light detector 140 having time varying data.
  • the processor 220 generates one or more fluorescence or phosphorescence sectional images of the object 150 and/or three-dimensional images of the object 150 based on the time varying data.
  • the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111.
  • DOE diffractive optical elements
  • the DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114.
  • the DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
  • an HIID 100 with multiple focal arrays 114 that can be designed by combining multiple HIIDs 100 of FIG. 2(a) in series into a single HIID 100 employing a long fluid channel 132 can be used to perform multi-spectral fluorescence or phosphorescence imaging.
  • an HIID 100 includes multiple focal arrays arranged in a series at different x-locations along the longitudinal axis of the fluid channel 132.
  • the HIID 100 also includes multiple differentiating elements 160 corresponding to the different focal arrays 114. Each differentiating element 160 transmits light of a different light property (e.g., wavelength, polarization, etc.).
  • a first differentiating element 160 associated with a first focal array 114 may allow light with a wavelength ⁇ to pass
  • a second differentiating element 160 associated with a second focal array 114 may allow light with a wavelength ⁇ 2 to pass
  • a third differentiating element 160 associated with a third focal array 114 may allow light with a wavelength ⁇ 2 to pass
  • the HIID 100 can generate fluorescence or phosphorescence images from light of wavelengths, ⁇ , ⁇ 2> and ⁇ 3 .
  • different structures in the object 150 being imaged may emit light have different light properties (e.g., ⁇ , ⁇ 2> ⁇ 3 ). In these cases, the HIID 100 may have
  • the HIID 100 can then image the different structures associated with the different light properties.
  • FIG. 7 is a schematic drawing of components of an HIID 100 having multiple focal arrays 114 in series with different differentiating elements 160 for multi- spectral fluorescence or phosphorescence imaging, according to embodiments of the invention.
  • FIG. 7 is an another illustrated example of an HIID 100 having multiple focal arrays 114 that can be designed by combining multiple HIIDs 100 of FIG. 2(a) in series into a single HIID 100 employing a long fluid channel 132.
  • the HIID 100 has five differentiating elements 160(1)-160(5) corresponding to the five focal arrays 114(1)-114(5).
  • Each of the differentiating elements 160(1)-160(5) transmits light of a different light property. In this way, a single passage of an object 150 through the fluid channel 132 will allow each segment to acquire a spectrally distinct image.
  • Embodiments of an HIID 100 including multiple focal arrays in series and corresponding differentiating elements 160 for multi-spectral fluorescence or
  • phosphorescence imaging may have advantages.
  • multi- spectral fluorescence images are typically generated by swapping the chromatic filters between each image acquisition step. As the number of slots in a filter carousel is limited, the acquisition of more than 5 wavelength bands typically requires a carousel swap.
  • an HIID 100 having a series of focal arrays, the acquisition of multi- spectral images can be implemented automatically by connecting several focal arrays, each sensitive to a particular emission wavelength band, in series. A single passage of an object 150 through the fluid channel 132 generates a complete set of fluorescence or phosphorescence images.
  • any of the HIIDs 100 may be added to other configurations in other embodiments.
  • the collection component 170 can be added to some configurations.
  • the components of any of the configurations of the HIID 100 may be integrated or separated according to particular needs.
  • the processor 210 may be integrated into the light detector 140 so that the light detector 140 performs all the functions of the processor 210 in some embodiments.
  • the holographic element 120 can be recorded using any holographic recording technique.
  • One recording method involves interfering a light field 700 through a recording mask having an array of apertures 705 with a collimated reference beam (write beam) 710 via a beam splitter 190, as shown in FIG. 8(a).
  • a recording mask refers to an array of apertures 705 patterned in a layer of metal film or coating on a substrate such as a glass slide.
  • FIG. 8(a) is a schematic drawing of a setup for off-axis recording a holographic element 120, according to embodiments of the invention. In the illustrated setup, a beam splitter 190 is used. In this illustration a recording mask is used.
  • the apertures may have an aperture size equal to the desired light spot size and the aperture spacing is equal to the desired spacing between light spots in the focal array of light spots.
  • the interference pattern can then be recorded on the holographic element 120.
  • the holographic element 120 When the holographic element 120 is illuminated by an illumination beam 111 (shown in FIG. 2(a)) propagating in the opposite direction as the original reference write beam, the holographic element 120 will generate an optical conjugate wave that will reconstitute into a focal array of light spots based on the array of apertures 705.
  • FIG. 8(b) is a schematic drawing of a setup for inline recording a holographic element 120, according to embodiments of the invention.
  • an incident collimated light beam transmitted through the apertures will interfere with the fairly strong uniform transmission through the metal film/coating (in effect, this serves as the write beam) to create a recordable interference pattern at a short distance away, as shown in FIG. 8(b).
  • the pattern can be recorded by placing the holographic element 120 arbitrarily close to the recording mask 760. This technique allows recording of holographic elements 120 that can generate holograms with excellent stability since there are no potential drifts between the two interfering components.
  • This method for creating a holographic element 120 for generating light spots is easy and readily scalable for mass-manufacture. Using this method, some embodiments of holographic elements 120 have been recorded to generate light spots 115 with diameters of about 0.60 micron and to have 10% efficiency in channeling of the illumination beam 111.
  • a silver halide holographic element 120 was recorded using a recording mask 760. After exposure, the holographic element 120 was developed and bleached to produce a phase hologram. A light spot 115 can then be generated by the holographic reconstruction process, where a conjugated collimated beam 710 is transformed into a light spot 115 by the holographic element 120.
  • the focal length between the holographic element 120 and the focal plane 116 (shown in FIG. 2(a)) is the same as the distance 770 between the recording mask 760 and the holographic element 120 during the recording process.
  • the recording mask can be fabricated using any suitable method.
  • a specialized mask 760 (shown in FIG. 8(b)) is made to record a holographic element 120 of FIG. 6 with a plurality of n focal arrays 114(1),. ,.,114(n) at different depths.
  • the recording mask 760 is made by starting with a piece of glass and depositing layers of SU-8 photoresist film or other suitable material layer on the glass in a step fashion. For example, each step can be 2 micron high and 50 micron wide. Any suitable step dimensional can be used in other embodiments.
  • a layer of material e.g., gold
  • a suitable thickness e.g. 200 nm thick
  • FIG. 9 shows a block diagram of subsystems that may be present in computer devices that are used in system 10, according to embodiments of the invention.
  • the computer 200 in communication with the HIID 100 may have any suitable combination of components in FIG. 9.
  • FIG. 9 The various components previously described in the Figures may operate using one or more computer devices to facilitate the functions described herein. Any of the elements in the Figures may use any suitable number of subsystems to facilitate the functions described herein. Examples of such subsystems or components are shown in a FIG. 9.
  • the subsystems shown in FIG. 9 are interconnected via a system bus 975. Additional subsystems such as a printer 974, keyboard 978, fixed disk 979 (or other memory comprising computer readable media), display 230, which is coupled to display adapter 982, and others are shown.
  • Peripherals and input/output (I/O) devices which couple to I/O controller 971, can be connected to the computer system by any number of means known in the art, such as serial port 957.
  • serial port 977 or external interface 981 can be used to connect the computer apparatus to a wide area network such as the Internet, a mouse input device, or a scanner.
  • the interconnection via system bus allows the central processor 210 to
  • an output device such as the printer 974 or display 230 of the HIID system 10 can output various forms of data.
  • the system 10 can output a fluorescence image of an object 150 or other results of analysis.
  • Any of the software components or functions described in this application may be implemented as software code to be executed by a processor using any suitable computer language such as, for example, Java, C++ or Perl using, for example, conventional or object-oriented techniques.
  • the software code may be stored as a series of instructions, or commands on a computer readable medium, such as a random access memory (RAM), a read only memory (ROM), a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD-ROM.
  • RAM random access memory
  • ROM read only memory
  • magnetic medium such as a hard-drive or a floppy disk
  • optical medium such as a CD-ROM.
  • Any such computer readable medium may reside on or within a single computational apparatus, and may be present on or within different computational apparatuses within a system or network.

Abstract

Embodiments of the present invention relate to holographically illuminated imaging devices including a holographic element for transforming an illumination beam into a focal array of light spots, a scanning mechanism for moving an object across one or more light spots in the focal array of light spots, and a light detector for detecting light associated with the focal array of light spots and generating light data associated with the received light.

Description

HOLOGRAPHICALLY ILLUMINATED IMAGING DEVICES
CROSS-REFERENCES TO RELATED APPLICATIONS
[0001] This is a non-provisional application of and claims priority to U.S. Provisional
Patent Application No. 61/251,237 entitled "Approaches for Building Compact Fluorescence Microscopes" filed on October 13, 2009 and to U.S. Provisional Patent Application No. 61/381,389 entitled "Fluorescence Optofluidic Microscope" filed on September 9, 2010. These provisional applications are hereby incorporated by reference in their entirety for all purposes.
[0002] This non-provisional application is related to the following co-pending and commonly- as signed patent applications, which are hereby incorporated by reference in their entirety for all purposes:
• U.S. Patent Application No. 12/398,050 entitled "Optofluidic Microscope Device with Photosensor Array" filed on March 4, 2009.
• U.S. Patent Application No. 12/399,823 entitled "Scanning Illumination Microscope" filed on March 6, 2009.
• U.S. Patent Application No. 12/886,779 entitled "Reflective Focusing and
Transmissive Projection Device" filed on September 21, 2010.
BACKGROUND OF THE INVENTION
[0003] Embodiments of the present invention generally relate to sensing and imaging devices. More specifically, certain embodiments relate to holographic ally illuminated imaging devices used in microscopy and photography.
[0004] Microscopes and other optical microscopy devices are used extensively in modern biomedicine and bioscience. Typically, conventional microscopes include an objective lens, a platform for supporting a specimen, and an eyepiece containing lenses for focusing images. These conventional microscope designs have bulky optics, and have proven to be expensive and difficult to miniaturize. Further, since high resolution objective lenses have a limited field of view, the specimen stage must be moved to increase the scope of the view, which can be time-consuming.
[0005] A conventional confocal laser scanning microscope uses a laser beam to provide light which is focused by an objective lens into a small focal volume at the specimen. Scattered and reflected laser light as well as any fluorescence light from the illuminated spot on the specimen is collected by the objective lens. The collected light is transmitted to a beam splitter which separates out the light of interest and transmits it to a detection apparatus. As the laser scans, an image can be obtained of the specimen. This technique can be time- consuming.
BRIEF SUMMARY OF THE INVENTION
[0006] Embodiments of the present invention relate to holographic illumination in sensing and imaging devices. More specifically, certain embodiments relate to
holographically illuminated imaging devices (HIIDs) having a holographic element to transform a planar wavefront from an illumination beam into at least one focal array of light spots in a fluid channel. A fluid flow moves an object through the light spots in the fluid channel. The object alters the light (e.g., fluorophores absorb light and emit light of a different light property). A light detector detects the altered light (e.g., emissions) and generates time varying data which can be used to produce an image of the object. One embodiment includes an HIID with a plurality of focal arrays along the fluid channel at different depths, forming a three-dimensional focal array. This configuration can be used to generate sectional images or three-dimensional images of the object moving through the fluid channel. [0007] One embodiment is directed to a HIID comprising a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots. The HIID further comprises a scanning mechanism configured to move an object across one or more light spots in the focal array of light spots. The HIID further comprises a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
[0008] Another embodiment is directed to a HIID comprising a body defining a fluid channel. The HIID further comprises a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots. The HIID further comprises a beam splitter configured to reflect the focal array of light spots into the fluid channel wherein a flow in the channel moves an object across one or more light spots in the focal array of light spots. The beam splitter is further configured to transmit light altered by the object. The HIID further comprises a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
[0009] Another embodiment is directed to a HIID comprising a holographic element configured to transform an illumination beam into a plurality of focal arrays of light spots at different focal planes. The HIID further comprises a scanning mechanism configured to move an object across one or more light spots in the plurality of focal arrays of light spots. The HIID further comprises a light detector configured to receive light associated with the plurality of focal arrays of light spots, and generate light data associated with the received light.
[0010] Another embodiment is directed to a system comprising a HIID and a processor. The HIID includes a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots. The HIID also includes a scanning mechanism configured to move an object across one or more light spots in the focal array of light spots. The HIID also includes a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light. The HIID also includes a processor in communication with the light detector. The processor is configured to receive a signal with light data and generate an image of the object based on the light data. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] FIG. 1 is a block diagram of components of an HIID system, in accordance with embodiments of the disclosure.
[0012] FIG. 2(a) is a schematic drawing of a cross sectional view of components of an HIID employing a microfluidic flow, according to embodiments of the invention.
[0013] FIG. 2(b) is a schematic drawing of a partial top view of components of the
HIID of FIG. 2(a), according to embodiments of the invention.
[0014] FIG. 3 is a schematic drawing of components of an HIID having a collection component, according to embodiments of the invention.
[0015] FIG. 4 is a schematic drawing of components of an HIID having a collection component including a diffraction optical element (DOE) and a beam block, according to embodiments of the invention.
[0016] FIG. 5 is a schematic drawing of components of an HIID having a reflective design, according to embodiments of the invention.
[0017] FIG. 6 is a schematic drawing of components of an HIID having multiple focal arrays in series at different depths for sectional imaging or three-dimensional imaging, according to embodiments of the invention.
[0018] FIG. 7 is a schematic drawing of components of an HIID having multiple focal arrays in series with different differentiating elements for multi-spectral fluorescence or phosphorescence imaging, according to embodiments of the invention.
[0019] FIG. 8(a) is a schematic drawing of a setup for off axis recording a holographic element, according to embodiments of the invention.
[0020] FIG. 8(b) is a schematic drawing of a setup for inline recording a holographic element, according to embodiments of the invention.
[0021] FIG. 9 is a block diagram of subsystems that may be present in computer devices that are used in an HIID system, according to embodiments of the invention. DETAILED DESCRIPTION OF THE INVENTION
[0022] Embodiments of the present invention will be described below with reference to the accompanying drawings. One embodiment includes an HIID having a holographic element for illuminating a fluid channel carrying an object being imaged. The holographic element transforms a planar wavelength of an illumination beam into an array of spherical wavefront or approximately spherical wavefront to form a focal array of tightly confined light spots diagonally extending across the fluid channel. As the object moves past light spots, the light is altered (e.g., fluorophores absorb light and emit light of a different property). A differentiating element transmits the altered light (e.g., emissions) to a light detector which generates time varying data, which is used to generate images (e.g., fluorescent images) of the object.
[0023] Some conventional imaging systems use a lens array to channel uniform light into light spots. The spacing between the light spots is restricted by the diameter of the lens. For example, to create an array of light spots with a spacing of 30 micron using an appropriate lens array, each lens would have about a 30 micron diameter. The numerical aperture of each lens is also limited by the lens diameter.
[0024] The HIID of embodiments does not have these restrictions because it uses a holographic element. A holographic element can represent a series of overlapping effective 'lenses.' The effective 'lenses' can channel an illumination beam into overlapping focal cones and into light spots. Since the focal cones overlap, the spacing between the light spots is not dependent on the diameter of the effective 'lens.' The holographic element can also have a much higher achievable numerical aperture than a lens array and may be capable of generating higher resolution images. Examples of holographic elements that generate light spots can be found in Wu, Jigang, Cui, Xiquan, Zheng, Guoan, Wang, Ying Min, Lee, Lap Man, Yang, Changhuei, "Wide field-of-view microscope based on holographic focus grid illumination," Optics Letters, Vol. 35, No. 13, July 1, 2010, which is hereby incorporated by reference in their entirety for all purposes.
[0025] The HIIDs of embodiments of the invention provide one or more advantages.
One advantage is that the HIID provides more localized illumination which can improve image resolution. Since the holographic element does not have the same physical restrictions of a lens array, the holographic element may be able to generate tighter focused light spots in a shorter focal length, which can allow for higher resolution images. In a microfluidic flow application (e.g., an optofluidic microscope), a holographic element may provide tightly focused lights spots within the short width of a fluid channel, which can provide better illumination than conventional systems. This improved illumination can result in higher resolution images. In some embodiments, image resolution of less than 0.6 micron can be achieved. Another advantage is that the HIID has more effective usage of a given illumination beam (e.g., excitation light) than conventional imaging devices. The use of a holographic element allows for effective channeling of the light power in an illumination beam into tightly confined light spots. In some embodiments, a holographic element of an HIID may be able to channel up to 47% of an illumination beam into the light spots. Some embodiments may be able to provide a local light intensity at the light spots of values of about 3xl04 W/cm2. Another advantage is that the HIID has few components in a simple multi-layered structure that can be fabricated in an on-chip design. Since the HIID can be designed in a multilayered structure, the device can be an on-chip design inexpensively fabricated using standard semiconductor and micro/nanofabrication procedures. A multi- layered on-chip design can also be easily miniaturized. Another advantage is that the HIID can employ microfluidic flow for high throughput analyses and imaging. These microfluidic flow methods can also be highly automated. Another advantage is that an HIID has the flexibility of being designed with a focal plane away from the surface a fluid channel in a microfluidic flow application. The HIID can be designed to locate the focal plane of the light spots at any arbitrary height within the fluid channel so that the high resolution images can be generated any arbitrary height. This flexibility is useful as it frees the restriction of having to flow specimens with the objects close to either the channel floor or ceiling for good image acquisition.
[0026] I. HIID System
[0027] FIG. 1 is a block diagram of components of an exemplary HIID system 10, in accordance with embodiments of the disclosure. The HIID system 10 includes an HIID 100 communicatively coupled to a host computer 200. Although the illustrated embodiment includes a single HIID 100 and a single host computer 200, other embodiments may include two or more HIIDs 100 and/or host computers 200.
[0028] The HIID 100 includes an illumination source 110, a holographic element 120, a scanning mechanism 130 and a light detector 140. The holographic element 120 transforms a wavefront of an illumination beam (shown in FIG. 2(a)) by the illumination source 110 into an array of converging spherical wavefront to form a focal array of light spots 114 (shown in FIG. 2(b)) to illuminate an object 150 (shown in FIG. 2(a)) being imaged by the HIID 100. Although many embodiments show an array of converging spherical wavefront,
approximately spherical wavefront or other wavefront with well separate structure can be used in other embodiments. The scanning mechanism 130 moves the focal array of light spots relative to the object 150 or move the object 150 relative to the focal array of light spots. The light detector 140 light altered (e.g., blocked, reduced intensity, and/or modified wavelength or other light property) by the object 150. The light detector 140 generates light data associated with light received by the light detector 140. Although the illustrated embodiment includes a single illumination source 110, a single holographic element 120, a single scanning mechanism 130 and a single light detector 140, other embodiments may include any suitable number of these components.
[0029] The host computer 200 comprises a processor 210 (e.g., a microprocessor) communicatively coupled to the light detector 140, a computer readable medium (CRM) 210, and a display 230. The processor 200 receives signals with light data from the light detector 140. The processor 210 executes code stored on the CRM 210 to generate images or otherwise analyze the object 150 using the light data. The images and other output can be shown on the display 230. Any suitable images can be generated such as photoluminescence images, intensity images, phase images, differential interference contrast (DIC) images, etc. A photoluminescence image can refer to a fluorescence image or a phosphorescence image.
[0030] The illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100. The illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available. The illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. The illumination source 110 may provide an illumination beam of any suitable wavelength, intensity, phase, polarization, spin angular momentum or other light property, and any suitable spatial distribution. In exemplary embodiments, the illumination source 110 provides an illumination beam with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120. In exemplary
fluorescence/phosphorescence embodiments, the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged. The fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second
wavelength). Some examples of suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
[0031] As used herein, a holographic element 120 refers to a suitable holographic film/plate/crystal capable of converting an illumination beam 111 (shown in FIG. 2(a)) from an illumination source 110 into a focal array of light spots 114 (shown in FIG 2(b)). In many illustrated embodiments, the holographic element 120 transforms a wavefront of the illumination beam 111 from the illumination source 110 into an array of spherical wavefront to form a focal array of light spots 114. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. The holographic element 120 can be made of any suitable materials. Some examples of suitable holographic materials include photographic emulsions, dichromated gelatin, and photoresists. The holographic element 120 can have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.). The holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. Some examples of suitable holographic recording techniques include in-line (Gabor) and off-axis (Leith-Upatnieks). To play back the recording, the holographic element 120 can be illuminated by an illumination beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120. Use of a holographic element 120 can allow for effective channeling of light power from the illumination source 110 into the light spots 115.
[0032] The focal array of light spots 114 (shown in FIG. 2(b)) can have any suitable number of light spots (e.g., 1, 10, 100, 200, etc.) and can be any suitable array or combination of arrays. Some examples of suitable arrays include a one-dimensional array, a two- dimensional array, a three-dimensional array, and a multiplicity of one-dimensional, two- dimensional, and/or three-dimensional arrays. The arrays can have any suitable orientation or combination of orientations. In some embodiments, a three-dimensional array can be used to image at different depth positions of the specimen having the object 150 being imaged. For example, FIG. 6 is an illustration of an embodiment of an HIID 100 having a holographic element 120 generating a three-dimensional focal array of light spots 600 along the longitudinal axis of the fluid channel 132 and at different focal planes through the depth of the fluid channel 132. In FIG. 6, the three-dimensional array 600 is comprised of a plurality of n one-dimensional focal arrays of light spots 114(l)-114(n) at n different focal planes 116(l)-116(n) at different depths of the fluid channel 132. As an object 150 moves through the fluid channel 132, the light spots illuminate the object 150 at different focal planes and the object 150 alters the light. The light data can be used to generate sectional images of the object 150 at different depths and/or generate three-dimensional images of the object 150.
[0033] Each light spot 115 can be of any suitable size. Some examples of suitable diameters (FWHM) are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc. In one exemplary embodiment, the light spot diameter is 0.6 microns (FWHM). Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
[0034] In some embodiments, the holographic element 120 can be replaced by a diffractive optical element (DOE) in the HIID 100. A DOE refers to any suitable structure capable of diffracting light to generate a desired light pattern such as a focal array of light spots. Some examples of suitable DOEs include a Fresnel Zone plate, diffraction grating, photon sieve, etc. The DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.). In some cases, using DOEs may be advantageous because they have a comparatively high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
[0035] As used herein, the scanning mechanism 130 refers to a suitable device(s) capable of moving the object 150 being imaged relative to the light spots or the light spots relative the object 150 to substantially illuminate the object 150. The scanning mechanism 130 can be based on any suitable method including, for example, microfluidic flow methods, optical tweezing methods, and scanning methods (raster scanning, linear scanning, etc.). An example of a scanning mechanism 130 employing a microfluidic flow method includes a fluid channel 132 having a fluid flow with the object 150 being imaged. In another example, the scanning mechanism 130 may include a raster scanning device for raster scanning the object 150 or specimen stage with the object 150 through the light spots or raster scanning the light spots over the object 150. The scanning mechanism 130 can be in any suitable location that does not block the light from the illumination source 110.
[0036] A light detector 140 (e.g., a photosensor) refers to any suitable device capable of detecting light and generating signals with light data. The signals may be in the form of electrical current that results from the photoelectric effect. The light detector can be a single detector, a one-dimensional detector array, or a two-dimensional detector array. Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT). Some examples of one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide- semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc.
[0037] The light detector 140 includes one or more discrete light detecting elements
140(a) (shown in FIG. 2(a)) of any suitable size (e.g., 1-10 microns) and any suitable shape (e.g., circular or square). For example, a CMOS or CCD light detecting element 140(a) may be 1-10 microns and an APD or PMT light detecting element 140(a) may be as large as 1-4 mm. The light detecting elements 140(a) can be arranged in any suitable form such as a one- dimensional array, a two-dimensional array, or a multiplicity of one-dimensional and/or two- dimensional arrays. The arrays can be in any suitable orientation or combination of orientations. In some cases, the light detecting elements 140(a) can be arranged to correspond to the focal array of light spots 114 (shown in FIG. 2(b)). For example, the light detecting elements 140(a) can have the same form as the focal array of light spots 114 so that one or more light detecting elements 140(a) corresponds to a light spot.
[0038] The light detecting elements 140(a) can detect any suitable light data. Light data refers to any suitable information related to the light detected by the light detecting elements 140(a). Light data may include, for example, information about the properties of the light detected such as the intensity of the light, the wavelength(s) of the light, the frequency or frequencies of the light, the polarization(s) of the light, the phase(s) of the light, the spin angular momentum(s) of the light, and/or other light properties associated with the light detected by the light detecting elements 140(a). Light data may also include the location of the light detecting element 140(a) associated with the light data and the time that the light was detected by the light detecting element 140(a). The light data may be data based on a single time, based on multiple times, or on a time varying basis. In some embodiments such as the microfluidic flow embodiments, the light data may be time varying data.
[0039] The system 10 also includes a host computer 200 communicatively coupled to the light detector 140. The host computer 200 comprises a processor 210 (e.g., a
microprocessor) coupled to a computer readable medium (CRM) 210 and a display 230. Alternatively, one or more components of the host computer 200 can be part of the HIID 100.
[0040] The processor 210 receives signals with light data from the light detector 140 associated with the light received by the light detecting elements 140(a). The processor 210 executes code stored on the CRM 220 to perform some of the functions of system 10 such as interpreting the light data from the light detector 142, performing analyses from the light data and/or generating images from the light data.
[0041] The CRM 220 (e.g., memory) stores code for performing some functions of system 10. The code is executable by the processor 210. In one embodiment, the CRM 220 comprises: a) code for interpreting the light data received from the light detector 142, b) code for performing analyses based on the light data, c) code for generating one or more images from the light data, d) code for displaying one or more images, and e) any other code for performing the functions of system 10.
[0042] The display 230 is communicatively coupled to the processor 210 to receive output data such as image data. Any suitable display may be used. In one embodiment, the display 230 may be part of the HIID 100. The display 230 may provide output such as images to a user of the HIID 100.
[0043] Modifications, additions, or omissions may be made to HIID system 10 without departing from the scope of the disclosure. For example, other embodiments of the HIID system 10 may not include a display 230. In addition, the components of system 10 may be integrated or separated according to particular needs. For example, the processor 210 may be integrated into the light detector 140 so that the light detector 140 performs all the functions of the processor 210 in some embodiments.
[0044] II. HIID Configurations
[0045] Several configurations of HIIDs 100 are described below. The first configuration includes an HIID 100 using a microfluidic flow method as a scanning mechanism 130. The second configuration adds a collection component 170 for collecting light for detection by the light detector 140. The third configuration is a reflective design including a beam splitter. The fourth configuration uses a three-dimensional focal array of light spots to sectionally image the object 150 at different depths. Although the illustrated embodiments of these configurations use microfluidic flow, other scanning mechanisms 130 can be used in these configurations.
[0046] A. Configuration 1
[0047] FIG. 2(a) is a schematic drawing of cross sectional view of components of an
HIID 100 employing a microfluidic flow method, according to embodiments of the invention. FIG. 2(b) is a drawing of a partial top view of components of the HIID 100 shown in FIG. 2(a) taken at the focal plane 116, according to embodiments of the invention. The drawing in FIG. 2(a) is a cross-section A-A of the HIID 100 in FIG. 2(b) through a focal array of light spots 114.
[0048] In FIGS. 2(a) and 2(b), the HIID 100 includes a multi-layered body 131 with a holographic element 120 and an illumination source 110 providing an illumination beam 111 at the holographic element 120. The multi-layered body 131 also defines or includes a fluid channel 132 having a fluid flow with the object 150 being imaged. The fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132. The body 131 also includes an optional differentiating element 160 located outside the second surface 136 of the fluid channel 132 and a light detector 140 located outside the differentiating element 160.
[0049] In the illustrated embodiment, the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. In the illustrated embodiment, each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117. The array of spherical wavefront forms the focal array of light spots 114. The focal array of light spots 114 includes light spots 115 collectively extending across the fluid channel 132 or across a portion of the fluid channel 132. An object 150 moving through the fluid channel 132 can alter (e.g., block, reduce intensity, change wavelength, or otherwise modify a light property) the light. The altered light spreads into an altered light volume 118. The differentiating element 160 transmits light altered by the object 150. The light detector 140 receives light and generates time varying light data based on the received light as the object 150 moves through the fluid channel 132. A processor 210 (shown in FIG. 1) can use the time varying light data to generate images or otherwise analyze the object 150.
[0050] The HIID 100 also includes an x-axis, a y-axis, and a z-axis. The x-axis and a y-axis lie in the plane of the second surface 136 of the fluid channel 132. The x-axis lies along a longitudinal axis of the fluid channel 132. The z-axis is orthogonal to the x-axis and the y-axis.
[0051] In the illustrated example, the body 131 is a multi-layered structure. In other embodiments, the body 131 may be a single, monolithic structure. The layers of the body 131 may include any suitable material or combination of materials having any suitable thickness. The layers of the body 131 may also include any suitable devices (e.g., holographic element 120, light detector 140). Although FIGS. 2(a) and 2(b) have certain layers, other embodiments of the invention may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131. For example, the body 131 may also include a collection component 170 (shown in FIG. 3) between the fluid channel 132 and the differentiating element 160 or between the differentiating element 160 and the light detector 140 in some embodiments. As another example, the body 131 may also include a layer (e.g., a protective layer) made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
[0052] The fluid channel 132 may have any suitable dimensions. For example, the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases. In one embodiment, the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100. For example, the height of the fluid channel may be sized to be about the diameter of the object 150.
[0053] In microfluidic flow embodiments, the fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132. Any suitable technique may be used for providing fluid flow and particulate transport of the objects 100 in the fluid channel 132 of these embodiments. Some convention techniques include pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, or thermocapilarity techniques. Other techniques may include gravity drive flow, hydrodynamic focusing, dielectrophoresis, and optical tweezing. Any suitable control device(s) may be used to control the flow of fluid and/or movement of the object 150 through the fluid channel 132. Some examples of suitable control devices include micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, and/or hydrodynamic focusing channels.
[0054] The illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100. The illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available. The illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120. In exemplary fluorescence and phosphorescence embodiments, the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged. The fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength). Some examples of suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
[0055] The holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront to form a focal array of light spots 114 at the focal plane 116. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. The holographic element 120 can be made of any suitable materials. The holographic element 120 can have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.). The holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 can be illuminated by a beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
[0056] In FIGS. 2(a) and 2(b), the focal array of light spots 114 includes a one- dimensional array of light spots 115 located at an angle, a with respect to the x-axis. The angle, a can be any suitable angle (e.g., 5 degrees, 10 degrees,...90 degrees, ...170 degrees, etc. ). In many cases, the light spots 115 collectively extend diagonally across the fluid channel 132. In other cases, the light spots 115 may collectively extend in a direction parallel to the y-axis and across the fluid channel 132. Any suitable number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.). In some cases, the number of light spots 115 may be determined by the number of light spots 115 needed to collectively extend across a width of the fluid channel 132 where the objects 150 being examined flow. Although FIGS. 2(a) and 2(b) show the HIID 100 having a single one-dimensional focal array of light spots 114, other embodiments may have a two-dimensional array, a three-dimensional array, or a combination of one, two, and/or three-dimensional arrays.
[0057] Each light spot 115 can be of any suitable size. Some examples of suitable diameters (FWHM) are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc. In one exemplary embodiment, the light spot diameter is 0.6 microns (FWHM). Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
[0058] In the illustrated example, the scanning mechanism 130 employs a microfluidic flow method. The scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132. Although the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments. For example, one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
[0059] In the illustrated embodiment, the light detector 140 detects light and generates signals with time varying light data about the properties of the light detected. Some examples of light properties that can be detected include intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc. The light detector can be a single detector, a one-dimensional detector array, or a two-dimensional detector array. Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT). Some examples of one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide- semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc. The light detector 140 may be a monochromatic or a color detector. For example, the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
[0060] The light detector 140 includes an array of discrete light detecting elements
140(a) of any suitable size (e.g., 1-10 microns) and any suitable shape (e.g., circular or square). The array of light detecting elements 140(a) may be a one-dimensional array or a two-dimensional array. The array or arrays can be in any suitable orientation or combination of orientations. In the illustrated example, the array is a two-dimensional array of light detecting elements 140(a) located at an angle, a with respect to the x-axis. Any suitable angle can be used. In the illustrated example, each light detecting element 140(a) detects light associated with a single light spot 115. In other cases, each light detecting element 140(a) may detect light from more than one light spot 115. Other embodiments may also have a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) from the two-dimensional array of light detecting elements 140(a) that detects light from a single light spot 115.
[0061] In FIGS. 2(a) and 2(b), the object 150 is shown at a time (t = ti) as the object
150 moves through the fluid channel 132 generally in the x-direction. Although the object 150 is shown as a cell, other embodiments may include other suitable object(s). Some examples of suitable objects include biological and inorganic entities. Some examples of biological entities include whole cells, cell components, microorganisms such as bacteria or viruses, cell components such as proteins, etc. Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
[0062] The body 131 of the HIID 100 may optionally include a differentiating element 160 located outside the second surface 136. A differentiating element 160 refers to any suitable device(s) (e.g., optical filters) capable of selectively transmitting light having select light properties (e.g., polarization, wavelength, frequency, intensity, phase, spin angular momentum, etc.) while substantially removing light the remaining light by any suitable method such as reflection, absorption or interference. Some examples of suitable devices include filters (e.g., interference filters, absorption filters, etc.). Any type of filter can be used such as dichroic filters, monochromatic filters, etc. In one embodiment, a polarization filter may be used. In the illustrated embodiment, the differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b). The interference filter 160(a) transmits the altered light and removes remaining light from the illumination source 110 by interference. The absorption filter absorbs remaining light from the illumination source 110. In fluorescence and phosphorescence applications, the
differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially removes excitation light.
[0063] In an exemplary operation, the illumination source 110 provides an illumination beam 111 at the holographic element 120. The holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
[0064] In the exemplary operation, each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117. The array of spherical wavefront forms the focal array of light spots 114. The focal array of light spots 114 is formed at the focal plane 116 in the fluid channel 132.
[0065] During operation, a fluid, within which the object 150 is suspended, flows through the fluid channel 132. As the object 150 flows through the fluid channel 132, the object 150 alters (blocks, reduces intensity, modifies wavelength or other light property or spatial distribution) the light in the fluid channel 132. FIGS. 2(a) and 2(b) show the object 150 at a specific time (t = ti) proximal a single light spot 115. At this time, light altered by the object 150 spreads from the site of the single light spot 115 in the form of an altered light volume 118. Although the illustration shows altered light only originating from the site of a light spots 115, altered light may also originate from other areas (e.g., focal cones 112 and spreading cones) in other embodiments. [0066] The differentiating element 160 transmits the altered light (e.g., reduced intensity, altered wavelength, etc.) to the light detecting elements 140(a). Light that does not interact with the object 150 is at least partially removed by the differentiating element 160.
[0067] In the illustrated embodiment, each light detecting element 140(a) receives light associated a single corresponding light spot 115 in the focal array 114. In other embodiments, each light detecting element 140(a) may receive light associated with other light spots 115. The light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through the fluid channel 132. The processor 210 receives a signal with time varying light data. The processor 210 uses the time varying light data to generate line scans associated with the y- locations of the light detecting elements 140(a). Each line scan is associated with a light spot 115. The time varying light data from the light detecting elements 140(a) is dependent on the profile of the object 150 as well as its optical properties. The processor 210 can reconstruct an image of the object 150 by appropriately shifting and assembling the line scans, and optionally other data such as rotation, velocity of the object 150, and changes in shape of the object 150, etc.
[0068] The HIID 100 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc. The images can be black and white images, grey tone images, color images, etc.
[0069] In one exemplary embodiment, the HIID 100 can be used in fluorescence or phosphorescence imaging (collectively, photoluminescence imaging). The specimen with one or more objects 150 may be prepared by mixing a reagent with the specimen. The reagent may be suitable chemical for attaching (tagging) portions (e.g., molecules of a cell nucleus) of the objects 150 with fluorophores. A fluorophore refers to a component of a molecule which causes the molecule to be fluorescent or phosphorescent. The resulting fluid is introduced into the fluid channel 132 of the HIID 100. The illumination source 110 provides an illumination beam 111 of excitation light having a first light property (e.g., first wavelength, first polarization, etc.) that can excite the fluorophores in the object 150. The holographic element 120 transforms the wavefront of the illumination source 110 of excitation light into an array of converging spherical wavefront, nearly spherical wavefront, or other wavefront having a well separated structure to form a focal array of light spots 114 of excitation light. The fluorophores absorb the excitation light and emit light (emissions) having a second light property (e.g., a second wavelength, a second polarization, etc.). The emissions spread from site of the light spot 115 in the form of an altered light volume 118. The differentiating element 160 transmits emissions and substantially removes remaining light. The light detector 140 detects light and generates time varying light data associated with the received light as the object 150 flows through the flow channel 132. The processor 210 receives a signal from the light detector 140 having time varying data and generates one or more fluorescence or phosphorescence images of the object 150 based on the time varying data.
[0070] In one embodiment, the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111. The DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114. The DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
[0071] B. Configuration 2 - HIID 100 with Collection Component
[0072] In some embodiments, the HIID 100 includes a collection component 170 for collecting light for detection by the light detector 140. FIG. 3 is a schematic drawing of components of an HIID 100 having a collection component 170, according to embodiments of the invention. The drawing in FIG. 3 is a cross sectional view of components HIID 100 at a line through a focal array of light spots 114. In FIG. 3, an illumination source 110 provides an illumination beam 111 to a holographic element 120.
[0073] In FIG. 3, the HIID 100 has a multi-layered body 131 including the holographic element 120. The multi-layered body 131 also defines or includes a fluid channel 132 having a fluid flow with an object 150 being imaged. The fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132. The body 131 also includes a collection component 170 outside the second surface 136 of the fluid channel 132, an optional differentiating element 160 located outside the collection component 170, and a light detector 140 located outside the differentiating element 160.
[0074] In the illustrated embodiment, the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. In the illustrated embodiment, each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117. The array of spherical wavefront forms the focal array of light spots 114. The focal array 114 includes light spots 115 that collectively extend across the fluid channel 132 or across a portion of the fluid channel 132. An object 150 moving through the fluid channel 132 can alter (e.g., block, reduce intensity, change wavelength, or otherwise modify a light property) light. The altered light spreads in an altered light volume 118. The collecting component 170 refocuses light transmitted through the second surface 136 into an array of collections spots 119 at an outside surface of the collection component 170. The differentiating element 160 transmits light altered by the object 150. The light detector 140 receives light and generates time varying light data based on the received light as the object 150 moves through the fluid channel 132. A processor 210 (shown in FIG. 1) can use the time varying light data to generate images or otherwise analyze the object 150. Using a collection component 170 can be advantageous in improving the quality of the light data collected at the light detector 140 which can improve the quality of the images and other analyses performed by the HIID 100. In fluorescence and phosphorescence applications, a collection component 170 can be advantageous to collect emissions that may be highly scattered and weak.
[0075] The HIID 100 also includes an x-axis and a z-axis. The x-axis lies along a longitudinal axis of the fluid channel 132. The z-axis is orthogonal to the x-axis.
[0076] In the illustrated embodiment, the body 131 is a multi-layer structure. The layers of the body 131 may include any suitable material or combination of materials having any suitable thickness. The layers of the body 131 may also include any suitable devices (e.g., holographic element 120, light detector 140). Other embodiments may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131. For example, the collection component 170 may be omitted in some embodiments. As another example, the body 131 may also include a protective layer made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134. [0077] The fluid channel 132 may have any suitable dimensions. For example, the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases. In one embodiment, the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100. For example, the height of the fluid channel may be sized to be about the diameter of the object 150. The fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132. Any suitable technique (e.g., pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, thermocapilarity techniques, gravity drive flow, hydrodynamic focusing, dielectrocphoresis, optical tweezing, etc.) may be used for providing fluid flow and particulate transport of the objects 100 in the fluid channel 132. Any suitable control device(s) (e.g., micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, hydrodynamic focusing channels, etc.) may be used to control the flow of fluid and/or movement of the object 150 through the fluid channel 132.
[0078] The illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100. The illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available. The illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120. In exemplary fluorescence and phosphorescence embodiments, the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged. The fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength). Some examples of suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
[0079] In the illustrated embodiment, the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 to an array of converging spherical wavefront to form a focal array of light spots 114 at the focal plane 116. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. The holographic element 120 can be made of any suitable materials and have any suitable dimensions (e.g., 1 mm x lmm, 2 mm x 2mm, ...,10 mm x 10 mm, etc.). The holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 can be illuminated by a beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
[0080] In FIG. 3, the focal array of light spots 114 includes a one-dimensional array of light spots 115 located at an angle, a (shown in FIG. 2(b)) with respect to the x-axis. The angle, a can be any suitable angle (e.g., 5 degrees, 10 degrees, ...90 degrees, ...170 degrees, etc.). Any suitable number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.). Although FIG. 3 has a single one-dimensional focal array of light spots 114, other embodiments may have a two-dimensional array, a three-dimensional array, or a combination of one, two, and/or three-dimensional arrays.
[0081] Each light spot 115 can be of any suitable size. Some examples of suitable diameters (FWHM) are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc. In one exemplary embodiment, the light spot diameter is 0.6 microns (FWHM). Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
[0082] In the illustrated example, the scanning mechanism 130 employs a microfluidic flow method. The scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132. Although the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments. For example, one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
[0083] In the illustrated embodiment, the light detector 140 detects light and generates signals with time varying light data about the properties of the light detected. Some examples of light properties that can be detected include intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc. The light detector 140 can be a single detector, a one-dimensional detector array, or a two-dimensional detector array of light detecting elements 140(a). Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT). Some examples of one- dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide-semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc. The light detector 140 may be a monochromatic or a color detector. For example, the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
[0084] The light detector 140 includes an array of discrete light detecting elements
140(a) of any suitable size (e.g., 1-10 microns) and any suitable shape (e.g., circular or square). The array of light detecting elements 140(a) may be a one-dimensional array or a two-dimensional array. The array or arrays can be in any suitable orientation or combination of orientations. In the illustrated example, the array is a two-dimensional array of light detecting elements 140(a) located at an angle, a with respect to the x-axis. Any suitable angle can be used. In the illustrated example, each light detecting element 140(a) detects light associated with a single light spot 115. In other cases, each light detecting element 140(a) may detect light from more than one light spot 115. Other embodiments may also have a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) from the two-dimensional array of light detecting elements 140(a) that detects light from a single light spot 115.
[0085] In FIG. 3, the object 150 is shown at a time (t = ti) as the object 150 moves through the fluid channel 132 generally in the x-direction. Although the object 150 is shown as a cell, other embodiments may include other suitable object(s) (e.g. biological and inorganic entities). Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
[0086] The body 131 of the HIID 100 may optionally include a differentiating element 160 located outside the second surface 136. The differentiating element 160 selectively transmits altered light while substantially removing the remaining light. The differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b). The interference filter 160(a) transmits the altered light and removes remaining light from the illumination source 110 by interference. The absorption filter absorbs remaining light from the illumination source 110. In fluorescence and phosphorescence applications, a differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially remove excitation light.
[0087] The collection component 170 refers to a device(s) capable of refocusing light passing through the second surface 136 and associated with each light spot 115 to one or more light detecting elements 140(a). By refocusing the altered light, the detection efficiency may be increased. The collection component 170 can include any suitable device or combination of suitable devices. Some examples of suitable devices include a refractive lens or other diffractive elements (e.g., Fresnel zone plate).
[0088] The collection component 170 can refocus light into any suitable light distribution at any suitable plane(s). In some embodiments, the light distribution may be a tightly confined collection spot 119. In other embodiments, the light distribution may be a wider distribution that can be detected by one or more light detecting elements 140(a). The collection component 170 may be in any suitable location. For example, the collection component 170 may be located between the differentiating element 160 and the light detector 140 of the HIID 100 shown in FIG. 2(a). As another example, the collection component 170 can be located between the second surface 136 of the fluid channel 132 and the
differentiating element 160 as shown in FIG. 3.
[0089] In FIG. 3, the collection component 170 refocuses light associated with each light spot 115 into an array of collection spots 119 at the outside surface of the collection component 170. Light transmitted through the second surface 136 continues spreading until the mid portion of the collection component 170. At the mid portion, the light no longer spreads and focuses to an array of collection spots 119 on the outer surface of the collection component 170. Any suitable device or devices (e.g., refractive lenses) may be used to provide for this collection.
[0090] FIG. 4 is a schematic drawing of components of an HIID 100 having a collection component 170 including a DOE (e.g., Fresnel zone plate, diffraction grating, photon sieve, etc.) 172 and a beam block 174, according to embodiments of the invention. The drawing is a cross sectional view through a portion of the HIID 100 having a light spot 115 of the focal array of light spots 114. The diffractive element 172 refers to a device capable of modifying light passing through the second surface 136 into collection spots 119(a) and 119(b). A beam block 174 can refer to a suitable device capable of blocking all light. In an exemplary fluorescence or phosphorescence operation, a beam block 174 can be designed to remove the unscattered excitation light.
[0091] In FIG. 4, the HIID 100 includes a multi-layered body 131 and an illumination source 110 providing an illumination beam 111. The body 131 includes a holographic element 120 and defines or includes a fluid channel 132 having a fluid flow with an object 150 being imaged. The fluid channel 132 has a first surface 134 and an opposing second surface 136. The body 131 also includes the collection component 170 having a DOE 172 and beam block 174, an optional differentiating element 160, a light detector 140, an x- axis, and a z-axis. By using a beam block 174, the differentiating element 160 in the HIID 100 can be less powerful and potentially smaller so that the HIID 100 having a beam block 174 can be more compact. In these embodiments, the addition of a collection component 170 with a beam block 174 can allow for a more compact HIID 100 and a more compact system 10.
[0092] In FIG. 4, the collection component 170 refocuses the light passing through the second surface 136. The DOE 172 or holographic elements or a refractive lens focuses the unscattered light (e.g., excitation light) passing through the second surface 136 from the spreading volume 117 to a plane where the beam block 174 is located. The beam block 174 blocks the light focused at the beam block 174. The DOE 172 focuses the light altered by the object 150 (e.g., emissions) that pass through the second surface 136 from altered light volume 118 into a second collection spot 119(b) at the detector plane at the outer surface of the collection component 170.
[0093] In an exemplary operation of an HIID 100 with a collection component 170, the illumination source 110 provides the illumination beam 111. The holographic element 120 transforms the wavefront, planar or otherwise, of the illumination source 110 into an array of spherical wavefront, nearly spherical wavefront, or other wavefront having a well separated structure to form a focal array of light spots 114 at the focal plane 116 in the fluid channel 132. The light spreads in the form of spreading volumes 117.
[0094] As fluid flows through the fluid channel 132, the object 150 alters light in the fluid channel 132. FIG. 3 shows the object 150 at a specific time (t = ti). The altered light spreads from each site of the light spot 115 in the form of an altered light volume 118.
Although the illustration shows altered light only originating from the site of the light spots 115, altered light may also originate from other areas (e.g., focal cones 112) in other embodiments. The collection component 170 refocuses light passing through the second surface 136 into an array of collection spots 119. In some cases, the collection component may have devices such as a beam block 174 that block light that did not interact with the object 150. The differentiating element 160 removes any light that did not interact with the object 150 and that transmits through the outer surface of the collection component 170. The differentiating element 160 transmits light altered by the object 150 to the light detecting elements 140(a).
[0095] In this exemplary operation, each light detecting element 140(a) receives light associated with a single corresponding light spot 115 in the focal array 114. In other embodiments, each light detecting element 140(a) may receive light associated with other light spots 115. The light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through the fluid channel 132. The processor 210 receives a signal with time varying light data and uses the time varying light data to generate line scans associated with the y-locations of the light detecting elements 140(a). Each line scan is associated with a light spot 115. The time varying light data from the light detecting elements 140(a) is dependent on the profile of the object 150 as well as its optical properties. The processor 210 can reconstruct an image of the object 150 by appropriately shifting and assembling the line scans, and optionally other data such as rotation, velocity of the object 150, and changes in shape of the object 150, etc.
[0096] The HIID 100 including a collection component 170 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc. For example, the HIID 100 with a collection component 170 can be used in fluorescence or phosphorescence imaging. In this example, the illumination source 110 provides an illumination beam 111 of excitation light having a first light property that can excite fluorophores in the object 150. In the illustrated embodiment, the holographic element 120 transforms the planar wavefront of the illumination beam 111 of excitation light into an array of converging spherical wavefront. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. In the illustrated embodiment, the spherical wavefront are in the form of focal cones 112 converging to a focal array of light spots 114 of excitation light. The fluorophores absorb the excitation light and emit light (emissions) having a second light property. The emissions spread from site of the light spot 115 in the form of an altered light volume 118. The collection component 170 refocuses light passing through the second surface 136 into an array of collection spots 119. The differentiating element 160 transmits emissions and substantially removes remaining light. The light detector 140 detects light and generates time varying light data associated with the received light as the object 150 flows through the flow channel 132. The processor 210 receives a signal from the light detector 140 having time varying data and generates one or more fluorescence or phosphorescence images of the object 150 based on the time varying data.
[0097] In one embodiment, the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111. The DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114. The DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
[0098] C. Configuration 3 - Reflective Design with Beam Splitter
[0099] In some embodiments, the HIID 100 has a reflective design configuration with a beam splitter 190. A beam splitter 190 refers to an optical device capable of splitting a single beam of light of a particular type into two or more beams of light of different types (e.g., different wavelengths, different polarizations, etc.). In a fluorescence or
phosphorescence application, the beam splitter 190 can be designed to reflect excitation light and transmit emitted light (emissions) from fluorophores. The beam splitter 190 can be in any suitable form (e.g., cube, half-silvered mirror, etc.).
[0100] FIG. 5 is a schematic drawing of components of a reflective design configuration of an HIID 100 having a beam splitter 190 in the form of a cube, according to embodiments of the invention. The drawing in FIG. 5 is a cross sectional view of the HIID 100 at a line through the focal array of light spots 114.
[0101] In FIG. 5, the HIID 100 includes a multi-layered body 131 defining or including a fluid channel 132 having a fluid flow carrying an object 150 being imaged or otherwise analyzed. The fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132. The HIID 100 also includes an x-axis along a longitudinal axis of the fluid channel 132 and a z-axis orthogonal to the x-axis.
[0102] The HIID 100 also includes a beam splitter 190 coupled at a first outer surface to the fluid channel 132, a holographic element 120 coupled to a second outer surface of the beam splitter 190, an illumination source 110 providing an illumination beam 111 to the holographic element 120, and an optional differentiating element 160 outside a third outer surface of the beam splitter 190. The first and third surfaces are opposing surfaces of the cube of the beam splitter 190. The beam splitter 190 splits light at a splitting plane 192 located at a 45 degree angle with respect to the x-axis of the fluid channel 132. In the illustrated embodiment, the beam splitter 190 reflects light with properties of the illumination beam 111 and transmits light having other properties. The HIID 100 also includes a collection component 170 coupled to the outside of the differential element 160 and a light detector 140 coupled to the outside of the collection component 170.
[0103] In an exemplary operation, the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. In the exemplary operation, each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117. The array of spherical wavefront forms the focal array of light spots 114. Light from the illumination beam 111 is reflected at the splitting plane 192 of the beam splitter 190 and transmitted through the second surface 136 of the fluid channel 132 to form the focal array of light spots 114 in the fluid channel 132. A fluid with the suspended object 150 flows through the fluid channel 132. As the object 150 moves across the focal array 114, the object 150 alters light from each light spot 115. The altered light (e.g., fluorescent emissions) from the site of the light spot 115 is transmitted through the splitting plane 192 of the beam splitter 190. The altered light is in the form of an altered light volume 118. The differentiating element 160 transmits the altered light and the collection component 170 refocuses light into a collection spot 119 at light detector 140.
[0104] In the illustrated embodiment, the body 131 is a multi-layer structure having layers of suitable material or combination of materials having any suitable thickness. The layers of the body 131 may also include suitable devices. In the illustrated embodiment, the body 131 defines or includes a fluid channel 132 having any suitable dimensions. The body 131 also includes the beam splitter 190, the differentiating element 160, the collection component 170, and the light detector 140. Other embodiments may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131. For example, the body 131 may also include a layer made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
[0105] The fluid channel 132 may have any suitable dimensions. For example, the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases. In one embodiment, the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100. For example, the height of the fluid channel may be sized to be about the diameter of the object 150. The fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132. Any suitable technique (e.g., pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, thermocapilarity techniques, gravity drive flow, hydrodynamic focusing, dielectrocphoresis, optical tweezing, etc.) may be used for providing fluid flow and particulate transport of the objects 100 in the fluid channel 132. Any suitable control device(s) (e.g., micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, hydrodynamic focusing channels, etc.) may be used to control the flow of fluid and/or movement of the object 150 through the fluid channel 132.
[0106] The illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100. The illumination source 110 may be provided by any suitable device(s). The illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120. In exemplary fluorescence and phosphorescence embodiments, the illumination source 110 provides suitable excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged. The fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength). [0107] In the illustrated embodiment, the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into an array of converging spherical wavefront to form a focal array of light spots 114 at the focal plane 116. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. The holographic element 120 can be made of any suitable materials and have any suitable dimensions (e.g., 1 mm x lmm, 2 mm x 2mm, ...,10 mm x 10 mm, etc.). The holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 is illuminated by an illumination beam 111 having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
[0108] In FIG. 5, the focal array of light spots 114 includes a one-dimensional array of light spots 115 located at an angle, a (shown in FIG. 2(b)) with respect to the x-axis. The angle, a can be any suitable angle (e.g., 5 degrees, 10 degrees, 45, degrees,...,170 degrees, etc.). Any suitable number of light spots 115 can be used (e.g., 1, 10, 50, 100, 500, etc.). Each light spot 115 can be of any suitable size. Some examples of suitable diameters (FWHM) are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc. In one exemplary embodiment, the light spot diameter is 0.6 microns (FWHM). Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
[0109] In the illustrated example, the scanning mechanism 130 employs a microfluidic flow method. The scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132. Although the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments. For example, one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150. [0110] The light detector 140 detects light and generates signals with time varying light data about the light properties (e.g., intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc.) of the light detected. The light detector 140 can be a single detector, a one-dimensional detector array, or a two-dimensional detector array of light detecting elements 140(a) (shown in FIG. 2(a)). Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT). Some examples of one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide-semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc. In some cases, each light detecting element 140(a) detects light associated with a single light spot 115. In other cases, each light detecting element 140(a) may detect light from more than one light spot 115. In some cases, a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) from the two-dimensional array of light detecting elements 140(a) detects light from a single light spot 115. The light detector 140 may be a monochromatic or a color detector. For example, the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
[0111] In FIG. 4, the object 150 is shown at a time (t = ti) as the object 150 moves through the fluid channel 132 generally in the x-direction. Although the object 150 is shown as a cell, other embodiments may include other suitable object(s) (e.g. biological and inorganic entities). Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
[0112] The body 131 of the HIID 100 may optionally include a differentiating element 160 outside a third outer surface of the beam splitter 190. The differentiating element 160 selectively transmits light altered by the object 150 while substantially removing other remaining light. In fluorescence and phosphorescence applications, a differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially remove excitation light.
[0113] The collection component 170 refers to a device(s) capable of refocusing light associated with each light spot 115 that is transmitted through the differentiating element 160, into a collection spot 119 at one or more light detecting elements 140(a) of the light detector 140. The collection component 170 can include any suitable device or combination of suitable devices (e.g., refractive lens or other diffractive elements). The collection component 170 can refocus light into any suitable light distribution at any suitable plane(s). In the illustrated example, the light distribution is a tightly confined collection spot 119. In other embodiments, the light distribution may be a wider distribution that can be detected by a single light detecting element 140(a) or by a grid of corresponding light detecting elements 140(a).
[0114] The beam splitter 190 splits a light beam of a particular type into two or more beams of light of different types (e.g., different wavelengths, different polarizations, etc.). In a fluorescence or phosphorescence application, the beam splitter 190 can be designed to reflect excitation light and transmit emissions. The beam splitter 190 can be of any suitable design form (e.g., cube, half-silvered mirror, dichroic mirrored prism, etc.) including any suitable device(s). In FIG. 4, the beam splitter 190 is a cube including two triangular portions. The beam splitter 190 includes a splitting plane 192 at the interface between two triangular portions. In some cases, the splitting plane 192 within the beam splitter 190 may be coated with a dichroic layer which reflects the light of the same type as the illumination beam (e.g., excitation light) and transmit light of other types (e.g., fluorescent emissions).
[0115] In one embodiment, the beam splitter 190 can be a polarized beam splitter. In this embodiment, the illumination beam 111 can be excitation light that is linearly polarized and can be reflected by the polarized beam splitter to form the focal array 114. In this example, about 50% of the emission may pass through the polarized beam splitter.
[0116] In an exemplary operation, the illumination source 120 provides an illumination beam 111. The holographic element 120 transforms the planar wavefront of the illumination beam 111 into an array of spherical wavefront to form a focal array of light spots 114. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. In the exemplary operation, the light is reflected at the splitting plane 192 located at a 45 degree angle with respect to the x-axis of the fluid channel 132 so that the light spots 115 are formed in the fluid channel 132. As the object 150 moves through the fluid channel 132, the object 150 alters light from each light spot 115. The altered light (e.g., fluorescent emissions) from each light spot 115 is transmitted through the splitting plane 192 of the beam splitter 190. FIG. 5 shows a single object 150 at a specific time (t = ti) altering light at a single light spot 115. At this time, light altered by the object 150 spreads from the site of the light spot 115 in the form of an altered light volume 118. The differentiating element 160 transmits the altered light and removes other light. At this time, the collection component 170 refocuses light altered by the object 150 at a single collection spot 119 at light detector 140. The light detecting elements 140(a) receive light and generate time varying light data about the light as the object 150 moves through the fluid channel 132. The processor 210 receives a signal with time varying light data and uses the time varying light data to generate line scans associated with the y-locations of the light detecting elements 140(a). Each line scan is associated with a light spot 115. The time varying light data from the light detecting elements 140(a) is dependent on the profile of the object 150 as well as its optical properties. The processor 210 can reconstruct an image of the object 150 by appropriately shifting and assembling the line scans, and optionally other data such as rotation, velocity of the object 150, and changes in shape of the object 150, etc.
[0117] The HIID 100 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc. In a fluorescence or phosphorescence imaging example, the HIID 100 provides an illumination beam 111 of excitation light having a first light property that can excite fluorophores in the object 150. The holographic element 120 transforms the wavefront of the illumination source 120 of excitation light into an array of spherical wavefront, approximately spherical wavefront or other wavefront having a well separated structure to form a focal array of light spots 114 of excitation light. The excitation light is reflected by the splitting plane 192 to form the focal array of light spots 114 in the fluid channel 132. The fluid channel 132 has a fluid flow with the object 150 being imaged. The fluorophores absorb excitation light and emit light (emissions) having a second light property different from the first light property. At a specific time (t = ti), an object 150 alters the light from a single light spots 115 as illustrated in FIG. 5. The emissions spread from site of the light spot 115 in the form of an altered light volume 118. In some cases, emissions also spread from the site of the focal cones 112. The splitting plane 192 transmits the emissions and the collection component 170 refocuses the emissions into a collection spot 119 associated with a light spot 115. As the object 150 moves through the fluid channel 132, the light detector 140 detects light and generates time varying light data associated with the received light. The processor 210 receives a signal from the light detector 140 having time varying data and generates one or more fluorescence or phosphorescence images of the object 150 based on the time varying data. [0118] In one embodiment, the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111. The DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114. The DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
[0119] E. Configuration 4 - Multiple Focal Arrays
[0120] The cost and complication of combining multiple HIID 100 illustrated in
FIG. 2(a) into a single HIID 100 with multiple focal arrays 114 can be relatively minor in many cases. Having multiple focal arrays 114 in a single HIID 100 may provide one or more advantages. HIID 100 with multiple focal arrays 114 multiplexed in parallel can be used in parallel processing to boost throughput. Other HIID 100 can have focal arrays in series to perform more detailed analysis of the same specimen. For example, an HIID 100 with a series of focal arrays each having a differentiating element 160 that passes a different emission light (e.g., light of a different wavelength) can be used to perform multi- spectral fluorescence imaging. As another example, an HIID 100 with a series of focal arrays at different focal planes 116 can be used to generate sectional images and three dimensional images of an object 150 as shown in FIG 6.
[0121] One design approach for combining multiple HIID 100 into a single HIID 100 with multiple focal arrays 114 in series is to employ a long fluid channel 132 through which can flow a specimen with object(s) 150. The focal arrays 114 can be located separately along the fluid channel 132 to separately image the same specimens. Any suitable spacing between the focal arrays can be used (e.g., 10 microns, 20 microns, etc.).
[0122] 1. Sectional Imaging and Three-dimensional Imaging
[0123] FIG. 6 is an illustrated example of an HIID 100 with multiple focal arrays 114 that can be designed by combining multiple HIIDs 100 of FIG. 2(a) in series into a single HIID 100 employing a long fluid channel 132. FIG. 6 is a schematic drawing of components of an HIID 100 having multiple focal arrays 114 in series at different depths for sectional imaging and/or three-dimensional imaging, according to embodiments of the invention. [0124] In FIG. 6, the HIID 100 includes a three-dimensional focal array of light spots
600 employing a microfluidic flow for generating sectional images (x-y images of the specimen at different z-values) at different depths through a fluid channel 132 and/or generating three-dimensional images, according to embodiments of the invention. The three- dimensional focal array of light spots 600 is comprised of a plurality of n one-dimensional focal arrays 114(1),. ,.,114(n) (n = 2, 3, 4, 5, etc.) at different focal planes 116(1),...,116(n) at different depths of the fluid channel 132. The plurality of n focal arrays 114(1),. ,.,114(n) are located at n different depths through the fluid channel 132 and at n different x locations along the longitudinal axis of the fluid channel 132. The HIID 100 can be used to take sectional images of an object 150 at different depths associated with the n focal planes 116(1) ,...,116(n) during a single pass through the fluid channel 132.
[0125] In FIG. 6, the HIID 100 includes a multi-layered body 131 with a holographic element 120 and an illumination source 110 providing an illumination beam 111 at the holographic element 120. The multi-layered body 131 also defines or includes a fluid channel 132 having a fluid flow with the object 150 being imaged. The fluid channel 132 has a first surface 134 and a second surface 136 on opposite sides of the fluid channel 132. The body 131 also includes an optional differentiating element 160 located outside the second surface 136 of the fluid channel 132 and a light detector 140 located outside the
differentiating element 160. The differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b) for removing light having the same light properties as the illumination beam 111.
[0126] In the illustrated embodiment, the holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into n arrays of converging spherical wavefront. Any suitable number can be used for n (e.g., 1, 5, 10, 100, 200, etc.). In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
[0127] In the illustrated embodiment, each volume is hour-glass shaped, forming a focal cone 112 converging into a light spot 115 and spreading into a spreading volume 117. The n arrays of spherical wavefront form n focal arrays of light spots 114(1), ...,114(n) at corresponding focal planes 116(1),...,116(n). Each of the focal arrays 114(1), ...,114(n) includes light spots 115 collectively extending across the fluid channel 132 or across a substantial portion of the fluid channel 132. Each focal array is located at a different focal plane 116(1),...,116(n) at different depths through the fluid channel 132. An object 150 moving through the fluid channel 132 can alter (e.g., block, reduce intensity, change wavelength, or otherwise modify a light property) the light in the fluid channel 132. The altered light is in the form of altered light volumes 118 (shown in FIG. 2(a)). The differentiating element 160 transmits light altered by the object 150. The light detector 140 receives light and generates time varying light data based on the received light as the object 150 moves through the fluid channel 132. A processor 210 (shown in FIG. 1) can use the time varying light data to generate sectional images of the object(s) 150 at different depths associated with the focal planes 116(1)...116(n). Any type of sectional image can be generated such as a fluorescence or phosphorescence image, intensity image, phase image, differential interference contrast (DIC) image, etc.
[0128] The HIID 100 also includes an x-axis, a y-axis, and a z-axis. The x-axis and a y-axis lie in the plane of the second surface 136 of the fluid channel 132. The x-axis lies along a longitudinal axis of the fluid channel 132. The z-axis is orthogonal to the x-axis and the y-axis.
[0129] In the illustrated example, the body 131 is a multi-layered structure. In other embodiments, the body 131 may be a single, monolithic structure. The layers of the body 131 may include any suitable material or combination of materials having any suitable thickness. The layers of the body 131 may also include suitable devices (e.g., holographic element 120, light detector 140). Although FIG. 6 has certain layers at certain locations, other embodiments of the invention may integrate, omit, or add one or more layers or change the location of one or more layers in the body 131. For example, the body 131 may also include a collection component 170 (shown in FIG. 3) between the fluid channel 132 and the differentiating element 160 or between the differentiating element 160 and the light detector 140 in some embodiments. As another example, the body 131 may also include a layer (e.g., a protective layer) made of opaque, semi-opaque, or transparent material that lies between the second surface 136 of the fluid channel 132 and the layer with the differentiating element 160 or outside the first surface 134.
[0130] The fluid channel 132 may have any suitable dimensions. For example, the height of the fluid channel 132 can range from 1 -20 microns and the width can range from 10-500 microns in some cases. In one embodiment, the fluid channel 132 may be sized based on the size of the objects 150 being imaged by the HIID 100. For example, the height of the fluid channel may be sized to be about the diameter of the object 150. The fluid flow in the fluid channel 132 is generally in the direction of the x-axis along a longitudinal axis of the fluid channel 132. Any suitable technique (e.g., pressure drive flow, electrokinetic transport, discrete droplet translocation via electrowetting, thermocapilarity techniques, gravity drive flow, hydrodynamic focusing, dielectrocphoresis, optical tweezing, etc.) may be used for providing fluid flow and particulate transport of the objects 100 in the fluid channel 132. Any suitable control device(s) (e.g., micropumps, direct current (DC) electrokinetic devices, dielectrophoresis electrodes, hydrodynamic focusing channels, etc.) may be used to control the flow of fluid and/or movement of the object 150 through the fluid channel 132.
[0131] The illumination source 110 may be a component of the HIID 100 or may be separate from the HIID 100. The illumination source 110 may be provided by any suitable device(s). Some suitable devices include light-emitting diodes (LED), laser of suitable wavelength, broadband source (e.g., mercury lamp, halogen lamp, etc.) with a suitable filter, etc. Suitable illumination sources are commercially available. The illumination source 110 may be placed in any suitable location to generate the appropriate wavefront at the holographic element 120. In the illustrated embodiment, the illumination source 110 provides an illumination beam 111 with the same wavelength, same spatial distribution and/or other light properties, but not necessarily the same intensity, as the reference beam used to record the holographic element 120. In exemplary fluorescence and phosphorescence embodiments, the illumination source 110 provides excitation light having a first light property (e.g., first wavelength) matching the excitation wavelength of the fluorophores in an object 150 being imaged. The fluorophores are excited by the excitation light and emit light (emissions) of a second light property (e.g., second wavelength). Some examples of suitable excitation light include fluorescence, 2-photon or higher order fluorescence, Raman, second harmonic or higher order, or other emission mechanism that results in emissions at a different wavelength or other different light property than the excitation light.
[0132] The holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into n arrays of converging spherical wavefront to form n focal arrays of light spots 114(1),. ,.,114(n) at corresponding focal planes 116(1),...,116(n) at different depth through the fluid channel 132. The holographic element 120 can be made of any suitable material(s). The holographic element 120 can have any suitable dimensions (e.g., 1 mm x 1 mm, 2 mm x 2 mm, 5 mm x 2 mm, 10 mm x 10 mm, 10 mm x 50 mm, etc.). The holographic element 120 can be made using any holographic recording technique capable of encoding (recording) data about the focal array of light spots. To play back, the holographic element 120 can be illuminated by a beam having the same wavelength, same spatial distribution, but not necessarily the same intensity, as the reference beam used to record the holographic element 120.
[0133] In FIG. 6, the holographic element forms n one-dimensional focal arrays of light spots 114(1),. ,.,114(n) at different depths through the fluid channel 132 and at different x locations along the fluid channel 132. The n one-dimensional focal arrays of light spots 114(1),. ,.,114(n) form the three-dimensional array of light spots 600. Any suitable number (e.g., 2, 3, 5, 10, 20, 50, 100, etc.) of one-dimensional focal arrays, n can be used. Each one- dimensional focal array 114(i) (i = 1 to n) is located at an angle, ο¾ with respect to the x-axis. The angle, ο¾ may be any suitable angle (e.g., 5 degrees, 10 degrees,...90 degrees, ...170 degrees, etc. ). In many cases, all the focal arrays 114(1),. ,.,114(n) will be located at the same angle, a angle. In some cases, the light spots 115 collectively extend diagonally across the fluid channel 132. In other cases, the light spots 115 may collectively extend in a direction parallel to the y-axis and across the fluid channel 132. Although the focal arrays
114 in the illustrated example have three light spotsll5, any suitable number of light spots
115 can be used (e.g., 1, 10, 50, 100, 500, etc.) in other embodiments. In some cases, the number of light spots 115 may be determined by the number of light spots 115 needed to collectively extend across a width of the fluid channel 132 where the object(s) 150 being examined flow.
[0134] Each light spot 115 can be of any suitable size. Some examples of suitable diameters (FWHM) are 0.4 microns, 0.6 microns, 0.8 microns, 1 micron, etc. In one exemplary embodiment, the light spot diameter is 0.6 microns (FWHM). Any suitable spacing (5 microns, 10 microns, 15 microns, etc.) can be used between the light spots 115. In one exemplary embodiment, a light spot spacing of 20 microns is used.
[0135] In the illustrated example, the scanning mechanism 130 employs a microfluidic flow method. The scanning mechanism 130 includes the fluid channel 132 defined by the body 131 and the fluid carrying the object 150 through the fluid channel 132. Although the illustrated embodiment includes a scanning mechanism 130 employing a microfluidic flow method, other methods (e.g., optical tweezing, scanning method, etc.) can be used in other embodiments. For example, one embodiment may have a scanning mechanism 130 that includes a scanning device (e.g., raster scanner, linear scanner, etc.) for scanning the object 150 or specimen stage with the object 150 through light spots 115 or scanning the light spots 115 across or through the object 150.
[0136] The light detector 140 detects light and generates signals with time varying light data about the light properties of the detected. Some examples of light properties that can be detected include intensity, wavelength, frequency, polarization, phase, spin angular momentum, etc. The light detector 140 can be a single detector, a one-dimensional detector array, or a two-dimensional detector array. Some examples of single detectors include a photo-diode (PD), an avalanche photo-diode (APD) and a photomultiplier tubes (PMT). Some examples of one-dimensional or two-dimensional detector arrays include a charge coupled device (CCD) array, a complementary metal-oxide-semiconductor (CMOS) array, an APD array, a PD array, a PMT array, etc. The light detector 140 may be a monochromatic or a color detector. For example, the light detector 140 may be a color light detector that generates light data that can be used to generate color images.
[0137] The light detector 140 includes a two-dimensional array of discrete light detecting elements 140(a) (shown in FIG. 2(a)) of any suitable size (e.g., 1-10 microns) and any suitable shape (e.g., circular or square). The array is located at an angle, a with respect to the x-axis. Any suitable angle can be used. Any suitable number of light detecting elements 140(a) may correspond to a light spot 115. In FIG. 6, each light detecting element 140(a) detects light from a single corresponding light spot 115. In another example, each light detecting element 140(a) may detect light from more than one light spot 115. In another example, a plurality (e.g., 2 x 2 grid, 4 x 4 grid, etc.) of light detecting elements 140(a) may detects light from a single light spot 115.
[0138] In FIG. 6, the object 150 is shown at a time (t = ti) as the object 150 moves through the fluid channel 132 generally in the x-direction. Although the object 150 is shown as a cell, other embodiments may include other suitable object(s) such as biological entities (e.g., whole cells, cell components, microorganisms such as bacteria or viruses, cell components such as proteins, etc.) and inorganic entities. Any suitable number of objects 150 may be imaged and/or analyzed using the HIID 100.
[0139] The body 131 of the HIID 100 may optionally include a differentiating element 160 located outside the second surface 136. The differentiating element 160 selectively transmits altered light while substantially removing the remaining light. The differentiating element 160 includes an interference filter 160(a) and an absorption filter 160(b). The interference filter 160(a) transmits the altered light and removes remaining light from the illumination source 110 by interference. The absorption filter absorbs remaining light from the illumination source 110. In fluorescence and phosphorescence applications, a differentiating element 160 may be used to transmit emissions from fluorophores in the object 150 and substantially remove excitation light.
[0140] In an exemplary operation, the illumination source 110 provides an illumination beam 111. The holographic element 120 transforms the planar wavefront of the illumination beam 111 from the illumination source 110 into n arrays of converging spherical wavefront. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure.
[0141] In the exemplary operation, each volume is hour-glass shaped, forming a focal cone 112 converging to a light spot 115 at the focal plane 116 and spreading to a spreading volume 117. The n arrays of converging spherical wavefront forms n focal arrays of light spots 114(1),. ,.,114(n) at different focal planes 116(1),...,116(n) at different depths of the fluid channel 132 and at different x locations along the fluid channel 132. The n focal arrays of light spots 114(1),. ,.,114(n) form the three-dimensional focal array of light spots 600.
[0142] During operation, a fluid, within which the object 150 is suspended, flows through the fluid channel 132. As the object 150 flows through the fluid channel 132, the object 150 alters (blocks, reduces intensity, modifies wavelength or other light property or spatial distribution) light in the fluid channel 132 as it passes through one or more of the focal arrays 114(1)...114(n) located at different depths of the fluid channel 132. The
differentiating element 160 transmits the altered light and removes light having the same properties as the illumination beam 111.
[0143] The light detecting elements 140(a) (shown in FIG. 2(a)) receive light and generate time varying light data about the light as the object 150 moves through focal arrays at different depths of the fluid channel 132. The processor 210 receives a signal with time varying light data associated with each of the focal arrays. The processor 210 uses the time varying light data to generate line scans associated with the y-locations of the light detecting elements 140(a) for each of the focal arrays. The time varying light data is dependent on the profile of the object 150 as well as its optical properties. The processor 210 can reconstruct a sectional image of the object 150 at a specific depth by appropriately shifting and assembling line scans from time varying data taken by light detecting elements associated with a focal array 114(i) having a focal plane 116(i) located at the specific depth. Optionally, other data (e.g., rotation, velocity of the object 150, and changes in shape of the object 150, etc.) can also be used to determine the sectional image. The processor 210 can also construct a three- dimensional image of the object 150 based on the sectional images or the time varying data.
[0144] The HIID 100 can be used to generate any suitable type of image such as a fluorescence image, phosphorescence image, intensity images, phase image, differential interference contrast (DIC) image, etc.
[0145] In one exemplary embodiment, the HIID 100 can be used in fluorescence or phosphorescence imaging. The specimen with one or more objects 150 may be prepared by mixing a reagent with the specimen. The resulting fluid is introduced into the fluid channel 132 of the HIID 100. The illumination source 110 provides an illumination beam 111 of excitation light having a first light property (e.g., first wavelength, first polarization, etc.) that can excite the fluorophores in the object 150. The holographic element 120 transforms the planar wavefront of the illumination beam 111 of excitation light into n arrays of converging spherical wavefront to form n focal array of light spots 114(1),. ,.,114(n) of excitation light at n focal planes at different depths through the fluid channel 132 and at different x-locations along the longitudinal axis of the fluid channel 132. In other embodiments, the holographic element 120 may also transform a wavefront, planar or otherwise, from the illumination source 110 into an approximately spherical wavefront or other wavefront having a well separated structure. As the object moves through the fluid channel 132, fluorophores in the object 150 absorb excitation light from a proximal light spot 115 at a particular depth. The fluorophores then emit light (emissions) having a second light property (e.g., a second wavelength, a second polarization, etc.). The emissions spread from site of the proximal light spot 115 in the form of an altered light volume 118. To a lesser extent, the fluorophores may also absorb excitation light from the focal cone 112 and the spreading volume 117. In this case, the fluorophores from these areas may emit light as well.
[0146] The differentiating element 160 transmits emissions and substantially removes excitation light. The light detector 140 detects light and generates time varying light data associated with the received light as the object 150 flows through the flow channel 132. The processor 210 receives a signal from the light detector 140 having time varying data. The processor 220 generates one or more fluorescence or phosphorescence sectional images of the object 150 and/or three-dimensional images of the object 150 based on the time varying data.
[0147] In one embodiment, the holographic element 120 can be replaced by one or more diffractive optical elements (DOE) (e.g., a Freznel zone plate (FZP), diffraction grating, photon sieve, etc.) at the same location illuminated by the illumination beam 111. The DOE diffracts the illumination beam 111 to generate the focal cones 112 and focal array of light spots 114. The DOE can be made of any suitable material and may have any suitable dimensions (e.g., 1 mm x 1mm, 2 mm x 2 mm, ..., 10mm x 10 mm). Using DOEs may be advantageous because they have a high shelf life. DOEs are also suitable for nanofabrication and semiconductor fabrication technique.
[0148] 2. Multi-spectral Fluorescence or Phosphorescence Imaging
[0149] Another example of an HIID 100 with multiple focal arrays 114 that can be designed by combining multiple HIIDs 100 of FIG. 2(a) in series into a single HIID 100 employing a long fluid channel 132 can be used to perform multi-spectral fluorescence or phosphorescence imaging. In one embodiment, an HIID 100 includes multiple focal arrays arranged in a series at different x-locations along the longitudinal axis of the fluid channel 132. The HIID 100 also includes multiple differentiating elements 160 corresponding to the different focal arrays 114. Each differentiating element 160 transmits light of a different light property (e.g., wavelength, polarization, etc.). For example, a first differentiating element 160 associated with a first focal array 114 may allow light with a wavelength λι to pass, a second differentiating element 160 associated with a second focal array 114 may allow light with a wavelength λ2 to pass, a third differentiating element 160 associated with a third focal array 114 may allow light with a wavelength λ2 to pass, etc. In this example, the HIID 100 can generate fluorescence or phosphorescence images from light of wavelengths, λι, λ2> and λ3. In some cases, different structures in the object 150 being imaged may emit light have different light properties (e.g., λι, λ2> λ3). In these cases, the HIID 100 may have
differentiating elements 160 associated with the different light properties corresponding to the different structures. The HIID 100 can then image the different structures associated with the different light properties.
[0150] FIG. 7 is a schematic drawing of components of an HIID 100 having multiple focal arrays 114 in series with different differentiating elements 160 for multi- spectral fluorescence or phosphorescence imaging, according to embodiments of the invention. FIG. 7 is an another illustrated example of an HIID 100 having multiple focal arrays 114 that can be designed by combining multiple HIIDs 100 of FIG. 2(a) in series into a single HIID 100 employing a long fluid channel 132. In this example, the HIID 100 has five differentiating elements 160(1)-160(5) corresponding to the five focal arrays 114(1)-114(5). Each of the differentiating elements 160(1)-160(5) transmits light of a different light property. In this way, a single passage of an object 150 through the fluid channel 132 will allow each segment to acquire a spectrally distinct image.
[0151] Embodiments of an HIID 100 including multiple focal arrays in series and corresponding differentiating elements 160 for multi-spectral fluorescence or
phosphorescence imaging may have advantages. With conventional microscopes, multi- spectral fluorescence images are typically generated by swapping the chromatic filters between each image acquisition step. As the number of slots in a filter carousel is limited, the acquisition of more than 5 wavelength bands typically requires a carousel swap. With an HIID 100 having a series of focal arrays, the acquisition of multi- spectral images can be implemented automatically by connecting several focal arrays, each sensitive to a particular emission wavelength band, in series. A single passage of an object 150 through the fluid channel 132 generates a complete set of fluorescence or phosphorescence images.
[0152] Modifications, additions, or omissions may be made to any of the
configurations of the HIIDs 100 without departing from the scope of the disclosure. In some cases, one of more components of any of the HIIDs 100 may be added to other configurations in other embodiments. For example, the collection component 170 can be added to some configurations. In addition, the components of any of the configurations of the HIID 100 may be integrated or separated according to particular needs. For example, the processor 210 may be integrated into the light detector 140 so that the light detector 140 performs all the functions of the processor 210 in some embodiments.
[0153] III. Fabrication Techniques
[0154] The holographic element 120 can be recorded using any holographic recording technique. One recording method involves interfering a light field 700 through a recording mask having an array of apertures 705 with a collimated reference beam (write beam) 710 via a beam splitter 190, as shown in FIG. 8(a). A recording mask refers to an array of apertures 705 patterned in a layer of metal film or coating on a substrate such as a glass slide. FIG. 8(a) is a schematic drawing of a setup for off-axis recording a holographic element 120, according to embodiments of the invention. In the illustrated setup, a beam splitter 190 is used. In this illustration a recording mask is used. In the illustrated example, the apertures may have an aperture size equal to the desired light spot size and the aperture spacing is equal to the desired spacing between light spots in the focal array of light spots. The interference pattern can then be recorded on the holographic element 120. When the holographic element 120 is illuminated by an illumination beam 111 (shown in FIG. 2(a)) propagating in the opposite direction as the original reference write beam, the holographic element 120 will generate an optical conjugate wave that will reconstitute into a focal array of light spots based on the array of apertures 705.
[0155] Another method is illustrated in FIG. 8(b). FIG. 8(b) is a schematic drawing of a setup for inline recording a holographic element 120, according to embodiments of the invention. In the illustrated embodiment, an incident collimated light beam transmitted through the apertures will interfere with the fairly strong uniform transmission through the metal film/coating (in effect, this serves as the write beam) to create a recordable interference pattern at a short distance away, as shown in FIG. 8(b). The pattern can be recorded by placing the holographic element 120 arbitrarily close to the recording mask 760. This technique allows recording of holographic elements 120 that can generate holograms with excellent stability since there are no potential drifts between the two interfering components. This method for creating a holographic element 120 for generating light spots is easy and readily scalable for mass-manufacture. Using this method, some embodiments of holographic elements 120 have been recorded to generate light spots 115 with diameters of about 0.60 micron and to have 10% efficiency in channeling of the illumination beam 111.
[0156] In one embodiment, a silver halide holographic element 120 was recorded using a recording mask 760. After exposure, the holographic element 120 was developed and bleached to produce a phase hologram. A light spot 115 can then be generated by the holographic reconstruction process, where a conjugated collimated beam 710 is transformed into a light spot 115 by the holographic element 120. The focal length between the holographic element 120 and the focal plane 116 (shown in FIG. 2(a)) is the same as the distance 770 between the recording mask 760 and the holographic element 120 during the recording process.
[0157] The recording mask can be fabricated using any suitable method. In one example, a specialized mask 760 (shown in FIG. 8(b)) is made to record a holographic element 120 of FIG. 6 with a plurality of n focal arrays 114(1),. ,.,114(n) at different depths. The recording mask 760 is made by starting with a piece of glass and depositing layers of SU-8 photoresist film or other suitable material layer on the glass in a step fashion. For example, each step can be 2 micron high and 50 micron wide. Any suitable step dimensional can be used in other embodiments. Then, a layer of material (e.g., gold) is deposited, with a suitable thickness (e.g., 200 nm thick), on the structure and mill apertures at the appropriate places with a focused ion-beam machine. The recording mask 760 can then be used to record the holographic element 120.
[0158] V. Computer devices
[0159] FIG. 9 shows a block diagram of subsystems that may be present in computer devices that are used in system 10, according to embodiments of the invention. For example, the computer 200 in communication with the HIID 100 may have any suitable combination of components in FIG. 9.
[0160] The various components previously described in the Figures may operate using one or more computer devices to facilitate the functions described herein. Any of the elements in the Figures may use any suitable number of subsystems to facilitate the functions described herein. Examples of such subsystems or components are shown in a FIG. 9. The subsystems shown in FIG. 9 are interconnected via a system bus 975. Additional subsystems such as a printer 974, keyboard 978, fixed disk 979 (or other memory comprising computer readable media), display 230, which is coupled to display adapter 982, and others are shown. Peripherals and input/output (I/O) devices, which couple to I/O controller 971, can be connected to the computer system by any number of means known in the art, such as serial port 957. For example, serial port 977 or external interface 981 can be used to connect the computer apparatus to a wide area network such as the Internet, a mouse input device, or a scanner. The interconnection via system bus allows the central processor 210 to
communicate with each subsystem and to control the execution of instructions from system memory 980 or the fixed disk 979, as well as the exchange of information between subsystems. The system memory 980 and/or the fixed disk 979 may embody a computer readable medium 220. Any of these elements may be present in the previously described features. A computer readable medium 220 according to an embodiment of the invention may comprise code for performing any of the functions described above. [0161] In some embodiments, an output device such as the printer 974 or display 230 of the HIID system 10 can output various forms of data. For example, the system 10 can output a fluorescence image of an object 150 or other results of analysis.
[0162] It should be understood that the present invention as described above can be implemented in the form of control logic using computer software in a modular or integrated manner. Based on the disclosure and teachings provided herein, a person of ordinary skill in the art will know and appreciate other ways and/or methods to implement the present invention using hardware and a combination of hardware and software.
[0163] Any of the software components or functions described in this application, may be implemented as software code to be executed by a processor using any suitable computer language such as, for example, Java, C++ or Perl using, for example, conventional or object-oriented techniques. The software code may be stored as a series of instructions, or commands on a computer readable medium, such as a random access memory (RAM), a read only memory (ROM), a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD-ROM. Any such computer readable medium may reside on or within a single computational apparatus, and may be present on or within different computational apparatuses within a system or network.
[0164] A recitation of "a", "an" or "the" is intended to mean "one or more" unless specifically indicated to the contrary.
[0165] The above description is illustrative and is not restrictive. Many variations of the disclosure will become apparent to those skilled in the art upon review of the disclosure. The scope of the disclosure should, therefore, be determined not with reference to the above description, but instead should be determined with reference to the pending claims along with their full scope or equivalents.
[0166] One or more features from any embodiment may be combined with one or more features of any other embodiment without departing from the scope of the disclosure. Further, modifications, additions, or omissions may be made to any embodiment without departing from the scope of the disclosure. The components of any embodiment may be integrated or separated according to particular needs without departing from the scope of the disclosure. [0167] All patents, patent applications, publications, and descriptions mentioned above are hereby incorporated by reference in their entirety for all purposes. None is admitted to be prior art.

Claims

WHAT IS CLAIMED IS:
1. A holographically illuminated imaging device, comprising:
a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots;
a scanning mechanism configured to move an object across one or more light spots in the focal array of light spots; and
a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
2. The holographically illuminated imaging device of claim 1 , further comprising a processor configured to generate an image of the object based on the light data.
3. The holographically illuminated imaging device e of claim 1, further comprising:
a differentiating element located between the light detector and the object, and configured to transmit emissions from fluorophores in the object; and
a processor configured to generate a photoluminescent image of the object based on light data.
4. The holographically illuminated imaging device of claim 1 , wherein the scanning mechanism comprises a fluid channel having a fluid carrying the object through the fluid channel, the light spots collectively and substantially extending across the fluid channel.
5. The holographically illuminated imaging device of claim 1, wherein the scanning mechanism is a scanning device configured to scan the object relative to the focal array of light spots.
6. The holographically illuminated imaging device of claim 1 , further comprising a collection component located between the light detector and the object, and configured to collect light at the light detector.
7. A holographically illuminated imaging device, comprising: a body defining a fluid channel;
a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots;
a beam splitter configured to reflect the focal array of light spots into the fluid channel wherein a flow in the channel moves an object across one or more light spots in the focal array of light spots, the beam splitter further configured to transmit light altered by the object; and
a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light.
8 A holographically illuminated imaging device, comprising:
a holographic element configured to transform an illumination beam into a plurality of focal arrays of light spots at different focal planes;
a scanning mechanism configured to move an object across one or more light spots in the plurality of focal arrays of light spots; and
a light detector configured to receive light associated with the plurality of focal arrays of light spots, and generate light data associated with the received light.
9. The holographically illuminated imaging device of claim 8, further comprising a processor configured to use the light data to generate one or more sectional images of the object associated with different focal planes.
10. The holographically illuminated imaging device of claim 8, further comprising a processor configured to generate a three-dimensional image of the object based on the light data.
11. The holographically illuminated imaging device e of claim 8, further comprising:
a differentiating element located between the light detector and the object, and configured to transmit emissions from fluorophores in the object; and
a processor configured to generate a photoluminescent image of the object based on light data.
12. The holographically illuminated imaging device of claim 8, wherein the scanning mechanism comprises a fluid channel having a fluid carrying the object through the fluid channel, wherein the focal arrays are located along the fluid channel, and wherein the light spots of each focal array collectively and substantially extend across the fluid channel.
13. The holographic illuminated imaging device of claim 8, wherein the scanning mechanism is a scanning device configured to scan the object relative to the plurality of focal arrays of light spots.
14. The holographically illuminated imaging device of claim 8, further comprising a collection component located between the light detector and the object, and configured to collect light at the light detector.
15. A system, comprising:
a holographically illuminated optofluidic imaging device including
a holographic element configured to transform an illumination beam from an illumination source into a focal array of light spots,
a scanning mechanism configured to move an object across one or more light spots in the focal array of light spots, and
a light detector configured to detect light associated with the focal array of light spots, and generate light data associated with the received light; and
a processor in communication with the light detector, the processor configured to receive a signal with light data and generate an image of the object based on the light data.
16. The system of claim 15, further comprising a display for displaying the image generated by the processor.
PCT/US2010/052512 2009-10-13 2010-10-13 Holographically illuminated imaging devices WO2011047053A2 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US25123709P 2009-10-13 2009-10-13
US61/251,237 2009-10-13
US38138910P 2010-09-09 2010-09-09
US61/381,389 2010-09-09
US12/903,650 2010-10-13
US12/903,650 US8767216B2 (en) 2009-10-13 2010-10-13 Holographically illuminated imaging devices

Publications (2)

Publication Number Publication Date
WO2011047053A2 true WO2011047053A2 (en) 2011-04-21
WO2011047053A3 WO2011047053A3 (en) 2011-06-09

Family

ID=43854635

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/052512 WO2011047053A2 (en) 2009-10-13 2010-10-13 Holographically illuminated imaging devices

Country Status (2)

Country Link
US (1) US8767216B2 (en)
WO (1) WO2011047053A2 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2548000A1 (en) * 2010-03-15 2013-01-23 Bio-Rad Laboratories, Inc. Microassembled imaging flow cytometer
US8536545B2 (en) 2010-09-09 2013-09-17 California Institute Of Technology Delayed emission detection devices and methods
US8767216B2 (en) 2009-10-13 2014-07-01 California Institute Of Technology Holographically illuminated imaging devices
US8946619B2 (en) 2011-04-20 2015-02-03 California Institute Of Technology Talbot-illuminated imaging devices, systems, and methods for focal plane tuning
US8970671B2 (en) 2010-02-23 2015-03-03 California Institute Of Technology Nondiffracting beam detection devices for three-dimensional imaging
US9086536B2 (en) 2011-03-09 2015-07-21 California Institute Of Technology Talbot imaging devices and systems

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8822894B2 (en) 2011-01-07 2014-09-02 California Institute Of Technology Light-field pixel for detecting a wavefront based on a first intensity normalized by a second intensity
US8039776B2 (en) 2008-05-05 2011-10-18 California Institute Of Technology Quantitative differential interference contrast (DIC) microscopy and photography based on wavefront sensors
WO2010090849A1 (en) * 2009-01-21 2010-08-12 California Institute Of Technology Quantitative differential interference contrast (dic) devices for computed depth sectioning
US8416400B2 (en) * 2009-06-03 2013-04-09 California Institute Of Technology Wavefront imaging sensor
US20130104981A1 (en) * 2011-10-27 2013-05-02 University Of Delaware Systems and methods for optical tracking
WO2014035892A1 (en) * 2012-08-31 2014-03-06 The Regents Of The University Of California Holographic imaging element operable to generate multiple different images of an object
US10048201B2 (en) * 2012-09-10 2018-08-14 The Trustees Of Princeton University Fluid channels for computational imaging in optofluidic microscopes
US9393087B2 (en) 2013-08-01 2016-07-19 Align Technology, Inc. Methods and systems for generating color images
CN105181809B (en) * 2015-10-15 2018-01-19 深圳大学 A kind of jewelry quality identification method and system based on more Spectrum Analysis
EP3974815A1 (en) * 2016-05-27 2022-03-30 Verily Life Sciences LLC Systems and methods for 4-d hyperspectrial imaging
US10775508B1 (en) * 2016-08-19 2020-09-15 Apple Inc. Remote sensing device
TWI673516B (en) * 2018-01-11 2019-10-01 國立臺灣大學 Illumination apparatus and system for multiplexed multi-depth confocal microscopy
US10724956B1 (en) * 2019-02-01 2020-07-28 Essen Instruments, Inc. Spectral unmixing
CN113624666B (en) 2021-09-07 2022-09-23 清华大学 Stream type imaging system based on dot matrix laser scanning
DE102021212505A1 (en) 2021-11-08 2023-05-11 Robert Bosch Gesellschaft mit beschränkter Haftung Optical device for exciting a sample, analyzer and method for exciting a sample
WO2024009737A1 (en) * 2022-07-07 2024-01-11 株式会社ジャパンディスプレイ Fluorescence detection device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060152780A1 (en) * 2004-02-10 2006-07-13 Zebra Imaging, Inc. Deposition of photosensitive media for digital hologram recording
US20070109619A1 (en) * 2000-10-07 2007-05-17 Physoptics Opto-Electronic Gmbh Information system and method for providing information using a holographic element
US20090231689A1 (en) * 2007-05-04 2009-09-17 Aperio Technologies, Inc. Rapid Microscope Scanner for Volume Image Acquisition

Family Cites Families (83)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5820406B2 (en) * 1975-06-10 1983-04-22 富士通株式会社 Hikari Sousasouchi
US4580151A (en) * 1984-10-22 1986-04-01 Ricoh Company, Ltd. Optical scanning apparatus
US4896952A (en) 1988-04-22 1990-01-30 International Business Machines Corporation Thin film beamsplitter optical element for use in an image-forming lens system
US4981362A (en) 1989-10-16 1991-01-01 Xerox Corporation Particle concentration measuring method and device
US5384573A (en) * 1990-10-29 1995-01-24 Essex Corporation Image synthesis using time sequential holography
US5247167A (en) 1992-08-06 1993-09-21 International Business Machines Corporation Multiple beam power monitoring system and method with radiation detection and focusing means of overlapping beams
JP3343276B2 (en) 1993-04-15 2002-11-11 興和株式会社 Laser scanning optical microscope
JPH0815156A (en) 1993-06-03 1996-01-19 Hamamatsu Photonics Kk Laser scan optical system and laser scan optical apparatus
DE69418248T2 (en) 1993-06-03 1999-10-14 Hamamatsu Photonics Kk Optical laser scanning system with Axikon
US6219441B1 (en) 1993-06-22 2001-04-17 General Electric Company Reconstruction of images from three-dimensional cone beam data
US5587832A (en) 1993-10-20 1996-12-24 Biophysica Technologies, Inc. Spatially light modulated confocal microscope and method
US5795755A (en) 1994-07-05 1998-08-18 Lemelson; Jerome H. Method of implanting living cells by laser poration at selected sites
DE69729659T2 (en) 1996-02-28 2005-06-23 Johnson, Kenneth C., Santa Clara MIKROLINSEN RASTER DEVICE FOR MICROLITHOGRAPHY AND FOR CONFOCUS MICROSCOPY WITH LARGE RECORDING FIELD
US5701008A (en) 1996-11-29 1997-12-23 He Holdings, Inc. Integrated infrared microlens and gas molecule getter grating in a vacuum package
US5973316A (en) 1997-07-08 1999-10-26 Nec Research Institute, Inc. Sub-wavelength aperture arrays with enhanced light transmission
US6248988B1 (en) 1998-05-05 2001-06-19 Kla-Tencor Corporation Conventional and confocal multi-spot scanning optical microscope
US6731391B1 (en) 1998-05-13 2004-05-04 The Research Foundation Of State University Of New York Shadow moire surface measurement using Talbot effect
US6628385B1 (en) 1999-02-05 2003-09-30 Axon Instruments, Inc. High efficiency, large field scanning microscope
ES2199822T3 (en) 1999-03-18 2004-03-01 Siemens Aktiengesellschaft MEASUREMENT SYSTEM OF THE DISTANCE OF LOCAL RESOLUTION.
US6621575B1 (en) 2000-01-20 2003-09-16 Laser- Und Medizin Technologie Gmbh Berlin Method and device for analyzing molecular reaction products in biological cells
US20020001089A1 (en) 2000-04-18 2002-01-03 Price Jeffrey H. Multiparallel three dimensional optical microscopy system
US7630063B2 (en) 2000-08-02 2009-12-08 Honeywell International Inc. Miniaturized cytometer for detecting multiple species in a sample
US7641856B2 (en) 2004-05-14 2010-01-05 Honeywell International Inc. Portable sample analyzer with removable cartridge
US6597438B1 (en) 2000-08-02 2003-07-22 Honeywell International Inc. Portable flow cytometry
EP1172712A1 (en) * 2000-07-14 2002-01-16 Universite Libre De Bruxelles Method for measuring the velocity of particles in a fluid medium in motion
US7209287B2 (en) 2000-09-18 2007-04-24 Vincent Lauer Confocal optical scanning device
US6525815B2 (en) 2000-11-10 2003-02-25 The Board Of Trustees Of The Leland Stanford Junior University Miniaturized Talbot spectrometer
US7283229B2 (en) 2001-01-25 2007-10-16 Precision System Science Co., Ltd. Small object identifying device and its identifying method
US7907765B2 (en) 2001-03-28 2011-03-15 University Of Washington Focal plane tracking for optical microtomography
US6646773B2 (en) 2001-05-23 2003-11-11 Board Of Regents, The University Of Texas System Digital micro-mirror holographic projection
JP4652634B2 (en) 2001-08-31 2011-03-16 キヤノン株式会社 Imaging device
US6865246B2 (en) 2001-09-26 2005-03-08 Massachusetts Institute Of Technology True 3D cone-beam imaging method and apparatus
US7381375B2 (en) 2001-10-26 2008-06-03 Millipore Corporation Assay systems with adjustable fluid communication
EP1468245B1 (en) 2002-01-11 2011-03-30 The General Hospital Corporation Apparatus for OCT imaging with axial line focus for improved resolution and depth of field
JP2003207454A (en) 2002-01-15 2003-07-25 Minolta Co Ltd Transmission light-detecting apparatus
US7072045B2 (en) 2002-01-16 2006-07-04 The Regents Of The University Of California High resolution optical coherence tomography with an improved depth range using an axicon lens
US7250973B2 (en) 2002-02-21 2007-07-31 Canon Kabushiki Kaisha Image pickup apparatus for reflecting light at an area between successive refractive areas
US6858436B2 (en) 2002-04-30 2005-02-22 Motorola, Inc. Near-field transform spectroscopy
US6706109B2 (en) 2002-05-14 2004-03-16 Engelhard Corporation Optically variable interference pigments
ATE285590T1 (en) 2002-10-25 2005-01-15 Evotec Technologies Gmbh METHOD AND APPARATUS FOR CAPTURING THREE-DIMENSIONAL IMAGERY OF FLOATED MICROOBJECTS USING HIGH-RESOLUTION MICROSCOPY
DE10257120B4 (en) 2002-12-05 2020-01-16 Leica Microsystems Cms Gmbh Scanning microscope for imaging an object
DE10257423A1 (en) 2002-12-09 2004-06-24 Europäisches Laboratorium für Molekularbiologie (EMBL) Microscope used in molecular biology comprises a focussing arrangement producing an extended planar object illumination region, a detection device, and a movement arrangement
EP1439566B1 (en) 2003-01-17 2019-08-28 ICT, Integrated Circuit Testing Gesellschaft für Halbleiterprüftechnik mbH Charged particle beam apparatus and method for operating the same
US7057806B2 (en) 2003-05-09 2006-06-06 3M Innovative Properties Company Scanning laser microscope with wavefront sensor
EP2259050A3 (en) 2003-08-26 2010-12-22 Blueshift Biotechnologies, Inc. Time dependent fluorescence measurements
WO2005027101A2 (en) 2003-09-18 2005-03-24 Koninklijke Philips Electronics N.V. System for shifting at least one light spot.
US7250598B2 (en) 2004-01-02 2007-07-31 Hollingsworth Russell E Plasmon enhanced near-field optical probes
US7301646B2 (en) 2004-01-21 2007-11-27 Carl Zeiss Smt Ag Device and method for the determination of imaging errors and microlithography projection exposure system
DE102004004296A1 (en) 2004-01-28 2005-08-25 Siemens Ag Device for generating a view with a spatial impression of a spatial object
WO2005099386A2 (en) 2004-04-13 2005-10-27 Board Of Regents, The University Of Texas System Holographic projector
JP2007535088A (en) 2004-04-28 2007-11-29 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ System for positioning an information carrier in an information carrier and device
US7751048B2 (en) 2004-06-04 2010-07-06 California Institute Of Technology Optofluidic microscope device
US7773227B2 (en) 2004-06-04 2010-08-10 California Institute Of Technology Optofluidic microscope device featuring a body comprising a fluid channel and having light transmissive regions
DE102004034988A1 (en) 2004-07-16 2006-02-02 Carl Zeiss Jena Gmbh Scanning microscope and use
US8585881B2 (en) 2004-09-10 2013-11-19 Onda Via, Inc. Localized chemical microgradients
WO2006078856A1 (en) 2005-01-16 2006-07-27 Baer Stephen C Realtime high magnification stereoscopic microscope
WO2007043013A2 (en) 2005-10-14 2007-04-19 Koninklijke Philips Electronics N.V. Method and system for scanning an information carrier via one-dimensional scanning
US7230722B2 (en) 2005-10-19 2007-06-12 University Of Maryland Shadow moire using non-zero talbot distance
DE102006004802B4 (en) 2006-01-23 2008-09-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Image acquisition system and method for producing at least one image capture system
US7567346B2 (en) 2006-03-01 2009-07-28 General Electric Company System and method for multimode imaging
US8189204B2 (en) 2006-05-02 2012-05-29 California Institute Of Technology Surface wave enabled darkfield aperture
US7768654B2 (en) 2006-05-02 2010-08-03 California Institute Of Technology On-chip phase microscope/beam profiler based on differential interference contrast and/or surface plasmon assisted interference
EP1892501A3 (en) 2006-08-23 2009-10-07 Heliotis AG Colorimetric three-dimensional microscopy
WO2008127410A2 (en) 2006-11-07 2008-10-23 New York University Holographic microfabrication and characterization system for soft matter and biological systems
WO2008093099A2 (en) 2007-02-02 2008-08-07 King's College London Method and apparatus for improving image resolution
GB0704491D0 (en) 2007-03-08 2007-04-18 Univ St Andrews Enhanced spectroscopic techniques using spatial beam shaping
DE102007019267A1 (en) 2007-04-24 2008-10-30 Degudent Gmbh Measuring arrangement and method for three-dimensional measuring of an object
JP2009098009A (en) 2007-10-17 2009-05-07 Fujifilm Corp Fluorescence sensor, and method for producing thin metal film with fine apertures to be used for the fluorescence sensor
US8325349B2 (en) 2008-03-04 2012-12-04 California Institute Of Technology Focal plane adjustment by back propagation in optofluidic microscope devices
JP2011513752A (en) 2008-03-04 2011-04-28 カリフォルニア インスティテュート オブ テクノロジー Method using optofluidic microscope apparatus
JP2011513794A (en) 2008-03-04 2011-04-28 カリフォルニア インスティテュート オブ テクノロジー Optofluidic microscope apparatus with photosensor array
US9046680B2 (en) 2008-03-07 2015-06-02 California Institute Of Technology Scanning illumination microscope
US8039776B2 (en) 2008-05-05 2011-10-18 California Institute Of Technology Quantitative differential interference contrast (DIC) microscopy and photography based on wavefront sensors
WO2010090849A1 (en) 2009-01-21 2010-08-12 California Institute Of Technology Quantitative differential interference contrast (dic) devices for computed depth sectioning
US8416400B2 (en) 2009-06-03 2013-04-09 California Institute Of Technology Wavefront imaging sensor
US8633432B2 (en) 2009-09-21 2014-01-21 California Institute Of Technology Reflective focusing and transmissive projection device
WO2011047053A2 (en) 2009-10-13 2011-04-21 California Institute Of Technology Holographically illuminated imaging devices
US8970671B2 (en) 2010-02-23 2015-03-03 California Institute Of Technology Nondiffracting beam detection devices for three-dimensional imaging
EP2550522B1 (en) 2010-03-23 2016-11-02 California Institute of Technology Super resolution optofluidic microscopes for 2d and 3d imaging
CN103154662A (en) 2010-10-26 2013-06-12 加州理工学院 Scanning projective lensless microscope system
US9643184B2 (en) 2010-10-26 2017-05-09 California Institute Of Technology e-Petri dishes, devices, and systems having a light detector for sampling a sequence of sub-pixel shifted projection images
US9086536B2 (en) 2011-03-09 2015-07-21 California Institute Of Technology Talbot imaging devices and systems
WO2012145566A2 (en) 2011-04-20 2012-10-26 California Institute Of Technology Talbot-illuminated imaging devices, systems, and methods for focal plane tuning

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070109619A1 (en) * 2000-10-07 2007-05-17 Physoptics Opto-Electronic Gmbh Information system and method for providing information using a holographic element
US20060152780A1 (en) * 2004-02-10 2006-07-13 Zebra Imaging, Inc. Deposition of photosensitive media for digital hologram recording
US20080008939A1 (en) * 2004-02-10 2008-01-10 Klug Michael A Deposition of Photosensitive Media For Digital Hologram Recording
US20090231689A1 (en) * 2007-05-04 2009-09-17 Aperio Technologies, Inc. Rapid Microscope Scanner for Volume Image Acquisition

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8767216B2 (en) 2009-10-13 2014-07-01 California Institute Of Technology Holographically illuminated imaging devices
US8970671B2 (en) 2010-02-23 2015-03-03 California Institute Of Technology Nondiffracting beam detection devices for three-dimensional imaging
US9357202B2 (en) 2010-02-23 2016-05-31 California Institute Of Technology High resolution imaging devices with wide field and extended focus
EP2548000A1 (en) * 2010-03-15 2013-01-23 Bio-Rad Laboratories, Inc. Microassembled imaging flow cytometer
EP2548000A4 (en) * 2010-03-15 2014-08-13 Bio Rad Laboratories Microassembled imaging flow cytometer
US9068916B2 (en) 2010-03-15 2015-06-30 Bio-Rad Laboratories, Inc. Microassembled imaging flow cytometer
US8536545B2 (en) 2010-09-09 2013-09-17 California Institute Of Technology Delayed emission detection devices and methods
US9086536B2 (en) 2011-03-09 2015-07-21 California Institute Of Technology Talbot imaging devices and systems
US8946619B2 (en) 2011-04-20 2015-02-03 California Institute Of Technology Talbot-illuminated imaging devices, systems, and methods for focal plane tuning

Also Published As

Publication number Publication date
US20110085219A1 (en) 2011-04-14
WO2011047053A3 (en) 2011-06-09
US8767216B2 (en) 2014-07-01

Similar Documents

Publication Publication Date Title
US8767216B2 (en) Holographically illuminated imaging devices
US10419665B2 (en) Variable-illumination fourier ptychographic imaging devices, systems, and methods
US9357202B2 (en) High resolution imaging devices with wide field and extended focus
JP6716121B2 (en) Digital holographic microscope
US9343494B2 (en) Light guided pixel configured for emissions detection and comprising a guide layer with a wavelength selective filter material and a light detector layer
JP5055292B2 (en) Confocal imaging method and apparatus
US9086536B2 (en) Talbot imaging devices and systems
US8633432B2 (en) Reflective focusing and transmissive projection device
EP3136079A1 (en) Incoherent lensfree cell holography and microscopy on a chip
US9360611B2 (en) System, method and apparatus for contrast enhanced multiplexing of images
JP2004170977A (en) Method and arrangement for optically grasping sample with depth of resolution
RU2510060C2 (en) Optical illumination apparatus and method
CN107850765B (en) Method and assembly for beam shaping and optical layer microscopy
US20160041099A1 (en) Light sheet fluorescence and differential interference contrast microscope
US8964183B2 (en) Systems and methods for screening of biological samples
JP2008535016A (en) Optical system for mapping signal light onto detector
US20130250088A1 (en) Multi-color confocal microscope and imaging methods
JP2011507007A (en) Multifocal spot generator and multifocal multi-spot scanning microscope
CN109060761B (en) High-speed Raman spectrum scanning imaging method and device with three-dimensional high spatial resolution
JP2023537295A (en) Synchrotron radiation detection method, detector and laser scanning microscope
EP3781977A1 (en) Depicting of objects
Pacheco Array confocal microscopy
Chen et al. Dynamic reconfigurable spectral imaging microscopy

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10824025

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10824025

Country of ref document: EP

Kind code of ref document: A2