US9002097B1 - Method and system for enhancing image quality - Google Patents

Method and system for enhancing image quality Download PDF

Info

Publication number
US9002097B1
US9002097B1 US13/776,939 US201313776939A US9002097B1 US 9002097 B1 US9002097 B1 US 9002097B1 US 201313776939 A US201313776939 A US 201313776939A US 9002097 B1 US9002097 B1 US 9002097B1
Authority
US
United States
Prior art keywords
charged particle
grayscales
particle beam
inspection system
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US13/776,939
Inventor
Chiyan Kuan
Joe Wang
Van-Duc Nguyen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ASML Netherlands BV
Original Assignee
Hermes Microvision Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hermes Microvision Inc filed Critical Hermes Microvision Inc
Priority to US13/776,939 priority Critical patent/US9002097B1/en
Assigned to HERMES MICROVISION INC. reassignment HERMES MICROVISION INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KUAN, CHIYAN, NGUYEN, VAN-DUC, WANG, JOE
Priority to US14/595,582 priority patent/US9436985B1/en
Application granted granted Critical
Publication of US9002097B1 publication Critical patent/US9002097B1/en
Assigned to HERMES MICROVISION INCORPORATED B.V. reassignment HERMES MICROVISION INCORPORATED B.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: Hermes Microvision, Inc.
Assigned to ASML NETHERLANDS B.V. reassignment ASML NETHERLANDS B.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HERMES MICROVISION INCORPORATED B.V.
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G06K9/60
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03FPHOTOMECHANICAL PRODUCTION OF TEXTURED OR PATTERNED SURFACES, e.g. FOR PRINTING, FOR PROCESSING OF SEMICONDUCTOR DEVICES; MATERIALS THEREFOR; ORIGINALS THEREFOR; APPARATUS SPECIALLY ADAPTED THEREFOR
    • G03F7/00Photomechanical, e.g. photolithographic, production of textured or patterned surfaces, e.g. printing surfaces; Materials therefor, e.g. comprising photoresists; Apparatus specially adapted therefor
    • G03F7/70Microphotolithographic exposure; Apparatus therefor
    • G03F7/70483Information management; Active and passive control; Testing; Wafer monitoring, e.g. pattern monitoring
    • G03F7/70605Workpiece metrology
    • G03F7/70616Monitoring the printed patterns
    • G03F7/7065Defects, e.g. optical inspection of patterned layer for defects
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/9501Semiconductor wafers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N23/00Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
    • G01N23/22Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by measuring secondary emission from the material
    • G01N23/225Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by measuring secondary emission from the material using electron or ion
    • G01N23/2251Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by measuring secondary emission from the material using electron or ion using incident electron beams, e.g. scanning electron microscopy [SEM]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03FPHOTOMECHANICAL PRODUCTION OF TEXTURED OR PATTERNED SURFACES, e.g. FOR PRINTING, FOR PROCESSING OF SEMICONDUCTOR DEVICES; MATERIALS THEREFOR; ORIGINALS THEREFOR; APPARATUS SPECIALLY ADAPTED THEREFOR
    • G03F1/00Originals for photomechanical production of textured or patterned surfaces, e.g., masks, photo-masks, reticles; Mask blanks or pellicles therefor; Containers specially adapted therefor; Preparation thereof
    • G03F1/68Preparation processes not covered by groups G03F1/20 - G03F1/50
    • G03F1/82Auxiliary processes, e.g. cleaning or inspecting
    • G03F1/84Inspecting
    • G03F1/86Inspecting by charged particle beam [CPB]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/001Image restoration
    • G06T5/005Retouching; Inpainting; Scratch removal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration by the use of histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
    • G06T5/77
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01JELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
    • H01J37/00Discharge tubes with provision for introducing objects or material to be exposed to the discharge, e.g. for the purpose of examination or processing thereof
    • H01J37/02Details
    • H01J37/22Optical or photographic arrangements associated with the tube
    • H01J37/222Image processing arrangements associated with the tube
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01JELECTRIC DISCHARGE TUBES OR DISCHARGE LAMPS
    • H01J37/00Discharge tubes with provision for introducing objects or material to be exposed to the discharge, e.g. for the purpose of examination or processing thereof
    • H01J37/26Electron or ion microscopes; Electron or ion diffraction tubes
    • H01J37/28Electron or ion microscopes; Electron or ion diffraction tubes with scanning beams
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2223/00Investigating materials by wave or particle radiation
    • G01N2223/40Imaging
    • G01N2223/42Imaging image digitised, -enhanced in an image processor
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2223/00Investigating materials by wave or particle radiation
    • G01N2223/60Specific applications or type of materials
    • G01N2223/611Specific applications or type of materials patterned objects; electronic devices
    • G01N2223/6116Specific applications or type of materials patterned objects; electronic devices semiconductor wafer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20216Image averaging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30148Semiconductor; IC; Wafer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/006Geometric correction
    • G06T5/80
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/30Noise filtering

Definitions

  • the present invention relates to a method for enhancing image quality scanned by using an inspection tool.
  • Defect inspection systems frequently utilize charged particle beams.
  • a charged particle beam such as an electron beam (e-beam)
  • e-beam electron beam
  • the interaction of the electron beam with the inspected surface generates secondary electron signals, which is collected as grayscale images, and which are compared to detect defect by observing the change in gray scale.
  • the e-beam inspection typically use multi-scans, i.e., repeated scans, for a same sample to obtain low noise image.
  • the scan times may be reduced or limited to lower the cost, but image quality would be a critical concern. Deteriorated image quality may ignore small defect and increase the false rate on defect determination, causes alignment error in the following alignment process, and even result in the devices to fail. As the dimensions of semiconductor devices decrease, inspection becomes even more important and image quality should be promoted.
  • Median filter is a nonlinear digital filtering technique used to remove noise.
  • the main idea of the median filter is to run through the signal entry by entry, replacing each entry with the median of neighboring entries.
  • a pixel with its neighbor can form a matrix, and a median value can be determined from this matrix to replace the possible extreme value of this pixel.
  • the median filter is not suitable for the defect inspection systems. If a defect happens to one pixel only, this defect will be ignored by the median filter. In addition, larger image distortion occurs when tuning brightness and contrast.
  • An object of this invention is to provide methods or systems for enhancing the image quality, thereby saving time and cost.
  • An embodiment of this invention provides a method for enhancing image quality, comprising the steps of: recording a sequence of grayscales of a pixel scanned by a charged particle beam; removing extreme values from the sequence of grayscales and remaining other grayscales; and determining a nominated grey level of the pixel from the remained grayscales.
  • Another embodiment of this invention provides a system for enhancing image quality, comprising: means for recording a sequence of grayscales of a pixel scanned by a charged particle beam; means for removing extreme values from the sequence of grayscales and remaining other grayscales; and means for calculating an average or a median of the remained grayscales to obtain an nominated grayscale of the pixel.
  • Another embodiment of this invention provides a method for enhancing image quality, comprising: scanning a specimen to obtain a plurality of frames by using a charged particle beam; removing extreme grayscales of each pixel of the plurality of frames; and averaging remained grayscales of each pixel of the plurality of frames to obtain a scanned image of the specimen.
  • FIG. 1 shows a method for enhancing image contrast according to an embodiment of this invention.
  • FIG. 2 shows recorded eight scanned grayscales with time information of a particular pixel.
  • FIG. 3A shows an example for discarding the extreme grayscales.
  • FIG. 3B shows a particular example of FIG. 3A .
  • FIG. 3C shows another particular example of FIG. 3A .
  • FIG. 4 shows an example in which a pie chart is used to check whether the discarded grayscales correlate with the time of scan.
  • FIG. 5 shows an example of FIG. 1 .
  • FIG. 6 shows an inspection system 6 according to an embodiment of this invention.
  • FIG. 7 is a flowchart showing the process of the inspection system according to an embodiment of this invention.
  • This invention is directed to methods and systems for improving image quality of frames obtained from an inspection system.
  • the inspection system repeatedly inspects a sample, and the inspected frames for the same sample are processed to obtain an improved image.
  • a cherry-pick method is employed to remove noises or values of the frames.
  • the term “cherry-pick” refers to employing an automatic or manual way, or an arbitrary or rational rule, to pick out the unwanted noises or values.
  • the inspection system may be an optical inspection system, or an inspection system using a charged particle beam.
  • embodiments of this invention employ the cherry-pick method to treat frames obtained from insufficient quantity of inspection times. For frames obtained from many inspection times, e.g., 100 times, the cherry-pick method may be unnecessary because the noises may contribute little weight in such cases.
  • the cherry-pick method is employed to treat frames obtained from limited inspection times, e.g., 4 or 10 times. Noises contribute big weight in such cases and they have to be removed.
  • the inspection system uses a charged particle beam to inspect the sample.
  • Systems capable of irradiating a charged particle beam can be employed by this invention.
  • the charged particle beam interacts with the sample and signals are thus generated and collected as grayscale frames.
  • the inspection system using the charged particle beam has the advantage of high resolution.
  • the inspection system is a point-to-point imaging system, such as a scanning electron microscope (SEM), a focused ion beam (FIB), or an atomic force microscope (AFM) inspection system.
  • SEM scanning electron microscope
  • FIB focused ion beam
  • AFM atomic force microscope
  • FIG. 1 shows a method for enhancing image quality according to an embodiment of this invention.
  • Step 10 a sequence of grayscales of a pixel scanned by a charged particle beam is recorded.
  • the method may employ a defect invention system emitting electron beams to repeatedly scan a specimen in time sequence.
  • the specimen may comprise a wafer, such as a silicon wafer, or a mask, such as an extreme ultraviolet mask.
  • the times of multi-scan may range from several to tens. For example, a 12 inch wafer is scanned for 8 times and eight frames are obtain, in which grayscales of each pixel of each frame incorporated with time information are recorded.
  • FIG. 2 shows the recorded eight scanned grayscales with time information of a particular pixel.
  • step 20 some of the recorded grayscales are removed from the sequence, and other grayscales are remained.
  • the method of this invention may employ a statistic manner to remove extreme values from the recorded sequence of grayscales.
  • the recorded grayscales may be firstly analyzed to identify its distribution by statistic charts, such as histogram, or other methods know in the art.
  • an upper limit and a lower limit may be defined to remove the abnormal extreme values.
  • the extreme grayscales may be due to the apparatus for emitting the charged particle beam, or due to accumulated charge in the scanned surface.
  • FIG. 3A shows an example for discarding the extreme grayscales.
  • the distribution of the recorded grayscales is a standard normal distribution with a mean ⁇ and a standard deviation ⁇ .
  • the area under the normal curve within 0.67 standard deviation of the mean is about 50% of the total area under the curve.
  • the area under the normal curve within 1.28 standard deviation of the mean is about 80% of the total area under the curve.
  • the extreme values are defined as the highest 25% and lowest 25% of the recorded sequence of grayscales. For example, the specimen is repeatedly scanned for four times and each pixel has four grayscales. According to the definition, the maximum and the minimum of the four will be discarded. In another embodiment, the extreme values are defined as the highest 10% and lowest 10% of the recorded sequence of grayscales.
  • some embodiment cherry-picks the recorded sequence of grayscales, picking up grayscales only within suitable range regardless whatever distributions.
  • An error diagnose may be made before removing the extreme grayscales and the extreme values may be accordingly defined.
  • the recorded sequence of grayscales incorporated with time information, as well as the parameters of scans, may provide useful information to spot the source of the noise.
  • the diagnose may use various statistical charts.
  • FIG. 4 shows an example in which a pie chart is used to check whether the discarded grayscales correlate with the time of scan.
  • the probability of each scan should be almost the same and about 25% in theory.
  • extreme grayscales may be changed after the error diagnose. For example, in the four-times scan shown in the last paragraph, it is diagnosed that the grayscales are deviated to high due to a problem of inspection system. In this case, the largest two grayscales may be defined as the extreme grayscales. In the contrary, if engineers diagnose that the grayscales are deviated to low due to another problem of inspection system, the smallest two grayscales may be defined as the extreme grayscales.
  • control charts may be employed to assist the error diagnose.
  • the control charts should be carefully used because there may be absence of a target value for the charged particle beam inspection.
  • a statistic method is employed to determine a nominated grayscale of the pixel from the remained grayscales.
  • the remained grayscales are averaged and the average value is used to denote the pixel, i.e., as the nominated grayscale of the pixel.
  • the median of the remained grayscales is used to denote the pixel.
  • the nominated grayscale is determined by other statistical methods except the average and median method.
  • the remained grayscales may be manipulated through other methods to denote the pixel.
  • FIG. 5 shows an example of FIG. 1 .
  • a eight-times scan in time sequence is performed to an extreme ultraviolet mask, and eight grayscales of each pixel are stored in which step 10 shows eight grayscales of a pixel, i.e., 210 , 165 , 163 , 163 , 162 , 161 , 160 , and 154 .
  • step 20 the maximum and the minimum grayscale of the eight, i.e., 210 and 154 , are automatically removed due to out of the upper and lower limits or for other reasons, and other six grayscales are remained.
  • the average or the median of the remained six grayscales is calculated to be the nominated grayscale of the pixel, which is 162.33 for the average or 162.5 for the median.
  • Another embodiment of this invention provides a system for enhancing image quality, which comprises: means for recording a sequence of grayscales of a pixel scanned by a charged particle beam; means for removing extreme values from the sequence of grayscales and remaining other grayscales of the sequence of grayscales; and means for determining a nominated grayscale of the pixel from the remained grayscales.
  • the system is configured to store image data generated by scanning a wafer or a mask, such as a silicon wafer or an extreme ultraviolet (EUV) mask.
  • the system may comprises one or more processors coupled to a detector, and each processor receives a portion of image data generated by the detector during scanning.
  • the system further comprises an array of storage media, such as a memory cell, separately coupled to each processor, storing all of the image data sent by each processor.
  • the one or more processors may be responsible for removing the extreme values and determining the nominated grayscale, which have been descried in the foregoing paragraphs.
  • Another embodiment of this invention provides a computer readable medium encoded with a computer program for enhancing image quality of frames obtained from the inspection system.
  • the computer readable medium primarily comprises the steps of: recording a sequence of grayscales of a pixel scanned by a charged particle beam; removing extreme values from the sequence of grayscales and remaining other grayscales; and determining a nominated grey level of the pixel from the remained grayscales.
  • FIG. 6 shows an inspection system 6 according to an embodiment of this invention.
  • a sample 70 such as a wafer or a mask, is loaded on a sample stage 68 to be inspected.
  • a charged particle beam generator 61 generates a primary charged particle beam 601 , preferably an electron beam.
  • a condenser lens module 62 condenses the primary charged particle beam 601 .
  • a probe forming objective lens module 63 focuses the condensed primary charged particle beam into a charged particle beam probe 602 .
  • a charged particle beam deflection module 64 deflects the formed charged particle beam probe 602 to the surface of the sample 70 . Secondary charged particles 603 are emitted from the surface of the sample 70 bombarded by the charged particle beam probe 602 .
  • a secondary charged particle detector module 65 detects the secondary charged particles 603 and generates a secondary charged particle detection signal 604 .
  • An image forming module 66 communicated with the secondary charged particle detector module 65 receives the secondary charged particle detection signal 604 and forms one or more frames.
  • the image forming module 66 may be a host, a terminal, a personal computer, or the like.
  • a noise-filtering module 67 communicated with the image-forming module 66 treats the scanned frames by methods mentioned in the foregoing embodiments, so as to obtain a image with improved quality.
  • noise-filtering module may comprise the above-mentioned processers and memories for storing and processing the image and inspection data of the frames.
  • the connection between the image forming module 66 and the secondary charged particle detector module 65 may be wire or wireless manners known in the art.
  • FIG. 7 is a flowchart showing the process of the inspection system according to an embodiment of this invention.
  • the inspection system performs a multi-scan to a sample.
  • the results of the multi-scan are treated by the method, particularly the cherry-pick method of this invention.
  • Step 703 after image-processing, an image with improved quality can be obtained.
  • Step 704 in the meantime, the image-processing method analyzes the scanned frames to check the condition of the inspection system. For example, the method may check whether a system error is presented.
  • Step 705 the defects of the sample can be determined by the improved image.
  • each pixel By cherry-picking the recorded sequence of grayscales, each pixel obtains a nominated grayscale with reduced noise.
  • the signal-to-noise ratio of the scanned image is increased and better image quality is hence obtained.
  • the qualified good image quality promotes the accuracy of the alignment process, increase defect-detecting sensitivity, and decrease defect false rate. Accordingly, embodiments of this invention provide methods and system can significantly reduce the inspection time and cost.

Abstract

This invention relates to methods and systems for enhance the signal-to-noise ratio of an image scanned by a charged particle beam. In an embodiment, a sequence of grayscales of a pixel is recorded first, extreme values of the sequence of grayscales are then identified and removed, and the remained grayscales are used to determine a nominated grayscale of the pixel.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a method for enhancing image quality scanned by using an inspection tool.
2. Description of Related Art
During the fabrication of semiconductor, pattern defects occur on the mask or wafer reducing the yield to a great degree. Defect inspection and review are widely used for yield management. High resolution, high throughput, and low radiation damage on specimen are requested for defect inspection systems.
Defect inspection systems frequently utilize charged particle beams. In such systems, a charged particle beam, such as an electron beam (e-beam), is irradiated on structures to be inspected. The interaction of the electron beam with the inspected surface generates secondary electron signals, which is collected as grayscale images, and which are compared to detect defect by observing the change in gray scale.
As the dimensions of structures to be inspected are continuously getting smaller and the resolution of the inspection systems are getting higher, enormous amount of data are generated. In addition, because the secondary electron signals may be strongly affected by extremely irregular noise, the e-beam inspection typically use multi-scans, i.e., repeated scans, for a same sample to obtain low noise image.
After multi-scans, all scanned grayscales of each pixel are averaged, and a scanned image with low noise is thus obtained.
Theoretically, the more times of the scan have been made, the better image quality would be; however, the e-beam inspection is a time-consuming process, and the increased complexity of structures and times of scan increase the cost of defect inspections, both in terms of expense and time.
The scan times may be reduced or limited to lower the cost, but image quality would be a critical concern. Deteriorated image quality may ignore small defect and increase the false rate on defect determination, causes alignment error in the following alignment process, and even result in the devices to fail. As the dimensions of semiconductor devices decrease, inspection becomes even more important and image quality should be promoted.
Median filter is a nonlinear digital filtering technique used to remove noise. The main idea of the median filter is to run through the signal entry by entry, replacing each entry with the median of neighboring entries. In one image frame, a pixel with its neighbor can form a matrix, and a median value can be determined from this matrix to replace the possible extreme value of this pixel.
The median filter is not suitable for the defect inspection systems. If a defect happens to one pixel only, this defect will be ignored by the median filter. In addition, larger image distortion occurs when tuning brightness and contrast.
In short, scan times should be reasonably reduced for saving time and cost. In limited scan times, the image quality has to be promoted, but qualified images are not always provided through a traditional averaging or median filter method. Therefore, it would be advantageous to provide methods or systems for enhancing the image quality.
SUMMARY OF THE INVENTION
An object of this invention is to provide methods or systems for enhancing the image quality, thereby saving time and cost.
An embodiment of this invention provides a method for enhancing image quality, comprising the steps of: recording a sequence of grayscales of a pixel scanned by a charged particle beam; removing extreme values from the sequence of grayscales and remaining other grayscales; and determining a nominated grey level of the pixel from the remained grayscales.
Another embodiment of this invention provides a system for enhancing image quality, comprising: means for recording a sequence of grayscales of a pixel scanned by a charged particle beam; means for removing extreme values from the sequence of grayscales and remaining other grayscales; and means for calculating an average or a median of the remained grayscales to obtain an nominated grayscale of the pixel.
Another embodiment of this invention provides a method for enhancing image quality, comprising: scanning a specimen to obtain a plurality of frames by using a charged particle beam; removing extreme grayscales of each pixel of the plurality of frames; and averaging remained grayscales of each pixel of the plurality of frames to obtain a scanned image of the specimen.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 shows a method for enhancing image contrast according to an embodiment of this invention.
FIG. 2 shows recorded eight scanned grayscales with time information of a particular pixel.
FIG. 3A shows an example for discarding the extreme grayscales.
FIG. 3B shows a particular example of FIG. 3A.
FIG. 3C shows another particular example of FIG. 3A.
FIG. 4 shows an example in which a pie chart is used to check whether the discarded grayscales correlate with the time of scan.
FIG. 5 shows an example of FIG. 1.
FIG. 6 shows an inspection system 6 according to an embodiment of this invention.
FIG. 7 is a flowchart showing the process of the inspection system according to an embodiment of this invention.
DESCRIPTION OF THE PREFERRED EMBODIMENT
Reference will now be made in detail to specific embodiments of the invention. Examples of these embodiments are illustrated in accompanying drawings. While the invention will be described in conjunction with these specific embodiments, it will be understood that it is not intended to limit the invention to these embodiments. On the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. The present invention may be practiced without some or all of these specific details. In other instances, well-known components and process operations have not been described in detail in order not to unnecessarily obscure the present invention. While drawings are illustrated in detail, it is appreciated that the quantity of the disclosed components may be greater or less than that disclosed, except where expressly restricting the amount of the components.
This invention is directed to methods and systems for improving image quality of frames obtained from an inspection system. The inspection system repeatedly inspects a sample, and the inspected frames for the same sample are processed to obtain an improved image. Preferably, a cherry-pick method is employed to remove noises or values of the frames. The term “cherry-pick” refers to employing an automatic or manual way, or an arbitrary or rational rule, to pick out the unwanted noises or values.
The inspection system may be an optical inspection system, or an inspection system using a charged particle beam. Preferably, embodiments of this invention employ the cherry-pick method to treat frames obtained from insufficient quantity of inspection times. For frames obtained from many inspection times, e.g., 100 times, the cherry-pick method may be unnecessary because the noises may contribute little weight in such cases. Preferably, the cherry-pick method is employed to treat frames obtained from limited inspection times, e.g., 4 or 10 times. Noises contribute big weight in such cases and they have to be removed.
Preferably, the inspection system uses a charged particle beam to inspect the sample. Systems capable of irradiating a charged particle beam can be employed by this invention. The charged particle beam interacts with the sample and signals are thus generated and collected as grayscale frames. The inspection system using the charged particle beam has the advantage of high resolution.
Typically, the inspection system is a point-to-point imaging system, such as a scanning electron microscope (SEM), a focused ion beam (FIB), or an atomic force microscope (AFM) inspection system. Scanning electron microscope (SEM) is an electron microscope that images a sample by scanning it with a high-energy beam of electrons in a raster scan pattern. The electrons of the beam interact with the atoms that make up the sample producing signals that contain information about the sample's surface topography. The focused ion beam resembles the SEM, the focused ion beam uses a focused beam of ions instead of a focused beam of electrons. The atomic force microscope was developed to overcome drawbacks of STM. AFM is capable of imaging almost any type of surfaces.
FIG. 1 shows a method for enhancing image quality according to an embodiment of this invention. Step 10, a sequence of grayscales of a pixel scanned by a charged particle beam is recorded. Preferably, the method may employ a defect invention system emitting electron beams to repeatedly scan a specimen in time sequence. The specimen may comprise a wafer, such as a silicon wafer, or a mask, such as an extreme ultraviolet mask. The times of multi-scan may range from several to tens. For example, a 12 inch wafer is scanned for 8 times and eight frames are obtain, in which grayscales of each pixel of each frame incorporated with time information are recorded. FIG. 2 shows the recorded eight scanned grayscales with time information of a particular pixel.
Referring to FIG. 1 again, in step 20, some of the recorded grayscales are removed from the sequence, and other grayscales are remained. The method of this invention may employ a statistic manner to remove extreme values from the recorded sequence of grayscales. The recorded grayscales may be firstly analyzed to identify its distribution by statistic charts, such as histogram, or other methods know in the art.
If the distribution is a standard normal distribution, an upper limit and a lower limit may be defined to remove the abnormal extreme values. The extreme grayscales may be due to the apparatus for emitting the charged particle beam, or due to accumulated charge in the scanned surface. FIG. 3A shows an example for discarding the extreme grayscales. The distribution of the recorded grayscales is a standard normal distribution with a mean μ and a standard deviation σ. An upper limit (UL) and a lower limit (LL) are respectively defined as UL=μ+z, and LL=μ−z, where z stands for a predetermined value multiplied the standard deviation (σ) of the normal distribution, usually ranged from about 0.5 σ to about 3σ. Grayscales greater than the upper limit and smaller than the lower limit will be discarded and others are remained. FIG. 3B shows a particular example of FIG. 3A in which the upper limit UL and the lower limit LL are respectively defined as UL=μ+0.67σ, and LL=μ−0.67σ. In this example, the area under the normal curve within 0.67 standard deviation of the mean is about 50% of the total area under the curve. FIG. 3C shows another particular example of FIG. 3A in which the upper limit UL and the lower limit LL are respectively defined as UL=μ+1.28σ, and LL=μ-1.28σ. In this example, the area under the normal curve within 1.28 standard deviation of the mean is about 80% of the total area under the curve.
Notice that some embodiments of this invention may use only the upper limit UL or the lower limit LL to discard extreme grayscales. In addition, if the number of scans are too small or the distribution is not normal distribution, it may use other definitions to discard the grayscales caused by noise. In one embodiment, the extreme values are defined as the highest 25% and lowest 25% of the recorded sequence of grayscales. For example, the specimen is repeatedly scanned for four times and each pixel has four grayscales. According to the definition, the maximum and the minimum of the four will be discarded. In another embodiment, the extreme values are defined as the highest 10% and lowest 10% of the recorded sequence of grayscales.
In addition, some embodiment cherry-picks the recorded sequence of grayscales, picking up grayscales only within suitable range regardless whatever distributions.
An error diagnose may be made before removing the extreme grayscales and the extreme values may be accordingly defined. The recorded sequence of grayscales incorporated with time information, as well as the parameters of scans, may provide useful information to spot the source of the noise. The diagnose may use various statistical charts. FIG. 4 shows an example in which a pie chart is used to check whether the discarded grayscales correlate with the time of scan. The symbol A, B, C, and D respectively denote the discarded grayscales scanned at T=1, T=2, T=3, and T=4 for a four-times scan. The probability of each scan should be almost the same and about 25% in theory. The pie chart, however, tells that 67% the discarded grayscales are scanned at T=3, and some special cause, such as electrons accumulated in the specimen surface, may disturb the probability distribution. In this case, all grayscales scanned at T=3 may be discarded.
The definition of extreme grayscales may be changed after the error diagnose. For example, in the four-times scan shown in the last paragraph, it is diagnosed that the grayscales are deviated to high due to a problem of inspection system. In this case, the largest two grayscales may be defined as the extreme grayscales. In the contrary, if engineers diagnose that the grayscales are deviated to low due to another problem of inspection system, the smallest two grayscales may be defined as the extreme grayscales.
Various statistical process control charts may be employed to assist the error diagnose. The control charts should be carefully used because there may be absence of a target value for the charged particle beam inspection.
Referring to FIG. 1 again, in step 30, a statistic method is employed to determine a nominated grayscale of the pixel from the remained grayscales. Preferably, the remained grayscales are averaged and the average value is used to denote the pixel, i.e., as the nominated grayscale of the pixel. In another embodiment, the median of the remained grayscales is used to denote the pixel. In another embodiment, the nominated grayscale is determined by other statistical methods except the average and median method. In another embodiment, in case of the distribution is abnormal or for other reasons, the remained grayscales may be manipulated through other methods to denote the pixel.
FIG. 5 shows an example of FIG. 1. A eight-times scan in time sequence is performed to an extreme ultraviolet mask, and eight grayscales of each pixel are stored in which step 10 shows eight grayscales of a pixel, i.e., 210, 165, 163, 163, 162, 161, 160, and 154. In step 20, the maximum and the minimum grayscale of the eight, i.e., 210 and 154, are automatically removed due to out of the upper and lower limits or for other reasons, and other six grayscales are remained. In step 30, the average or the median of the remained six grayscales is calculated to be the nominated grayscale of the pixel, which is 162.33 for the average or 162.5 for the median.
Another embodiment of this invention provides a system for enhancing image quality, which comprises: means for recording a sequence of grayscales of a pixel scanned by a charged particle beam; means for removing extreme values from the sequence of grayscales and remaining other grayscales of the sequence of grayscales; and means for determining a nominated grayscale of the pixel from the remained grayscales.
The system is configured to store image data generated by scanning a wafer or a mask, such as a silicon wafer or an extreme ultraviolet (EUV) mask. The system may comprises one or more processors coupled to a detector, and each processor receives a portion of image data generated by the detector during scanning. In addition, the system further comprises an array of storage media, such as a memory cell, separately coupled to each processor, storing all of the image data sent by each processor. In addition, the one or more processors may be responsible for removing the extreme values and determining the nominated grayscale, which have been descried in the foregoing paragraphs.
Another embodiment of this invention provides a computer readable medium encoded with a computer program for enhancing image quality of frames obtained from the inspection system. The computer readable medium primarily comprises the steps of: recording a sequence of grayscales of a pixel scanned by a charged particle beam; removing extreme values from the sequence of grayscales and remaining other grayscales; and determining a nominated grey level of the pixel from the remained grayscales.
For illustrative purpose, FIG. 6 shows an inspection system 6 according to an embodiment of this invention. A sample 70, such as a wafer or a mask, is loaded on a sample stage 68 to be inspected. A charged particle beam generator 61 generates a primary charged particle beam 601, preferably an electron beam. A condenser lens module 62 condenses the primary charged particle beam 601. A probe forming objective lens module 63 focuses the condensed primary charged particle beam into a charged particle beam probe 602. A charged particle beam deflection module 64 deflects the formed charged particle beam probe 602 to the surface of the sample 70. Secondary charged particles 603 are emitted from the surface of the sample 70 bombarded by the charged particle beam probe 602. A secondary charged particle detector module 65 detects the secondary charged particles 603 and generates a secondary charged particle detection signal 604. An image forming module 66 communicated with the secondary charged particle detector module 65 receives the secondary charged particle detection signal 604 and forms one or more frames. The image forming module 66 may be a host, a terminal, a personal computer, or the like. A noise-filtering module 67 communicated with the image-forming module 66 treats the scanned frames by methods mentioned in the foregoing embodiments, so as to obtain a image with improved quality. noise-filtering module may comprise the above-mentioned processers and memories for storing and processing the image and inspection data of the frames. The connection between the image forming module 66 and the secondary charged particle detector module 65 may be wire or wireless manners known in the art.
FIG. 7 is a flowchart showing the process of the inspection system according to an embodiment of this invention. Step 701, the inspection system performs a multi-scan to a sample. Step 702, the results of the multi-scan are treated by the method, particularly the cherry-pick method of this invention. Step 703, after image-processing, an image with improved quality can be obtained. Step 704, in the meantime, the image-processing method analyzes the scanned frames to check the condition of the inspection system. For example, the method may check whether a system error is presented. Step 705, the defects of the sample can be determined by the improved image.
By cherry-picking the recorded sequence of grayscales, each pixel obtains a nominated grayscale with reduced noise. The signal-to-noise ratio of the scanned image is increased and better image quality is hence obtained. The qualified good image quality promotes the accuracy of the alignment process, increase defect-detecting sensitivity, and decrease defect false rate. Accordingly, embodiments of this invention provide methods and system can significantly reduce the inspection time and cost.
Although specific embodiments have been illustrated and described, it will be appreciated by those skilled in the art that various modifications may be made without departing from the scope of the present invention, which is intended to be limited solely by the appended claims.

Claims (7)

What is claimed is:
1. An inspection system for inspecting a sample comprising:
a charged particle beam generator for generating a primary charged particle beam;
a condenser lens module arranged below the charged particle beam generator and adapted for condensing the primary charged particle beam;
a probe forming objective lens module arranged below the condenser lens module and adapted for focusing the condensed primary charged particle beam into a charged particle beam probe;
a charged particle beam deflection module arranged below the condenser lens module for deflecting the charged particle beam probe to a surface of the sample;
a secondary charged particle detector module for detecting a secondary charged particle detection signal generated from the sample;
an image forming module communicated with the secondary charged particle detector module for receiving the secondary charged particle detection signal and forming at one or more frames; and
a noise-filtering module communicated with the image forming module and encoded with a computer program for determining a defect, wherein the computer program performs the following steps: recording a sequence of grayscales of a pixel of the frames scanned by the charged particle beam; removing extreme values from the sequence of grayscales; and determining a nominated grey level of the pixel from remained grayscales.
2. The inspection system of claim 1, wherein the nominated grey level is the average or the median of the remained grayscales.
3. The inspection system of claim 1, wherein the extreme values include the highest 25% and the lowest 25% of the sequence of grayscales.
4. The inspection system of claim 1, wherein the extreme values include the highest 10% and the lowest 10% of the sequence grayscales.
5. The inspection system of claim 1, wherein the extreme values include the largest and smallest grayscales.
6. The inspection system of claim 1, wherein the sequence is a time mode.
7. The inspection system of claim 1, wherein the charged particle beam is an electron beam.
US13/776,939 2013-02-26 2013-02-26 Method and system for enhancing image quality Active 2033-06-22 US9002097B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/776,939 US9002097B1 (en) 2013-02-26 2013-02-26 Method and system for enhancing image quality
US14/595,582 US9436985B1 (en) 2013-02-26 2015-01-13 Method and system for enhancing image quality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/776,939 US9002097B1 (en) 2013-02-26 2013-02-26 Method and system for enhancing image quality

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/595,582 Continuation US9436985B1 (en) 2013-02-26 2015-01-13 Method and system for enhancing image quality

Publications (1)

Publication Number Publication Date
US9002097B1 true US9002097B1 (en) 2015-04-07

Family

ID=52745206

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/776,939 Active 2033-06-22 US9002097B1 (en) 2013-02-26 2013-02-26 Method and system for enhancing image quality
US14/595,582 Active US9436985B1 (en) 2013-02-26 2015-01-13 Method and system for enhancing image quality

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/595,582 Active US9436985B1 (en) 2013-02-26 2015-01-13 Method and system for enhancing image quality

Country Status (1)

Country Link
US (2) US9002097B1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019045225A (en) * 2017-08-31 2019-03-22 株式会社 Ngr Image generation method
CN114420619A (en) * 2022-03-30 2022-04-29 晶芯成(北京)科技有限公司 Wafer alignment device and method, and wafer testing method
CN115049668A (en) * 2022-08-16 2022-09-13 江苏众联管业有限公司 Steel strip roll mark identification method based on feature extraction
JP7154671B1 (en) 2022-08-15 2022-10-18 株式会社Photo electron Soul Method for creating detection data in electron beam application apparatus, image synthesis method for irradiation target, program, recording medium, and electron beam application apparatus

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10365639B2 (en) * 2016-01-06 2019-07-30 Kla-Tencor Corporation Feature selection and automated process window monitoring through outlier detection
CN110449645B (en) * 2019-07-26 2020-06-16 武汉数字化设计与制造创新中心有限公司 Method for improving surface shape precision of FIBM three-dimensional microstructure
EP4092614A1 (en) 2021-05-21 2022-11-23 ASML Netherlands B.V. Data processing device and method, charged particle assessment system and method
EP4341890A1 (en) 2021-05-21 2024-03-27 ASML Netherlands B.V. Data processing device and method, charged particle assessment system and method
EP4123683A1 (en) 2021-07-20 2023-01-25 ASML Netherlands B.V. Data processing device and method, charged particle assessment system and method
EP4343812A1 (en) 2022-09-26 2024-03-27 ASML Netherlands B.V. Data processing device and method, charged particle assessment system and method
WO2023227424A1 (en) 2022-05-27 2023-11-30 Asml Netherlands B.V. Data processing device and method, charged particle assessment system and method
WO2024017737A1 (en) 2022-07-21 2024-01-25 Asml Netherlands B.V. Charged particle assessment system and method
EP4333019A1 (en) 2022-09-02 2024-03-06 ASML Netherlands B.V. Charged particle assessment system and method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6169282B1 (en) * 1997-10-29 2001-01-02 Hitachi, Ltd. Defect inspection method and apparatus therefor
US20100158317A1 (en) 2008-12-23 2010-06-24 Wei Fang Method and system for determining a defect during sample inspection involving charged particle beam imaging
US7831083B1 (en) * 2006-07-13 2010-11-09 Kla-Tencor Technologies Corporation Image quality monitoring for substrate inspection
US20110210181A1 (en) * 2007-12-26 2011-09-01 Carl Zeiss Sms Gmbh Apparatus and method for investigating and/or modifying a sample
US8068662B2 (en) * 2009-03-30 2011-11-29 Hermes Microvision, Inc. Method and system for determining a defect during charged particle beam inspection of a sample
US8582864B2 (en) * 2006-01-20 2013-11-12 Hitachi High-Technologies Corporation Fault inspection method
US8606017B1 (en) * 2009-12-22 2013-12-10 Hermes Microvision, Inc. Method for inspecting localized image and system thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6545275B1 (en) * 1999-09-03 2003-04-08 Applied Materials, Inc. Beam evaluation
ATE484840T1 (en) * 2001-10-10 2010-10-15 Applied Materials Israel Ltd METHOD AND DEVICE FOR ALIGNING A COLUMN FOR CHARGED PARTICLE BEAMS
JP2006040991A (en) * 2004-07-23 2006-02-09 Hitachi Ltd Method of evaluating semiconductor device and manufacturing method thereof
US8692214B2 (en) * 2009-08-12 2014-04-08 Hermes Microvision, Inc. Charged particle beam inspection method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6169282B1 (en) * 1997-10-29 2001-01-02 Hitachi, Ltd. Defect inspection method and apparatus therefor
US8582864B2 (en) * 2006-01-20 2013-11-12 Hitachi High-Technologies Corporation Fault inspection method
US7831083B1 (en) * 2006-07-13 2010-11-09 Kla-Tencor Technologies Corporation Image quality monitoring for substrate inspection
US20110210181A1 (en) * 2007-12-26 2011-09-01 Carl Zeiss Sms Gmbh Apparatus and method for investigating and/or modifying a sample
US20100158317A1 (en) 2008-12-23 2010-06-24 Wei Fang Method and system for determining a defect during sample inspection involving charged particle beam imaging
US8068662B2 (en) * 2009-03-30 2011-11-29 Hermes Microvision, Inc. Method and system for determining a defect during charged particle beam inspection of a sample
US8606017B1 (en) * 2009-12-22 2013-12-10 Hermes Microvision, Inc. Method for inspecting localized image and system thereof

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019045225A (en) * 2017-08-31 2019-03-22 株式会社 Ngr Image generation method
CN114420619A (en) * 2022-03-30 2022-04-29 晶芯成(北京)科技有限公司 Wafer alignment device and method, and wafer testing method
JP7154671B1 (en) 2022-08-15 2022-10-18 株式会社Photo electron Soul Method for creating detection data in electron beam application apparatus, image synthesis method for irradiation target, program, recording medium, and electron beam application apparatus
WO2024038824A1 (en) * 2022-08-15 2024-02-22 株式会社Photo electron Soul Method for creating detection data in electron beam application device, method for synthesizing image of irradiation target, program, recording medium, and electron beam application device
JP2024025993A (en) * 2022-08-15 2024-02-28 株式会社Photo electron Soul Method for creating detection data in electron beam application device, method for synthesizing images of irradiation target, program, recording medium, and electron beam application device
CN115049668A (en) * 2022-08-16 2022-09-13 江苏众联管业有限公司 Steel strip roll mark identification method based on feature extraction

Also Published As

Publication number Publication date
US9436985B1 (en) 2016-09-06

Similar Documents

Publication Publication Date Title
US9436985B1 (en) Method and system for enhancing image quality
US10697900B2 (en) Correlating SEM and optical images for wafer noise nuisance identification
US7635851B2 (en) Electron beam apparatus and method of generating an electron beam irradiation pattern
US8712184B1 (en) Method and system for filtering noises in an image scanned by charged particles
JP5500871B2 (en) Template matching template creation method and template creation apparatus
JP5543872B2 (en) Pattern inspection method and pattern inspection apparatus
US9766187B2 (en) Repeater detection
JP2006332296A (en) Focus correction method in electronic beam applied circuit pattern inspection
WO2016002003A1 (en) Substrate inspection apparatus and substrate inspection method
US20110187847A1 (en) Scanning type charged particle microscope device and method for processing image acquired with scanning type charged particle microscope device
WO2016033300A1 (en) Repeater detection
TW201721226A (en) Method and system for noise mitigation in a multi-beam scanning electron microscopy system
US10096100B2 (en) Inspection device, inspection method, and image processing program
WO2018138875A1 (en) Charged particle beam device
US10557802B2 (en) Capture of repeater defects on a semiconductor wafer
JP2012169571A (en) Defect extraction scanning electron microscope inspection system, and extraction method thereof
JP5174863B2 (en) Image acquisition condition setting device and computer program
TW202208836A (en) Image alignment for noisy images
US10380731B1 (en) Method and system for fast inspecting defects
JP4548432B2 (en) Electron microscope method, electron microscope array biological sample inspection method and biological inspection apparatus using the same
JP3788586B2 (en) Pattern inspection apparatus and method
TWI808554B (en) Dislocation type and density discrimination in semiconductor materials using cathodoluminescence measurements
JP6033325B2 (en) Semiconductor inspection apparatus and inspection method using charged particle beam
JP2001325595A (en) Method and device for image processing and charged particle microscopical inspecting device
WO2017159360A1 (en) Evaluation method for charged particle beam, computer program for evaluating charged particle beam, and evaluation device for charged particle beam

Legal Events

Date Code Title Description
AS Assignment

Owner name: HERMES MICROVISION INC., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KUAN, CHIYAN;WANG, JOE;NGUYEN, VAN-DUC;REEL/FRAME:029875/0132

Effective date: 20130219

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: HERMES MICROVISION INCORPORATED B.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HERMES MICROVISION, INC.;REEL/FRAME:054866/0742

Effective date: 20181219

Owner name: ASML NETHERLANDS B.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HERMES MICROVISION INCORPORATED B.V.;REEL/FRAME:054870/0156

Effective date: 20181219

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8