WO1997047235A1 - Dermal diagnostic analysis system and method - Google Patents

Dermal diagnostic analysis system and method Download PDF

Info

Publication number
WO1997047235A1
WO1997047235A1 PCT/IL1997/000187 IL9700187W WO9747235A1 WO 1997047235 A1 WO1997047235 A1 WO 1997047235A1 IL 9700187 W IL9700187 W IL 9700187W WO 9747235 A1 WO9747235 A1 WO 9747235A1
Authority
WO
WIPO (PCT)
Prior art keywords
skin
skin region
image information
digital image
analysis system
Prior art date
Application number
PCT/IL1997/000187
Other languages
French (fr)
Inventor
Yoav Smith
Noam Levi
Original Assignee
J.M.I. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by J.M.I. Ltd. filed Critical J.M.I. Ltd.
Priority to EP97925253A priority Critical patent/EP0904007A4/en
Priority to AU30455/97A priority patent/AU3045597A/en
Publication of WO1997047235A1 publication Critical patent/WO1997047235A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/44Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
    • A61B5/441Skin evaluation, e.g. for skin disorder diagnosis
    • A61B5/444Evaluating skin marks, e.g. mole, nevi, tumour, scar
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/44Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
    • A61B5/441Skin evaluation, e.g. for skin disorder diagnosis
    • A61B5/445Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02Operational features
    • A61B2560/0223Operational features of calibration, e.g. protocols for calibrating sensors
    • A61B2560/0228Operational features of calibration, e.g. protocols for calibrating sensors using calibration standards
    • A61B2560/0233Optical standards

Definitions

  • the present invention relates to medical diagnostic equipment and methods, and more particularly, to a dermal diagnostic analysis system and method employing digital analysis of skin photographs of patients to detect changes in lesions, moles, etc., per a pre-defined set of useful analysis parameters .
  • the prior art includes examples of image analysis of human skin images, and several applications exist, such as for medical diagnostic purposes and identification of individuals.
  • US Patent 4,699, 149 to Rice disclose apparatus for the identification of individuals by scanning a region of the skin to detect the position of subcutaneous blood vessels by measurement of a parameter such as the reflection of incident radiation.
  • US Patent 5,241 ,468 to Kenet there is disclosed an apparatus for spectrally enhancing the image of the skin, to detect melanoma or other conditions creating a dermal pigment.
  • the apparatus includes means for increasing the color saturation.
  • US Patent 5, 195, 145 to Backus et al discloses apparatus and methods to scan and record the skin surface topography, and can be used to scan fingerprints for identification purposes.
  • US Patent 5, 130,935 to Takiguchi discloses color image processing apparatus for correcting the color image in a region on a representative value and measured quantity.
  • US Patent 4,947,443 to Costello discloses a method of fingerprint scanning to verify a person's identity relative to topographically-related physical skin surface characteristics.
  • US Patent 4,805,233 to Denyer discloses a skin-pattern recognition method and device for authenticating a person by comparing information taken from current and previous skin images.
  • US Patents 3,668,633 and 3,614,737 to Sadowsky disclose an apparatus for identifying an individual by a linear light scanner producing a shadow effect unique to the individual.
  • a designated skin area is positively oriented to improve accuracy.
  • Melanoma one of the less common forms of skin cancer, also claims the highest rate of fatalities. In the US alone, about 600,000 white males contract skin cancer every year, and about 1 % die of the disease. Melanoma accounts for 75 % of skin cancer related deaths, based on National Cancer Institute data. Melanoma progresses via several stages, beginning with external changes in the shape or color of existing spots or moles, at which stage it is possible to successfully treat 99% of the cases. At a more developed stage, the cancerous cells penetrate the lymphatic system, eventually entering the blood system and organs. At these later stages, recovery rates are very poor, while at the earlier stages, proper detection leads to high recovery rates. High-risk victims include fair skinned people in warm climates.
  • Diagnosis and treatment of melanoma are characterized by stages which include identification of the external signs, such as changes in the size or color of an existing spot or mole. After examination by a family doctor, the patient is referred to a dermatologist or plastic surgeon for further examination, where the mole appears suspicious, these specialists will either keep it under observation, or call for biopsy to be performed.
  • US Patent 5,291 ,889 to Kenet discloses an apparatus for positioning a live body surface image in relation to a stored image to allow for observation over time for diagnostic purposes. A comparison of the images over time is critical for proper diagnosis of the patient, and the Kenet patent allows for an operator to perform alignment of a real and stored image. However, this alignment procedure is performed manually, and is complicated by the need to superimpose, intermingle or juxtapose the images. Therefore, the procedure is time-consuming and costly.
  • a dermal diagnostic analysis system comprising: an imaging element for capturing an image of a skin region; a processing element for converting the captured image to digital image information for analysis, display and storage; and a display element for displaying the digital image information, wherein the digital image information is provided on the display element as border outline of a dark area within the skin region in accordance with a pre-defined set of parameters, the digital image information including aspects of the displayed border outline such as its contour, and skin color variations of the area along a pre-selected section line segment, wherein the skin color variations are normalized with respect to a reference portion of the captured skin region image.
  • the dermal diagnostic analysis system is provided as a combination of a high resolution digital camera, computer processor and data storage facility, and color screen display.
  • the camera is focused on a region of interest on the skin of a patient, such as a spot, mole or lesion, and the computer processor receives the captures image.
  • the displayed image comprises digital image information which provides a border outline of a dark area on the skin in accordance with a pre-defined set of parameters.
  • border outline is analyzed for certain aspects of its contour, such as the size and largest distance between two points thereon, and the skin color variation along a pre-selected section line segment.
  • the digital image information can also be analyzed with respect to the asymmetrical shape of the lesion, and irregularity of its contour.
  • a histogram can be developed for the color components appearing in a chosen skin area.
  • the invention provides a comprehensive solution to the problems encountered by skin diagnostic specialists, in maintaining a consistent set of visual images for observations over time, so as to properly diagnose visual changes in the skin.
  • the system provides acquisition and storage of patient images, using the digital camera to provide direct conversion of patient images, without intermediary scanning. Color constancy is maintained despite varying lighting conditions via normalization of the color components of the image with respect to the reference color label, having a fixed size.
  • a full-featured image database management facility is integral to the system.
  • the inventive system is an advanced tool which provides a comprehensive diagnostic picture, including contour analysis, color component analysis, and a rate of change analysis.
  • patient image data can be tracked over time and successive images of the same lesion can be examined side-by-side, or by overlay techniques, with zoom close-up views.
  • the diagnostic analysis can be performed by quantifying the visual appearance of the lesion over a range of criteria. These measurements can be analyzed for diagnostic significance using graphic displays. A list of relevant diagnostic and treatment options can be displayed, specific to the configuration observed. The analysis can be customized to reflect recent research methods, or previous experience in clinical treatments.
  • FIG. 1 is a schematic block diagram of a dermal diagnostic analysis system constructed and operated in accordance with the principles of the present invention
  • FIG. 2 is an illustration of the physical layout of the Fig.1 system, showing a specialist taking a patient's skin image;
  • FIG. 3 illustrates a typical system display screen
  • FIG. 4 shows a flowchart for establishing the border outline around the dark area on the skin
  • FIG. 5 shows a flowchart for finding the closed list of adjacent border points around the lesion area on the skin
  • FIG. 6 shows a flowchart for finding the degree of asymmetry associated with the skin image
  • FIG. 7 shows a flow chart for finding the degree of irregularity of the skin lesion
  • FIGs. 8-9 show, respectively, a typical display screen of a skin image, and a graphical representation of a color distribution analysis performed on the image;
  • FIG. 10 shows a histogram representation of he parameters of interest relating to a skin lesion under study;
  • FIGs. 1 1-12 illustrate typical display screens of a skin image, respectively, showing former and more recent versions of the skin area under study;
  • FIG. 13a-b illustrate a combined flowchart for finding the number of lesions on a particular skin region, and their related characteristic parameters;
  • FIG. 14 illustrates a flowchart for identifying and locating the label which is used to calibrate the image
  • FIG. 15 illustrates a flowchart for color correction.
  • FIG. 16 is a schematic illustration of another embodiment of a dermal diagnostic analysis system according to the present invention.
  • the present invention relates to dermal diagnostic analysis system and method for quantifying the visual appearance of skin disorders.
  • System 10 preferably comprises a high-resolution digital camera 12, such as kodak 5 DCS 420, the camera having a lens 13, a computer processor 14 such as a personal computer having 32 MB RAM with a 1.3 GB Hard Disc, and high speed processor, such as Intel Pentium.
  • a high-resolution digital camera 12 such as kodak 5 DCS 420
  • the camera having a lens 13
  • a computer processor 14 such as a personal computer having 32 MB RAM with a 1.3 GB Hard Disc, and high speed processor, such as Intel Pentium.
  • standard computer peripherals such as mouse 16, color display screen 18, and keyboard 20 are connected to computer 14.
  • computer 14 such as a personal computer having 32 MB RAM with a 1.3 GB Hard Disc
  • 10 14 is an optical disc drive 22, having a 230 MB storage capacity.
  • An external system memory 24 is connected to drive 22.
  • FIG. 2 there is illustrated a physical layout of the inventive dermal diagnostic analysis system 10.
  • Camera 12 is fcv used on a region of interest on the skin of a patient 28, such as a spot 28, mole or lesion,
  • each data point in the bitmap file contains information relating to three color components for representing the skin image. These colors are typically chosen as red, green and blue (RGB) .
  • a calibration subsystem for two-dimensional scaling of the skin image, independent of the camera photo angle or patient pose and distance from the camera.
  • the calibration subsystem also provides color correction of the skin image. In order to achieve this, there is placed a
  • label 30 having reference colors on the skin area under study.
  • the label 30 forms part of the captured image and is processed together with the skin image.
  • the reference color label 30 enables system 10 to maintain color uniformity of the displayed skin image, despite differences in lighting conditions. This is especially useful when the health specialist 32 takes several images of the skin over a period of time, for repeatable observation of the skin condition.
  • the calibration subsystem automatically locates the reference color label 30 within the skin image, by execution of a search algorithm (see flowchart, Fig. 14). The two-dimensional scaling of the image is then performed, and color correction is then performed by execution of the algorithm shown in Fig. 15.
  • a typical display screen of a skin image 35 comprising digital image information which provides a border outline of a dark area on the skin in accordance with a pre-defined set of parameters.
  • the border outline is analyzed for certain aspects of its contour, such as the size and largest distance between two points thereon, and the skin color variations along a preselected section line segment.
  • a “sliding" segment 37 of the display which enables the user to scan all the previously collected photographic images associated with a particular patient, to assist in choosing the image to be studied.
  • Fig. 4 there is shown a flowchart representing the computer processor 14 operation in establishing the border outline around the dark area on the skin.
  • the system initializes itself for processing the digital information contained in the bitmap of image points provided with the captured image.
  • the color range of interest is defined by selecting points PI , P2 within the image bitmap.
  • a line L is defined along which the bitmap is searched to find the border of the image, starting with point PI to the image edge.
  • processor 14 reads the next border point along line L into variable "a” .
  • decision block 50 it is determined whether point "a" is inside the bitmap, and if "NO", no border has been found, since the lesion must be inside the bitmap.
  • block 54 operates to find a closed list of adjacent border points including point "a” .
  • decision block 56 it is determined whether the closed list surrounds points PI , P2. If “NO” , the system repeats the search procedure in block 48. If “YES”, the list of border points is displayed as the lesion border.
  • Fig. 5 there is shown a flowchart representing the computer processor 14 operation in finding the closed list of adjacent border points around the lesion area on the skin.
  • the algorithm finds several closed lists of border points and chooses from them the closed list which surrounds the area of interest.
  • An auxiliary list "options” is used to ignore irrelevant border points which are connected to the list.
  • a list L is defined in block 62 as the list of adjacent border points, and in block 64, the first border outline point "a" is stored in list L.
  • point "a” is marked as an occupied point
  • the group of unoccupied points surrounding "a” are defined as belonging to "A” .
  • decision block 70 a query is made to see if set "A" is empty, and if not, in block 72, a point “c” is chosen from the group “A".
  • block 74 to an auxiliary list “options” there are added all points in "A” excluding "c” .
  • point "a” is set to contain “c” , and operation returns to block 64, where point "a” is stored in list L, and the operation continues.
  • decision block 70 if set "A" is empty, decision block 78 is entered, and if the list L is completed, it is transferred to output in block 80. If not, in block 82, there is inserted into “b” the last point in list “options” which is not “a” .
  • the list L is truncated in block 84 by removing all points non-adjacent to "b” , and in block 86, all the removed points are marked as unoccupied.
  • block 88 "a” is set to contain “b” , and operation returns to block 64, where point "a” is stored in list L, and then operation continues.
  • the skin lesions may be represented by an image in which the borders are unclear, and thus it will be difficult for the algorithms of Figs. 4-5 to determine the border automatically via the bitmap.
  • the dermal diagnostic analysis system 10 is provided with a manual method of drawing the border outline on display screen 18 using the mouse 16 under control of computer 14. Once this is done, the standard image parameters can be analyzed as with the border outline achieved via automatic processing.
  • Fig. 6 there is shown a flowchart representing the computer processor 14 operation in finding the degree of asymmetry associated with the skin image.
  • start block 90 a search is made in the list of adjacent border points to find two points Po, PI which are spaced apart a maximum distance.
  • the lesion area is computed, and stored in "S" .
  • SI is used to hold the value of the lesion area under a section line extending between Po and PI .
  • a variable S2 is used to hold the lesion area above the section line extending between Po and PI .
  • the asymmetry is computed according to the formula:
  • Fig. 7 there is shown a flowchart representing the computer processor 14 operation in finding the degree of irregularity of the skin lesion.
  • the lesion perimeter P is computed, and in block 106, the lesion diameter D is computed as the distance between points Po and PI , which were previously determined.
  • the lesion area is computed and is stored in "S”, and in block 110, the relationship for the measure of irregularity is given by the parameter: PD/4S.
  • Figs. 8-9 there are illustrated , respectively, a typical display screen of a skin image, and a graphical representation of a color distribution analysis performed on the image.
  • a section line Po-Pl is drawn on the skin image of Fig. 8, and the points along the section line corresponding to the data point in the bitmap file are selected for color distribution analysis.
  • the color distribution values are displayed graphically along the section line, and pointer 112 determines the location of point P in Fig. 8.
  • the color information is especially important for diagnostic purposes. For example, if the lesion is analyzed over time, changes in color distribution may be recognized, indicating activity in the skin lesion area, with diagnostic implications.
  • the dermal diagnostic analysis system 10 of the present invention features a calculation of the average color within the skin lesion (preferably based on the three color components RGB). In addition, the average color in the skin area nearby the lesion is also calculated. The average color value serves as a useful parameter in diagnostic efforts to monitor color changes in the lesion, which are distinguishable from color changes in the surrounding skin area, due to natural color changes, tanning, etc.
  • Fig. 10 there is illustrated a histogram representation of the parameters of interest in connection with a skin lesion under study.
  • This display feature enables comparison of these parameters over a period of time, such that during each visit to the dermatologist or other health professional, the parameters of the lesion can be viewed in relation to their time progression.
  • the parameters available for display in this fashion are: 1) area 2) perimeter
  • Display of the time progression of these parameters is an important aspect in the diagnostic method, since the skin lesion can be displayed over time and compared in relation to quantifiable data with verifiable dates.
  • Another method for of comparison of skin lesions can be achieved by applying the algorithm for finding the border outline in both the old and new skin images based on the same color range.
  • Figs. 11-12 there are illustrated typical display screens of a skin image which has been sampled to reduce its size.
  • Figs. 1 1- 12 respectively, there are shown former and more recent versions of the skin image and the area under study. This is an important aspect of the diagnostic technique since it enables early detection of new lesions or changes in existing ones.
  • the dermatologist or health professional can adjust the threshold value of color which determines which colors will comprise the lesions. The comparison between the bitmaps is based on this threshold value, to reveal changes in existing lesions, and detecting new ones.
  • the value selected for the color parameter is shown on the scale 120 under the display, and mouse 16 can be used to vary the value. As shown in Figs.
  • the dermal diagnostic analysis system 10 executes an algorithm (see flowchart in Figs. 13a-b) to find all the existing lesions, and display them in list 122 along with the related parameter values.
  • the dermatologist or health professional then supplies three image points for alignment of the old and new skin images.
  • the dermal diagnostic analysis system 10 can then find all the new lesions appearing in the new image, by comparing the lists of lesions generated with respect to the old and new images.
  • Fig. 13a there is shown a flowchart representing the computer processor 14 operation in finding the number of lesions on a particular region of the skin.
  • the algorithm detects and counts all the lesions in the area of interest.
  • the method of finding all of the points comprising a single lesion is explained in detail by the flowchart of Fig. 13b, where each lesion point is marked as occupied.
  • the operation begins in block 130, where each point in the image bit map is sequentially read.
  • block 132 a non-occupied point "a" is identified which is contained in a lesion, and in block 134, each point connected with "a" is read and marked occupied.
  • the lesion is added to the list of existing lesions and its characteristic parameters are read and stored.
  • a list L is defined as a search list of points, where each point includes, in addition to its coordinates x,y in the bitmap, the direction of toward the next point in the list.
  • the initial point "a” is inputted from the algorithm of Fig. 13a (block 134).
  • block 142 it is determined if there are neighboring points to "a" which are unoccupied and contained in a lesion. If there are, in block 144 the first neighbor point in the clockwise direction is stored in "b” . Point "a " is stored in list L in block 146, and marked as occupied.
  • point "b” is stored in “a” , and the search is continued from there. If block 142 determines that there are no unoccupied neighboring points to "a" contained in the lesion, block 150 checks whether the list L is empty , and if it is, in block 152 point "a” is marked occupied, and the routine ends in block 153. If L is not empty, in block 154, using point "a” the lesion parameters are updated. Finally, in block 156, the last point in list L is found and stored in "a”, and operation returns to block 142.
  • Fig. 14 there is shown a flowchart representing the computer processor 14 operation as part of the calibration subsystem, to identify and locate label 30.
  • the calibration system utilizes a label 30 having reference colors which s photographed and processed with the skin image, to enable two-dimensional scaling of the skin image, independent of the camera photo angle or patient pose and distance from the camera.
  • the calibration subsystem also provides color correction of the skin image.
  • label 30 is designed with a single black rectangle, and several gray rectangles. Based on this fact, the calibration subsystem is able to identify and detect the location of the label and perform the scaling and color correction functions.
  • K x K is defined as a constant representing the size of the pixel search box.
  • a search is conducted to find the ten darkest boxes in the image, and in block 164, the darkest unchecked box coordinates are placed in storage at "R" .
  • the color range of pixels in R is used to find the border outline of the image area containing R.
  • a local search routine is performed to identify the remaining gray rectangles of the label adjacent to the border outline found in the previous step.
  • the system calculates the size of the rectangles in it, and in accordance with the results of this calculation, the system establishes the pixel/mm ratio for scaling the vertical and horizontal directions separately. This ratio also allows appropriate correction of the image dimensions.
  • the color calibration of the stored image is performed by the calibration subsystem in relation to the known colors of the label 30, so that appropriate compensation is provided for lighting conditions, etc. which may tend to affect the picture.
  • a flowchart representing the computer processor 14 operation in providing color correction as part of the calibration subsystem In block 180, all the colors of the rectangles in the label are read sequentially, and in block 182, the gray level of the current and next rectangles are defined as GI and G2, where G2 > GI and there are no other gray levels of rectangles in between. In block 184, the actual gray levels of the current and next rectangles are defined as T(G1 ) and T(G2) , and in block 186, a new color value is defined as the variable NEWCOL (r). and its value is set in block 188 for each r value, where G I ⁇ r ⁇ G2, by the equation:
  • each point in the image bitmap is read, and in block 192, the gray level of each point is defined as "G" . Finally, in block 194, the color correction of each image bitmap point is made by multiplying the color correction factor NEWCOL(G) by the color value of each image bitmap point.
  • label 30 may feature any shape and size and may include any combination of reference colors.
  • a set of labels 30 is provided, each label featuring a specific shape and reference colors so as to enable to detect changes over time in the shape and color of an existing mole or lesion.
  • each label may feature a specific size so as to enable to accurately analyze skin regions of various sizes.
  • a label 30 of large dimensions allows to focus lens 13 of camera 12 on a larger skin region and to accurately monitor changes over time within such region, such as appearance of new moles and lesions.
  • label 30 preferably features a specific size for calibrating the size of spots within a skin region, thereby enabling to determine size changes of existing spots and appearance of new spots within the skin region.
  • the specific shapes, sizes and reference colors of labels 30 are adapted so as to enable monitoring of different forms of skin disorders as well as burns, injuries and the like.
  • a data base including information such as reference bitmaps and parameters relating to known pathological cases, for enabling the dermatologist to accurately diagnose the stage of the disease.
  • a diagnostic analysis system includes a lens 13 remotely connected to a digital camera 12 by means of a wire 15 so as to allow a patient to independently monitor the progress of the disease without the need to frequently visit a dermatologist. The results of such self- monitoring may be sent to the dermatologist for diagnosis. While the invention has been described with respect to a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of the invention may be made.

Abstract

Dermal diagnostic analysis system and method are provided which may be used for quantifying the visual appearance of skin disorders such as melanoma. The system comprises an imaging element (12) for capturing an image of a skin region; a processing element (14) for converting the captured image to digital image information for analysis, display and storage; and a display element (18) for displaying the digital image information, wherein the digital image information is provided on the display element as border outline of a dark area within the skin region in accordance with a predefined set of parameters; and the digital image information including aspects of the displayed border outline such as its contour, and skin color variations of the area along a pre-selected section line segment, wherein the skin color variations are normalized with respect to a reference portion of the captured skin region image.

Description

DERMAL DIAGNOSTIC ANALYSIS SYSTEM AND METHOD
FIELD AND BACKGROUND OF THE INVENTION
The present invention relates to medical diagnostic equipment and methods, and more particularly, to a dermal diagnostic analysis system and method employing digital analysis of skin photographs of patients to detect changes in lesions, moles, etc., per a pre-defined set of useful analysis parameters .
The prior art includes examples of image analysis of human skin images, and several applications exist, such as for medical diagnostic purposes and identification of individuals.
For example, US Patent 4,699, 149 to Rice disclose apparatus for the identification of individuals by scanning a region of the skin to detect the position of subcutaneous blood vessels by measurement of a parameter such as the reflection of incident radiation. In US Patent 5,241 ,468 to Kenet, there is disclosed an apparatus for spectrally enhancing the image of the skin, to detect melanoma or other conditions creating a dermal pigment. The apparatus includes means for increasing the color saturation.
In US Patent 5,230,025 to Fishbine et al, there is disclosed an identification image recording apparatus for generating data characteristics of fingerprints and recording them.
US Patent 5, 195, 145 to Backus et al discloses apparatus and methods to scan and record the skin surface topography, and can be used to scan fingerprints for identification purposes. US Patent 5, 130,935 to Takiguchi discloses color image processing apparatus for correcting the color image in a region on a representative value and measured quantity.
US Patent 4,947,443 to Costello discloses a method of fingerprint scanning to verify a person's identity relative to topographically-related physical skin surface characteristics. US Patent 4,805,233 to Denyer discloses a skin-pattern recognition method and device for authenticating a person by comparing information taken from current and previous skin images.
US Patents 3,668,633 and 3,614,737 to Sadowsky disclose an apparatus for identifying an individual by a linear light scanner producing a shadow effect unique to the individual. A designated skin area is positively oriented to improve accuracy.
Melanoma, one of the less common forms of skin cancer, also claims the highest rate of fatalities. In the US alone, about 600,000 white males contract skin cancer every year, and about 1 % die of the disease. Melanoma accounts for 75 % of skin cancer related deaths, based on National Cancer Institute data. Melanoma progresses via several stages, beginning with external changes in the shape or color of existing spots or moles, at which stage it is possible to successfully treat 99% of the cases. At a more developed stage, the cancerous cells penetrate the lymphatic system, eventually entering the blood system and organs. At these later stages, recovery rates are very poor, while at the earlier stages, proper detection leads to high recovery rates. High-risk victims include fair skinned people in warm climates. Diagnosis and treatment of melanoma are characterized by stages which include identification of the external signs, such as changes in the size or color of an existing spot or mole. After examination by a family doctor, the patient is referred to a dermatologist or plastic surgeon for further examination, where the mole appears suspicious, these specialists will either keep it under observation, or call for biopsy to be performed.
In about 85 % of cases of suspicious-looking spots and moles, the doctor is not sure whether to perform a biopsy or not. Because of the many parameters involved in visual observation of the changes in these skin disorders, it would be desirable to provide a tool to assist the doctor in making this determination. US Patent 5,291 ,889 to Kenet discloses an apparatus for positioning a live body surface image in relation to a stored image to allow for observation over time for diagnostic purposes. A comparison of the images over time is critical for proper diagnosis of the patient, and the Kenet patent allows for an operator to perform alignment of a real and stored image. However, this alignment procedure is performed manually, and is complicated by the need to superimpose, intermingle or juxtapose the images. Therefore, the procedure is time-consuming and costly.
Thus, it would be desirable to provide a simple, comprehensive and cost-effective system for identification and diagnosis of skin disorders, for use by skin specialists.
SUMMARY OF THE INVENTION
Accordingly, it is a principal object of the present invention to overcome the disadvantages associated with the complexity of prior art skin diagnostic systems, and provide a diagnostic analysis tool for quantifying the visual appearance of skin disorders over a range of criteria for analysis purposes.
In accordance with a preferred embodiment of the present invention, there is provided a dermal diagnostic analysis system comprising: an imaging element for capturing an image of a skin region; a processing element for converting the captured image to digital image information for analysis, display and storage; and a display element for displaying the digital image information, wherein the digital image information is provided on the display element as border outline of a dark area within the skin region in accordance with a pre-defined set of parameters, the digital image information including aspects of the displayed border outline such as its contour, and skin color variations of the area along a pre-selected section line segment, wherein the skin color variations are normalized with respect to a reference portion of the captured skin region image.
In a preferred embodiment, the dermal diagnostic analysis system is provided as a combination of a high resolution digital camera, computer processor and data storage facility, and color screen display. The camera is focused on a region of interest on the skin of a patient, such as a spot, mole or lesion, and the computer processor receives the captures image.
In the same skin region, there is placed a fixed size label having a reference color, which forms part of the captured image and is processed together with the skin image. The reference color label enables the system to maintain color uniformity and convey the actual dimensions of the displayed skin image, despite differences in lighting conditions and camera angle. Thus, when the health specialist takes several images of the skin over a period of time, respectable skin observation is achieved. The displayed image comprises digital image information which provides a border outline of a dark area on the skin in accordance with a pre-defined set of parameters. Thus border outline is analyzed for certain aspects of its contour, such as the size and largest distance between two points thereon, and the skin color variation along a pre-selected section line segment.
The digital image information can also be analyzed with respect to the asymmetrical shape of the lesion, and irregularity of its contour. A histogram can be developed for the color components appearing in a chosen skin area. The invention provides a comprehensive solution to the problems encountered by skin diagnostic specialists, in maintaining a consistent set of visual images for observations over time, so as to properly diagnose visual changes in the skin. The system provides acquisition and storage of patient images, using the digital camera to provide direct conversion of patient images, without intermediary scanning. Color constancy is maintained despite varying lighting conditions via normalization of the color components of the image with respect to the reference color label, having a fixed size. A full-featured image database management facility is integral to the system. Thus the inventive system is an advanced tool which provides a comprehensive diagnostic picture, including contour analysis, color component analysis, and a rate of change analysis.
Using the system, patient image data can be tracked over time and successive images of the same lesion can be examined side-by-side, or by overlay techniques, with zoom close-up views. The diagnostic analysis can be performed by quantifying the visual appearance of the lesion over a range of criteria. These measurements can be analyzed for diagnostic significance using graphic displays. A list of relevant diagnostic and treatment options can be displayed, specific to the configuration observed. The analysis can be customized to reflect recent research methods, or previous experience in clinical treatments.
Other features and advantages of the invention will become apparent from the following drawings and description.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention is herein described, by way of example only, with reference to the accompanying drawings, wherein:
FIG. 1 is a schematic block diagram of a dermal diagnostic analysis system constructed and operated in accordance with the principles of the present invention;
FIG. 2 is an illustration of the physical layout of the Fig.1 system, showing a specialist taking a patient's skin image;
FIG. 3 illustrates a typical system display screen;
FIG. 4 shows a flowchart for establishing the border outline around the dark area on the skin; FIG. 5 shows a flowchart for finding the closed list of adjacent border points around the lesion area on the skin;
FIG. 6 shows a flowchart for finding the degree of asymmetry associated with the skin image; FIG. 7 shows a flow chart for finding the degree of irregularity of the skin lesion;
FIGs. 8-9 show, respectively, a typical display screen of a skin image, and a graphical representation of a color distribution analysis performed on the image; FIG. 10 shows a histogram representation of he parameters of interest relating to a skin lesion under study;
FIGs. 1 1-12 illustrate typical display screens of a skin image, respectively, showing former and more recent versions of the skin area under study; FIG. 13a-b illustrate a combined flowchart for finding the number of lesions on a particular skin region, and their related characteristic parameters;
FIG. 14 illustrates a flowchart for identifying and locating the label which is used to calibrate the image; and FIG. 15 illustrates a flowchart for color correction.
FIG. 16 is a schematic illustration of another embodiment of a dermal diagnostic analysis system according to the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention relates to dermal diagnostic analysis system and method for quantifying the visual appearance of skin disorders.
Although the invention is herein described with reference to melanoma, it may be used for quantifying and monitoring other forms of skin disorders such as psoriasis as well as burns, injuries and the like. Referring now to Fig. 1 , there is shown a schematic block diagram of a dermal diagnostic analysis system 10 constructed and operated in accordance with the principles of the present invention. System 10 preferably comprises a high-resolution digital camera 12, such as kodak 5 DCS 420, the camera having a lens 13, a computer processor 14 such as a personal computer having 32 MB RAM with a 1.3 GB Hard Disc, and high speed processor, such as Intel Pentium. Preferably, standard computer peripherals such as mouse 16, color display screen 18, and keyboard 20 are connected to computer 14. Also connected to computer
10 14 is an optical disc drive 22, having a 230 MB storage capacity. An external system memory 24 is connected to drive 22.
In Fig. 2, there is illustrated a physical layout of the inventive dermal diagnostic analysis system 10. Camera 12 is fcv used on a region of interest on the skin of a patient 28, such as a spot 28, mole or lesion,
15 and computer processor 14 receives the captured image, by data acquisition of a bitmap file. Preferably, each data point in the bitmap file contains information relating to three color components for representing the skin image. These colors are typically chosen as red, green and blue (RGB) .
20 As part of the novel design of dermal diagnostic analysis system 10, there is provided a calibration subsystem for two-dimensional scaling of the skin image, independent of the camera photo angle or patient pose and distance from the camera. The calibration subsystem also provides color correction of the skin image. In order to achieve this, there is placed a
25 label 30 having reference colors on the skin area under study. The label 30 forms part of the captured image and is processed together with the skin image. The reference color label 30 enables system 10 to maintain color uniformity of the displayed skin image, despite differences in lighting conditions. This is especially useful when the health specialist 32 takes several images of the skin over a period of time, for repeatable observation of the skin condition.
The calibration subsystem automatically locates the reference color label 30 within the skin image, by execution of a search algorithm (see flowchart, Fig. 14). The two-dimensional scaling of the image is then performed, and color correction is then performed by execution of the algorithm shown in Fig. 15.
In Fig. 3, there is illustrated a typical display screen of a skin image 35, comprising digital image information which provides a border outline of a dark area on the skin in accordance with a pre-defined set of parameters. The border outline is analyzed for certain aspects of its contour, such as the size and largest distance between two points thereon, and the skin color variations along a preselected section line segment.
As shown at the bottom of Fig. 3, there is a "sliding" segment 37 of the display which enables the user to scan all the previously collected photographic images associated with a particular patient, to assist in choosing the image to be studied.
In Fig. 4, there is shown a flowchart representing the computer processor 14 operation in establishing the border outline around the dark area on the skin. In start block 40, the system initializes itself for processing the digital information contained in the bitmap of image points provided with the captured image. In block 44, the color range of interest is defined by selecting points PI , P2 within the image bitmap. In block 46, a line L is defined along which the bitmap is searched to find the border of the image, starting with point PI to the image edge. In block 48, processor 14 reads the next border point along line L into variable "a" . In decision block 50, it is determined whether point "a" is inside the bitmap, and if "NO", no border has been found, since the lesion must be inside the bitmap. If "YES" , block 54 operates to find a closed list of adjacent border points including point "a" . In decision block 56, it is determined whether the closed list surrounds points PI , P2. If "NO" , the system repeats the search procedure in block 48. If "YES", the list of border points is displayed as the lesion border.
In Fig. 5, there is shown a flowchart representing the computer processor 14 operation in finding the closed list of adjacent border points around the lesion area on the skin. The algorithm finds several closed lists of border points and chooses from them the closed list which surrounds the area of interest. An auxiliary list "options" is used to ignore irrelevant border points which are connected to the list. After start block 60, a list L is defined in block 62 as the list of adjacent border points, and in block 64, the first border outline point "a" is stored in list L. In block 66, point "a" is marked as an occupied point, and in block 68, the group of unoccupied points surrounding "a" are defined as belonging to "A" . In decision block 70, a query is made to see if set "A" is empty, and if not, in block 72, a point "c" is chosen from the group "A". In block 74, to an auxiliary list "options" there are added all points in "A" excluding "c" . In block 76, point "a" is set to contain "c" , and operation returns to block 64, where point "a" is stored in list L, and the operation continues.
In decision block 70, if set "A" is empty, decision block 78 is entered, and if the list L is completed, it is transferred to output in block 80. If not, in block 82, there is inserted into "b" the last point in list "options" which is not "a" . The list L is truncated in block 84 by removing all points non-adjacent to "b" , and in block 86, all the removed points are marked as unoccupied. In block 88, "a" is set to contain "b" , and operation returns to block 64, where point "a" is stored in list L, and then operation continues.
As will be appreciated by those skilled in the art, the skin lesions may be represented by an image in which the borders are unclear, and thus it will be difficult for the algorithms of Figs. 4-5 to determine the border automatically via the bitmap. For this situation, the dermal diagnostic analysis system 10 is provided with a manual method of drawing the border outline on display screen 18 using the mouse 16 under control of computer 14. Once this is done, the standard image parameters can be analyzed as with the border outline achieved via automatic processing.
In Fig. 6, there is shown a flowchart representing the computer processor 14 operation in finding the degree of asymmetry associated with the skin image. Once the border outline points have been calculated per the flowchart in Figs. 4-5, these are provided in start block 90. In block 92, a search is made in the list of adjacent border points to find two points Po, PI which are spaced apart a maximum distance. In block 94, the lesion area is computed, and stored in "S" . In block 96, a variable SI is used to hold the value of the lesion area under a section line extending between Po and PI . In block 98, a variable S2 is used to hold the lesion area above the section line extending between Po and PI . In block 100, the asymmetry is computed according to the formula:
|5i -52jxl00
This parameter gives an indication of degree of lesion asymmetry. In Fig. 7, there is shown a flowchart representing the computer processor 14 operation in finding the degree of irregularity of the skin lesion. In block 104, the lesion perimeter P is computed, and in block 106, the lesion diameter D is computed as the distance between points Po and PI , which were previously determined. In block 108, the lesion area is computed and is stored in "S", and in block 110, the relationship for the measure of irregularity is given by the parameter: PD/4S.
In Figs. 8-9, there are illustrated , respectively, a typical display screen of a skin image, and a graphical representation of a color distribution analysis performed on the image. Using the computer 14 and mouse 16, a section line Po-Pl is drawn on the skin image of Fig. 8, and the points along the section line corresponding to the data point in the bitmap file are selected for color distribution analysis. As shown in Fig. 9, The color distribution values are displayed graphically along the section line, and pointer 112 determines the location of point P in Fig. 8. The color information is especially important for diagnostic purposes. For example, if the lesion is analyzed over time, changes in color distribution may be recognized, indicating activity in the skin lesion area, with diagnostic implications. The dermal diagnostic analysis system 10 of the present invention features a calculation of the average color within the skin lesion (preferably based on the three color components RGB). In addition, the average color in the skin area nearby the lesion is also calculated. The average color value serves as a useful parameter in diagnostic efforts to monitor color changes in the lesion, which are distinguishable from color changes in the surrounding skin area, due to natural color changes, tanning, etc.
In Fig. 10, there is illustrated a histogram representation of the parameters of interest in connection with a skin lesion under study. This display feature enables comparison of these parameters over a period of time, such that during each visit to the dermatologist or other health professional, the parameters of the lesion can be viewed in relation to their time progression. Preferably, the parameters available for display in this fashion are: 1) area 2) perimeter
3) diameter
4) color
5) asymmetry 6) irregularity
Display of the time progression of these parameters is an important aspect in the diagnostic method, since the skin lesion can be displayed over time and compared in relation to quantifiable data with verifiable dates. Another method for of comparison of skin lesions can be achieved by applying the algorithm for finding the border outline in both the old and new skin images based on the same color range.
In Figs. 11-12, there are illustrated typical display screens of a skin image which has been sampled to reduce its size. In Figs. 1 1- 12, respectively, there are shown former and more recent versions of the skin image and the area under study. This is an important aspect of the diagnostic technique since it enables early detection of new lesions or changes in existing ones. The dermatologist or health professional can adjust the threshold value of color which determines which colors will comprise the lesions. The comparison between the bitmaps is based on this threshold value, to reveal changes in existing lesions, and detecting new ones. The value selected for the color parameter is shown on the scale 120 under the display, and mouse 16 can be used to vary the value. As shown in Figs. 1 1-12, changes in the existing lesions (1-8) can be seen and compared, and new lesion (9) can be detected. After the threshold value is adjusted, the dermal diagnostic analysis system 10 executes an algorithm (see flowchart in Figs. 13a-b) to find all the existing lesions, and display them in list 122 along with the related parameter values.
The dermatologist or health professional then supplies three image points for alignment of the old and new skin images. The dermal diagnostic analysis system 10 can then find all the new lesions appearing in the new image, by comparing the lists of lesions generated with respect to the old and new images.
In Fig. 13a, there is shown a flowchart representing the computer processor 14 operation in finding the number of lesions on a particular region of the skin. The algorithm detects and counts all the lesions in the area of interest. The method of finding all of the points comprising a single lesion is explained in detail by the flowchart of Fig. 13b, where each lesion point is marked as occupied. In Fig. 13a, the operation begins in block 130, where each point in the image bit map is sequentially read. In block 132, a non-occupied point "a" is identified which is contained in a lesion, and in block 134, each point connected with "a" is read and marked occupied. In block 136, the lesion is added to the list of existing lesions and its characteristic parameters are read and stored.
In Fig. 13b, there is shown a flowchart representing the computer processor 14 operation in scanning the connectivity component of point "a" . In block 138, a list L is defined as a search list of points, where each point includes, in addition to its coordinates x,y in the bitmap, the direction of toward the next point in the list. In block 140, the initial point "a" is inputted from the algorithm of Fig. 13a (block 134). In block 142, it is determined if there are neighboring points to "a" which are unoccupied and contained in a lesion. If there are, in block 144 the first neighbor point in the clockwise direction is stored in "b" . Point "a " is stored in list L in block 146, and marked as occupied. In block 148, point "b" is stored in "a" , and the search is continued from there. If block 142 determines that there are no unoccupied neighboring points to "a" contained in the lesion, block 150 checks whether the list L is empty , and if it is, in block 152 point "a" is marked occupied, and the routine ends in block 153. If L is not empty, in block 154, using point "a" the lesion parameters are updated. Finally, in block 156, the last point in list L is found and stored in "a", and operation returns to block 142.
In Fig. 14, there is shown a flowchart representing the computer processor 14 operation as part of the calibration subsystem, to identify and locate label 30. As stated previously, the calibration system utilizes a label 30 having reference colors which s photographed and processed with the skin image, to enable two-dimensional scaling of the skin image, independent of the camera photo angle or patient pose and distance from the camera. The calibration subsystem also provides color correction of the skin image.
Preferably, label 30 is designed with a single black rectangle, and several gray rectangles. Based on this fact, the calibration subsystem is able to identify and detect the location of the label and perform the scaling and color correction functions. In block 160, K x K is defined as a constant representing the size of the pixel search box. In block 162, a search is conducted to find the ten darkest boxes in the image, and in block 164, the darkest unchecked box coordinates are placed in storage at "R" . In block 166, the color range of pixels in R is used to find the border outline of the image area containing R. In block 168, a local search routine is performed to identify the remaining gray rectangles of the label adjacent to the border outline found in the previous step.
Assuming all the gray rectangles of the label were found, in block 170, then in block 172, the label is identified, and the procedure ends in block 174. If not, this indicates that the label was not found, and the procedure returns to block 164, to continue examining the existing group of ten darkest boxes.
After the automatic identification of the label, the system calculates the size of the rectangles in it, and in accordance with the results of this calculation, the system establishes the pixel/mm ratio for scaling the vertical and horizontal directions separately. This ratio also allows appropriate correction of the image dimensions.
The color calibration of the stored image is performed by the calibration subsystem in relation to the known colors of the label 30, so that appropriate compensation is provided for lighting conditions, etc. which may tend to affect the picture.
In Fig. 15, there is shown a flowchart representing the computer processor 14 operation in providing color correction as part of the calibration subsystem. In block 180, all the colors of the rectangles in the label are read sequentially, and in block 182, the gray level of the current and next rectangles are defined as GI and G2, where G2 > GI and there are no other gray levels of rectangles in between. In block 184, the actual gray levels of the current and next rectangles are defined as T(G1 ) and T(G2) , and in block 186, a new color value is defined as the variable NEWCOL (r). and its value is set in block 188 for each r value, where G I ≤ r ≤ G2, by the equation:
- χ[T(Gl) +-^- χ<T(G2) -T(G1))] r L2 -LI
In block 190, each point in the image bitmap is read, and in block 192, the gray level of each point is defined as "G" . Finally, in block 194, the color correction of each image bitmap point is made by multiplying the color correction factor NEWCOL(G) by the color value of each image bitmap point.
According to further features of the preferred embodiments, label 30 may feature any shape and size and may include any combination of reference colors. Preferably, when using the present invention for monitoring melanoma, a set of labels 30 is provided, each label featuring a specific shape and reference colors so as to enable to detect changes over time in the shape and color of an existing mole or lesion. Further, each label may feature a specific size so as to enable to accurately analyze skin regions of various sizes. For example, a label 30 of large dimensions allows to focus lens 13 of camera 12 on a larger skin region and to accurately monitor changes over time within such region, such as appearance of new moles and lesions. According to the present invention, label 30 preferably features a specific size for calibrating the size of spots within a skin region, thereby enabling to determine size changes of existing spots and appearance of new spots within the skin region.
Further according to the present invention, the specific shapes, sizes and reference colors of labels 30 are adapted so as to enable monitoring of different forms of skin disorders as well as burns, injuries and the like.
Further according to the present invention there is provided a data base including information such as reference bitmaps and parameters relating to known pathological cases, for enabling the dermatologist to accurately diagnose the stage of the disease.
According to another embodiment (FIG. 16), a diagnostic analysis system according to the present invention includes a lens 13 remotely connected to a digital camera 12 by means of a wire 15 so as to allow a patient to independently monitor the progress of the disease without the need to frequently visit a dermatologist. The results of such self- monitoring may be sent to the dermatologist for diagnosis. While the invention has been described with respect to a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of the invention may be made.

Claims

WHAT IS CLAIMED IS:
1 . A dermal diagnostic analysis system comprising:
(a) an imaging element for capturing an image of a skin region;
(b) a processing element for converting said captured image to digital image information for analysis, display and storage; and
(c) a display element for displaying said digital image information, wherein said digital image information is provided on said display element as a border outline of a dark area within said skin region in accordance with a pre-defined set of parameters, said digital image information including aspects of said displayed border outline such as its contour, and skin color variations of said area along a preselected section line segment, wherein said skin color variations are normalized with respect to a reference portion of said captured skin region image.
2. A dermal diagnostic analysis system comprising:
(a) an imaging element for capturing an image of a skin region;
(b) a processing element for converting said captured image to digital image information; and
(c) a display element for displaying said digital image information, said digital image information including skin color variations within said skin region, wherein said skin color variations are normalized with respect to a reference portion of said captured skin region.
3. The dermal diagnostic analysis system of claim 2, wherein said reference portion is a detachable label having reference colors.
4. The dermal diagnostic analysis system of claim 2, wherein said reference portion is a detachable label having a specific shape.
5. The dermal diagnostic analysis system of claim 2, wherein said reference portion is a detachable label having a specific size.
6. The dermal diagnostic analysis system of claim 2, wherein said imaging element includes a camera having a lens remotely connected thereto.
7. The dermal diagnostic analysis system of claim 2, wherein said processing element includes a storage element for storing said digital image information.
8. The dermal diagnostic analysis system of claim 7, wherein said reference portion is a detachable label having reference colors for enabling monitoring of color changes of a spot within said skin region.
9. The dermal diagnostic analysis system of claim 7, wherein said reference portion is a detachable label having a specific shape for enabling monitoring of shape changes of a spot within said skin region.
10. The dermal diagnostic analysis system of claim 7, wherein said reference portion is a detachable label having a specific size for calibrating the size of spots within said skin region, thereby enabling to determine size changes of existing spots and appearance of new spots within said skin region.
11 . A method for dermal diagnostic analysis, comprising: (a) capturing an image of a skin region by means of an imaging element;
(b) converting said captured image to digital image information by means of a processing element; and
(c) normalizing said digital information with respect to a reference portion of said capmred skin region.
12. The method of claim 11 , further comprising: displaying said digital image information on a display element.
13. The method of claim 11 , further comprising: storing said digital image information.
14. The method of claim 13, further comprising: comparing a first digital image information with a second digital image information.
15. The method of claim 14, wherein said first and second digital image information relate to a former and more recent captured images of a skin region, thereby enabling to detect changes over time within said skin region.
16. The method of claim 15, wherein said reference portion is a detachable label having reference colors for enabling monitoring of color changes of a spot within said skin region.
17. The method of claim 15, wherein said reference portion is a detachable label having a specific shape for enabling monitoring of shape changes of a spot within said skin region.
18. The method of claim 15, wherein said reference portion is a detachable label having a specific size for calibrating the size of spots within said skin region, thereby enabling to determine size changes of existing spots and appearance of new spots within said skin region.
PCT/IL1997/000187 1996-06-11 1997-06-10 Dermal diagnostic analysis system and method WO1997047235A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP97925253A EP0904007A4 (en) 1996-06-11 1997-06-10 Dermal diagnostic analysis system and method
AU30455/97A AU3045597A (en) 1996-06-11 1997-06-10 Dermal diagnostic analysis system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IL11863496A IL118634A0 (en) 1996-06-11 1996-06-11 Dermal imaging diagnostic analysis system and method
IL118634 1996-06-11

Publications (1)

Publication Number Publication Date
WO1997047235A1 true WO1997047235A1 (en) 1997-12-18

Family

ID=11068959

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL1997/000187 WO1997047235A1 (en) 1996-06-11 1997-06-10 Dermal diagnostic analysis system and method

Country Status (5)

Country Link
EP (1) EP0904007A4 (en)
AU (1) AU3045597A (en)
CA (1) CA2258124A1 (en)
IL (1) IL118634A0 (en)
WO (1) WO1997047235A1 (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000076398A1 (en) * 1999-06-14 2000-12-21 The Procter & Gamble Company Skin imaging and analysis systems and methods
EP1078598A1 (en) * 1999-08-27 2001-02-28 Institut für Neurosimulation und Bildtechnologien GmbH Method and device for classifying skin anomalies, in particular melanoma
DE10021431A1 (en) * 2000-05-03 2001-11-22 Inst Neurosimulation Und Bildt Method and device for classifying optically observable skin or mucosal changes
GB2364567A (en) * 2000-07-07 2002-01-30 Astron Clinica Ltd Determining distribution of chromophores in skin or other epithelial tissue
WO2002036002A1 (en) 2000-11-01 2002-05-10 3M Innovative Properties Company Electrical sensing and/or signal application device
WO2002065069A2 (en) * 2000-11-07 2002-08-22 Hypermed, Inc. Hyperspectral imaging calibration device
WO2002094098A1 (en) * 2001-05-18 2002-11-28 Polartechnics Limited Diagnostic feature extraction in dermatological examination
WO2002094097A1 (en) * 2001-05-18 2002-11-28 Polartechnics Limited Boundary finding in dermatological examination
US6907193B2 (en) 2001-11-08 2005-06-14 Johnson & Johnson Consumer Companies, Inc. Method of taking polarized images of the skin and the use thereof
US6922523B2 (en) 2001-11-08 2005-07-26 Johnson & Johnson Consumer Companies, Inc. Method of promoting skin care products
US6961517B2 (en) 2001-11-08 2005-11-01 Johnson & Johnson Consumer Companies, Inc. Method of promoting skin care products
US6993167B1 (en) 1999-11-12 2006-01-31 Polartechnics Limited System and method for examining, recording and analyzing dermatological conditions
US7006657B2 (en) 2000-12-21 2006-02-28 L'oreal S.A. Methods for enabling evaluation of typological characteristics of external body portion, and related devices
WO2006078902A2 (en) * 2005-01-19 2006-07-27 Dermaspect, Llc Devices and methods for identifying and monitoring changes of a suspect area on a patient
AU2002308394B2 (en) * 2001-05-18 2006-11-23 Polartechnics Limited Boundary finding in dermatological examination
US20080260218A1 (en) * 2005-04-04 2008-10-23 Yoav Smith Medical Imaging Method and System
WO2008150343A1 (en) * 2007-05-22 2008-12-11 Eastman Kodak Company Monitoring physiological conditions
EP2063775A2 (en) * 2006-09-19 2009-06-03 KCI Licensing, Inc. System and method for tracking healing progress of tissue
US7558416B2 (en) 2006-10-02 2009-07-07 Johnson & Johnson Consumer Companies, Inc. Apparatus and method for measuring photodamage to skin
ES2334307A1 (en) * 2008-04-11 2010-03-08 Catfosc.Health Made To Measure, S. L. Device for monitoring surface alterations over time and method associated therewith
US7738032B2 (en) 2001-11-08 2010-06-15 Johnson & Johnson Consumer Companies, Inc. Apparatus for and method of taking and viewing images of the skin
US8026942B2 (en) 2004-10-29 2011-09-27 Johnson & Johnson Consumer Companies, Inc. Skin imaging system with probe
US8107696B2 (en) 2006-10-02 2012-01-31 Johnson & Johnson Consumer Companies, Inc. Calibration apparatus and method for fluorescent imaging
US8189887B2 (en) 2006-10-02 2012-05-29 Johnson & Johnson Consumer Companies, Inc. Imaging standard apparatus and method
US20160275681A1 (en) * 2015-03-18 2016-09-22 Canfield Scientific, Incorporated Methods and apparatus for identifying skin features of interest
EP3222215A4 (en) * 2014-11-19 2018-09-05 Shiseido Company, Ltd. Stain evaluation device, stain evaluation method, and program
US20190347434A1 (en) * 2015-07-20 2019-11-14 Notarize, Inc. System and method for validating authorship of an electronic signature session
US10765592B2 (en) 2006-09-19 2020-09-08 Kci Licensing, Inc. System and method for determining a fill status of a canister of fluid in a reduced pressure treatment system
US10806835B2 (en) 2006-09-19 2020-10-20 Kci Licensing, Inc. Reduced pressure treatment system having blockage clearing and dual-zone pressure protection capabilities
US11229732B2 (en) 2006-09-19 2022-01-25 Kci Licensing, Inc. System and method for locating fluid leaks at a drape of a reduced pressure delivery system

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3668633A (en) 1970-01-29 1972-06-06 Dactylog Co Orientation and linear scan device for use in an apparatus for individual recognition
US4699149A (en) 1984-03-20 1987-10-13 Joseph Rice Apparatus for the identification of individuals
US4805233A (en) 1986-06-10 1989-02-14 Daimler-Benz Aktiengesellschaft Anti-theft arrangement for a sound-reproducing apparatus installed into a mounting compartment of a motor vehicle
US4947443A (en) 1986-05-07 1990-08-07 Costello Brendan D Method and apparatus for verifying identity
US5016173A (en) * 1989-04-13 1991-05-14 Vanguard Imaging Ltd. Apparatus and method for monitoring visually accessible surfaces of the body
US5130935A (en) 1986-03-31 1992-07-14 Canon Kabushiki Kaisha Color image processing apparatus for extracting image data having predetermined color information from among inputted image data and for correcting inputted image data in response to the extracted image data
US5133020A (en) * 1989-07-21 1992-07-21 Arch Development Corporation Automated method and system for the detection and classification of abnormal lesions and parenchymal distortions in digital medical images
US5146923A (en) * 1986-12-18 1992-09-15 Dhawan Atam P Apparatus and method for skin lesion examination
US5195145A (en) 1989-11-13 1993-03-16 Identity Technologies Incorporated Apparatus to record epidermal topography
US5230025A (en) 1990-08-31 1993-07-20 Digital Biometrics, Inc. Method and apparatus for capturing skin print images
US5241468A (en) 1989-04-13 1993-08-31 Vanguard Imaging Ltd. Apparatus and method for spectral enhancement of body-surface images to improve sensitivity of detecting subtle color features
US5420628A (en) * 1990-01-16 1995-05-30 Research Development Foundation Video densitometer with determination of color composition
US5438989A (en) * 1990-08-10 1995-08-08 Hochman; Darryl Solid tumor, cortical function, and nerve tissue imaging methods and device

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3668633A (en) 1970-01-29 1972-06-06 Dactylog Co Orientation and linear scan device for use in an apparatus for individual recognition
US4699149A (en) 1984-03-20 1987-10-13 Joseph Rice Apparatus for the identification of individuals
US5130935A (en) 1986-03-31 1992-07-14 Canon Kabushiki Kaisha Color image processing apparatus for extracting image data having predetermined color information from among inputted image data and for correcting inputted image data in response to the extracted image data
US4947443A (en) 1986-05-07 1990-08-07 Costello Brendan D Method and apparatus for verifying identity
US4805233A (en) 1986-06-10 1989-02-14 Daimler-Benz Aktiengesellschaft Anti-theft arrangement for a sound-reproducing apparatus installed into a mounting compartment of a motor vehicle
US5146923A (en) * 1986-12-18 1992-09-15 Dhawan Atam P Apparatus and method for skin lesion examination
US5241468A (en) 1989-04-13 1993-08-31 Vanguard Imaging Ltd. Apparatus and method for spectral enhancement of body-surface images to improve sensitivity of detecting subtle color features
US5016173A (en) * 1989-04-13 1991-05-14 Vanguard Imaging Ltd. Apparatus and method for monitoring visually accessible surfaces of the body
US5133020A (en) * 1989-07-21 1992-07-21 Arch Development Corporation Automated method and system for the detection and classification of abnormal lesions and parenchymal distortions in digital medical images
US5195145A (en) 1989-11-13 1993-03-16 Identity Technologies Incorporated Apparatus to record epidermal topography
US5420628A (en) * 1990-01-16 1995-05-30 Research Development Foundation Video densitometer with determination of color composition
US5438989A (en) * 1990-08-10 1995-08-08 Hochman; Darryl Solid tumor, cortical function, and nerve tissue imaging methods and device
US5230025A (en) 1990-08-31 1993-07-20 Digital Biometrics, Inc. Method and apparatus for capturing skin print images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP0904007A4

Cited By (51)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000076398A1 (en) * 1999-06-14 2000-12-21 The Procter & Gamble Company Skin imaging and analysis systems and methods
US6571003B1 (en) 1999-06-14 2003-05-27 The Procter & Gamble Company Skin imaging and analysis systems and methods
EP1078598A1 (en) * 1999-08-27 2001-02-28 Institut für Neurosimulation und Bildtechnologien GmbH Method and device for classifying skin anomalies, in particular melanoma
US6993167B1 (en) 1999-11-12 2006-01-31 Polartechnics Limited System and method for examining, recording and analyzing dermatological conditions
DE10021431A1 (en) * 2000-05-03 2001-11-22 Inst Neurosimulation Und Bildt Method and device for classifying optically observable skin or mucosal changes
DE10021431C2 (en) * 2000-05-03 2002-08-22 Inst Neurosimulation Und Bildt Method and device for classifying optically observable skin or mucosal changes
GB2364567A (en) * 2000-07-07 2002-01-30 Astron Clinica Ltd Determining distribution of chromophores in skin or other epithelial tissue
US7103398B2 (en) 2000-11-01 2006-09-05 3M Innovative Properties Company Electrical sensing and/or signal application device
WO2002036002A1 (en) 2000-11-01 2002-05-10 3M Innovative Properties Company Electrical sensing and/or signal application device
WO2002065069A2 (en) * 2000-11-07 2002-08-22 Hypermed, Inc. Hyperspectral imaging calibration device
WO2002065069A3 (en) * 2000-11-07 2004-02-19 Hypermed Inc Hyperspectral imaging calibration device
US6810279B2 (en) 2000-11-07 2004-10-26 Hypermed, Inc. Hyperspectral imaging calibration device
US7013172B2 (en) 2000-11-07 2006-03-14 Hypermed, Inc. Hyperspectral imaging calibration device
US7006657B2 (en) 2000-12-21 2006-02-28 L'oreal S.A. Methods for enabling evaluation of typological characteristics of external body portion, and related devices
WO2002094097A1 (en) * 2001-05-18 2002-11-28 Polartechnics Limited Boundary finding in dermatological examination
WO2002094098A1 (en) * 2001-05-18 2002-11-28 Polartechnics Limited Diagnostic feature extraction in dermatological examination
AU2002308394B2 (en) * 2001-05-18 2006-11-23 Polartechnics Limited Boundary finding in dermatological examination
US6922523B2 (en) 2001-11-08 2005-07-26 Johnson & Johnson Consumer Companies, Inc. Method of promoting skin care products
US6907193B2 (en) 2001-11-08 2005-06-14 Johnson & Johnson Consumer Companies, Inc. Method of taking polarized images of the skin and the use thereof
US7738032B2 (en) 2001-11-08 2010-06-15 Johnson & Johnson Consumer Companies, Inc. Apparatus for and method of taking and viewing images of the skin
US6961517B2 (en) 2001-11-08 2005-11-01 Johnson & Johnson Consumer Companies, Inc. Method of promoting skin care products
US7376346B2 (en) 2001-11-08 2008-05-20 J&J Consumer Companies, Inc. Method of promoting skin care products
US8026942B2 (en) 2004-10-29 2011-09-27 Johnson & Johnson Consumer Companies, Inc. Skin imaging system with probe
US7657101B2 (en) 2005-01-19 2010-02-02 Dermaspect, Llc Devices and methods for identifying and monitoring changes of a suspect area on a patient
US9723270B2 (en) 2005-01-19 2017-08-01 Dermaspect Llc Devices and methods for identifying and monitoring changes of a suspect area of a patient
WO2006078902A3 (en) * 2005-01-19 2006-12-07 Dermaspect Llc Devices and methods for identifying and monitoring changes of a suspect area on a patient
US8068675B2 (en) 2005-01-19 2011-11-29 Dermaspect, Llc Devices and methods for identifying and monitoring changes of a suspect area of a patient
AU2006206334C1 (en) * 2005-01-19 2011-05-19 Dermaspect Llc Devices and methods for identifying and monitoring changes of a suspect area on a patient
AU2006206334B2 (en) * 2005-01-19 2010-09-23 Dermaspect Llc Devices and methods for identifying and monitoring changes of a suspect area on a patient
WO2006078902A2 (en) * 2005-01-19 2006-07-27 Dermaspect, Llc Devices and methods for identifying and monitoring changes of a suspect area on a patient
US20080260218A1 (en) * 2005-04-04 2008-10-23 Yoav Smith Medical Imaging Method and System
US8467583B2 (en) 2005-04-04 2013-06-18 Yissum Research Development Company Of The Hebrew University Of Jerusalem Ltd. Medical imaging method and system
EP2063775A2 (en) * 2006-09-19 2009-06-03 KCI Licensing, Inc. System and method for tracking healing progress of tissue
US10765592B2 (en) 2006-09-19 2020-09-08 Kci Licensing, Inc. System and method for determining a fill status of a canister of fluid in a reduced pressure treatment system
US11229732B2 (en) 2006-09-19 2022-01-25 Kci Licensing, Inc. System and method for locating fluid leaks at a drape of a reduced pressure delivery system
AU2007297654B2 (en) * 2006-09-19 2011-12-08 3M Innovative Properties Company System and method for tracking healing progress of tissue
US10806835B2 (en) 2006-09-19 2020-10-20 Kci Licensing, Inc. Reduced pressure treatment system having blockage clearing and dual-zone pressure protection capabilities
EP2063775A4 (en) * 2006-09-19 2010-12-01 Kci Licensing Inc System and method for tracking healing progress of tissue
KR101174187B1 (en) 2006-09-19 2012-08-14 케이씨아이 라이센싱 인코포레이티드 System and method for tracking healing progress of tissue
US8189887B2 (en) 2006-10-02 2012-05-29 Johnson & Johnson Consumer Companies, Inc. Imaging standard apparatus and method
US7558416B2 (en) 2006-10-02 2009-07-07 Johnson & Johnson Consumer Companies, Inc. Apparatus and method for measuring photodamage to skin
US8107696B2 (en) 2006-10-02 2012-01-31 Johnson & Johnson Consumer Companies, Inc. Calibration apparatus and method for fluorescent imaging
WO2008150343A1 (en) * 2007-05-22 2008-12-11 Eastman Kodak Company Monitoring physiological conditions
ES2334307A1 (en) * 2008-04-11 2010-03-08 Catfosc.Health Made To Measure, S. L. Device for monitoring surface alterations over time and method associated therewith
EP3222215A4 (en) * 2014-11-19 2018-09-05 Shiseido Company, Ltd. Stain evaluation device, stain evaluation method, and program
US11317851B2 (en) 2014-11-19 2022-05-03 Shiseido Company, Ltd. Skin spot evaluation apparatus, skin spot evaluation method and program
US20160275681A1 (en) * 2015-03-18 2016-09-22 Canfield Scientific, Incorporated Methods and apparatus for identifying skin features of interest
WO2016149626A1 (en) * 2015-03-18 2016-09-22 Canfield Scientific, Incorporated Methods and apparatus for identifying skin features of interest
US11164670B2 (en) 2015-03-18 2021-11-02 Canfield Scientific, Incorporated Methods and apparatus for identifying skin features of interest
US20190347434A1 (en) * 2015-07-20 2019-11-14 Notarize, Inc. System and method for validating authorship of an electronic signature session
US11803665B2 (en) * 2015-07-20 2023-10-31 Notarize, Inc. System and method for validating authorship of an electronic signature session

Also Published As

Publication number Publication date
IL118634A0 (en) 1996-10-16
EP0904007A4 (en) 1999-08-04
EP0904007A1 (en) 1999-03-31
CA2258124A1 (en) 1997-12-18
AU3045597A (en) 1998-01-07

Similar Documents

Publication Publication Date Title
EP0904007A1 (en) Dermal diagnostic analysis system and method
US11382558B2 (en) Skin feature imaging system
US10201281B2 (en) System, method and article for normalization and enhancement of tissue images
RU2350265C2 (en) Automatic detection of skin lesions
US6215893B1 (en) Apparatus and method for measurement and temporal comparison of skin surface images
US8472682B2 (en) Medical image processing
US7894651B2 (en) Quantitative analysis of skin characteristics
US20120206587A1 (en) System and method for scanning a human body
US6154560A (en) System and method for staging regional lymph nodes using quantitative analysis of endoscopic ultrasound images
US20090060304A1 (en) Dermatology information
US9779504B1 (en) Method and system for identifying anomalies in medical images especially those including one of a pair of symmetric body parts
US20040264749A1 (en) Boundary finding in dermatological examination
US9401021B1 (en) Method and system for identifying anomalies in medical images especially those including body parts having symmetrical properties
JP2005137756A (en) Health measuring system and program
EP3219251A1 (en) Organ image capture device and program
KR20210014267A (en) Ultrasound diagnosis apparatus for liver steatosis using the key points of ultrasound image and remote medical-diagnosis method using the same
JP3758894B2 (en) Mammogram image diagnosis support device
JP7283878B2 (en) VIDEO PROCESSING DEVICE, VIDEO PROCESSING METHOD, AND VIDEO PROCESSING PROGRAM
JP2006149679A (en) Method, device and program for determining degree of health
JP3548473B2 (en) Method and apparatus for identifying arteriovenous of fundus image, recording medium and apparatus
CN109993754B (en) Method and system for skull segmentation from images
CN113842212A (en) Fluorescence scattering optical tomography processing method and system
Rimskaya et al. Development Of A Mobile Application For An Independent Express Assessment Of Pigmented Skin Lesions
CN117275712A (en) Skin erythema and mottle severity quantification method
Barone et al. 3D Imaging Analysis of Chronic Wounds Through Geometry and Temperature Measurements

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK TJ TM TR TT UA UG US UZ VN YU AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH KE LS MW SD SZ UG AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 2258124

Country of ref document: CA

Ref country code: CA

Ref document number: 2258124

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1997925253

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 98501410

Format of ref document f/p: F

WWP Wipo information: published in national office

Ref document number: 1997925253

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 1997925253

Country of ref document: EP