US20110309149A1 - Hand Held Machine Vision Method and Apparatus - Google Patents
Hand Held Machine Vision Method and Apparatus Download PDFInfo
- Publication number
- US20110309149A1 US20110309149A1 US13/163,954 US201113163954A US2011309149A1 US 20110309149 A1 US20110309149 A1 US 20110309149A1 US 201113163954 A US201113163954 A US 201113163954A US 2011309149 A1 US2011309149 A1 US 2011309149A1
- Authority
- US
- United States
- Prior art keywords
- image
- item
- feature
- information
- hhd
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K2207/00—Other aspects
- G06K2207/1011—Aiming
Definitions
- the present invention relates to machine vision and more specifically to portable machine vision systems for collecting images of items or groups of items, identifying the item(s) and performing one or more secondary functions using the collected images.
- a camera and a light source may be rigidly mounted adjacent a station along a manufacturing transfer line including clamps that, when a semi-finished product is moved to the station, clamp the product in a precise juxtaposition (i.e., at a precise distance from and along a precise trajectory to) with respect to the camera and light source.
- the camera and light source may be positioned twelve inches from and normal to a space between first and second product components such that an image of the clamped product generated by the camera shows the first and second components separated by the space having a space dimension.
- the image may be provided to a processor for identifying the space dimension and for comparing the identified dimension to a required space dimension between the first and second components.
- the processor is programmed to scale the space defined by the first and second components in the image appropriately assuming the precise juxtaposition of the camera to the components (i.e., assuming a normal camera trajectory and twelve inches between the camera and the space). Where the identified dimension is different than an expected and required dimension the processor may be programmed to reject the part, to store the difference, to indicate the difference, to suggest a correction to eliminate the difference, etc.
- imaging applications in addition to dimension determination include color verification, defect detection, object/pattern verification, object recognition, assembly verification and archival processes for storing images and/or other correlated information (e.g., the results of color verification processes, defect detection processes, etc.).
- camera images are processed in a different fashion to facilitate different functions but the precise juxtaposition restrictions required to generate meaningful/useful images still exist.
- the product (e.g., a jet engine) being assembled may be mounted for rotation about one or more axis so that assembly personnel can manipulate the product easily to obtain different optimal vantage points for installing components.
- product position is alterable, even if a stationary camera were provided adjacent an assembly station, precise positioning of the camera with respect to the product would be difficult to achieve as the product is moved to optimize position for installation purposes.
- camera position with respect to the product/feature being imaged is unknown or is inaccurately assumed, resulting images can be mis-scaled such that comparison to required ranges is inappropriate.
- a machine vision system assumes that a camera is twelve inches from and normal to a space between the two features when an image is obtained.
- the system may be programmed to identify the two features and measures the dimension there between. Thereafter, the system scales the measured dimension assuming the image was taken from twelve inches and at an angle normal to the space between the two features.
- the dimension calculated by the system will be different than the actual dimension and an error will likely be indicated even if the actual dimension is within the required range.
- Another exemplary application where constrained vision systems are not easily employed but where the advantages of machine vision described above would be useful is in small manufacturing plants. For instance, in a small metal working facility there may be 1000 different measurements that routinely need to be taken on various products. Here, while at least some of the 1000 measurements may need to be made hundreds of times each year, the volume of product associated with even the most routine measurements may not justify the costs associated with even a single stationary machine vision system. In these cases the advantages of machine vision are typically foregone and all measurements end up being manual.
- HHD hand held portable device
- the HHD can be positioned in any relative juxtaposition with respect to a product or product feature to obtain images thereof for analysis by system software.
- the camera can be positioned in several different positions to obtain the images.
- system software can be programmed to recognize an obtained image as similar to a specific one of a plurality of optimal stored images that includes specific features of interest so that, when the image is obtained, the system can automatically perform different processes on the image information.
- the HHD may include a guidance mechanism for helping a user position the HHD with respect to a product or feature for obtaining an image suitable for specific processes.
- guidance may be provided by simply transmitting a specific light pattern toward a product to show the field of camera view.
- the guidance may be “active” and include indications that direct an HHD user to move the HHD in specific directions relative to the product or feature being imaged. Where active guidance is provided, the HHD may have access to optimal product images stored in a database.
- the HHD may obtain an image, compare the image to one or more of the optimal images to identify positional changes that would result in a more optimal positioning of the HHD and then provide guidance to move left, move right, move up, move down, move forward, move backward, adjust pitch, adjust roll, etc.
- an identification tag e.g., bar code, RFID tag, etc.
- the HHD may also be equipped with a tag reader for obtaining information form the tags.
- the HHD may be used to obtain information from the tag so that the product type can be determined.
- the HHD may be programmed to perform different functions for each different product type.
- the HHD may be programmed to guide the HHD user to obtain two different images that are similar to optimal stored images and to perform various measurements of features in the images while, for a second product type the HHD may be programmed to guide the HHD user to obtain five different images from various orientations and to perform various measurements of features in the five images.
- the HHD can perform product type specific processes and provide product type specific instructions.
- At least some embodiments of the present invention include a method for use with a portable device including a processor, the method comprising the steps of providing an identification tag on at least one item that includes item identifying information, obtaining item identifying information from the identification tag via the portable device, obtaining at least one image of the at least one item via the portable device and performing a supplemental process using the identifying information and the at least one image.
- some embodiments of the invention include a method for use with a database and a portable device including a processor, the method comprising the steps of (a) storing information in the database regarding at least one optimal relative juxtaposition of the portable device with respect to a first item type to be imaged, (b) positioning the portable device proximate an instance of the first item, (c) obtaining at least one intermediate image of the first item instance; an (d) providing guidance information indicating relative movement of the portable device with respect to the first item instance to move the portable device toward the at least one optimal relative juxtaposition with respect to the first item instance.
- the method may further include the step of, prior to step (d), examining the intermediate image to identify position of the portable device with respect to the first item instance, the step of providing guidance including providing guidance as a function of the intermediate image examination. Steps (b) through (d) may be repeated until the portable device is at least substantially in the at least one optimal relative juxtaposition with respect to the first item instance.
- At least some embodiments of the invention include a method for use with a database and a portable device including a processor, the method for obtaining information associated with a subset of a plurality of different item types, the method comprising the steps of providing an identification tag on at least one item that includes item identifying information, obtaining item identifying information from the identification tag via the portable device, identifying the item type from the item identifying information, obtaining at least one image of the at least one item via the portable device, identifying at least one supplemental process to be performed on the obtained image wherein the supplemental subprocess is identified at least in part as a function of the item type and performing the at least one supplemental process on the obtained image.
- some embodiments include a method for use with a database and a portable device including a processor, the method for performing functions associated with different items, the method comprising the steps of providing identification tags on each of a plurality of items, each tag including identifying information useable to specifically identify an associated item, obtaining item identifying information from at least one identification tag corresponding to a specific item via the portable device, obtaining other information associated with the specific item including at least one image of the specific item via the portable device, performing supplemental processes on the other information associated with the specific item, monitoring the portable device for a transition indication and, when a transition indication is received, halting the supplemental processes.
- Some embodiments include a system for use with items that include identification tags where each tag includes item identifying information, the apparatus comprising a portable housing. a processor mounted within the housing, a tag information obtainer supported by the housing for obtaining information from the tags and a camera supported by the housing, wherein, the processor runs a program to, when information is obtained from a tag via the obtainer and an image is obtained via the camera, perform a supplemental process on the image as a function of the information obtained from the tag.
- some embodiments of the invention include an apparatus for use with items that include identification tags where each tag includes item identifying information, the apparatus comprising a portable housing, a processor mounted within the housing, a tag information obtainer supported by the housing for obtaining information from the tags and a camera supported by the housing, wherein, the processor runs a program to, when information is obtained from a tag associated with a specific item via the obtainer, perform supplemental processes associated with the specific item on images obtained by the camera until a transition indication is received and, when a transition indication is received, halting the supplemental processes associated with the specific item.
- some embodiments include a method for use with a portable device including a processor, the method comprising the steps of identifying at least one item using the portable device, obtaining at least one image of the at least one item via the portable device and performing a supplemental process on the at least one image as a function of the identity of the item.
- the invention includes a method for marking a product for use with a camera including a field of view, the method comprising the steps of providing an identification tag on the product wherein the tag is machine readable to obtain information associated with the product and providing a source mark on the product spatially proximate the tag such that both the tag and the source mark can be simultaneously located within the camera field of view.
- some embodiments include a method for use with a portable device including a processor, the method comprising the steps of associating an identification tag with at least one item that includes item identifying information, obtaining item identifying information from the identification tag via the portable device, obtaining at least one image of the at least one item via the portable device and performing a supplemental process using the identifying information and the at least one image.
- the step of associating may include providing the identification tag on the item or providing the tag in a booklet along with human distinguishable information associated with the item.
- FIG. 1 is a schematic view of an exemplary system including a handheld portable identification tag reader and camera device according to at least some aspects of the present invention
- FIG. 2 is a schematic diagram illustrating some of the components that form the handheld device of FIG. 1 ;
- FIG. 3 is a perspective view of the handheld device of FIG. 1 being used to obtain information from an identification tag according to at least some aspects of the present invention
- FIG. 4 is a flow chart illustrating an exemplary method according to the present invention.
- FIG. 5 is a perspective view of a handheld device like the one illustrating in FIG. 1 being used to obtain an image of an item for performing any of several different supplemental processes according to various aspects of the present invention
- FIG. 6 is a flow chart illustrating a subprocess that may be substituted for a portion of the method of FIG. 4 ;
- FIG. 7 is a an exemplary database according to at least some aspects of the present invention.
- FIG. 8 is a flow chart illustrating another exemplary method according to at least some embodiments of the present invention.
- FIG. 9 is an exemplary database consistent with at least some aspects of the present invention.
- FIG. 10 is a plan view of an exemplary feedback arrangement that may form part of the handheld device of FIG. 1 ;
- FIG. 11 is similar to FIG. 8 , albeit illustrating another method according to at least some embodiments of the present invention.
- FIG. 12 is another exemplary feedback arrangement according to at least some aspects of the present invention.
- FIG. 13 is a screenshot for providing HHD guidance information according to at least some aspects of the present invention.
- FIG. 14 is similar to FIG. 13 , albeit providing other guidance information
- FIG. 15 is similar to FIG. 14 , albeit providing other guidance information as well providing a real time image and a phantom showing an optimal image orientation;
- FIG. 16 is similar to FIG. 15 , albeit providing other guidance instructions;
- FIG. 17 is similar to FIG. 15 , albeit providing results of a supplemental process after an optimal image has been obtained;
- FIG. 18 is similar to FIG. 15 , albeit providing alternate instructions for obtaining either of two different optimal images;
- FIG. 19 is similar to FIG. 18 , albeit providing results after an optimal image has been obtained;
- FIG. 20 is similar to FIG. 19 , albeit providing results after a different optimal image has been obtained;
- FIG. 21 is a partial plan view showing a source mark and an identification tag on an item
- FIG. 22 is a flow chart illustrating a method for verifying parts according to at least some aspects of the present invention.
- FIG. 23 is a flow chart illustrating a method for associating a portable device with a product for processing.
- FIG. 24 is a schematic diagram illustrating an HHD being used to obtain an image of a kit including various components according to at least some aspects of the present invention.
- FIG. 1 the present invention will be described in the context of an exemplary information system 10 including a work station 12 , a server 13 , a database 14 , a wireless access point 16 and a handheld portable devices (HHD) 20 .
- Work station 12 is linked to server 13 for two-way communication via a network generally identified by numeral 18 .
- server 13 is linked via network 18 to access point 16 as well as to database 14 for two-way communication therewith.
- Server 13 runs programs 15 stored in database 14 to perform various methods according to the present invention which will be described hereinafter.
- database 14 In addition to storing programs 15 run by server 13 , database 14 also stores information in a product/function database 17 corresponding to items or products for which some process or method may be performed by system 10 . In addition, in at least some embodiments of the present invention, database 14 also stores results or at least a subset of the results in a results database 19 that occur after programs 15 have been performed.
- interface 12 includes a display screen 22 and some type input device such as keyboard 24 .
- Other types of input devices are contemplated including a mouse, a track ball, voice recognition hardware, etc.
- work station 12 a system operator can perform various tasks, depending upon the method being performed by server 13 , to facilitate method steps to be described hereinafter.
- Access point 16 is a wireless transceiver that is capable of receiving wireless signals (e.g., 802.11b, blue tooth, etc.) and transmitting similarly coded wireless information within the area surrounding access point 16 .
- wireless signals e.g., 802.11b, blue tooth, etc.
- server 13 can transmit information wirelessly within the space surrounding access point 16 by transmitting the information first via network 18 to access point 16 and causing access point 16 to transmit the information within the surrounding area.
- HHD 20 includes a housing 26 having a pistol type shape and includes a grip shaped handle 27 for easy gripping via a user's hand and a barrel 29 that extends away from a user when handle 27 is gripped.
- An activation button in the form of a trigger 30 is provided on handle 27 where a users index finger resides during normal use.
- housing 26 a plurality of components are mounted including, among other things, a processor 21 , a camera 23 , an HHD memory device 25 , a light source 11 and a camera lens 28 .
- HHD 20 also includes a separate tag reader 400 , some type of feedback device 32 , 39 , and/or a transceiver 34 , shown linked to processor 21 via phantom lines to indicate that at least some embodiments do not include these or a subset of these components.
- Processor 21 is linked for two-way communication to memory device 25 for storing programs and information therein and retrieving program code and stored information when required.
- processor 21 is linked for two-way communication to transceiver 34 so that processor 21 can communicate with server 13 via access point 16 and network 18 to receive information therefrom and provide information thereto.
- processor 21 is linked to activation button/trigger 30 for receiving activation signals therefrom.
- Processor 21 is linked to light source 11 for controlling activation thereof.
- source 11 will include two or more white light LEDs that shine light through lens 28 (see again FIG. 1 ) when trigger 30 is activated to illuminate a space in front of lens 28 .
- the LEDs generate a short flash of light.
- the light source 11 may be capable of generating continuous light over a longer duration (e.g., 20 seconds).
- Processor 21 is also linked to camera/sensor 23 for receiving images generated thereby.
- camera lens 28 is at the front end of barrel 29 and has a field of view identified by numeral 42 .
- transceiver 34 is mounted near the top end of barrel 29 to facilitate relatively unobstructed communication with access point 16 .
- Feedback configuration 32 , 39 ( 39 is a speaker) is mounted on the top surface of barrel 29 to facilitate feedback to an HHD operator.
- blade 200 includes various features (e.g., edges) and feature characteristics (e.g., dimensions, curvatures, colors, etc.).
- blade 200 includes edges F 1 through F 12 , top, middle and bottom thickness T 1 , T 2 and T 3 between edges F 1 and F 2 , edges F 3 and F 4 and edges F 5 and F 6 , respectively, a length dimension L between edges F 7 and F 8 , a width dimension W between edges F 9 and F 10 and a curvature between edge portions F 11 and F 12 .
- HHD 20 may be, and indeed is intended to be, used with many different product/item types in at least some applications, HHD operations will be described in the context of exemplary blade 200 .
- an identification tag 202 is provided on blade 200 that includes a conventional bar code.
- Other identification tag types are contemplated including 2D bar codes, dot matrices, RFID tags, optical character recognition type tags, etc.
- HHD 20 does not itself include a feedback configuration 32 and that, in fact, HHD 20 may be used independent of the other system components illustrated in FIG. 1 .
- a database 17 is provided that correlates item identification information and supplemental item related functions.
- HHD 20 is provided that includes a camera/tag reader as described above.
- identification tags are provided on items including blade 200 in FIG. 3 to be used with system 10 .
- a system user uses HHD 20 to obtain identification information from one of the ID tags 202 .
- HHD 20 is used to obtain an image of the item associated with the most recently obtained tag information. For instance, referring once again to FIG. 3 and also to FIG. 5 , where HHD 20 is used to obtain ID information from tag 202 at block 114 where tag 202 resides on blade 200 , at block 116 , HHD 20 is used to obtain an image of blade 200 (see FIG. 5 ).
- HHD processor 21 identifies the item associated with tag 202 in database 17 and the correlated supplemental function(s).
- processor 21 performs the supplemental function(s) using the obtained image.
- processor 21 may store the obtained image correlated with the identifying information in HHD memory 25 .
- a single image may be obtained which includes features of an item that are of interest as well as the tag information.
- HHD 20 may be useable to obtain a full image of blade 200 including information specified by tag 202 .
- processor 21 may be programmed to isolate the region of interest of the obtained image including the tag 202 , read the tag information and then perform a supplemental process on the image as a whole that is associated with the identification tag information.
- HHD 20 may be used to obtain a image of an item where the image includes the ID tag on the item as well as other item features.
- HHD processor 21 identifies the ID tag (e.g., 202 in FIG. 6 ) in the image and reads the identification information thereon.
- control passes back to block 117 in FIG. 4 where the process described above continues.
- HHD 20 may perform programs to analyze obtained images to identify regions of interest in the images, visually distinguishable product features within regions of interest and characteristics of those features.
- HHD 20 may be programmed to, when tag information indicates that an item associated therewith is a rotor blade 200 , analyze the obtained image to identify top and bottom edges F 7 and F 8 , respectively, measure the length dimension L between edges F 7 and F 8 , and store the length dimension L correlated with the blade identifying information in HHD memory 25 .
- any of the other blade dimensions T 1 , T 2 , T 3 , W or C may be calculated and stored.
- HHD processor 21 may be programmed to, after item/product dimensions have been calculated, compare the calculated values to the optimal values and store results of the comparison in a correlated fashion with item identifying information in HHD memory 25 .
- HHD 20 includes a transceiver 34
- some or at least a portion of processing described above and hereinafter may be performed by server 13 .
- tag identification information and images may be wirelessly transmitted from HHD 20 to server 13 via access point 16 and network 18 so that server 13 can perform the item/product identifying process, identify supplemental functions and perform supplemental functions.
- HHD 20 may simply obtain tag identifying information and product images, correlate and store the identifying information and images and download the correlated information to server 13 in batch either wirelessly or via a hard wire connection (e.g., a USB port), additional supplemental processes being performed thereafter via server 13 .
- a hard wire connection e.g., a USB port
- server 13 may provide at least a subset of the process results to an HHD user via display 22 .
- product images may be provided via display 22 as well as product identifying information (e.g., “rotor blade type 00 - 0001 ”).
- product identifying information e.g., “rotor blade type 00 - 0001 ”.
- the calculated values may be provided via display 22 either in a list form or, where an obtained image is generated, as markings on the generated image.
- the differences may be indicated via display 22 in some fashion.
- an affirmation of the values as acceptable may be provided via display 22 .
- the above feedback functions may also be performed/facilitated via display 22 where HHD processor 21 performs most of the supplemental functions and then transmits results to the display via point 16 and network 18 .
- an exemplary, albeit simplified, product/function database 17 is illustrated that includes three separate columns, an item ID No. column 78 , an image features column 86 and a feature function column 92 .
- Item ID No. column 78 lists a separate identification number for each one of the items that may be used by system 10 in FIG. 1 .
- an identification number would be listed in column 78 for a rotor blade type.
- item number 00 - 0001 corresponds to rotor blade 200 as illustrated in FIG. 3 .
- item numbers 00 - 0002 and 00 - 0003 correspond to a seat frame and a motor chassis, respectively.
- image features column 86 lists at least one and, in many cases, a plurality of feature subsets (each subset including at least one feature) for each one of the identification numbers in column 78 .
- column 86 lists six feature subsets 82 , 90 , 91 , 93 , 95 and 97 for product ID number 00 - 0001 in column 78 .
- the feature subsets 82 , 90 , 91 , 93 , 95 and 97 corresponding to image ID number 00 - 0001 include features F 1 and F 2 , features F 3 and F 4 , features F 5 and F 6 , features F 7 and F 8 , features F 9 and F 10 and features F 11 and F 12 which correspond to different edges of rotor blade 200 as illustrated in FIG. 3 .
- instructions for either processor 21 or server 13 will also be specified in column 86 or elsewhere that indicate how the features should be identified in obtained images. For instance, referring again to FIGS.
- instructions for identifying top and bottom edges F 7 and F 8 may simply cause processor 21 or server 13 to identify the most distal edges within an obtained image or to identify the length dimension generally as the long dimension of the product and then identify the edges that define the length.
- an HHD 20 may be used to obtain an image of a product where the image includes the features (e.g., edges, curvatures, etc.) of interest.
- the obtained image may be presented via display 22 and interface tools (e.g., a mouse, trackball, etc.) may be used to select image features such as edges.
- interface tools e.g., a mouse, trackball, etc.
- software run by server 13 may help the user charged with commissioning to distinguish features. For instance, where a mouse controlled cursor is moved to edge F 7 (see again FIG. 3 ), the software may identify the edge from differences in color in the image and highlight the border or edge F 7 for selection via the mouse input device.
- the software may automatically identify a specific region of interest within the obtained image in which the feature resides and develop and store rules for identifying similar features in subsequent images.
- feature function column 92 indicates a different function for each one of the feature subsets listed in column 86 .
- a first function 94 indicates that a thickness T 1 defined by the space between features F 1 and F 2 is to be measured.
- characteristic 96 indicates that a middle thickness T 2 between features F 3 and F 4 should be measured.
- the characteristics associated with feature subsets 91 , 93 , 95 and 97 indicate that a bottom thickness T 3 , a length L, a width W and a curvature C should be measured, respectively.
- the feature function column will also indicate a desired value for a dimension or a desired value range and may instruct either the HHD processor 21 or server 13 to perform some additional function such as, for instance, storing measured values, comparing measured values to required values and indicating variances, comparing measured and required/expected values and indicating when measured values are within required ranges, etc.
- server 13 may provide an interface for grouping image features into subsets (e.g., 82 , 90 , 91 , etc) and for selecting associated feature functions. For example, referring again to FIGS. 3 and 7 , after edge sections F 1 and F 2 are selected (e.g., subset 82 ), the commissioning software may provide function options including “Measure dimension and provide feedback via display”, “Measure dimension and store”, “Measure dimension, compare to range of acceptable dimensions and indicate differences”, etc. When a feature function is selected in this example, it is contemplated that server 13 would populate an associated section of feature function column 92 . Other commissioning procedures are contemplated.
- HHD processor 21 performs most of the supplemental processes. Nevertheless, it should be appreciated that, in at least some cases, some or most of the process steps could also be performed by server 13 in communication with HHD 20 via access point 16 .
- a database 17 is provided that correlates item IDs, visually distinguishable image features of interest to be identified in obtained images and feature function information.
- an HHD 20 is provided that includes a camera/tag reader as described above.
- ID tags are provided on items to be used with HHD 20 .
- HHD 20 is used to obtain ID information from an ID tag (e.g., 202 , in FIG. 7 ).
- HHD processor 21 accesses database 17 to identify features of interest and feature functions correlated with the obtained product identification information.
- HHD 20 is used to obtain an image of the item from which the identification information was most recently obtained.
- processor 21 identifies the item features of interest in the obtained image.
- processor 21 ascertains feature characteristics for comparison to expected characteristics or to a range of expected characteristics. Consistent with the example above, processor 21 may attempt to identify any of thicknesses T 1 , T 2 or T 3 , length L, width W or curvature C.
- processor 21 compares image characteristics to required characteristics to identify any differences.
- processor 21 provides feedback regarding feature characteristics.
- processor 21 transmits information via transceiver 34 to access point 16 and on to server 13 which provides feedback via display screen 22 .
- processor 21 or server 13 may be programmed to correlate and store item identification information, features and characteristic information including any differences between measured and required characteristics in the results database 19 (see again FIG. 1 ).
- the systems described above have several advantages, such systems also may have some short comings in the context of certain applications.
- the systems described above rely on the assumption that an HHD user will be extremely familiar with the products being imaged, the supplemental functions or processes being performed via the system and advantageous relative juxtapositions (e.g., angle, spacing, pitch of HHD, etc.) between the HHD and the products/features being imaged from which to obtain the images.
- the HHD user would have to know which features are of interest and generally optimal angles and distances of the HHD to the product being imaged to ensure that suitable images are obtained for accurately identifying the features and feature characteristics.
- filtering and software compensation schemes may be used to compensate for minor differences between angles and distances of the camera to the features of interest, larger differences may not be accurately discernable and hence may not be able to be accurately compensated.
- HHD user is not familiar with products, advantageous imaging juxtapositions and product features of interest however, the systems described above would be difficult to use at best.
- system 10 may be programmed to help an HHD user position HHD 20 such that an image obtained thereby is optimal for performing other functions such as dimension measurement, color identification, and so on.
- an expanded product/function database 17 ′ may be provided that includes, in addition to ID number column 78 , features column 86 and feature function column 92 , an optimal images column 76 .
- optimal images column 76 lists at least one and, in some cases, several optimal images, for each one of the item ID numbers listed in column 78 .
- an image identifier 73 which is labeled “I- 1 (30° front view)” is listed in column 76 for item identification number 00 - 0001 in column 78 .
- two separate image identifiers are listed in column 76 for item identification number 00 - 0002
- twelve separate image identifiers are listed in column 76 for ID number 00 - 0003 , and so on.
- an optimal image of a product has been captured during a commissioning procedure and stored in database 17 for each of the image identifiers listed in column 76 .
- the idea here is that, when HHD 20 is used to obtain an image of a product, the obtained image can be compared to one or more optimal images to identify HHD movements required to move the HHD into an optimal juxtaposition with respect to the product being imaged or at least to identify if the HHD is within an acceptable range of optimal relative juxtapositions.
- an HHD position within an optimal range of relative juxtapositions will include a position wherein the characteristics that can be calculated from an image obtained from the position will be sufficiently accurate for the application associated with the characteristics.
- sufficiency of accuracy is a matter of designer choice.
- Feedback can be provided either via the HHD or some external device (e.g., display 22 , see again FIG. 1 ) to help the HHD user reposition the HHD for obtaining a more optimal image for use in performing other supplemental functions.
- a guidance program can be located in HHD memory device 25 that can compare obtained images to optimal images, identify differences and generate relatively simple guidance instructions usable by an HHD user to realign the HHD with an item being imaged.
- the guidance program can recognize when an obtained image is optimal or at least relatively optimal and can then use that image to perform other functions.
- exemplary simple guidance instructions may indicate that an HHD is aligned or misaligned with an item being imaged and may also indicate when an optimal image has been obtained.
- the HHD may be capable of indicating that the HHD should be moved up, down, left, right, forward and in reverse in addition to indicating whether or not the top of the HHD should be moved forward or backward or left or right to affect pitch and roll adjustments of the HHD.
- Other more complex and helpful active guidance systems are contemplated as described hereinafter.
- more than one optimal image may be associated with a single product.
- an edge view image associated with identifier 101 and a plan view associated with identifier 103 are specified for a rotor blade having ID number 00 - 0002 .
- HHD 20 may be programmed to identify the optimal image most like an obtained image and provide guidance toward obtaining an image akin to the most similar optimal image.
- the supplemental functions associated with each different optimal image would be different. For instance, as seen in FIG. 9 , functions including calculating T 1 , T 2 and T 3 are associated with optimal image identifier 101 while functions including calculating L, W and C are associated with optimal image identifier 103 .
- an exemplary simplified feedback configuration 32 a including three light emitting diodes (LEDs) 36 , 38 and 40 that are arranged on the top surface of housing barrel 29 within easy view of an HHD operator.
- the LEDs are labeled as “misaligned”, “aligned” and “image obtained” indicating misalignment, alignment and that an optimal image has been obtained.
- misaligned LED 36 is illuminated.
- aligned LED 38 is illuminated and misaligned LED 36 is turned off.
- LED 40 is illuminated.
- FIG. 11 an exemplary method 160 according to at least some aspects of the present invention where active guidance is provided to an HHD 20 user is illustrated.
- a database 17 ′ that correlates item IDs, optimal images, visually distinguishable image features and feature functions is provided.
- an HHD including a camera/tag reader is provided.
- ID tags are provided on items to be used with system 10 .
- HHD 20 is used to obtain ID information from one of the item ID tags.
- HHD processor 21 accesses database 17 ′ to identify optimal images associated with the obtained ID information. Consistent with the example above, where information has been obtained from tag 202 on blade 200 , processor 21 identifies the optimal image associated with image identifier 73 .
- HHD 20 is used to obtain an intermediate image of blade 200 .
- processor 21 compares the compared and optimal images to identify the optimal image that is most similar to the obtained image. In the present case, because there is only one optimal image in column 76 associated with the rotor blade identification number 00 - 0001 , the single optimal image associated with identifier 73 is identified at block 174 . In other cases where two or more optimal image identifiers are listed in column 76 (e.g., in the case of blades have ID number 00 - 0002 ), processor 21 selects one of the optimal images for performing the guidance process at block 174 .
- processor 21 determines whether or not the obtained image is substantially similar to the most similar optimal image (e.g., the obtained image is suitable for sufficiently accurately performing the feature functions associated therewith). Where the obtained image is not substantially similar to the optimal image, control passes to block 178 where processor 21 provides guidance via the feedback devices (e.g., the LEDs 36 , 38 and 40 in FIG. 10 ). After block 178 , control passes back up to block 172 where the subprocess including blocks 172 , 174 and 176 is repeated.
- the feedback devices e.g., the LEDs 36 , 38 and 40 in FIG. 10
- feedback indicating alignment may be provided via LEDs 36 , 38 and 40 (see again FIG. 10 ).
- processor 21 again accesses database 17 ′ to identify features of interest that should be visually distinguishable in the obtained image, the functions to be performed on the features and the required characteristics that are correlated with the item identification number and matching optimal image.
- processor 21 identifies features F 1 through F 12 as of interest and dimensions T 1 , T 2 , T 3 , L, W and C to be measured.
- processor 21 attempts to identify the features of interest in the obtained image.
- processor 21 uses the identified features to calculate the characteristics that are to be compared to the expected characteristics.
- processor 21 compares the calculated characteristics to the expected characteristics to identify differences.
- feedback regarding any differences is provided.
- feedback will be provided by transmitting feedback information to access point 16 and on to server 13 where server provides the feedback information via display 22 .
- feedback may be provided via an audio speaker 39 (see again FIG. 1 ) linked to processor 21 .
- processor may generate a sound discernable as an affirmation of the product dimensions whereas, if one or more values are outside acceptable ranges some other discernible sound may be generated.
- one or two additional LEDs could be provided as part of feedback assembly 32 a (see again FIG. 10 ) to indicate acceptable or unacceptable calculated values.
- a second exemplary feedback arrangement 32 b which includes ten separate arrow shaped covers provided over LEDs to provide active guidance to an HHD user for obtaining an optimal image.
- the arrows are divided into two groups, one to indicate desirable HHD position movements within a space 44 and a second group to indicate desirable HHD orientation movement provided within a space 46 .
- the arrows within position space 44 include an up arrow 52 , a down arrow 56 , a left arrow 54 , a right arrow 50 , a forward arrow 60 and a back arrow 62 .
- the position arrows 52 , 56 , 54 , 50 , 60 and 62 are used to indicate that an HHD user should move an HHD up, down, left, right, forward and backward with respect to an item being imaged, respectively. For instance, when an item being imaged is to the right of the center of the HHD camera field of view, arrow 50 indicating that the HHD should be moved to the right may be illuminated. Similarly, if an item appears much smaller in an obtained image than is optimal, arrow 60 may be illuminated to indicate that the HHD should be moved forward with respect to the item.
- orientation arrows indicate how the barrel of the HHD 20 should be moved to adjust pitch and roll. For instance, when arrow 66 is illuminated, the HHD barrel 29 should be moved forward with respect to the HHD handle 27 thereby affecting a forward pitch movement. Similarly, where arrow 68 is illuminated, the barrel 29 should be rotated to the right with respect to handle 27 affecting a roll of the HHD.
- a feedback arrangement may include a small flat panel display screen mounted directly on HHD 20 .
- an exemplary HHD display screen 32 c is best illustrated in FIG. 15 and may include text instructions 228 to guide an HHD user to obtain an optimal image as well as an actual real time video display section 224 showing a most recently obtained image 226 and, in at least some cases, a phantom image 222 overlaid over the actual image to show an optimal image.
- an HHD 20 is equipped with its own feedback display arrangement 32 c
- relatively detailed instructions can be provided to an HHD user for obtaining optimal images.
- instructions 212 may be provided via display 32 c instructing HHD user to position the HHD lens 28 in front of an item identification tag (e.g., 202 ) to obtain identification information by pressing the activator button 30 .
- the HHD processor 21 identifies the item associated with the identification information and provides feedback 216 as shown in FIG.
- the image 226 is presented within image space 224 .
- an optimal image phantom 222 is provided within space 224 to help the HHD user to quickly and intuitively determine how the HHD position has to be modified in order to obtain the optimal image.
- instructions 228 are provided by the processor 21 to indicate textually how the HHD position has to be modified to obtain the optimal image.
- the instructions are provided in a step-wise fashion to first direct the HHD user with respect to pitch and roll, left and right and up and down movement and then to instruct the user with respect to forward and backward movement.
- the text instructions request that the user move the HHD to the right and rotate the HHD clockwise for optimal alignment.
- a new set of instructions 232 request that the user move the HHD forward for optimal alignment.
- processor 21 obtains a final image and uses that final image to identify features of interest and to calculate characteristics of interest from the features of interest. Next, in at least some applications, processor 21 compares the measured characteristics to the required characteristics and provides feedback. As illustrated in FIG. 17 , in the present example, processor 21 indicates the length, width and three thicknesses of interest for the blade and indicates that, in the present case, the blade curvature is outside the acceptable range.
- two or more image identifiers in column 76 may be associated with a single item identification number in column 78 .
- edge view image identifier 101 and plan view image identifier 103 are associated with item identification number 00 - 0002 in column 78 .
- processor 21 may provide alternate instructions and allow the HHD user to obtain any one of the optimal images through different movements of the HHD 20 .
- tag 202 corresponds to item identification number 00 - 0002 in database 17 ′ illustrated in FIG. 9 so that both edge view identifier 101 and plan view identifier 103 are associated with blade 200 .
- processor 21 may identify either of the edge view or the plan view images associated with image identifiers 101 and 103 as possible optimal images the HHD user is attempting to obtain.
- processor 21 may be programmed to provide alternate instructions 248 guiding the user to either align the HHD to obtain the optimal edge view image or to obtain the optimal plan view image.
- alternate instructions 248 guiding the user to either align the HHD to obtain the optimal edge view image or to obtain the optimal plan view image.
- FIG. 19 where the HHD user follows the instructions to obtain the optimal edge view image, once the optimal image has been obtained, characteristic dimensions associated therewith including thickness T 1 , T 2 and T 3 are obtained and feedback is provided regarding the measured values 260 as well as feedback regarding whether or not the values are acceptable 262 .
- FIG. 20 where the HHD user follows the instructions for obtaining the optimal plan view image, once the optimal plan view image is obtained, feedback 272 is provided indicating the measured values as well as providing warnings where appropriate.
- one additional and particularly advantageous supplemental function that may be performed by system 10 includes a part verification function.
- identification tags are provided on products or items so that product consumers can verify that the items are genuine parts from specific manufacturers that are known to provide high quality products.
- Harbinger Aero Parts may provide identification tags on each one of their rotor blades that can be used by an end user to attempt to verify authenticity.
- part counterfeiters have begun to copy the information on identification tags and place similar tags on counterfeit parts so that end users can no longer verify part authenticity by tag information alone.
- a source mark in the form of a trademark or the like can be provided either as part of an identification tag or proximate an identification tag such that when an image of the identification tag is obtained, an image of the source mark is also obtained.
- the source mark in addition to verifying an item identification number in an attempt to verify authenticity, the source mark can be compared to a trademark of the trusted supplier and, if the source mark is different than the trusted supplier's trademark, the part can be recognized as a counterfeit part.
- the source mark is not present in the obtained image, the part can be recognized as a counterfeit part. While part counterfeiters could copy source marks as well as identification tags and use those marks and tags together in an attempt to continue to counterfeit products, copying a source mark like a trademark would be a separate trademark violation and would be relatively easily actionable.
- an exemplary source mark 300 is shown printed or placed on a blade 200 next to an identification tag 202 where both the mark 300 and tag 202 can be simultaneously imaged for part verification purposes.
- an exemplary method 302 for verifying parts using a source mark and an identification tag is illustrated. Beginning at block 304 , a database is provided that correlates source marks with item identification information. At block 306 ID tags and source marks are placed on items to be used with the system 10 . At block 308 , an HHD 20 is provided that is capable of simultaneously reading ID tag and source mark combinations. At block 310 , the HHD is used to read a tag and source mark combination.
- the database is used to verify source mark authenticity.
- the database is used to identify the type of item associated with the identification tag.
- the HHD processor 21 determines whether or not the source mark and item type have been verified. Where the source type and item type have been verified, at block 318 processor 21 indicates that the part is authentic. In the alternative, where either the source mark or the item type has not been verified at block 316 , at block 320 the HHD processor 21 indicates that the part is likely a counterfeit part. Indication may be either audible (e.g., a small speaker) or visual (e.g., an LED or the like).
- HHD 20 may be used to obtain ten different optimal images of the product associated with the identification tag, the HHD processor 21 performing a different subset of supplemental functions for each one of the obtained images without having to reassociate with the product each time a new image is obtained.
- HHD 20 association with the previous product is broken and a new HHD product association is formed with the new product.
- a database is provided that correlates item IDs, optimal images, guidance functions, visually distinguishable item features of interest and feature functions.
- a HHD 20 including a camera/tag reader is provided at process block 354 .
- ID tags are provided on items or products.
- HHD 20 is used to obtain ID information from an ID tag located on one of the products.
- HHD 20 is used to obtain an image of the product including the tag from which identification information was most recently obtained.
- HHD processor 21 performs supplemental processes associated with the obtained identification information.
- HHD processor 21 determines whether or not new tag identification information has been obtained. Where new tag identification information has not been obtained, control passes down to block 366 .
- processor 21 determines whether or not some other disassociating indication has been received by the HHD.
- a disassociating indication may include holding the activation button 30 in for more than 5 continuous seconds. Where no other disassociating indication has been received, control passes back up to block 362 where the sub-loop including blocks 362 , 364 and 366 continues.
- kit component verification is contemplated.
- a kit 420 is illustrated that includes a number of components where at least one of the components includes a tag 422 .
- the tag information may be associated with a list of kit components in a database where image features include instances of the kit components along with instructions regarding how to identify the components in an image, the feature function being to identify each list component in an obtained image.
- the HHD processor 21 may be programmed to identify the tag in the image, obtain kit identification information from the tag, identify the kit image and component list, attempt to identify the kit components in the image and then provide feedback regarding whether or not the kit is complete and any components that do not appear in the kit.
- a portable HHD may be associated with an item in ways other than obtaining tag information from a tag that resides on the item.
- a tag may reside in a parts booklet or the like where the tag is spatially associated (e.g., on the same page in the booklet) with an image of the item/product.
- a tag for a rotor blade as described above may be presented next to an optimal image.
- an HHD user could obtain tag information from the booklet to associate the HHD temporarily with an item and then perform image obtaining processes and other supplemental processes using the HHD as described above.
- an end process or disassociation tag may be included in a booklet or elsewhere in proximity to where an HHD is used to disassociate the HHD with an item that the HHD is currently associated with.
- commissioning procedures are contemplated wherein items having known standard characteristics are imaged to generate at least one optimal image for each item and then features on the items are identified as well as feature characteristics of interest and acceptable ranges of characteristic values.
- the present invention may be used with any type of commissioning procedure that generates suitable database information.
- HHD including a camera/sensor capable of obtaining both ID tag information as well as images of products/items
- the camera and the tag reader are separate HHD components.
- the tag reader may take several forms including a bar code reader, an optical character recognition reader, an RF sensor, etc.
- optimal images instead of storing optimal images to facilitate guidance, other types of information that reflect optimal images may be stored. For instance, general orientation of edges of a product may be stored along with ranges of dimensions for comparison to similar features and dimensions in obtained images.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Electromagnetism (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Toxicology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
- Studio Devices (AREA)
Abstract
Description
- This patent is a continuation-in-part of U.S. patent application Ser. No. 11/020,640 which was filed on Dec. 22, 2004 and which has the same title.
- Not applicable.
- The present invention relates to machine vision and more specifically to portable machine vision systems for collecting images of items or groups of items, identifying the item(s) and performing one or more secondary functions using the collected images.
- When assembly lines were first configured to increase the rate of manufacturing processes, often the results of processes had to be measured by hand to ensure high quality products. For instance, where two parts had to be between two and 2⅛th inch apart, a line worker had to use some type of mechanical hand held measuring device to manually measure the distance between the two parts and confirm that the distance was within the required range. Similarly, where a bottle was to be filled to a specific height with detergent prior to shipping, a line worker would have to manually examine the bottle to ensure that the detergent level was within a required range. While manual inspection and measurement can have good results when performed correctly, in many cases such procedures were prone to error, were mundane for the persons performing the procedures, were relatively expensive and time consuming to implement and could only be performed on a random basis (i.e., on every 100th product that passed along the line).
- More recently, camera or machine vision systems have been developed that eliminate many of the problems associated with manual inspection procedures. For instance, in one application a camera and a light source may be rigidly mounted adjacent a station along a manufacturing transfer line including clamps that, when a semi-finished product is moved to the station, clamp the product in a precise juxtaposition (i.e., at a precise distance from and along a precise trajectory to) with respect to the camera and light source. Here, the camera and light source may be positioned twelve inches from and normal to a space between first and second product components such that an image of the clamped product generated by the camera shows the first and second components separated by the space having a space dimension. In this case, the image may be provided to a processor for identifying the space dimension and for comparing the identified dimension to a required space dimension between the first and second components.
- To determine the space dimension in the image, the processor is programmed to scale the space defined by the first and second components in the image appropriately assuming the precise juxtaposition of the camera to the components (i.e., assuming a normal camera trajectory and twelve inches between the camera and the space). Where the identified dimension is different than an expected and required dimension the processor may be programmed to reject the part, to store the difference, to indicate the difference, to suggest a correction to eliminate the difference, etc.
- Other imaging applications in addition to dimension determination include color verification, defect detection, object/pattern verification, object recognition, assembly verification and archival processes for storing images and/or other correlated information (e.g., the results of color verification processes, defect detection processes, etc.). In each of the applications listed above, camera images are processed in a different fashion to facilitate different functions but the precise juxtaposition restrictions required to generate meaningful/useful images still exist.
- Systems like the one described above work well in the context of mechanical components that ensure specific relative juxtapositions of a camera, a light source and a product or product feature being imaged. Hereinafter systems that rigidly mount cameras and light sources in specific positions with respect to other components that restrict product position during imaging will be referred to as “constrained vision systems”.
- Unfortunately, there are a huge number of manufacturing and other applications where constrained vision systems are not easily employed but where the advantages of machine vision described above (i.e., accuracy, speed, low cost, consistency, etc.) would be useful. For instance, in the case of jet engine manufacturing, engines are typically assembled in relatively small numbers at assembly stations. Here, an engine often includes a large number of different components and the dimensions and spacings between many of the components must be precise in order for the engine to operate properly. Measurement of each of the required dimensions and spacings would require an excessive number of stationary cameras and light sources and would therefore be too costly for most applications. In addition, even if costs associated with required stationary cameras and sources were not an issue, placement of the cameras and sources adjacent the assembly station and at proper positions for obtaining required images would be impossible given the fact that assembly personnel need to move freely within the assembly station space during the assembly process.
- Moreover, in many applications the product (e.g., a jet engine) being assembled may be mounted for rotation about one or more axis so that assembly personnel can manipulate the product easily to obtain different optimal vantage points for installing components. Here, where product position is alterable, even if a stationary camera were provided adjacent an assembly station, precise positioning of the camera with respect to the product would be difficult to achieve as the product is moved to optimize position for installation purposes. Where camera position with respect to the product/feature being imaged is unknown or is inaccurately assumed, resulting images can be mis-scaled such that comparison to required ranges is inappropriate. For instance, assume that a required distance between two features must be within a range of five and 5⅛th inches and a machine vision system assumes that a camera is twelve inches from and normal to a space between the two features when an image is obtained. In this case, when an image is obtained, the system may be programmed to identify the two features and measures the dimension there between. Thereafter, the system scales the measured dimension assuming the image was taken from twelve inches and at an angle normal to the space between the two features. In this case, if a camera used to obtain an image is at an angle (e.g., 15 degrees) with respect to normal and/or is fifteen inches from the space as opposed to twelve inches, the dimension calculated by the system will be different than the actual dimension and an error will likely be indicated even if the actual dimension is within the required range.
- Another exemplary application where constrained vision systems are not easily employed but where the advantages of machine vision described above would be useful is in small manufacturing plants. For instance, in a small metal working facility there may be 1000 different measurements that routinely need to be taken on various products. Here, while at least some of the 1000 measurements may need to be made hundreds of times each year, the volume of product associated with even the most routine measurements may not justify the costs associated with even a single stationary machine vision system. In these cases the advantages of machine vision are typically foregone and all measurements end up being manual.
- Thus, it would be advantageous to have a system and methods whereby the advantages of machine vision systems could be employed in many applications in which such advantages have heretofore been foregone for various reasons and where costs associated therewith can be reduced appreciably. More specifically, it would be advantageous to have a system and methods whereby one camera and light assembly could be used to obtain many different product/feature images of one or a plurality of products and where the system could automatically identify product types, image types and specific features associated with image and product types and could then perform product and image specific applications or supplemental processes. Furthermore, it would be advantageous to have a system and methods that provide guidance to a system operator for generally optimally positioning a camera/light source with respect to products and features for obtaining suitable images for processing.
- It has been recognized that many of the advantages associated with machine vision in the context of constrained vision systems above can be extended to other applications by providing a camera and light source on a hand held portable device (hereinafter an “HHD”). Here, the HHD can be positioned in any relative juxtaposition with respect to a product or product feature to obtain images thereof for analysis by system software. Where many different product characteristics need to be imaged for examination purposes, the camera can be positioned in several different positions to obtain the images. In at least some cases system software can be programmed to recognize an obtained image as similar to a specific one of a plurality of optimal stored images that includes specific features of interest so that, when the image is obtained, the system can automatically perform different processes on the image information.
- In at least some cases the HHD may include a guidance mechanism for helping a user position the HHD with respect to a product or feature for obtaining an image suitable for specific processes. In some cases guidance may be provided by simply transmitting a specific light pattern toward a product to show the field of camera view. In other cases the guidance may be “active” and include indications that direct an HHD user to move the HHD in specific directions relative to the product or feature being imaged. Where active guidance is provided, the HHD may have access to optimal product images stored in a database. Here, the HHD may obtain an image, compare the image to one or more of the optimal images to identify positional changes that would result in a more optimal positioning of the HHD and then provide guidance to move left, move right, move up, move down, move forward, move backward, adjust pitch, adjust roll, etc.
- Where the HHD is to be used to obtain images of two or more different product types, an identification tag (e.g., bar code, RFID tag, etc.) may be placed on each of the products with information useable to identify the product and the HHD may also be equipped with a tag reader for obtaining information form the tags. In this case, prior to or after obtaining an image of a product, the HHD may be used to obtain information from the tag so that the product type can be determined. The HHD may be programmed to perform different functions for each different product type. For instance, for a first product type the HHD may be programmed to guide the HHD user to obtain two different images that are similar to optimal stored images and to perform various measurements of features in the images while, for a second product type the HHD may be programmed to guide the HHD user to obtain five different images from various orientations and to perform various measurements of features in the five images. After the tag information is obtained the HHD can perform product type specific processes and provide product type specific instructions.
- Consistent with the above comments, at least some embodiments of the present invention include a method for use with a portable device including a processor, the method comprising the steps of providing an identification tag on at least one item that includes item identifying information, obtaining item identifying information from the identification tag via the portable device, obtaining at least one image of the at least one item via the portable device and performing a supplemental process using the identifying information and the at least one image.
- In addition, some embodiments of the invention include a method for use with a database and a portable device including a processor, the method comprising the steps of (a) storing information in the database regarding at least one optimal relative juxtaposition of the portable device with respect to a first item type to be imaged, (b) positioning the portable device proximate an instance of the first item, (c) obtaining at least one intermediate image of the first item instance; an (d) providing guidance information indicating relative movement of the portable device with respect to the first item instance to move the portable device toward the at least one optimal relative juxtaposition with respect to the first item instance.
- Here, in some cases the method may further include the step of, prior to step (d), examining the intermediate image to identify position of the portable device with respect to the first item instance, the step of providing guidance including providing guidance as a function of the intermediate image examination. Steps (b) through (d) may be repeated until the portable device is at least substantially in the at least one optimal relative juxtaposition with respect to the first item instance.
- At least some embodiments of the invention include a method for use with a database and a portable device including a processor, the method for obtaining information associated with a subset of a plurality of different item types, the method comprising the steps of providing an identification tag on at least one item that includes item identifying information, obtaining item identifying information from the identification tag via the portable device, identifying the item type from the item identifying information, obtaining at least one image of the at least one item via the portable device, identifying at least one supplemental process to be performed on the obtained image wherein the supplemental subprocess is identified at least in part as a function of the item type and performing the at least one supplemental process on the obtained image.
- In addition, according to some inventive aspects, some embodiments include a method for use with a database and a portable device including a processor, the method for performing functions associated with different items, the method comprising the steps of providing identification tags on each of a plurality of items, each tag including identifying information useable to specifically identify an associated item, obtaining item identifying information from at least one identification tag corresponding to a specific item via the portable device, obtaining other information associated with the specific item including at least one image of the specific item via the portable device, performing supplemental processes on the other information associated with the specific item, monitoring the portable device for a transition indication and, when a transition indication is received, halting the supplemental processes.
- Some embodiments include a system for use with items that include identification tags where each tag includes item identifying information, the apparatus comprising a portable housing. a processor mounted within the housing, a tag information obtainer supported by the housing for obtaining information from the tags and a camera supported by the housing, wherein, the processor runs a program to, when information is obtained from a tag via the obtainer and an image is obtained via the camera, perform a supplemental process on the image as a function of the information obtained from the tag.
- Moreover, some embodiments of the invention include an apparatus for use with items that include identification tags where each tag includes item identifying information, the apparatus comprising a portable housing, a processor mounted within the housing, a tag information obtainer supported by the housing for obtaining information from the tags and a camera supported by the housing, wherein, the processor runs a program to, when information is obtained from a tag associated with a specific item via the obtainer, perform supplemental processes associated with the specific item on images obtained by the camera until a transition indication is received and, when a transition indication is received, halting the supplemental processes associated with the specific item.
- Furthermore, some embodiments include a method for use with a portable device including a processor, the method comprising the steps of identifying at least one item using the portable device, obtaining at least one image of the at least one item via the portable device and performing a supplemental process on the at least one image as a function of the identity of the item.
- According to one aspect the invention includes a method for marking a product for use with a camera including a field of view, the method comprising the steps of providing an identification tag on the product wherein the tag is machine readable to obtain information associated with the product and providing a source mark on the product spatially proximate the tag such that both the tag and the source mark can be simultaneously located within the camera field of view.
- In addition, some embodiments include a method for use with a portable device including a processor, the method comprising the steps of associating an identification tag with at least one item that includes item identifying information, obtaining item identifying information from the identification tag via the portable device, obtaining at least one image of the at least one item via the portable device and performing a supplemental process using the identifying information and the at least one image. Here, the step of associating may include providing the identification tag on the item or providing the tag in a booklet along with human distinguishable information associated with the item.
- These and other objects, advantages and aspects of the invention will become apparent from the following description. In the description, reference is made to the accompanying drawings which form a part hereof, and in which there is shown a preferred embodiment of the invention. Such embodiment does not necessarily represent the full scope of the invention and reference is made therefore, to the claims herein for interpreting the scope of the invention.
-
FIG. 1 is a schematic view of an exemplary system including a handheld portable identification tag reader and camera device according to at least some aspects of the present invention; -
FIG. 2 is a schematic diagram illustrating some of the components that form the handheld device ofFIG. 1 ; -
FIG. 3 is a perspective view of the handheld device ofFIG. 1 being used to obtain information from an identification tag according to at least some aspects of the present invention; -
FIG. 4 is a flow chart illustrating an exemplary method according to the present invention; -
FIG. 5 is a perspective view of a handheld device like the one illustrating inFIG. 1 being used to obtain an image of an item for performing any of several different supplemental processes according to various aspects of the present invention; -
FIG. 6 is a flow chart illustrating a subprocess that may be substituted for a portion of the method ofFIG. 4 ; -
FIG. 7 is a an exemplary database according to at least some aspects of the present invention; -
FIG. 8 is a flow chart illustrating another exemplary method according to at least some embodiments of the present invention; -
FIG. 9 is an exemplary database consistent with at least some aspects of the present invention; -
FIG. 10 is a plan view of an exemplary feedback arrangement that may form part of the handheld device ofFIG. 1 ; -
FIG. 11 is similar toFIG. 8 , albeit illustrating another method according to at least some embodiments of the present invention; -
FIG. 12 is another exemplary feedback arrangement according to at least some aspects of the present invention; -
FIG. 13 is a screenshot for providing HHD guidance information according to at least some aspects of the present invention; -
FIG. 14 is similar toFIG. 13 , albeit providing other guidance information; -
FIG. 15 is similar toFIG. 14 , albeit providing other guidance information as well providing a real time image and a phantom showing an optimal image orientation; -
FIG. 16 is similar toFIG. 15 , albeit providing other guidance instructions; -
FIG. 17 is similar toFIG. 15 , albeit providing results of a supplemental process after an optimal image has been obtained; -
FIG. 18 is similar toFIG. 15 , albeit providing alternate instructions for obtaining either of two different optimal images; -
FIG. 19 is similar toFIG. 18 , albeit providing results after an optimal image has been obtained; -
FIG. 20 is similar toFIG. 19 , albeit providing results after a different optimal image has been obtained; -
FIG. 21 is a partial plan view showing a source mark and an identification tag on an item; -
FIG. 22 is a flow chart illustrating a method for verifying parts according to at least some aspects of the present invention; -
FIG. 23 is a flow chart illustrating a method for associating a portable device with a product for processing; and -
FIG. 24 is a schematic diagram illustrating an HHD being used to obtain an image of a kit including various components according to at least some aspects of the present invention. - One or more specific embodiments of the present invention will be described below. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
- Referring now to the drawings wherein like reference numerals correspond to similar elements throughout the several views and, more specifically, referring to
FIG. 1 , the present invention will be described in the context of anexemplary information system 10 including awork station 12, aserver 13, adatabase 14, awireless access point 16 and a handheld portable devices (HHD) 20.Work station 12 is linked toserver 13 for two-way communication via a network generally identified bynumeral 18. In addition,server 13 is linked vianetwork 18 to accesspoint 16 as well as todatabase 14 for two-way communication therewith.Server 13 runsprograms 15 stored indatabase 14 to perform various methods according to the present invention which will be described hereinafter. - In addition to storing
programs 15 run byserver 13,database 14 also stores information in a product/function database 17 corresponding to items or products for which some process or method may be performed bysystem 10. In addition, in at least some embodiments of the present invention,database 14 also stores results or at least a subset of the results in aresults database 19 that occur afterprograms 15 have been performed. - In at least some embodiments of the present invention,
interface 12 includes adisplay screen 22 and some type input device such askeyboard 24. Other types of input devices are contemplated including a mouse, a track ball, voice recognition hardware, etc. Usingwork station 12, a system operator can perform various tasks, depending upon the method being performed byserver 13, to facilitate method steps to be described hereinafter. -
Access point 16, as well known in the art, is a wireless transceiver that is capable of receiving wireless signals (e.g., 802.11b, blue tooth, etc.) and transmitting similarly coded wireless information within the area surroundingaccess point 16. Whenaccess point 16 receives information, the information is decoded and transmitted toserver 13 vianetwork 18. Similarly,server 13 can transmit information wirelessly within the space surroundingaccess point 16 by transmitting the information first vianetwork 18 to accesspoint 16 and causingaccess point 16 to transmit the information within the surrounding area. - Referring still to
FIG. 1 and also toFIG. 2 ,HHD 20 includes ahousing 26 having a pistol type shape and includes a grip shapedhandle 27 for easy gripping via a user's hand and abarrel 29 that extends away from a user whenhandle 27 is gripped. An activation button in the form of atrigger 30 is provided onhandle 27 where a users index finger resides during normal use. Within housing 26 a plurality of components are mounted including, among other things, aprocessor 21, acamera 23, anHHD memory device 25, alight source 11 and acamera lens 28. In at least someembodiments HHD 20 also includes aseparate tag reader 400, some type offeedback device transceiver 34, shown linked toprocessor 21 via phantom lines to indicate that at least some embodiments do not include these or a subset of these components.Processor 21 is linked for two-way communication tomemory device 25 for storing programs and information therein and retrieving program code and stored information when required. In addition, where HHD includes atransceiver 34,processor 21 is linked for two-way communication totransceiver 34 so thatprocessor 21 can communicate withserver 13 viaaccess point 16 andnetwork 18 to receive information therefrom and provide information thereto. - Referring still to
FIG. 2 ,processor 21 is linked to activation button/trigger 30 for receiving activation signals therefrom.Processor 21 is linked tolight source 11 for controlling activation thereof. In at least some cases source 11 will include two or more white light LEDs that shine light through lens 28 (see againFIG. 1 ) whentrigger 30 is activated to illuminate a space in front oflens 28. In some cases whentrigger 30 is activated the LEDs generate a short flash of light. In some cases it is contemplated that thelight source 11 may be capable of generating continuous light over a longer duration (e.g., 20 seconds).Processor 21 is also linked to camera/sensor 23 for receiving images generated thereby. - Referring still to
FIG. 1 ,camera lens 28 is at the front end ofbarrel 29 and has a field of view identified bynumeral 42. In the embodiment illustrated inFIG. 1 ,transceiver 34 is mounted near the top end ofbarrel 29 to facilitate relatively unobstructed communication withaccess point 16.Feedback configuration 32, 39 (39 is a speaker) is mounted on the top surface ofbarrel 29 to facilitate feedback to an HHD operator. - Referring to
FIG. 3 , an exemplary product, a jetengine rotor blade 200, is illustrated where the blade includes various features (e.g., edges) and feature characteristics (e.g., dimensions, curvatures, colors, etc.). For instance,blade 200 includes edges F1 through F12, top, middle and bottom thickness T1, T2 and T3 between edges F1 and F2, edges F3 and F4 and edges F5 and F6, respectively, a length dimension L between edges F7 and F8, a width dimension W between edges F9 and F10 and a curvature between edge portions F11 and F12. Hereinafter, whileHHD 20 may be, and indeed is intended to be, used with many different product/item types in at least some applications, HHD operations will be described in the context ofexemplary blade 200. InFIG. 3 , anidentification tag 202 is provided onblade 200 that includes a conventional bar code. Other identification tag types are contemplated including 2D bar codes, dot matrices, RFID tags, optical character recognition type tags, etc. - Referring now to
FIG. 4 , an exemplary simplified andgeneral method 110 according to at least some aspects of the present invention is shown. In the case of this first example, it is assumed thatHHD 20 does not itself include afeedback configuration 32 and that, in fact,HHD 20 may be used independent of the other system components illustrated inFIG. 1 . Referring also toFIGS. 1 and 2 , atblock 108, adatabase 17 is provided that correlates item identification information and supplemental item related functions. - At
block 111,HHD 20 is provided that includes a camera/tag reader as described above. Atblock 112, identification tags are provided onitems including blade 200 inFIG. 3 to be used withsystem 10. Continuing, atblock 114, a system user usesHHD 20 to obtain identification information from one of the ID tags 202. Atblock 116,HHD 20 is used to obtain an image of the item associated with the most recently obtained tag information. For instance, referring once again toFIG. 3 and also toFIG. 5 , whereHHD 20 is used to obtain ID information fromtag 202 atblock 114 wheretag 202 resides onblade 200, atblock 116,HHD 20 is used to obtain an image of blade 200 (seeFIG. 5 ). Atblock 117,HHD processor 21 identifies the item associated withtag 202 indatabase 17 and the correlated supplemental function(s). Atblock 118processor 21 performs the supplemental function(s) using the obtained image. Thus, for instance, where the supplemental function is simply to store the obtained image with item identifying information,processor 21 may store the obtained image correlated with the identifying information inHHD memory 25. - According to other embodiments of the present invention, instead of requiring a system user to separately obtain an item image and identification information from a
tag 202 or the like, a single image may be obtained which includes features of an item that are of interest as well as the tag information. For instance, referring once again toFIG. 5 , in at least somecases HHD 20 may be useable to obtain a full image ofblade 200 including information specified bytag 202. Here, after an item image has been obtained,processor 21 may be programmed to isolate the region of interest of the obtained image including thetag 202, read the tag information and then perform a supplemental process on the image as a whole that is associated with the identification tag information. - Consistent with the comments in the preceding paragraph, referring now to
FIG. 6 , an exemplary subprocess that may be substituted for a portion of the process ofFIG. 4 is illustrated. Referring also toFIG. 4 , after ID tags are provided on items to be used withsystem 10,HHD 20 may be used to obtain a image of an item where the image includes the ID tag on the item as well as other item features. Next, atblock 130,HHD processor 21 identifies the ID tag (e.g., 202 inFIG. 6 ) in the image and reads the identification information thereon. Afterblock 130, control passes back to block 117 inFIG. 4 where the process described above continues. - In addition to storing correlated images and item/product identifying information, other supplemental functions are contemplated that may be performed via
HHD 20. For instance, in at least some cases, it is contemplated thatHHD 20 may perform programs to analyze obtained images to identify regions of interest in the images, visually distinguishable product features within regions of interest and characteristics of those features. For example, referring again toFIG. 3 ,HHD 20 may be programmed to, when tag information indicates that an item associated therewith is arotor blade 200, analyze the obtained image to identify top and bottom edges F7 and F8, respectively, measure the length dimension L between edges F7 and F8, and store the length dimension L correlated with the blade identifying information inHHD memory 25. Similarly, any of the other blade dimensions T1, T2, T3, W or C may be calculated and stored. - As another example, where optimal product dimensions have been specified in a database (e.g., in memory 25),
HHD processor 21 may be programmed to, after item/product dimensions have been calculated, compare the calculated values to the optimal values and store results of the comparison in a correlated fashion with item identifying information inHHD memory 25. - Referring still to
FIG. 1 , whereHHD 20 includes atransceiver 34, some or at least a portion of processing described above and hereinafter may be performed byserver 13. For instance, tag identification information and images may be wirelessly transmitted fromHHD 20 toserver 13 viaaccess point 16 andnetwork 18 so thatserver 13 can perform the item/product identifying process, identify supplemental functions and perform supplemental functions. - Similarly, in at least some cases,
HHD 20 may simply obtain tag identifying information and product images, correlate and store the identifying information and images and download the correlated information toserver 13 in batch either wirelessly or via a hard wire connection (e.g., a USB port), additional supplemental processes being performed thereafter viaserver 13. - Where
work station 12 or at leastdisplay 22 is proximate the location ofblade 200 during the imaging process andserver 13 performs at least parts of the supplemental processes,server 13 may provide at least a subset of the process results to an HHD user viadisplay 22. For instance, product images may be provided viadisplay 22 as well as product identifying information (e.g., “rotor blade type 00-0001”). As another instance, where product features and characteristics are calculated from an image, the calculated values may be provided viadisplay 22 either in a list form or, where an obtained image is generated, as markings on the generated image. As still one other instance, where calculated values are different than expected or optimal values, the differences may be indicated viadisplay 22 in some fashion. Moreover, where calculated values are within an expected or acceptable range, an affirmation of the values as acceptable may be provided viadisplay 22. The above feedback functions may also be performed/facilitated viadisplay 22 whereHHD processor 21 performs most of the supplemental functions and then transmits results to the display viapoint 16 andnetwork 18. - Referring now to
FIG. 7 , an exemplary, albeit simplified, product/function database 17 is illustrated that includes three separate columns, an itemID No. column 78, an image featurescolumn 86 and afeature function column 92. ItemID No. column 78 lists a separate identification number for each one of the items that may be used bysystem 10 inFIG. 1 . For instance, in the present example where the rotor blade ofFIG. 3 is an item for which supplemental processes may be performed, an identification number would be listed incolumn 78 for a rotor blade type. Hereinafter, unless indicated otherwise, it will be assumed that item number 00-0001 corresponds torotor blade 200 as illustrated inFIG. 3 . In theexemplary database 17, item numbers 00-0002 and 00-0003 correspond to a seat frame and a motor chassis, respectively. - Referring still to
FIG. 7 , image featurescolumn 86 lists at least one and, in many cases, a plurality of feature subsets (each subset including at least one feature) for each one of the identification numbers incolumn 78. For instance,column 86 lists sixfeature subsets column 78. The feature subsets 82, 90, 91, 93, 95 and 97 corresponding to image ID number 00-0001 include features F1 and F2, features F3 and F4, features F5 and F6, features F7 and F8, features F9 and F10 and features F11 and F12 which correspond to different edges ofrotor blade 200 as illustrated inFIG. 3 . Here, in addition to identifying features of interest that should be visually discernable within images to be obtained, it is contemplated that instructions for eitherprocessor 21 orserver 13 will also be specified incolumn 86 or elsewhere that indicate how the features should be identified in obtained images. For instance, referring again toFIGS. 3 , 5 and 7, instructions for identifying top and bottom edges F7 and F8 may simply causeprocessor 21 orserver 13 to identify the most distal edges within an obtained image or to identify the length dimension generally as the long dimension of the product and then identify the edges that define the length. - Here it is contemplated that the instructions for identifying features would be provided or specified during some type of commissioning procedure. For instance, in at least some cases an
HHD 20 may be used to obtain an image of a product where the image includes the features (e.g., edges, curvatures, etc.) of interest. Next, the obtained image may be presented viadisplay 22 and interface tools (e.g., a mouse, trackball, etc.) may be used to select image features such as edges. Here, software run byserver 13 may help the user charged with commissioning to distinguish features. For instance, where a mouse controlled cursor is moved to edge F7 (see againFIG. 3 ), the software may identify the edge from differences in color in the image and highlight the border or edge F7 for selection via the mouse input device. Once a feature is selected in a commissioning image, the software may automatically identify a specific region of interest within the obtained image in which the feature resides and develop and store rules for identifying similar features in subsequent images. - Referring again to
FIG. 7 ,feature function column 92 indicates a different function for each one of the feature subsets listed incolumn 86. For instance, afirst function 94 indicates that a thickness T1 defined by the space between features F1 and F2 is to be measured. Similarly, characteristic 96 indicates that a middle thickness T2 between features F3 and F4 should be measured. The characteristics associated withfeature subsets HHD processor 21 orserver 13 to perform some additional function such as, for instance, storing measured values, comparing measured values to required values and indicating variances, comparing measured and required/expected values and indicating when measured values are within required ranges, etc. - Here again it is assumed that the feature functions are specified during a commissioning procedure. For instance, after features of interest have been identified and rules for identifying the features in obtained images have been developed and stored,
server 13 may provide an interface for grouping image features into subsets (e.g., 82, 90, 91, etc) and for selecting associated feature functions. For example, referring again toFIGS. 3 and 7 , after edge sections F1 and F2 are selected (e.g., subset 82), the commissioning software may provide function options including “Measure dimension and provide feedback via display”, “Measure dimension and store”, “Measure dimension, compare to range of acceptable dimensions and indicate differences”, etc. When a feature function is selected in this example, it is contemplated thatserver 13 would populate an associated section offeature function column 92. Other commissioning procedures are contemplated. - Hereinafter, unless indicated otherwise, it will be assumed that
HHD processor 21 performs most of the supplemental processes. Nevertheless, it should be appreciated that, in at least some cases, some or most of the process steps could also be performed byserver 13 in communication withHHD 20 viaaccess point 16. - Referring now to
FIG. 8 , anexemplary method 136 according to at least some aspects of the present invention is illustrated. Referring also toFIGS. 2 , 3, and 7, atblock 138, adatabase 17 is provided that correlates item IDs, visually distinguishable image features of interest to be identified in obtained images and feature function information. Atblock 140, anHHD 20 is provided that includes a camera/tag reader as described above. Atblock 142, ID tags are provided on items to be used withHHD 20. Atblock 144,HHD 20 is used to obtain ID information from an ID tag (e.g., 202, inFIG. 7 ). Atblock 146HHD processor 21accesses database 17 to identify features of interest and feature functions correlated with the obtained product identification information. Atblock 148,HHD 20 is used to obtain an image of the item from which the identification information was most recently obtained. Atblock 150,processor 21 identifies the item features of interest in the obtained image. Atblock 152,processor 21 ascertains feature characteristics for comparison to expected characteristics or to a range of expected characteristics. Consistent with the example above,processor 21 may attempt to identify any of thicknesses T1, T2 or T3, length L, width W or curvature C. - Continuing, at
block 154,processor 21 compares image characteristics to required characteristics to identify any differences. Atblock 156,processor 21 provides feedback regarding feature characteristics. Here, in at least some embodiments, it is contemplated that to provide feedback,processor 21 transmits information viatransceiver 34 to accesspoint 16 and on toserver 13 which provides feedback viadisplay screen 22. In at least some cases, afterblock 156, eitherprocessor 21 orserver 13 may be programmed to correlate and store item identification information, features and characteristic information including any differences between measured and required characteristics in the results database 19 (see againFIG. 1 ). - While the systems described above have several advantages, such systems also may have some short comings in the context of certain applications. For example, in general, the systems described above rely on the assumption that an HHD user will be extremely familiar with the products being imaged, the supplemental functions or processes being performed via the system and advantageous relative juxtapositions (e.g., angle, spacing, pitch of HHD, etc.) between the HHD and the products/features being imaged from which to obtain the images. Indeed, to obtain an image including features of interest for performing the supplemental functions, the HHD user would have to know which features are of interest and generally optimal angles and distances of the HHD to the product being imaged to ensure that suitable images are obtained for accurately identifying the features and feature characteristics. Here, while filtering and software compensation schemes may be used to compensate for minor differences between angles and distances of the camera to the features of interest, larger differences may not be accurately discernable and hence may not be able to be accurately compensated. Where an HHD user is not familiar with products, advantageous imaging juxtapositions and product features of interest however, the systems described above would be difficult to use at best.
- To deal with the alignment problem described above, in at least some cases it is contemplated that
system 10 may be programmed to help an HHDuser position HHD 20 such that an image obtained thereby is optimal for performing other functions such as dimension measurement, color identification, and so on. To this end, referring toFIG. 9 , in at lease some cases an expanded product/function database 17′ may be provided that includes, in addition toID number column 78, featurescolumn 86 andfeature function column 92, anoptimal images column 76. As illustrated,optimal images column 76 lists at least one and, in some cases, several optimal images, for each one of the item ID numbers listed incolumn 78. For instance, animage identifier 73 which is labeled “I-1 (30° front view)” is listed incolumn 76 for item identification number 00-0001 incolumn 78. As another instance, two separate image identifiers are listed incolumn 76 for item identification number 00-0002, twelve separate image identifiers are listed incolumn 76 for ID number 00-0003, and so on. - Here, it is assumed that an optimal image of a product has been captured during a commissioning procedure and stored in
database 17 for each of the image identifiers listed incolumn 76. The idea here is that, whenHHD 20 is used to obtain an image of a product, the obtained image can be compared to one or more optimal images to identify HHD movements required to move the HHD into an optimal juxtaposition with respect to the product being imaged or at least to identify if the HHD is within an acceptable range of optimal relative juxtapositions. In this case, an HHD position within an optimal range of relative juxtapositions will include a position wherein the characteristics that can be calculated from an image obtained from the position will be sufficiently accurate for the application associated with the characteristics. Here, sufficiency of accuracy is a matter of designer choice. - Feedback can be provided either via the HHD or some external device (e.g.,
display 22, see againFIG. 1 ) to help the HHD user reposition the HHD for obtaining a more optimal image for use in performing other supplemental functions. Here, it is assumed that a guidance program can be located inHHD memory device 25 that can compare obtained images to optimal images, identify differences and generate relatively simple guidance instructions usable by an HHD user to realign the HHD with an item being imaged. In addition, the guidance program can recognize when an obtained image is optimal or at least relatively optimal and can then use that image to perform other functions. For instance, exemplary simple guidance instructions may indicate that an HHD is aligned or misaligned with an item being imaged and may also indicate when an optimal image has been obtained. As another example, the HHD may be capable of indicating that the HHD should be moved up, down, left, right, forward and in reverse in addition to indicating whether or not the top of the HHD should be moved forward or backward or left or right to affect pitch and roll adjustments of the HHD. Other more complex and helpful active guidance systems are contemplated as described hereinafter. - Referring again to
FIG. 9 , as indicated above, in at least some cases more than one optimal image may be associated with a single product. For instance, an edge view image associated withidentifier 101 and a plan view associated withidentifier 103 are specified for a rotor blade having ID number 00-0002. Where two or more optimal images are associated with one product, it is contemplated thatHHD 20 may be programmed to identify the optimal image most like an obtained image and provide guidance toward obtaining an image akin to the most similar optimal image. Here it is contemplated that the supplemental functions associated with each different optimal image would be different. For instance, as seen inFIG. 9 , functions including calculating T1, T2 and T3 are associated withoptimal image identifier 101 while functions including calculating L, W and C are associated withoptimal image identifier 103. - Referring now to
FIG. 10 , an exemplarysimplified feedback configuration 32 a is illustrated including three light emitting diodes (LEDs) 36, 38 and 40 that are arranged on the top surface ofhousing barrel 29 within easy view of an HHD operator. The LEDs are labeled as “misaligned”, “aligned” and “image obtained” indicating misalignment, alignment and that an optimal image has been obtained. WhenHHD 20 is being used to obtain an item image, if the obtained image is not substantially similar to an optimal image,misaligned LED 36 is illuminated. Once an obtained image is substantially aligned with an optimal image, alignedLED 38 is illuminated andmisaligned LED 36 is turned off. After an optimal image or at least an image that is suitable for performing feature functions associated therewith has been obtained,LED 40 is illuminated. - Referring now to
FIG. 11 , anexemplary method 160 according to at least some aspects of the present invention where active guidance is provided to anHHD 20 user is illustrated. Referring also toFIGS. 1 , 2, 3, 9 and 10, atblock 162, adatabase 17′ that correlates item IDs, optimal images, visually distinguishable image features and feature functions is provided. Atblock 164, an HHD including a camera/tag reader is provided. Atblock 166, ID tags are provided on items to be used withsystem 10. Atblock 168,HHD 20 is used to obtain ID information from one of the item ID tags. Atblock 170,HHD processor 21accesses database 17′ to identify optimal images associated with the obtained ID information. Consistent with the example above, where information has been obtained fromtag 202 onblade 200,processor 21 identifies the optimal image associated withimage identifier 73. - Continuing, at
block 172,HHD 20 is used to obtain an intermediate image ofblade 200. Atblock 174,processor 21 compares the compared and optimal images to identify the optimal image that is most similar to the obtained image. In the present case, because there is only one optimal image incolumn 76 associated with the rotor blade identification number 00-0001, the single optimal image associated withidentifier 73 is identified atblock 174. In other cases where two or more optimal image identifiers are listed in column 76 (e.g., in the case of blades have ID number 00-0002),processor 21 selects one of the optimal images for performing the guidance process atblock 174. - After
block 174, atblock 176,processor 21 determines whether or not the obtained image is substantially similar to the most similar optimal image (e.g., the obtained image is suitable for sufficiently accurately performing the feature functions associated therewith). Where the obtained image is not substantially similar to the optimal image, control passes to block 178 whereprocessor 21 provides guidance via the feedback devices (e.g., theLEDs FIG. 10 ). Afterblock 178, control passes back up to block 172 where thesubprocess including blocks - Referring once again to block 176, once the obtained image is substantially similar to one of the optimal images, control passes from
block 176 to block 179 where the most recent intermediate image is used as a final image. In addition, feedback indicating alignment may be provided viaLEDs FIG. 10 ). Atblock 180,processor 21 again accessesdatabase 17′ to identify features of interest that should be visually distinguishable in the obtained image, the functions to be performed on the features and the required characteristics that are correlated with the item identification number and matching optimal image. Again, in the present example,processor 21 identifies features F1 through F12 as of interest and dimensions T1, T2, T3, L, W and C to be measured. Atblock 182,processor 21 attempts to identify the features of interest in the obtained image. Atblock 183,processor 21 uses the identified features to calculate the characteristics that are to be compared to the expected characteristics. Atblock 184,processor 21 compares the calculated characteristics to the expected characteristics to identify differences. Atblock 186, feedback regarding any differences is provided. - Here, once again, in at least some embodiments, feedback will be provided by transmitting feedback information to access
point 16 and on toserver 13 where server provides the feedback information viadisplay 22. In other embodiments feedback may be provided via an audio speaker 39 (see againFIG. 1 ) linked toprocessor 21. Here, where all calculated values are within acceptable ranges, processor may generate a sound discernable as an affirmation of the product dimensions whereas, if one or more values are outside acceptable ranges some other discernible sound may be generated. In the alternative, one or two additional LEDs could be provided as part offeedback assembly 32 a (see againFIG. 10 ) to indicate acceptable or unacceptable calculated values. - Referring now to
FIG. 12 , a secondexemplary feedback arrangement 32 b is illustrated which includes ten separate arrow shaped covers provided over LEDs to provide active guidance to an HHD user for obtaining an optimal image. Here, the arrows are divided into two groups, one to indicate desirable HHD position movements within aspace 44 and a second group to indicate desirable HHD orientation movement provided within aspace 46. The arrows withinposition space 44 include an uparrow 52, adown arrow 56, aleft arrow 54, aright arrow 50, aforward arrow 60 and aback arrow 62. As the labels imply, theposition arrows arrow 50 indicating that the HHD should be moved to the right may be illuminated. Similarly, if an item appears much smaller in an obtained image than is optimal,arrow 60 may be illuminated to indicate that the HHD should be moved forward with respect to the item. - Similarly, the orientation arrows indicate how the barrel of the
HHD 20 should be moved to adjust pitch and roll. For instance, whenarrow 66 is illuminated, theHHD barrel 29 should be moved forward with respect to the HHD handle 27 thereby affecting a forward pitch movement. Similarly, wherearrow 68 is illuminated, thebarrel 29 should be rotated to the right with respect to handle 27 affecting a roll of the HHD. - In at least some other embodiments it is contemplated that a feedback arrangement may include a small flat panel display screen mounted directly on
HHD 20. To this end, an exemplaryHHD display screen 32 c is best illustrated inFIG. 15 and may includetext instructions 228 to guide an HHD user to obtain an optimal image as well as an actual real timevideo display section 224 showing a most recently obtainedimage 226 and, in at least some cases, aphantom image 222 overlaid over the actual image to show an optimal image. - Where an
HHD 20 is equipped with its ownfeedback display arrangement 32 c, relatively detailed instructions can be provided to an HHD user for obtaining optimal images. To this end, referring once again toFIGS. 1 , 2, 3 and 9 and also toFIG. 13 , initially whenHHD 20 is turned on,instructions 212 may be provided viadisplay 32 c instructing HHD user to position theHHD lens 28 in front of an item identification tag (e.g., 202) to obtain identification information by pressing theactivator button 30. Next, after identification information has been obtained, theHHD processor 21 identifies the item associated with the identification information and providesfeedback 216 as shown inFIG. 14 that identifies the type of item as well as provides anotherinstruction 218 to direct the lens at the blade along a 30° front view trajectory as required to obtain the optimal image (see again imageindicator 73 incolumn 76 ofFIG. 9 ). Once an image of the item is obtained, as illustrated inFIG. 15 , theimage 226 is presented withinimage space 224. In addition, anoptimal image phantom 222 is provided withinspace 224 to help the HHD user to quickly and intuitively determine how the HHD position has to be modified in order to obtain the optimal image. In addition,instructions 228 are provided by theprocessor 21 to indicate textually how the HHD position has to be modified to obtain the optimal image. - In the illustrated example, the instructions are provided in a step-wise fashion to first direct the HHD user with respect to pitch and roll, left and right and up and down movement and then to instruct the user with respect to forward and backward movement. Thus, in
FIG. 15 the text instructions request that the user move the HHD to the right and rotate the HHD clockwise for optimal alignment. InFIG. 16 , once the operator has moved the HHD right and rotated the HHD counter-clockwise, a new set ofinstructions 232 request that the user move the HHD forward for optimal alignment. - Referring to
FIG. 17 , after the HHD has been moved forward an appropriate amount and the obtainedimage 226 is substantially similar to theoptimal image 222,processor 21 obtains a final image and uses that final image to identify features of interest and to calculate characteristics of interest from the features of interest. Next, in at least some applications,processor 21 compares the measured characteristics to the required characteristics and provides feedback. As illustrated inFIG. 17 , in the present example,processor 21 indicates the length, width and three thicknesses of interest for the blade and indicates that, in the present case, the blade curvature is outside the acceptable range. - Referring once again to
FIG. 9 , as described above, in at least some cases, two or more image identifiers incolumn 76 may be associated with a single item identification number incolumn 78. Again, inFIG. 9 , edgeview image identifier 101 and planview image identifier 103 are associated with item identification number 00-0002 incolumn 78. - In at least some cases it is contemplated that where multiple optimal images are associated with a single item identification number and an obtained image is similar to two or more of the optimal images,
processor 21 may provide alternate instructions and allow the HHD user to obtain any one of the optimal images through different movements of theHHD 20. For the purposes of the next example, referring again toFIG. 3 , it will be assumed thattag 202 corresponds to item identification number 00-0002 indatabase 17′ illustrated inFIG. 9 so that bothedge view identifier 101 andplan view identifier 103 are associated withblade 200. Referring once again toFIGS. 1 , 2, 5 and 9 as well asFIG. 18 , after identification information has been obtained from atag 202 onblade 200 as well as animage 226 ofblade 200,processor 21 may identify either of the edge view or the plan view images associated withimage identifiers - In this case,
processor 21 may be programmed to providealternate instructions 248 guiding the user to either align the HHD to obtain the optimal edge view image or to obtain the optimal plan view image. Referring toFIG. 19 , where the HHD user follows the instructions to obtain the optimal edge view image, once the optimal image has been obtained, characteristic dimensions associated therewith including thickness T1, T2 and T3 are obtained and feedback is provided regarding the measuredvalues 260 as well as feedback regarding whether or not the values are acceptable 262. Referring toFIG. 20 , where the HHD user follows the instructions for obtaining the optimal plan view image, once the optimal plan view image is obtained, feedback 272 is provided indicating the measured values as well as providing warnings where appropriate. - In addition to the supplemental functions'described above, one additional and particularly advantageous supplemental function that may be performed by
system 10 includes a part verification function. To this end, in many cases identification tags are provided on products or items so that product consumers can verify that the items are genuine parts from specific manufacturers that are known to provide high quality products. Thus, for instance, to ensure that a rotor blade was manufactured by Harbinger Aero Parts, a reputable parts manufacturer, Harbinger Aero Parts may provide identification tags on each one of their rotor blades that can be used by an end user to attempt to verify authenticity. Unfortunately, part counterfeiters have begun to copy the information on identification tags and place similar tags on counterfeit parts so that end users can no longer verify part authenticity by tag information alone. - To deal with the above problem, it has been recognized that a source mark in the form of a trademark or the like can be provided either as part of an identification tag or proximate an identification tag such that when an image of the identification tag is obtained, an image of the source mark is also obtained. In this case, in addition to verifying an item identification number in an attempt to verify authenticity, the source mark can be compared to a trademark of the trusted supplier and, if the source mark is different than the trusted supplier's trademark, the part can be recognized as a counterfeit part. In addition, if the source mark is not present in the obtained image, the part can be recognized as a counterfeit part. While part counterfeiters could copy source marks as well as identification tags and use those marks and tags together in an attempt to continue to counterfeit products, copying a source mark like a trademark would be a separate trademark violation and would be relatively easily actionable.
- Consistent with the comments above, referring to
FIG. 21 , anexemplary source mark 300 is shown printed or placed on ablade 200 next to anidentification tag 202 where both themark 300 and tag 202 can be simultaneously imaged for part verification purposes. Referring also toFIG. 22 , anexemplary method 302 for verifying parts using a source mark and an identification tag is illustrated. Beginning atblock 304, a database is provided that correlates source marks with item identification information. Atblock 306 ID tags and source marks are placed on items to be used with thesystem 10. Atblock 308, anHHD 20 is provided that is capable of simultaneously reading ID tag and source mark combinations. Atblock 310, the HHD is used to read a tag and source mark combination. Atblock 312, the database is used to verify source mark authenticity. Atblock 314, the database is used to identify the type of item associated with the identification tag. Atblock 316, theHHD processor 21 determines whether or not the source mark and item type have been verified. Where the source type and item type have been verified, atblock 318processor 21 indicates that the part is authentic. In the alternative, where either the source mark or the item type has not been verified atblock 316, atblock 320 theHHD processor 21 indicates that the part is likely a counterfeit part. Indication may be either audible (e.g., a small speaker) or visual (e.g., an LED or the like). - In at least some cases it is contemplated that, after an HHD is used to obtain product identifying information from a tag that is placed on or associated with a particular product, the HHD will continue to be associated with the particular product for the purpose of performing supplemental functions until a transition indication or event occurs such as either new tag information being obtained from a different tag or the HHD user performing some process to indicate that the association between the HHD and the product should be broken. Thus, for instance, after identification information is obtained from a tag,
HHD 20 may be used to obtain ten different optimal images of the product associated with the identification tag, theHHD processor 21 performing a different subset of supplemental functions for each one of the obtained images without having to reassociate with the product each time a new image is obtained. At any time, if the HHD is used to obtain information from a different ID tag,HHD 20 association with the previous product is broken and a new HHD product association is formed with the new product. - Consistent with the comments in the previous paragraph, referring now to
FIG. 23 , anothermethod 350 that is consistent with at least some aspects of the present invention is illustrated. Referring also toFIGS. 1 , 2 and 5, atblock 352, a database is provided that correlates item IDs, optimal images, guidance functions, visually distinguishable item features of interest and feature functions. Atprocess block 354, aHHD 20 including a camera/tag reader is provided. Atblock 356, ID tags are provided on items or products. Atblock 358,HHD 20 is used to obtain ID information from an ID tag located on one of the products. Atblock 360,HHD 20 is used to obtain an image of the product including the tag from which identification information was most recently obtained. Atblock 362,HHD processor 21 performs supplemental processes associated with the obtained identification information. Atblock 364,HHD processor 21 determines whether or not new tag identification information has been obtained. Where new tag identification information has not been obtained, control passes down to block 366. Atblock 366,processor 21 determines whether or not some other disassociating indication has been received by the HHD. Here, for instance, a disassociating indication may include holding theactivation button 30 in for more than 5 continuous seconds. Where no other disassociating indication has been received, control passes back up to block 362 where thesub-loop including blocks HHD processor 21 waits to receive new ID tag information. Referring once again to block 364, where new tag ID information is obtained, control passes back up to block 360 whereprocessor 21 waits for a new image to be obtained viaHHD 20. - While the invention may be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and have been described in detail herein. However, it should be understood that the invention is not intended to be limited to the particular forms disclosed. For example, other supplemental processes are contemplated. For instance, kit component verification is contemplated. To this end, referring to
FIG. 24 , akit 420 is illustrated that includes a number of components where at least one of the components includes a tag 422. Here, the tag information may be associated with a list of kit components in a database where image features include instances of the kit components along with instructions regarding how to identify the components in an image, the feature function being to identify each list component in an obtained image. When an image of a kit is obtained, theHHD processor 21 may be programmed to identify the tag in the image, obtain kit identification information from the tag, identify the kit image and component list, attempt to identify the kit components in the image and then provide feedback regarding whether or not the kit is complete and any components that do not appear in the kit. - In addition, systems are contemplated wherein a portable HHD may be associated with an item in ways other than obtaining tag information from a tag that resides on the item. For instance, in at least some cases a tag may reside in a parts booklet or the like where the tag is spatially associated (e.g., on the same page in the booklet) with an image of the item/product. For instance, a tag for a rotor blade as described above may be presented next to an optimal image. Here, an HHD user could obtain tag information from the booklet to associate the HHD temporarily with an item and then perform image obtaining processes and other supplemental processes using the HHD as described above. Similarly, an end process or disassociation tag may be included in a booklet or elsewhere in proximity to where an HHD is used to disassociate the HHD with an item that the HHD is currently associated with.
- Moreover, while some systems are described above as including guidance capabilities, in at least some cases it is contemplated that no guidance functions may be provided. Similarly, while some systems are described above that include association via a tag, in some cases such association may not be supported. For instance, where an HHD is used with a single item type, the HHD may be preprogrammed for use with the single item type and the supplemental processes may all be the same regardless of the instance of the item that is imaged. Here there is still value in the inventive concepts as different processes may be performed depending on which image is obtained and depending on the quality of the images obtained.
- Furthermore, various types of commissioning procedures are contemplated wherein items having known standard characteristics are imaged to generate at least one optimal image for each item and then features on the items are identified as well as feature characteristics of interest and acceptable ranges of characteristic values. The present invention may be used with any type of commissioning procedure that generates suitable database information.
- In addition, while the inventive aspects have been described above in the context of an HHD including a camera/sensor capable of obtaining both ID tag information as well as images of products/items, it should be appreciated that other HHD configurations are contemplated where the camera and the tag reader are separate HHD components. Here, note that the tag reader may take several forms including a bar code reader, an optical character recognition reader, an RF sensor, etc.
- Moreover, instead of storing optimal images to facilitate guidance, other types of information that reflect optimal images may be stored. For instance, general orientation of edges of a product may be stored along with ranges of dimensions for comparison to similar features and dimensions in obtained images.
- Thus, the invention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention as defined by the following appended claims. To apprise the public of the scope of this invention, the following claims are made:
Claims (38)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/163,954 US20110309149A1 (en) | 2004-12-22 | 2011-06-20 | Hand Held Machine Vision Method and Apparatus |
US13/361,528 US9798910B2 (en) | 2004-12-22 | 2012-01-30 | Mobile hand held machine vision method and apparatus using data from multiple images to perform processes |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US2064004A | 2004-12-22 | 2004-12-22 | |
US11/123,480 US7963448B2 (en) | 2004-12-22 | 2005-05-06 | Hand held machine vision method and apparatus |
US13/163,954 US20110309149A1 (en) | 2004-12-22 | 2011-06-20 | Hand Held Machine Vision Method and Apparatus |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/123,480 Division US7963448B2 (en) | 2004-12-22 | 2005-05-06 | Hand held machine vision method and apparatus |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US33707708A Continuation-In-Part | 2004-12-22 | 2008-12-17 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20110309149A1 true US20110309149A1 (en) | 2011-12-22 |
Family
ID=46321979
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/123,480 Active 2028-08-08 US7963448B2 (en) | 2004-12-22 | 2005-05-06 | Hand held machine vision method and apparatus |
US13/163,954 Abandoned US20110309149A1 (en) | 2004-12-22 | 2011-06-20 | Hand Held Machine Vision Method and Apparatus |
US13/361,528 Active 2027-08-08 US9798910B2 (en) | 2004-12-22 | 2012-01-30 | Mobile hand held machine vision method and apparatus using data from multiple images to perform processes |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/123,480 Active 2028-08-08 US7963448B2 (en) | 2004-12-22 | 2005-05-06 | Hand held machine vision method and apparatus |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/361,528 Active 2027-08-08 US9798910B2 (en) | 2004-12-22 | 2012-01-30 | Mobile hand held machine vision method and apparatus using data from multiple images to perform processes |
Country Status (1)
Country | Link |
---|---|
US (3) | US7963448B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9286530B2 (en) | 2012-07-17 | 2016-03-15 | Cognex Corporation | Handheld apparatus for quantifying component features |
US20160307332A1 (en) * | 2015-04-14 | 2016-10-20 | Nintendo Co., Ltd | Identifying And Tracking Objects Via Lighting Patterns |
US9736382B2 (en) | 2013-06-18 | 2017-08-15 | Koninklijke Philips N.V. | Device reader and means of generating an image therefor |
Families Citing this family (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7963448B2 (en) | 2004-12-22 | 2011-06-21 | Cognex Technology And Investment Corporation | Hand held machine vision method and apparatus |
US9552506B1 (en) | 2004-12-23 | 2017-01-24 | Cognex Technology And Investment Llc | Method and apparatus for industrial identification mark verification |
US8108176B2 (en) | 2006-06-29 | 2012-01-31 | Cognex Corporation | Method and apparatus for verifying two dimensional mark quality |
US7984854B2 (en) * | 2006-07-17 | 2011-07-26 | Cognex Corporation | Method and apparatus for multiplexed symbol decoding |
US8169478B2 (en) * | 2006-12-14 | 2012-05-01 | Cognex Corporation | Method and apparatus for calibrating a mark verifier |
JP4856585B2 (en) * | 2007-06-07 | 2012-01-18 | 株式会社ユニバーサルエンターテインメント | Personal identification communication system and program executed in personal identification communication system |
US9734376B2 (en) | 2007-11-13 | 2017-08-15 | Cognex Corporation | System and method for reading patterns using multiple image frames |
US9047742B2 (en) * | 2009-05-07 | 2015-06-02 | International Business Machines Corporation | Visual security for point of sale terminals |
US8411177B2 (en) * | 2009-06-24 | 2013-04-02 | Symbol Technologies, Inc. | Method and apparatus for providing current pulses to illumination source in imaging scanner |
CN102902948A (en) * | 2011-07-28 | 2013-01-30 | 国际商业机器公司 | Computer, method for determining position of computer and system for manufacturing label |
EP2808455B1 (en) * | 2012-01-27 | 2018-05-30 | Doosan Infracore Co., Ltd. | Operational stability enhancing device for construction machinery |
JP5548962B2 (en) * | 2012-03-06 | 2014-07-16 | カシオ計算機株式会社 | Mobile terminal and program |
US8881982B2 (en) | 2012-04-20 | 2014-11-11 | Honeywell Scanning & Mobility | Portable encoded information reading terminal configured to acquire images |
US20140176689A1 (en) * | 2012-12-21 | 2014-06-26 | Samsung Electronics Co. Ltd. | Apparatus and method for assisting the visually impaired in object recognition |
US11039108B2 (en) * | 2013-03-15 | 2021-06-15 | James Carey | Video identification and analytical recognition system |
US9674490B2 (en) | 2013-04-18 | 2017-06-06 | Magna Electronics Inc. | Vision system for vehicle with adjustable cameras |
DE102013111527A1 (en) * | 2013-10-18 | 2015-04-23 | Thomas Daub | System for recording an inspection characteristic of a test object |
USD727905S1 (en) * | 2014-04-17 | 2015-04-28 | Faro Technologies, Inc. | Laser scanning device |
US10337656B2 (en) * | 2015-10-27 | 2019-07-02 | Ford Global Technologies, Llc | Quick connect with visual indicator |
US9787951B2 (en) * | 2015-12-18 | 2017-10-10 | Serge Kannon | Vehicle proximity warning system |
USD832845S1 (en) * | 2016-08-01 | 2018-11-06 | Hand Held Products, Inc. | Optical scanner |
CN106776777B (en) * | 2016-11-11 | 2020-04-07 | 深圳中兴网信科技有限公司 | Geographic position information identification method and device and terminal |
US10152641B2 (en) * | 2017-01-20 | 2018-12-11 | Jack Cooper Logistics, LLC | Artificial intelligence based vehicle dashboard analysis |
JP6929115B2 (en) * | 2017-04-25 | 2021-09-01 | オリンパス株式会社 | Endoscope device, endoscopy system and report generation method |
USD848429S1 (en) * | 2017-11-08 | 2019-05-14 | Lee Seng Fook | Hand held 3D scanning device with feedback system |
USD848428S1 (en) * | 2017-11-08 | 2019-05-14 | Lee Seng Fook | Hand held 3D scanning device |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4929819A (en) * | 1988-12-12 | 1990-05-29 | Ncr Corporation | Method and apparatus for customer performed article scanning in self-service shopping |
US5609223A (en) * | 1994-05-30 | 1997-03-11 | Kabushiki Kaisha Tec | Checkout system with automatic registration of articles by bar code or physical feature recognition |
US5883968A (en) * | 1994-07-05 | 1999-03-16 | Aw Computer Systems, Inc. | System and methods for preventing fraud in retail environments, including the detection of empty and non-empty shopping carts |
US6149062A (en) * | 1988-01-14 | 2000-11-21 | Intermec Ip Corp. | Interface with hand-held data capture terminal, proximity and label sensing, and enhanced sensitivity and power efficiency |
US20040118916A1 (en) * | 2002-12-18 | 2004-06-24 | Duanfeng He | System and method for verifying RFID reads |
US6804683B1 (en) * | 1999-11-25 | 2004-10-12 | Olympus Corporation | Similar image retrieving apparatus, three-dimensional image database apparatus and method for constructing three-dimensional image database |
Family Cites Families (205)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US821520A (en) | 1905-08-29 | 1906-05-22 | Samuel Moeller | Wheel-support for plows. |
US3868634A (en) | 1972-11-03 | 1975-02-25 | Scanner | Reading of contrasting data by means of continuously attempting to decode read signals |
US3890597A (en) | 1973-09-17 | 1975-06-17 | Taplin Business Machines | Bar geometry verification system for bar-coded characters |
US4282425A (en) | 1979-07-25 | 1981-08-04 | Norand Corporation | Instant portable bar code reader |
US4308455A (en) | 1980-06-26 | 1981-12-29 | E. I. Du Pont De Nemours And Company | Method for decoding bar-coded labels |
US4408344A (en) | 1981-04-09 | 1983-10-04 | Recognition Equipment Incorporated | OCR and Bar code reader using multi port matrix array |
US4421978A (en) | 1981-08-20 | 1983-12-20 | International Business Machines Corporation | Decoding method for multicharacter labels |
US5187356A (en) | 1981-12-28 | 1993-02-16 | Norand Corporation | Instant portable bar code reader |
US5187355A (en) | 1981-12-28 | 1993-02-16 | Norand Corporation | Instant portable bar code reader |
US6158661A (en) | 1981-12-28 | 2000-12-12 | Intermec Ip Corp. | Instant portable bar code reader |
US4894523A (en) | 1981-12-28 | 1990-01-16 | Norand Corporation | Instant portable bar code reader |
US6234395B1 (en) | 1981-12-28 | 2001-05-22 | Intermec Ip Corp. | Instant portable bar code reader |
IT1150467B (en) | 1982-03-17 | 1986-12-10 | Pama Spa | PROCEDURE FOR THE FORMATION OF SOLES WITH HEEL AND SUB-HEEL, FOR MAXIMUM FEMALE SHOES WITH SUPPORTING BODY OR INCORPORATED ARMOR AND SHAPED AND ARMED SOLES OBTAINED WITH THAT PROCEDURE |
US5675137A (en) | 1986-04-18 | 1997-10-07 | Cias, Inc. | Bar code decoding using moving averages to break the (n,k) code barrier for UPC, EAN Code 128 and others |
US4782220A (en) | 1986-09-29 | 1988-11-01 | Mars, Incorporated | Method and apparatus for bar code data autodiscrimination |
US4924078A (en) | 1987-11-25 | 1990-05-08 | Sant Anselmo Carl | Identification symbol, system and method |
US4866784A (en) | 1987-12-02 | 1989-09-12 | Eastman Kodak Company | Skew detector for digital image processing system |
US5163104A (en) | 1988-02-24 | 1992-11-10 | Transtechnology Corporation | Digital image processing technique including improved gray scale compression |
US5053609A (en) | 1988-05-05 | 1991-10-01 | International Data Matrix, Inc. | Dynamically variable machine readable binary code and method for reading and producing thereof |
US5124538B1 (en) | 1988-08-26 | 1995-01-31 | Accu Sort Systems Inc | Scanner |
US5028772A (en) | 1988-08-26 | 1991-07-02 | Accu-Sort Systems, Inc. | Scanner to combine partial fragments of a complete code |
JPH02141889A (en) | 1988-11-22 | 1990-05-31 | Eastman Kodatsuku Japan Kk | Bar-code reading method |
US4948955A (en) | 1988-12-22 | 1990-08-14 | The Boeing Company | Barcode location determination |
US5872354A (en) | 1989-01-31 | 1999-02-16 | Norand Corporation | Hand-held data capture system with interchangable modules including autofocusing data file reader using the slope of the image signal to determine focus |
US5304786A (en) | 1990-01-05 | 1994-04-19 | Symbol Technologies, Inc. | High density two-dimensional bar code symbol |
JPH03116109A (en) | 1989-09-29 | 1991-05-17 | Hoya Corp | Aspherical lens system of two-group, two-element constitution |
US5262626A (en) | 1989-12-06 | 1993-11-16 | Symbol Technologies, Inc. | Decoding bar codes from multiple scans using element replacement |
US5155343A (en) | 1990-03-28 | 1992-10-13 | Chandler Donald G | Omnidirectional bar code reader with method and apparatus for detecting and scanning a bar code symbol |
US5276316A (en) | 1990-05-02 | 1994-01-04 | Ncr Corporation | Method for reconstructing complete bar code signals from partial bar code scans |
US5120940A (en) | 1990-08-10 | 1992-06-09 | The Boeing Company | Detection of barcodes in binary images with arbitrary orientation |
US5627359A (en) | 1991-09-17 | 1997-05-06 | Metrologic Instruments, Inc. | Laser code symbol scanner employing optical filtering system having narrow band-pass characteristics and spatially separated optical filter elements with laser light collection optics arranged along laser light return path disposed therebetween |
US5124537A (en) | 1990-10-29 | 1992-06-23 | Omniplanar, Inc. | Omnidirectional bar code reader using virtual scan of video raster scan memory |
US5192856A (en) | 1990-11-19 | 1993-03-09 | An Con Genetics, Inc. | Auto focusing bar code reader |
US5296690A (en) | 1991-03-28 | 1994-03-22 | Omniplanar, Inc. | System for locating and determining the orientation of bar codes in a two-dimensional image |
US5262652A (en) | 1991-05-14 | 1993-11-16 | Applied Materials, Inc. | Ion implantation apparatus having increased source lifetime |
US5278397A (en) | 1991-07-25 | 1994-01-11 | Symbol Technologies, Inc. | Multi-resolution bar code reader |
US5198650A (en) | 1991-06-24 | 1993-03-30 | Ncr Corporation | Hands free/hand held bar code scanner |
US5378883A (en) | 1991-07-19 | 1995-01-03 | Omniplanar Inc. | Omnidirectional wide range hand held bar code reader |
US5332892A (en) | 1991-07-25 | 1994-07-26 | Symbol Technologies, Inc. | Optical systems for bar code scanners |
US5262623A (en) | 1991-09-04 | 1993-11-16 | Omniplanar, Inc. | Method and apparatus for distinguishing a preferred bar code or the like |
US5657402A (en) | 1991-11-01 | 1997-08-12 | Massachusetts Institute Of Technology | Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method |
US5286960A (en) | 1991-11-04 | 1994-02-15 | Welch Allyn, Inc. | Method of programmable digitization and bar code scanning apparatus employing same |
US5262625A (en) | 1991-11-15 | 1993-11-16 | Ncr Corporation | Multiple bar code decoding system and method |
US5291008A (en) | 1992-01-10 | 1994-03-01 | Welch Allyn, Inc. | Optical assembly and apparatus employing same using an aspherical lens and an aperture stop |
US5756981A (en) | 1992-02-27 | 1998-05-26 | Symbol Technologies, Inc. | Optical scanner for reading and decoding one- and-two-dimensional symbologies at variable depths of field including memory efficient high speed image processing means and high accuracy image analysis means |
US5902988A (en) | 1992-03-12 | 1999-05-11 | Norand Corporation | Reader for decoding two-dimensional optically readable information |
US5276315A (en) | 1992-05-14 | 1994-01-04 | United Parcel Service Of America, Inc. | Method and apparatus for processing low resolution images of degraded bar code symbols |
US5487115A (en) | 1992-05-14 | 1996-01-23 | United Parcel Service | Method and apparatus for determining the fine angular orientation of bar code symbols in two-dimensional CCD images |
ATE185634T1 (en) | 1992-05-26 | 1999-10-15 | United Parcel Service Inc | CAMERA READING DEVICE FOR VARIOUS CODES |
US5343028A (en) | 1992-08-10 | 1994-08-30 | United Parcel Service Of America, Inc. | Method and apparatus for detecting and decoding bar code symbols using two-dimensional digital pixel images |
US5418862A (en) | 1992-08-10 | 1995-05-23 | United Parcel Service Of America | Method and apparatus for detecting artifact corners in two-dimensional images |
US20020044689A1 (en) | 1992-10-02 | 2002-04-18 | Alex Roustaei | Apparatus and method for global and local feature extraction from digital images |
JP3238507B2 (en) | 1992-12-21 | 2001-12-17 | 旭光学工業株式会社 | Special symbol reader |
US5486689A (en) | 1993-01-22 | 1996-01-23 | Intermec Corporation | Method and apparatus for decoding unresolved multi-width bar code symbology profiles |
US5412197A (en) | 1993-01-29 | 1995-05-02 | United Parcel Service Of America, Inc. | Method and apparatus for decoding bar code symbols using gradient signals |
WO1994018641A1 (en) | 1993-02-02 | 1994-08-18 | Label Vision Systems, Inc. | Method and apparatus for decoding bar code data from a video signal and applications thereof |
US5461417A (en) | 1993-02-16 | 1995-10-24 | Northeast Robotics, Inc. | Continuous diffuse illumination method and apparatus |
US5304787A (en) | 1993-06-01 | 1994-04-19 | Metamedia Corporation | Locating 2-D bar codes |
US5446271A (en) | 1993-08-06 | 1995-08-29 | Spectra-Physics Scanning Systems, Inc. | Omnidirectional scanning method and apparatus |
US5420409A (en) | 1993-10-18 | 1995-05-30 | Welch Allyn, Inc. | Bar code scanner providing aural feedback |
IT1264733B1 (en) | 1993-11-04 | 1996-10-04 | Datalogic Spa | LASER READING DEVICE OR SCANNER FOR READING CHARACTERS HAVING A DIFFERENT DEGREE OF REFLECTENCE, IN PARTICULAR OF CODES A |
US5481098A (en) | 1993-11-09 | 1996-01-02 | Spectra-Physics Scanning Systems, Inc. | Method and apparatus for reading multiple bar code formats |
CN1104791A (en) | 1993-12-30 | 1995-07-05 | 富冈信 | Two dimensional code for processing data |
US7387253B1 (en) | 1996-09-03 | 2008-06-17 | Hand Held Products, Inc. | Optical reader system comprising local host processor and optical reader |
US5825006A (en) | 1994-03-04 | 1998-10-20 | Welch Allyn, Inc. | Optical reader having improved autodiscrimination features |
US5932862A (en) | 1994-03-04 | 1999-08-03 | Welch Allyn, Inc. | Optical reader having improved scanning-decoding features |
US5463214A (en) | 1994-03-04 | 1995-10-31 | Welch Allyn, Inc. | Apparatus for optimizing throughput in decoded-output scanners and method of using same |
US5591956A (en) | 1995-05-15 | 1997-01-07 | Welch Allyn, Inc. | Two dimensional data encoding structure and symbology for use with optical readers |
US5929418A (en) * | 1994-03-04 | 1999-07-27 | Welch Allyn, Inc. | Optical reader having improved menuing features |
US5557091A (en) | 1994-04-15 | 1996-09-17 | Krummel; Larry | Method and system for bar code image processing |
US5550366A (en) | 1994-06-20 | 1996-08-27 | Roustaei; Alexander | Optical scanner with automatic activation |
US5627358A (en) | 1994-06-20 | 1997-05-06 | Roustaei; Alexander | System and method for reading two-dimensional barcodes |
US5811784A (en) | 1995-06-26 | 1998-09-22 | Telxon Corporation | Extended working range dataform reader |
US5942987A (en) | 1994-09-09 | 1999-08-24 | Intermec Ip Corp. | Radio frequency identification system with write broadcast capability |
US5455414A (en) | 1994-09-15 | 1995-10-03 | Metanetics Corporation | Simplified bar code decoding with dynamically loadable data character sets |
JP2765231B2 (en) | 1994-09-19 | 1998-06-11 | 住友電気工業株式会社 | Barcode scanning device |
US5523552A (en) | 1994-10-19 | 1996-06-04 | Symbol Technologies, Inc. | Method and apparatus to scan randomly oriented two-dimensional bar code symbols |
ATE165681T1 (en) | 1994-10-25 | 1998-05-15 | United Parcel Service Inc | METHOD AND DEVICE FOR A PORTABLE CONTACTLESS IMAGE RECORDING DEVICE |
JP2867904B2 (en) | 1994-12-26 | 1999-03-10 | 株式会社デンソー | 2D code reader |
EP0722148A2 (en) | 1995-01-10 | 1996-07-17 | Welch Allyn, Inc. | Bar code reader |
US5786586A (en) | 1995-01-17 | 1998-07-28 | Welch Allyn, Inc. | Hand-held optical reader having a detachable lens-guide assembly |
DE69620663T2 (en) | 1995-01-27 | 2002-11-21 | Toshiba Kawasaki Kk | Color cathode ray tube |
US5514858A (en) | 1995-02-10 | 1996-05-07 | Intermec Corporation | Method and apparatus for decoding unresolved complex multi-width bar code symbology profiles |
US5821520A (en) | 1995-04-28 | 1998-10-13 | Symbol Technologies, Inc. | Bar code scanning system with the pre-decoding signal processing and method for bar code candidate selection for decoding |
US5646391A (en) | 1995-05-11 | 1997-07-08 | Psc, Inc. | Optical assembly for controlling beam size in bar code scanners |
US5780834A (en) | 1995-05-15 | 1998-07-14 | Welch Allyn, Inc. | Imaging and illumination optics assembly |
US5739518A (en) | 1995-05-17 | 1998-04-14 | Metanetics Corporation | Autodiscrimination for dataform decoding and standardized recording |
US5814827A (en) | 1995-05-19 | 1998-09-29 | Symbol Technologies, Inc. | Optical scanner with extended depth of focus |
US5637849A (en) | 1995-05-31 | 1997-06-10 | Metanetics Corporation | Maxicode data extraction using spatial domain features |
US5539191A (en) | 1995-06-22 | 1996-07-23 | Intermec Corporation | Method and apparatus for decoding unresolved bar code profiles using edge finding circuitry |
US5691773A (en) | 1995-09-12 | 1997-11-25 | Metanetics Corporation | Anti-hand-jittering dataform readers and methods |
US5796089A (en) | 1995-09-21 | 1998-08-18 | Symbol Technologies, Inc. | Bar code scanner with simplified auto-focus capability |
US5777309A (en) | 1995-10-30 | 1998-07-07 | Intermec Corporation | Method and apparatus for locating and decoding machine-readable symbols |
US5744790A (en) | 1996-01-25 | 1998-04-28 | Symbol Technologies, Inc. | Split optics focusing apparatus for CCD-based bar code scanner |
US5742037A (en) | 1996-03-07 | 1998-04-21 | Cognex Corp. | Method and apparatus for high speed identification of objects having an identifying feature |
US6078251A (en) * | 1996-03-27 | 2000-06-20 | Intermec Ip Corporation | Integrated multi-meter and wireless communication link |
US6021380A (en) | 1996-07-09 | 2000-02-01 | Scanis, Inc. | Automatic semiconductor wafer sorter/prober with extended optical inspection |
US6075905A (en) | 1996-07-17 | 2000-06-13 | Sarnoff Corporation | Method and apparatus for mosaic image construction |
JP2793571B2 (en) | 1996-07-19 | 1998-09-03 | 日本電気エンジニアリング株式会社 | Barcode reader |
US6629642B1 (en) | 1996-08-02 | 2003-10-07 | Symbol Technologies, Inc. | Data system and method for accessing a computer network using a collection of bar code symbols |
US5767498A (en) | 1996-09-17 | 1998-06-16 | Ncr Corporation | Bar code error scanner |
US5877486A (en) | 1996-10-11 | 1999-03-02 | Intermec Ip Corp. | Method and apparatus for enhancing resolution of reflectance signals produced from machine-readable symbols |
US6075883A (en) | 1996-11-12 | 2000-06-13 | Robotic Vision Systems, Inc. | Method and system for imaging an object or pattern |
US5767497A (en) | 1996-12-04 | 1998-06-16 | United Parcel Service Of America, Inc. | Method and apparatus for decoding bar code symbols using ratio analysis of module size |
US5936224A (en) | 1996-12-11 | 1999-08-10 | Intermec Ip Corporation | Method and apparatus for reading machine-readable symbols by employing a combination of multiple operators and/or processors |
US6408429B1 (en) | 1997-01-17 | 2002-06-18 | Cognex Corporation | Machine vision system for identifying and assessing features of an article |
US5992744A (en) | 1997-02-18 | 1999-11-30 | Welch Allyn, Inc. | Optical reader having multiple scanning assemblies with simultaneously decoded outputs |
DE19710724C2 (en) | 1997-03-14 | 2002-09-26 | Sick Ag | Optoelectronic sensor |
US5880451A (en) | 1997-04-24 | 1999-03-09 | United Parcel Service Of America, Inc. | System and method for OCR assisted bar code decoding |
AU7564698A (en) | 1997-05-05 | 1998-11-27 | Alexander R. Roustaei | Optical scanner and image reader for reading images and decoding optical information including one and two dimensional symbologies at variable depth of field |
US6141033A (en) | 1997-05-15 | 2000-10-31 | Cognex Corporation | Bandwidth reduction of multichannel images for machine vision |
DE19734031A1 (en) | 1997-08-06 | 1999-02-11 | Sick Ag | Method and device for reading a bar code consisting of a predetermined number of code elements |
US6056198A (en) | 1997-08-07 | 2000-05-02 | Psc Scanning, Inc. | Optical scanning system and method including a collection system for range enhancement |
US6000612A (en) | 1997-10-10 | 1999-12-14 | Metanetics Corporation | Portable data collection device having optical character recognition |
US5949052A (en) | 1997-10-17 | 1999-09-07 | Welch Allyn, Inc. | Object sensor system for stationary position optical reader |
US6298176B2 (en) * | 1997-10-17 | 2001-10-02 | Welch Allyn Data Collection, Inc. | Symbol-controlled image data reading system |
US6334060B1 (en) | 1997-10-28 | 2001-12-25 | Acumen, Inc. | Multi-channel or split-frequency, low frequency, telemetry circuit and method between transmitters and receivers |
US5914476A (en) | 1997-11-04 | 1999-06-22 | Welch Allyn, Inc. | Optical reader configured to accurately and rapidly read multiple symbols |
US6765606B1 (en) * | 1997-11-13 | 2004-07-20 | 3Dv Systems, Ltd. | Three dimension imaging by dual wavelength triangulation |
US5969326A (en) | 1998-01-14 | 1999-10-19 | Intermec Ip Corp. | Method and apparatus of autodiscriminating in symbol reader employing prioritized and updated table of symbologies |
US6250551B1 (en) | 1998-06-12 | 2001-06-26 | Symbol Technologies, Inc. | Autodiscrimination and line drawing techniques for code readers |
US6176429B1 (en) | 1998-07-17 | 2001-01-23 | Psc Scanning, Inc. | Optical reader with selectable processing characteristics for reading data in multiple formats |
US6152371A (en) | 1998-08-12 | 2000-11-28 | Welch Allyn, Inc. | Method and apparatus for decoding bar code symbols |
US6513714B1 (en) | 1998-09-14 | 2003-02-04 | Psc Scanning, Inc. | Character reconstruction and element level processing in bar code scanning system |
US6454168B1 (en) | 1998-09-14 | 2002-09-24 | Psc Scanning, Inc. | Correlation and stitching techniques in a bar code scanning system |
US6161760A (en) | 1998-09-14 | 2000-12-19 | Welch Allyn Data Collection, Inc. | Multiple application multiterminal data collection network |
US6561427B2 (en) | 1998-09-14 | 2003-05-13 | Psc Scanning, Inc. | Decoding system and methods in a bar code scanning system |
US6490376B1 (en) | 1998-09-17 | 2002-12-03 | Metrologic Instruments, Inc. | Skew processing of raster scan images |
US6088482A (en) | 1998-10-22 | 2000-07-11 | Symbol Technologies, Inc. | Techniques for reading two dimensional code, including maxicode |
US6446868B1 (en) | 1998-11-23 | 2002-09-10 | Informatics, Inc. | Scanning system for decoding two-dimensional barcode symbologies with a one-dimensional general purpose scanner |
US6289113B1 (en) | 1998-11-25 | 2001-09-11 | Iridian Technologies, Inc. | Handheld iris imaging apparatus and method |
US6082619A (en) | 1998-12-16 | 2000-07-04 | Matsushita Electric Industrial Co., Ltd. | Method for locating and reading a two-dimensional barcode |
US6525648B1 (en) | 1999-01-29 | 2003-02-25 | Intermec Ip Corp | Radio frequency identification systems and methods for waking up data storage devices for wireless communication |
DE10012715B4 (en) | 1999-03-19 | 2014-05-28 | Cognex ,Ltd. | Method for positioning a scanner relative to a coded surface and scanner, in particular for reading bar codes, two-dimensional codes and color codes |
US6176428B1 (en) | 1999-04-07 | 2001-01-23 | Symbol Technologies, Inc. | Techniques for reading postal code |
US6371373B1 (en) | 1999-05-25 | 2002-04-16 | Matsushita Electric Industrial Co., Ltd. | Method for reading a two-dimensional barcode |
US6677852B1 (en) | 1999-09-22 | 2004-01-13 | Intermec Ip Corp. | System and method for automatically controlling or configuring a device, such as an RFID reader |
US6189792B1 (en) | 1999-12-14 | 2001-02-20 | Ncr Corporation | System and methods for exemplar based bar code error detection and correction |
US6398113B1 (en) | 1999-12-23 | 2002-06-04 | Ncr Corporation | System and methods for collaborative bar code error detection and correction |
US6728419B1 (en) | 2000-02-17 | 2004-04-27 | Xerox Corporation | Multi-tasking multi-threaded image processing system and method for image capture devices |
JP4693074B2 (en) | 2000-04-28 | 2011-06-01 | ルネサスエレクトロニクス株式会社 | Appearance inspection apparatus and appearance inspection method |
US6899272B2 (en) | 2000-05-17 | 2005-05-31 | Symbol Technologies, Inc | Bioptics bar code reader |
DE50102147D1 (en) * | 2000-06-09 | 2004-06-03 | Aventis Pharma Gmbh | ACYLPHENYL URINE DERIVATIVES, METHOD FOR THE PRODUCTION THEREOF AND THEIR USE AS A MEDICINAL PRODUCT |
US6601772B1 (en) | 2000-07-14 | 2003-08-05 | Intellidot Corporation | Compact matrix code and one-touch device and method for code reading |
DE10040899A1 (en) | 2000-08-18 | 2002-02-28 | Gavitec Gmbh | Method and device for decoding optical codes |
WO2002027659A2 (en) * | 2000-09-26 | 2002-04-04 | Advantage 3D Llc | Method and system for generation, storage and distribution of omni-directional object views |
US7164810B2 (en) | 2001-11-21 | 2007-01-16 | Metrologic Instruments, Inc. | Planar light illumination and linear imaging (PLILIM) device with image-based velocity detection and aspect ratio compensation |
US6681151B1 (en) | 2000-12-15 | 2004-01-20 | Cognex Technology And Investment Corporation | System and method for servoing robots based upon workpieces with fiducial marks using machine vision |
US6637658B2 (en) | 2001-01-22 | 2003-10-28 | Welch Allyn, Inc. | Optical reader having partial frame operating mode |
JP4164241B2 (en) | 2001-02-15 | 2008-10-15 | 株式会社ルネサステクノロジ | Semiconductor device |
DE10113426A1 (en) | 2001-03-19 | 2002-09-26 | Gavitec Gmbh | Code reader incorporates illumination device for sidewards illumination of scanned code |
US6761316B2 (en) | 2001-03-27 | 2004-07-13 | Symbol Technologies, Inc. | Compact auto ID reader and radio frequency transceiver data collection module |
US7108184B2 (en) | 2001-03-30 | 2006-09-19 | Baxter International, Inc. | Coding symbology and a method for printing same |
US6899273B2 (en) | 2001-05-02 | 2005-05-31 | Hand Held Products, Inc. | Optical reader comprising soft key including permanent graphic indicia |
US7111787B2 (en) | 2001-05-15 | 2006-09-26 | Hand Held Products, Inc. | Multimode image capturing and decoding optical reader |
JP3624288B2 (en) | 2001-09-17 | 2005-03-02 | 株式会社日立製作所 | Store management system |
US7061524B2 (en) | 2001-11-13 | 2006-06-13 | The Board Of Trustees Of The Leland Stanford Junior University | Motion/saturation detection system and method for synthesizing high dynamic range motion blur free images from multiple captures |
US7053953B2 (en) | 2001-12-21 | 2006-05-30 | Eastman Kodak Company | Method and camera system for blurring portions of a verification image to show out of focus areas in a captured archival image |
US9092841B2 (en) | 2004-06-09 | 2015-07-28 | Cognex Technology And Investment Llc | Method and apparatus for visual detection and inspection of objects |
GB2417075B (en) | 2002-04-08 | 2006-06-21 | Pryor Edward & Son | Improved marking system |
US6965862B2 (en) | 2002-04-11 | 2005-11-15 | Carroll King Schuller | Reading machine |
US6824059B2 (en) | 2002-04-30 | 2004-11-30 | Hewlett-Packard Development Company, L.P. | Apparatus for capturing images and barcodes |
US7219843B2 (en) | 2002-06-04 | 2007-05-22 | Hand Held Products, Inc. | Optical reader having a plurality of imaging modules |
JP3516144B1 (en) | 2002-06-18 | 2004-04-05 | オムロン株式会社 | Optical information code reading method and optical information code reader |
US7774075B2 (en) * | 2002-11-06 | 2010-08-10 | Lin Julius J Y | Audio-visual three-dimensional input/output |
US20040091255A1 (en) | 2002-11-11 | 2004-05-13 | Eastman Kodak Company | Camera flash circuit with adjustable flash illumination intensity |
US6913199B2 (en) | 2002-12-18 | 2005-07-05 | Symbol Technologies, Inc. | System and method for verifying optical character recognition of optical code reads |
US7181066B1 (en) | 2002-12-26 | 2007-02-20 | Cognex Technology And Investment Corporation | Method for locating bar codes and symbols in an image |
SE0301143D0 (en) | 2003-04-17 | 2003-04-17 | C Technologies Ab | Method and device for loading data |
US7227628B1 (en) | 2003-10-10 | 2007-06-05 | Kla-Tencor Technologies Corp. | Wafer inspection systems and methods for analyzing inspection data |
US7823789B2 (en) | 2004-12-21 | 2010-11-02 | Cognex Technology And Investment Corporation | Low profile illumination for direct part mark readers |
US7604174B2 (en) | 2003-10-24 | 2009-10-20 | Cognex Technology And Investment Corporation | Method and apparatus for providing omnidirectional lighting in a scanning device |
US7270272B2 (en) | 2003-11-13 | 2007-09-18 | Metrologic Instruments, Inc. | Digital image-based bar code symbol reading system employing a multi-mode image-processing symbol reading subsystem |
US7163149B2 (en) | 2004-03-02 | 2007-01-16 | Symbol Technologies, Inc. | System and method for illuminating and reading optical codes imprinted or displayed on reflective surfaces |
JP4337597B2 (en) | 2004-03-26 | 2009-09-30 | カシオ計算機株式会社 | Code symbol reader and program |
DE102004017504A1 (en) | 2004-04-08 | 2005-10-27 | Sick Ag | Method and apparatus for reading a bar code |
US7121467B2 (en) | 2004-05-21 | 2006-10-17 | Intermec Ip Corp. | Indicators of optimum positioning of a data collection device for reading data carriers, such as RFID tags and machine-readable symbols |
US7376272B2 (en) | 2004-06-14 | 2008-05-20 | Xerox Corporation | Method for image segmentation to identify regions with constant foreground color |
US7609846B2 (en) | 2004-07-13 | 2009-10-27 | Eastman Kodak Company | Matching of digital images to acquisition devices |
US7097102B2 (en) | 2004-07-29 | 2006-08-29 | Symbol Technologies, Inc. | System and method for decoding optical codes read by an imager-based optical code reader |
US20060027657A1 (en) | 2004-08-04 | 2006-02-09 | Laurens Ninnink | Method and apparatus for high resolution decoding of encoded symbols |
US7311262B2 (en) | 2004-08-09 | 2007-12-25 | Optoelectronics Co., Ltd. | Method of decoding a symbol with a low contrast |
US20060050961A1 (en) | 2004-08-13 | 2006-03-09 | Mohanaraj Thiyagarajah | Method and system for locating and verifying a finder pattern in a two-dimensional machine-readable symbol |
US7175090B2 (en) | 2004-08-30 | 2007-02-13 | Cognex Technology And Investment Corporation | Methods and apparatus for reading bar code identifications |
US7204420B2 (en) | 2004-08-31 | 2007-04-17 | Symbol Technologies, Inc. | Scanner and method for eliminating specular reflection |
US7070099B2 (en) | 2004-09-30 | 2006-07-04 | Symbol Technologies, Inc. | Modular architecture for a data capture device |
US7219841B2 (en) | 2004-11-05 | 2007-05-22 | Hand Held Products, Inc. | Device and system for verifying quality of bar codes |
US7617984B2 (en) | 2004-12-16 | 2009-11-17 | Cognex Technology And Investment Corporation | Hand held symbology reader illumination diffuser |
US7333208B2 (en) | 2004-12-20 | 2008-02-19 | Xerox Corporation | Full width array mechanically tunable spectrophotometer |
US7963448B2 (en) | 2004-12-22 | 2011-06-21 | Cognex Technology And Investment Corporation | Hand held machine vision method and apparatus |
US7383994B2 (en) | 2005-05-03 | 2008-06-10 | Datalogic Scanning, Inc. | Methods and systems for forming images of moving optical codes |
US7770799B2 (en) | 2005-06-03 | 2010-08-10 | Hand Held Products, Inc. | Optical reader having reduced specular reflection read failures |
US8699103B2 (en) | 2005-06-15 | 2014-04-15 | Xerox Corporation | System and method for dynamically generated uniform color objects |
US7498566B2 (en) | 2005-06-16 | 2009-03-03 | Siemens Medical Solutions Usa, Inc. | Automated quality control mechanism for a nuclear detector |
US7878402B2 (en) | 2005-12-20 | 2011-02-01 | Cognex Technology And Investment Corporation | Decoding distorted symbols |
US7614554B2 (en) | 2006-03-09 | 2009-11-10 | Jadak Technologies, Inc. | Electrosurgical device having RFID and optical imaging capabilities |
US8108176B2 (en) | 2006-06-29 | 2012-01-31 | Cognex Corporation | Method and apparatus for verifying two dimensional mark quality |
US7984854B2 (en) | 2006-07-17 | 2011-07-26 | Cognex Corporation | Method and apparatus for multiplexed symbol decoding |
US8169478B2 (en) | 2006-12-14 | 2012-05-01 | Cognex Corporation | Method and apparatus for calibrating a mark verifier |
WO2008118425A1 (en) | 2007-03-23 | 2008-10-02 | Ltt, Ltd | Method and apparatus for using a limited capacity portable data carrier |
US20080245869A1 (en) | 2007-03-23 | 2008-10-09 | Ltt, Ltd | Method and apparatus for reading a printed indicia with a limited field of view sensor |
DE602008006482D1 (en) | 2007-03-27 | 2011-06-09 | Casio Computer Co Ltd | Bar code reader and computer readable medium |
US9734376B2 (en) | 2007-11-13 | 2017-08-15 | Cognex Corporation | System and method for reading patterns using multiple image frames |
US8858856B2 (en) * | 2008-01-08 | 2014-10-14 | Stratasys, Inc. | Method for building and using three-dimensional objects containing embedded identification-tag inserts |
US8737721B2 (en) * | 2008-05-07 | 2014-05-27 | Microsoft Corporation | Procedural authoring |
-
2005
- 2005-05-06 US US11/123,480 patent/US7963448B2/en active Active
-
2011
- 2011-06-20 US US13/163,954 patent/US20110309149A1/en not_active Abandoned
-
2012
- 2012-01-30 US US13/361,528 patent/US9798910B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6149062A (en) * | 1988-01-14 | 2000-11-21 | Intermec Ip Corp. | Interface with hand-held data capture terminal, proximity and label sensing, and enhanced sensitivity and power efficiency |
US4929819A (en) * | 1988-12-12 | 1990-05-29 | Ncr Corporation | Method and apparatus for customer performed article scanning in self-service shopping |
US5609223A (en) * | 1994-05-30 | 1997-03-11 | Kabushiki Kaisha Tec | Checkout system with automatic registration of articles by bar code or physical feature recognition |
US5883968A (en) * | 1994-07-05 | 1999-03-16 | Aw Computer Systems, Inc. | System and methods for preventing fraud in retail environments, including the detection of empty and non-empty shopping carts |
US6804683B1 (en) * | 1999-11-25 | 2004-10-12 | Olympus Corporation | Similar image retrieving apparatus, three-dimensional image database apparatus and method for constructing three-dimensional image database |
US20040118916A1 (en) * | 2002-12-18 | 2004-06-24 | Duanfeng He | System and method for verifying RFID reads |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9286530B2 (en) | 2012-07-17 | 2016-03-15 | Cognex Corporation | Handheld apparatus for quantifying component features |
US9803975B2 (en) | 2012-07-17 | 2017-10-31 | Cognex Corporation | Handheld apparatus for quantifying component features |
US9736382B2 (en) | 2013-06-18 | 2017-08-15 | Koninklijke Philips N.V. | Device reader and means of generating an image therefor |
US10091428B2 (en) | 2013-06-18 | 2018-10-02 | Koninklijke Philips N.V. | Device reader and means of generating an image therefor |
US20160307332A1 (en) * | 2015-04-14 | 2016-10-20 | Nintendo Co., Ltd | Identifying And Tracking Objects Via Lighting Patterns |
US10456685B2 (en) * | 2015-04-14 | 2019-10-29 | Nintendo Co., Ltd. | Identifying and tracking objects via lighting patterns |
Also Published As
Publication number | Publication date |
---|---|
US7963448B2 (en) | 2011-06-21 |
US9798910B2 (en) | 2017-10-24 |
US20120206592A1 (en) | 2012-08-16 |
US20060131418A1 (en) | 2006-06-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7963448B2 (en) | Hand held machine vision method and apparatus | |
US9803975B2 (en) | Handheld apparatus for quantifying component features | |
US8302864B2 (en) | Method and apparatus using aiming pattern for machine vision training | |
US8169478B2 (en) | Method and apparatus for calibrating a mark verifier | |
US10592715B2 (en) | System and method for reading patterns using multiple image frames | |
CN106383131B (en) | Visual detection method, device and system for printed matter | |
US8646689B2 (en) | Deformable light pattern for machine vision system | |
US20120325907A1 (en) | Remote crane bar code system | |
US9420205B2 (en) | Image acquisition method of object on supporting surface | |
US20210358110A1 (en) | Device and Method for Processing at Least One Work Area With a Processing Tool | |
US20210318117A1 (en) | System and Method For Verifying ADAS Calibration Target Selection | |
US10217011B2 (en) | Apparatus and method for facilitating manual sorting of slides | |
CN108010011B (en) | Device for assisting in identifying target area on target object and equipment comprising device | |
CN101161457A (en) | Positioning device for a color measuring head | |
WO2002001480A1 (en) | Operator assisted method for making keys | |
EP3706951B1 (en) | Laser marking through the lens of an image scanning system | |
US20090108073A1 (en) | Method and apparatus for aligning a code and a reader without displaying a background image | |
CN107931828B (en) | One-key positioning method in laser processing, laser processing method and system | |
CN107490588B (en) | Method for locating tire defects | |
US11853045B2 (en) | Installation support apparatus, installation support system, and installation support program | |
CN113777109A (en) | Workpiece detection method, system, equipment and storage medium | |
EP3647890A1 (en) | Assembly system and method for operating an assembly system | |
JP2018054437A (en) | Inspection device | |
JPH11328404A (en) | Image recognizing device and method therefor | |
US11579440B2 (en) | Focus assessment in dynamically focused laser system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: COGNEX TECHNOLOGY AND INVESTMENT CORPORATION, CALI Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TESTA, JUSTIN;REEL/FRAME:032898/0172 Effective date: 20050428 |
|
AS | Assignment |
Owner name: COGNEX TECHNOLOGY AND INVESTMENT LLC, MASSACHUSETT Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE NAME AND COMPANY OF ASSIGNEE PREVIOUSLY RECORDED AT REEL: 032898 FRAME: 0172. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:TESTA, JUSTIN;REEL/FRAME:033935/0210 Effective date: 20140513 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |