WO2000042595A1 - Light and color sensing pointing device - Google Patents

Light and color sensing pointing device Download PDF

Info

Publication number
WO2000042595A1
WO2000042595A1 PCT/US2000/001229 US0001229W WO0042595A1 WO 2000042595 A1 WO2000042595 A1 WO 2000042595A1 US 0001229 W US0001229 W US 0001229W WO 0042595 A1 WO0042595 A1 WO 0042595A1
Authority
WO
WIPO (PCT)
Prior art keywords
pointing device
sensor
light
color
position sensing
Prior art date
Application number
PCT/US2000/001229
Other languages
French (fr)
Inventor
Nicholas Milley
Thomas Lianza
Carl Lutz
Original Assignee
Sequel Imaging, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sequel Imaging, Inc. filed Critical Sequel Imaging, Inc.
Priority to AU24156/00A priority Critical patent/AU2415600A/en
Priority to US09/618,680 priority patent/US6738856B1/en
Publication of WO2000042595A1 publication Critical patent/WO2000042595A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0264Electrical interface; User interface
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0272Handheld
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0291Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/50Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543Mice or pucks
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/463Colour matching
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/50Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
    • G01J3/51Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors using colour filters

Definitions

  • the present invention relates generally to simple, convenient, and cost-effective color calibration, and more specifically to an apparatus and method to measure light and color data useful for color calibration, wherein the apparatus electronics are housed in a standard pointing device such as a mouse or pen.
  • CTR's cathode ray tubes
  • printers printers
  • cameras video-recorders
  • scanners interconnected with personal computers and work stations vary significantly.
  • manufacturers and designers of the equipment utilize components from different sources and use differing techniques that can lead to substantial degradation in performance when interconnected with other components. This occurs whenever devices incorrectly transpose color objects from one medium to another.
  • the increased demand for color images, coupled with the increase in computational power of desktop computers has lead to a need to make color measurements on the desktop.
  • the measurement of color is a complex task. The complexity arises from the need to correlate the measurements made by an instrument with the impressions or sensations perceived by the human observer. The correlation is hampered by differences in absolute 5 sensitivity between the eye and instrument as well as other issues related to human perception. Objects are nomally measured using a different illuminant than the one used for viewing the objects. This factor further complicates the measurement process.
  • Colorimetric analysis of colors on web presses during the production run of a newspaper or magazine is another industry that requires accurate color calibration.
  • Another application of this technology is in the automatic calibration of hardcopy within a color copier.
  • a test pattern is printed and examined by the sensor while still in the copier.
  • Colorimeteric information is collected and sent back to a calibration subsystem to adjust the color balance of the media.
  • the prior art encompasses numerous color calibration techniques utilizing colorimeters, spectrophotometers, densitometers and similar color measuring devices. These systems generally are expensive and sophisticated devices utilizing customized hardware and software to make accurate color measurements. In most instances the color information is measured in factory and laboratory environments and used to create calibration tables for the device in order to produce accurate color outputs.
  • a calibration sensor is used to measure reflective, transmissive, or self-luminance specimens.
  • This device uses a plurality of light sources wherein each light source emits a different wavelength light source, in conjunction with a reference channel photodetector, sample channel photodetector, and a means for directing the light.
  • the directing means uses an optical cap, a reflector cone, and a receptor piece to coordinate and direct light emissions.
  • This patent discloses the use of a housing similar to a pointing device to house the circuitry of the invention, without incorporating positional mechanisms or circuitry in conjunction with the calibration hardware.
  • This art introduces the concept of a measurement device housed in the form factor of a pointing device.
  • pointing devices are intended to encompass all the possible embodiments that can be perform a positioning function, such as a mouse.
  • a positioning function such as a mouse.
  • an electro-optical mouse is disclosed in U.S. Patent 4,364,035, wherein the non-mechanical mouse uses electro-magnetic energy transmitted between the mouse and the surface to provide reference positional information.
  • U.S. Patent 5,288,993 a photosensitive array and is used in conjunction with a speckled ball illuminated with diffuse light to determine the
  • a commercial implementation of an advanced optical sensing pointing device is the Microsoft IntelliMouse. This device uses an optical sensor to replace the standard mouse ball o system.
  • the IntelliMouse incorporates a digital camera to take pictures of the surface and processes movement based on these picture images.
  • the present apparatus performs light and color measurement functions concurrently with positional sensing functionality.
  • the positional sensing can be mechanical, such as ball and track implementations or via the optical sensing positional technology.
  • the present invention provides for a package for light measurement and to the microprocessor firmware that performs light/color measurements and the sensing of X/Y position (like a computer mouse) for desktop computer systems.
  • a single microprocessor can be used for both applications, or separate microprocessors can be utilized.
  • the light/color measurements are intended to include computer displays (including, but not limited to, Cathode Ray Tube (CRT) devices, Liquid Crystal Display (LCD) panels, and plasma screen displays) for display calibration, and the measurement of color from reflective material (such as printed matted) for printer, scanner and digital camera calibration.
  • CTR Cathode Ray Tube
  • LCD Liquid Crystal Display
  • plasma screen displays for display calibration
  • the measurement of color from reflective material such as printed matted
  • Prior light/color sensing instruments for displays such as those from Sequel Imaging, X- Rite, and Minolta use separate color sensing devices.
  • U.S. Patent 5,892,585 describes color measurement techniques. Positional optical sensing technology for desktop mouse devices is embodied in devices such as those from Microsoft and Logitech. However, the present invention combines these two technologies into a single device and allows for a cost-effective duai function mouse.
  • the present invention is a color-measuring device for emitted and/or reflected light packaged with a positional sensing mechanism in a physical package such as a standard computer mouse.
  • a positional sensing mechanism in a physical package such as a standard computer mouse.
  • One embodiment of the invention uses a ball for positional sensing and incorporates an aperture (either behind of or in front of the ball) through which the light sensing mechanism operates.
  • the invention provides the standard functions of desktop computer mouse but also provides functionality as a monitor calibrator and/or a reflective densitometer/colorimeter.
  • Optical positional sensing devices do not employ mechanical positional hardware, and in another embodiment the present invention can be implemented with the optical sensing pointing device. In this embodiment, it is possible for the unit to use a single microprocessor and a single aperture.
  • the device contains a microprocessor and electronics for communication to a host CPU.
  • This microprocessor interfaces the positional measurement subsystem and the light-sensing subsystem, either in a single chip or two chips.
  • the position sensing subsystem and the light sensing subsystem may contain their own microprocessors as necessary for effective operation of the subsystem.
  • the system microprocessor performs the functions of data acquisition from the positional and light sensing subsystems, processes this data as necessary to conform required host communications protocols, transmits data to the host desktop CPU, and receives/interprets commands from the host for operation of the invention's several functions.
  • Operation of the positional sensors and light sensors may be combined for use in measuring reflective targets.
  • the position of the light sensor on the target is necessary information for the host measurement software to determine which color patch being measured.
  • the invention is meant to be adaptable to existing mouse products and packaging.
  • the main technology of the invention is embodied in the microprocessor firmware to handle the various input mechanisms and in the housing and operation of the light sensor to achieve desired accuracy in a non-optimal package.
  • the invention extends the typical positional sensing functionality of the computer mouse to include measurement of light-emitting displays, color/density measurement of reflective material. These functional extensions are enabled through the incorporation of multiple, specialized sensor subsystems whose control and data acquisition is provided by a single microprocessor.
  • the design of the physical package that incorporates the present invention has significant economic and marketable factors.
  • the present invention can be easily incorporated into the existing mouse shells, where there is physical room for the components.
  • mice designs represent many years of manufacturing expertise and substantial capital expenditures.
  • the mouse designs are ergonomic and configured for aesthetic appeal.
  • the components and electronics fits into existing designs to take advantage of the well-known designs.
  • an aperture opening on the pointing device that is covered by an optically clear piece of plastic or glass, forming an aperture window, to prevent accidental damage to the sensor unit.
  • a shielded aperture window allows restricts interfering light sources. Stray light that arrives from sources other than the desired emissions increases the error rates and otherwise produces inaccurate measurements.
  • An alternative embodiment uses a retractable shield with a spring contact. The spring provides pressure on the collar to maintain a tight fit against the object being sensed. The aperture window is prone to dust buildup, and should be cleaned prior to each use.
  • One embodiment of the light and color sensing invention is employed in the mechanical ball position sensing system.
  • a ball rotating between two slotted wheels, one in the horizontal (x) direction and one in the vertical direction (y), through which an infrared light illuminates.
  • An infrared light detector senses the on/off illumination level through the slotted wheel.
  • an illumination source in the mouse illuminates a decoder pad, and a light sensor in the mouse detects the reflection and the two-dimensional movement (x-y) is derived.
  • Still another embodiment uses the same light sensor for both position detection and light measurement, both illuminated and not illuminated.
  • Optical sensing pointing devices can be retrofit to include the necessary elements of the present invention and allow both optical position sensing as well as light and color sensing.
  • Yet another embodiment incorporates an imaging sensor that is used both for analysis of a surface for motion detection and analysis of an illumination for color measurement.
  • the 2 dimensional data detected by the sensor is stored and compared with previous data to detect position information.
  • 5 dimensional data detected by the sensor can be pixel averaged to provide a low noise measurement of the average illumination across the detector.
  • the light source can be a LED or other illuminating device. Typically, the source is mounted to o illuminate at a 45-degree angle with the reflected light collected at 90 degrees by the sensors. This embodiment may also use a separate dedicated microprocessor to process the data. Synchronization and communications protocol may be required to fully enable this variation.
  • the light sensing mechanism consists of a single light sensor with filter. 5
  • the light sensor views the display under measurement through an aperture in front of or behind the trackball.
  • the aperture is enclosed on the external underside of the mouse by a raised rib of plastic material that also serves to stabilize the mouse horizontally with respect to the desktop during positional measurements.
  • the light sensor may be expanded to multiple sensors to increase accuracy for measurement of color from a display or surface.
  • the sensors are mated with tuned color filters to enable accurate color measurement of the display.
  • light pipes may be used to transmit the light from the aperture to the sensors.
  • the light sensor may be further expanded to allow for measurement of both position and intensity information. This would be analogous to using a miniature digital camera to capture the scene characteristics. The digital scene is then analyzed either for position or average value.
  • a further embodiment of the light-sensing mechanism introduces a light source for o illumination of material under the aperture.
  • the light source is controlled by the microprocessor.
  • a microprocessor interfaces each of the sensing mechanisms and reads their output, processes the sensor data as necessary, and transmits the data to the host central processing unit (CPU) via a communications port.
  • the host CPU sends commands to the microprocessor to ir tiate/terminate a function or to check status of a sensor or function.
  • the base embodiment of the microprocessor connects the output pins of the sensors to the input/output (I/O) pins of the microprocessor.
  • a larger embodiment includes an electronically erasable programmable read-only memory (EEPROM) or some other mechanism for storing data such as characterization data of the light sensors or additional program instructions/data for use by the microprocessor.
  • EEPROM electronically erasable programmable read-only memory
  • the microprocessor may communicate to the host CPU via several methods.
  • One embodiment uses a serial, cabled protocol such as RS-232, ADB, or USB.
  • Another embodiment uses infrared transmission or radio transmission to the host.
  • the USB communication protocol is a standard that maximizes the efficiency of the present invention and makes the invention cost effective and easily implemented.
  • the color and light sensor mouse electronics can be integrated into the USB mouse and provide the dual function mouse, especially for higher end PC's and work stations that require color calibration.
  • Modern computer display devices contain detailed colorimetric information relating to the color properties of the display device.
  • the format of the data describing these properties is specified by the Video Electronic Standards Association (VESA).
  • VESA Video Electronic Standards Association
  • the protocol for capturing this information is also well specified.
  • the communication structure of the current invention makes use of these standards to allow for cost effective and compact communication.
  • the present invention can also be used as a densitometer to improve the color and luminance of printed matter.
  • the user would invoke the software routine to commence calibration, and instruct the user to place the light and color sensor onto the printed matter.
  • the printed matter would already consist of a test pattern.
  • the sensor would output the data back to the computer to create calibration data table.
  • the start/stop instructions as well as any additional features or functions can be easily implemented using the mouse buttons.
  • An alternative embodiment allows the software to invoke the calibration procedures on a time interval basis.
  • the software can be resident firmware embedded into the microprocessor, software resident on the host computer, or a combination of the two.
  • a software package can work in conjunction with the light and color sensor mouse to provides an easy user interface.
  • the results of the calibration can be stored in memory of the device and used to correct the errors.
  • the pointing device electronics and the light/color sensing electronics can be separate or combined, depending upon the availability of access to the existing position sensing electronics.
  • the mechanical position sensing variations such as the track ball
  • the actual components of the light and color sensing circuits have to be physically separated inside the housing of the pointing device.
  • the optical position sensing varieties employ similar hardware, and the addition of the light and color sensing electronics can be physically separated or combined within one external aperture.
  • a microprocessing means is central to the functionality of the present invention.
  • the microprocessor interfaces each of the sensing mechanisms and reads their output, processes the sensor data as necessary, and transmits the data to the host central processing unit (CPU) via a communications port.
  • the host CPU sends commands to the microprocessor to initiate/terminate a function or to check status of a sensor or function.
  • the base embodiment of the microprocessor connects the output pins of the sensors to the input/output (I/O) pins of the microprocessor.
  • a larger embodiment includes an electronically erasable programmable read-only memory (EEPROM) or some other mechanism for storing data such as characterization data of the light sensors or additional program instructions/data for use by the microprocessor.
  • the microprocessor may communicate to the host CPU via several methods. One embodiment uses a serial, cabled protocol such as RS-232, ADB, or USB. Another embodiment uses infrared transmission or radio transmission to the host.
  • the USB communication protocol is a standard that maximizes the efficiency of the present 5 invention and makes the invention cost effective and easily implemented.
  • the color and light sensor mouse electronics can be integrated into the USB mouse and provide the dual function mouse, especially for higher end PC's and work stations that require color calibration.
  • Another variation of the present invention includes a separate light source for illuminating o the object to be measured, such as for reflective measurements.
  • the light source can be a simple light emitting diode (LED) or similar device that can be located within the compartment. Multiple LED's having different color could be employed to provide more accurate calibration.
  • the viewport would have a separating means to prevent/limit the light source from being internally detected. The light source would help illuminate the objects to be measured, especially objects 5 lacking independent light sources.
  • an x-y position sensing mechanism uses a ball rotating two slotted wheels, one in the horizontal direction and one in the vertical direction, through which an infrared light illuminates.
  • An infrared light detector senses the on/off illumination level through the slotted o wheel.
  • the mouse is positioned on a decoder pad.
  • An illumination source in the mouse illuminates the decoder pad.
  • a light sensor detects the reflection and the two- dimensional movement is derived.
  • Still another embodiment uses the above method of position detection, yet uses the same 5 light sensor for both position detection and light measurement, both illuminated and emissive.
  • Still another embodiment uses a two dimensional sensor to detect position and intensity information from sources that are illuminated or emissive.
  • the light sensing system of the present invention measures illuminated devices, such as computer displays, so that associated software can calibrate a display, scanner, or other object for accurate color reproduction.
  • the basic subsystem consists of a single light sensor mounted within the sensor housing. The sensor is covered by a photopic glass and wired directly to the I/O pins of the system microprocessor. Upon receipt of the appropriate command, the system microprocessor ignores input from the position indicating system and collects data from the light sensor.
  • the light sensor is a light-to-frequency converter that outputs a string of pulses whose frequency is directly proportional to the amount of light striking the sensor.
  • the system microprocessor counts the pulses, formats the data, and sends the data to the host.
  • the device returns to "mouse-mode" upon receipt of the appropriate command from the host computer.
  • EEPROM memory is added, and stores data about the transfer function of the sensors and is used to calibrate the sensor to a known standard.
  • the calibration enables software to calculate an absolute color coordinate or an absolute luminance.
  • Another embodiment includes a frequency-detect sensor to measure and monitor refresh rates.
  • This sensor is a light-to-voltage converter and is used by the microprocessor to sense monitor refresh. With this data, software can accurately calculate luminance or color from the object sensed.
  • Yet another embodiment incorporates three light sensors with tuned color filters. This enables the highly accurate measurement of color and luminance from the display.
  • This embodiment can use the existing microprocessor in the mouse, but may use a separate dedicated microprocessor in the mouse to read data from the three channels simultaneously. Using dual microprocessors requires a communications protocol and synchronization scheme to transfer data.
  • the light source can be a LED or other illuminating device. Typically, the source is mounted to illuminate at a 45-degree angle with the reflected light collected at 90 degrees by the sensors. This embodiment may also use a separate dedicated microprocessor to process the data.
  • Synchronization and communications protocol may be required to fully enable this variation.
  • the light sensing mechanism consists of a single light sensor with filter.
  • the light sensor views the display under measurement through an aperture in front of or behind the trackball or CCD.
  • the aperture is enclosed on the external underside of the mouse by a raised rib of plastic material that also serves to stabilize the mouse horizontally with respect to the desktop during positional measurements.
  • the light sensor may be expanded to multiple sensors to increase accuracy for measurement of color from a display or surface.
  • the sensors are mated with tuned color filters to enable accurate color measurement of the display.
  • light pipes may be used to transmit the light from the aperture to the sensors.
  • the light sensor may be further expanded to multiple sensors to allow for 2-dimensional pattern analysis as well as intensity measurement.
  • a further embodiment of the light-sensing mechanism introduces a light source for illumination of material under the aperture.
  • the light source is controlled by the microprocessor.
  • the microprocessor may communicate to the host CPU via several methods.
  • One embodiment uses a serial, cabled protocol such as RS-232, ADB, or USB.
  • Another embodiment uses infrared transmission or radio transmission to the host.
  • the USB communication protocol is a recent standard that maximizes the efficiency of the present invention and makes the invention cost effective and easily implemented.
  • the color and light sensor mouse electronics can be integrated into the USB mouse and provide the dual function mouse, especially for higher end PC's and work stations that require color calibration.
  • the user indicates to the host computer that a calibration is desired.
  • the computer invokes the necessary software routine and a display screen is provided instructing the user to place the light and color sensor onto the display along with any test parameters.
  • the computer software will invoke an appropriate color patch or reference display.
  • the mouse buttons can be used for interacting with the system software, and completing any number of measuring sequences.
  • the data from the light and color sensor is transmitted back to the host computer for evaluation.
  • the data is used to compute a calibration table by comparing expected color and luminance values to the displayed color and luminance values.
  • the calibration data is then used to correct the display so that the system is optimized.
  • the system software can employ a variety of o additional features and implementations.
  • the present invention can also be used as a densitometer to improve the color and luminance of printed matter.
  • the user would invoke the software routine to commence calibration, and instruct the user to place the light and color sensor onto the printed matter.
  • the printed matter 5 would already consist of a test pattern.
  • the sensor would output the data back to the computer to create calibration data table.
  • the start stop instructions as well as any additional features or functions can be easily implemented using the mouse buttons.
  • An alternative embodiment allows the software to invoke 0 the calibration procedures on a time interval basis.
  • the software can be resident firmware embedded into the microprocessor, software resident on the host computer, or a combination of the two.
  • a software package can work in conjunction with the light and color sensor mouse to 5 provides an easy user interface.
  • the results of the calibration can be stored in memory of the device and used to correct the errors.
  • the connection between the light and color sensing pointing device and the host computer is a USB cable that includes a microprocessor.
  • the microprocessor manages the o communications between the pointing device, the host system, and the display system.
  • Modern display systems contain communication sub systems to allow for transmission of the display device color characteristics. Knowledge of this information allows use of a single color sensitivity sensor to detect the relative amplitude of the individual color display primaries. This enables calculation of display color temperature.
  • the microprocessor in the USB cable translates commands to monitor
  • the microprocessor utilizes the VESA (Video Electronics Standards Association) standards DDC/CI and MCCS to communicate information to the monitor. Commands may be sent via the USB interface directly to the Display Device. Display devices that adhere to the MCCS standard can be l o digitally adjusted via commands sent thru this cable.
  • VESA Video Electronics Standards Association
  • software instructions could initiate the calibration, or the user could initiate the calibration process by pressing an icon or executing the applicable software.
  • the software would provide instructions to the user to place the light and color sensor mouse on the object to be calibrated, such as the CRT.
  • the user would place the mouse onto the CRT screen and hold the mouse there flush against the CRT until the calibration was completed.
  • a test pattern is initiated by the program, and the light and color sensor mouse would measure and store the results.
  • the results would be used to form a calibration table to correct the CRT.
  • the user may be instructed to 25 move the mouse across the CRT in certain situations, but normally a single position would be sufficient.
  • the user would be instructed to place the mouse on the printed matter.
  • the printed matter could be a test print specifically for the calibration purposes.
  • the calibration 3 o data recorded by the light and color sensor mouse would be recorded and a calibration table formed to correct the printer or web.
  • the measured results could be compared to a standard, or compared to results from the CRT display or to the results of another printer matter measurement.
  • Scanners, digital cameras, and video units could be tested in a similar fashion, whereby the 5 data measured is compared to a reference measurement or to another calibrated reference and a calibration table is formed to correct the device.
  • the photodiode sensor unit is typically a silicon integrated circuit, with a connection to the mouse microprocessor for power and for communicating the measurement results to a host l o computer.
  • the power source can also be obtained from a battery, photovoltaic source, or from a separate microprocessor.
  • the photodiode sensor is not required when the light and color sensing elements are installed in conjunction with the optical position sensing pointing device.
  • the software makes the measurements instructions are provided to move to a different patch or to drag the mouse over the color patches.
  • the different patch sections can be differentiated by the user or by the software that calculates the position of the mouse.
  • connection between the light and color sensmg pointing device and the host computer is a USB cable that includes a microprocessor.
  • the microprocessor manages the communications between the pointing device and the host system.
  • An object includes a pointing device for measuring x-y position and emitted light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means has an inner sensor compartment with a sensor viewport, and the position sensing means senses a set of x-y position data.
  • a pointing device for measuring x-y position and emitted light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means has an inner sensor compartment with a sensor viewport, and the position sensing means senses a set of x-y position data.
  • FIG. 30 viewport.
  • a photodiode integrated circuit or equivalent, for measuring a set of readings, wherein the photodiode is located adjacent the infrared optical filter on a second side, and wherein the photodiode is connected to a power source.
  • a computing means is used for processing the set of readings, and there is a means of communicating the set of readings and the set of x-y position data to a host computer.
  • Further objects include a pointing device, wherein the set of readings is photometric data.
  • a pointing device further comprising a color optical filter located within the inner sensor compartment, wherein the color optical filter is positioned between the infrared optical filter and the photodiode.
  • the system is capable of measuring a set of o readings with colorimetric data.
  • the system can include a plurality of color optical filters located within the inner compartment, wherein the plurality of color optical filters are positioned adjacent the second side of the infrared optical filter.
  • the pointing device can vary, and in some embodiments the position sensing means is 5 mechanical. Other pointing device utilize position sensing means that are an optical system. In the preferred embodiment the pointing device is a computer mouse.
  • the pointing device requires a power source, and the power can be selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic o source in the mouse, and a photovoltaic means.
  • An additional object of the pointing device further comprising a means of switching between the sensor means and the position sensing means.
  • the switching can be automated by a software routine or by operator intervention such as clicking a mouse button. 5
  • Another object of the invention is a pointing device for measuring x-y position and reflected light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means has an inner sensor compartment with a sensor viewport, and wherein the position sensing means senses a set of x-y position data.
  • This embodiment for reflective surfaces requires an 0 illumination source adjacent the sensor viewport.
  • a photodiode integrated circuit for measuring a set of readings, wherein the photodiode is located adjacent the infrared optical filter on a second side, and wherein the photodiode is connected to a power source.
  • Further objects include a pointing device, wherein the set of readings is photometric data.
  • a pointing device further comprising a color optical filter located within the l o inner sensor compartment, wherein the color optical filter is positioned between the infrared optical filter and the photodiode.
  • the system is capable of measuring a set of readings with colorimetric data.
  • the system can include a plurality of color optical filters located within the inner compartment, wherein the plurality of color optical filters are positioned adjacent the second side of the infrared optical filter.
  • the pointing device can vary, and in some embodiments the position sensing means is mechanical. Other pointing device utilize position sensing means that are an optical system. In the preferred embodiment the pointing device is a computer mouse.
  • the pointing device requires a power source, and the power can be selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic source in the mouse, and a photovoltaic means.
  • An additional object of the pointing device further comprising a means of switching 25 between the sensor means and the position sensing means.
  • the switching can be automated by a software routine or by operator intervention such as clicking a mouse button.
  • An additional object is a pointing device, wherein the illuminated source, such as LED's, is positioned at a 45 degree angle to the sensor viewport.
  • An object of the invention is a pointing device for measuring x-y position and emitted light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means and the position sensing means are in an inner compartment having a lens, and wherein the position sensing means senses a set of x-y position data.
  • a pointing device for measuring x-y position and emitted light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means and the position sensing means are in an inner compartment having a lens, and wherein the position sensing means senses a set of x-y position data.
  • an infrared optical filter located within the inner compartment, wherein a first side of the infrared optical filter is located adjacent the lens.
  • a computing means is used for processing the set of light readings, and there is a means of communicating the set of light readings and the set of x-y position data to a host computer.
  • a pointing device wherein the set of light readings is photometric data. Also there is a pointing device, further comprising a color optical filter located within the inner compartment, wherein the color optical filter is adjacent the second side of the infrared optical filter.
  • the system is capable of measuring a set of light readings for colorimetric data.
  • the position sensing devices includes the position sensing means that is a CCD system. Further, wherein the pointing device is a computer mouse.
  • the power source for the system is selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic source in said mouse, and a photovoltaic means.
  • An additional object is a pointing device, further comprising a means of switching between the sensor means and the position sensing means.
  • An object of the invention is a pointing device for measuring x-y position and reflected light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means and the position sensing means are in an inner compartment having a lens, and wherein the position sensing means measures a set of x-y position data.
  • the system has a means of measuring a set of light readings, and a computing means for processing the set of light readings.
  • a pointing device wherein the set of light readings is photometric data. Also there is a pointing device, further comprising a color optical filter located within the inner compartment, wherein the color optical filter is adjacent the second side of the infrared optical filter.
  • the system is capable of measuring a set of light readings for colorimetric data.
  • the position sensing devices includes the position sensing means that is a CCD system. Further, wherein the pointing device is a computer mouse.
  • the power source for the system is selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic source in said mouse, and a photovoltaic means.
  • An additional object is a pointing device, further comprising a means of switching between the sensor means and the position sensing means.
  • Yet another object is a pointing device, wherein the illuminated source is positioned at a 45 degree angle to the lens.
  • Yet a further object of the invention is a method of calibrating a color dependent source using a pointing device comprising the steps of activating a calibration software module, placing the pointing device onto a surface to be calibrated, measuring a set of color characteristics of the pointing device, generating a calibration table using the set of color characteristics, transmitting the calibration table to a memory storage device, returning the pointing device to a position sensing state.
  • An object of the invention is a communication cable with integrated processing means for connecting a host computer to a display device, comprising a first cable connecting the host computer to the display device, where the cable has a processing means. There is a second cable connecting from the host computer to the processing means of the first cable, wherein the
  • processing means controls communications between the host computer and the display device.
  • An additional object is a communication cable with integrated processing means wherein the first cable is a VGA cable for normal connection between the host computer and the display device. Furthermore, the second cable is a USB cable, and wherein the processing means l o transfers control of the display device to the second cable.
  • Further object includes a communication cable with integrated processing means, further comprising a calibration module connected to the processing means of the first cable. Additionally, the calibration module is also a position sensing mouse in the preferred embodiment.
  • a further object is a communication cable with integrated processing means, further comprising a hub for making multiple connections.
  • the USB hub connects to the host computer and has multiple ports for connecting to calibration modules and other display devices through the smart cable.
  • Integrated cable processing allows access and manipulation of advanced computer controlled features existent within peripherals (i.e. the monitor) without total system integration. That is, the operating system and host CPU hardware only need support standard VGA features.
  • the communication channel present in the cable allows access to computer controlled features not supported in all CPU / operating system vendors.
  • EMI transmissions which must be minimized to meet commercial standards exist, they can be shielded within the cable itself. In fact, components can be shielded from one another as well as the environment if required. Accomplishing this shielding within the same devices simplifies conformance to commercial standards. Additionally, this smart cable allows access to commands which peripherals support which the operating system does not. A different software driver is not required for each different operating system, it is only necessary to adhere to a standard communications protocol.
  • FIG. 1 (a) Top view of a light and color sensing mouse with light sensor
  • FIG. 1(b) Bottom view of a light and color sensing mouse with light sensor for a trackball position system
  • FIG. 2 Cutaway diagram of system components of light and color sensing mouse
  • FIG. 3 Basic block diagram showing the interconnection of the components
  • FIG. 4 Bottom view of a light and color sensing mouse with light sensor for an optical sensor mouse
  • FIG. 5 Cutaway diagram of system components of light and color sensing mouse for an optical sensor positioning system
  • FIG. 6(a) Cutaway diagram of system components of light and color sensing mouse for an optical sensor mouse
  • FIG. 6(b) Cutaway diagram of system components of light and color sensing mouse for an optical sensor mouse
  • FIG. 7 Cutaway diagram illustrating angled positioning of illumination source
  • FIG. 8(a) Smart cable showing monitor cable with USB pigtail and circuit
  • FIG. 8(b) USB circuit with wiring for smart cable
  • FIG. 10 Adapter for VGA cable with USB male port
  • FIG. 11 System connection diagram showing a smart cable with integral mouse/calibrator attached
  • FIG. 12 System connection diagram showing smart cable for communication to the monitor and a separate USB mouse calibrator
  • FIG. 13 Schematic Diagram of smart cable processor
  • FIG. 1(a) a top view of a standard computer mouse 10 is shown.
  • a cable 20 is attached to one end of the mouse 10 to transmit the coordinate and command and position signals from the mouse.
  • the position signals result from the user moving the mouse and the circuitry measuring the movement and producing a corresponding signal to move the cursor on a monitor or other type display.
  • the mouse typically has at least one click sensor 30 that allows the operator to interface with the computer.
  • the aesthetic design of the mouse 10 as well as the location of the cable 20 and the click sensors 30 vary according to the manufacturer.
  • FIG. 1(b) illustrates the bottom view of a ball type mouse 10, showing the mouse trackball
  • the light and color sensing hardware fits within a standard mouse 10, wherein the optical sensor viewport 70 is accessed via the viewport aperture 80.
  • the viewport aperture 80 is designed to limit extraneous light from the sensor optical sensor viewport 70, as extraneous light interferes with the accuracy and efficiency of the sensing electronics.
  • the viewport aperture 80 opening may be covered by an optically clear piece of plastic or glass, forming the optical sensor viewport 70, to prevent accidental damage to the sensor unit.
  • a shielded viewport aperture 80 allows for the desired light emission but restricting interfering light sources. Stray light that arrives from sources other than the desired emissions increase the error rates and otherwise produce inaccurate measurements.
  • a collar, ring, or sleeve 65 is fitted to the viewport aperture 80 as shown in FIG. 2(a).
  • This collar 65 is made of hard rubber or plastic and also can serve as a stabilizer skid for the trackball when being used as a mouse.
  • the depth of the collar can vary but should be adequate to form a seal when placed on the object to be sensed.
  • a rubber seal or O-ring 67 can serve as the shield, as depicted in FIG. 2(b).
  • FIG. 2(c) and FIG. 2(d) An alternative retractable shield embodiment is shown in FIG. 2(c) and FIG. 2(d).
  • the optical sensor viewport 70 uses a retractable shield 71 with a spring actuator 72.
  • the spring provides pressure on the collar 65 to maintain a tight fit against the surface to be sensed
  • the viewport aperture 80 is prone to dust buildup, and should be cleaned prior to use.
  • the inner components of the light and color sensing elements for the track ball mouse are 5 shown in FIG. 3.
  • the mouse trackball 50 is encased within a horizontal encoder 100 and a vertical encoder 120.
  • the encoders are used to accurately determine the x-y position.
  • the sensor viewport 70 typically has an internal compartment 150 that retains the optical elements.
  • An infrared optical filter 120 is placed within the internal compartment 150, followed by one or more color optical filters 130.
  • a photodiode integrated circuit (IC) 140 or similar light measuring device l o electronically connects the optical elements with the electronic circuits.
  • IC photodiode integrated circuit
  • optical filters 130 There can be one or more optical filters 130, depending on the accuracy and the implementation. Initial research has indicated that a single green filter is sufficient for most cases, eliminating the extra cost and manufacturing costs associated with multiple filters. In addition, the
  • FIG. 4 is a basic block diagram illustrating the interconnection of the various elements of the present invention.
  • a host computer 200 can be any type of personal computer, laptop or
  • any device with a controller can be a host computer.
  • the host communication interface 210 is typically a thin cable connecting the position sensing electronics
  • the processing electronics 220 encompasses both the typical pointing device electronics as 25 well as the light and color sensing electronics.
  • the pointing device electronics generates horizontal and vertical positioning inputs 230 that are processed by the processing electronics 220.
  • the light and color sensing electronics comprises light sensing inputs 240 and a light sensing subsystem 260.
  • Sensor characterization data 270 is used 30 by the processing electronics 220 to aid the computer 200 in producing accurate object transfer.
  • FIG. 5 illustrates an optical position sensor mouse inco ⁇ orating a CCD 300, such as the IntelliMouse system.
  • the CCD 300 is a CMOS digital camera that processes pictures at a high rate and 'measures' x-y relationships by comparing the pictures as the mouse is moved.
  • the electronics of the CCD system can be shared with the light and color sensing electronics to reduce cost and add the benefits of color measuring to the position sensing functions of the pointing device.
  • the CCD 300 is contained within an aperture opening 310 that provides an outer surface o rim and retains the lens 320.
  • the lens 320 is slightly recessed to prevent damage and to reduce dirt buildup and limit scratching of the lens 320.
  • the electronic circuitry can be separate or combined.
  • FIG. 6 shows a cutaway illustration of the internal elements of the CCD position system and the light and color sensing system.
  • the CCD 300 is mounted within a CCD compartment 330 and is in close proximity to the lens 320.
  • the individual elements of the light and color measuring system comprises the infrared optical filter placed into the compartment 150, followed by one or more color optical filters.
  • the color optical filters are not necessary, but the device will only be 0 capable of making photometric measurements with the color optical filters 130.
  • a photodiode IC 140 is the last component in the compartment 150 and communicates to the mouse processing electronics, as does the CCD 300.
  • a combined CCD position sensing system and light and color measuring system are 5 combined in a single compartment in FIG. 7(a).
  • the compartment 400 is suitable adjusted to retain the elements of the combined system.
  • An infrared optical filter 410 is placed nearest to the lens 440.
  • a color optical filter 420 is placed after the infrared filter. If the color filter is eliminated, only photometric measurements can be taken.
  • the CCD sensor 430 is placed on top of the other filter(s) and takes pictures in the same fashion as previously indicated. The filters do not interfere with the positional sensing functions.
  • FIG. 7(b) A side view of the placement of the elements is shown in FIG. 7(b).
  • the compartment 400 houses the infrared optical filter 410, the optional color filter(s) 420, and the CCD 430.
  • the lens 440 allows the camera to take the pictures for position sensing independent of the light and color components.
  • the light and color sensing pointing device In order to measure objects that are not illuminated like a monitor, the light and color sensing pointing device must generate an independent light source.
  • LED's light emitting diodes
  • the LED's 500 are installed into the compartment wall 510.
  • the LED's 500 are angled in the preferred embodiment, preferably at approximately 45 degrees.
  • the source is mounted to illuminate at a 45-degree angle with the reflected light collected at 90 degrees by the sensors.
  • the lens 530 is also placed on the ledge 520 along with the other components.
  • FIG. 9 shows one connection strategy that is employed the by the present invention.
  • the basic interface connection 500 is via the USB bus.
  • On end of the cable 510 is connected to the central processing unit (CPU), while the other end 520 is connected to the monitor .
  • a third connection is branched off from the CPU end and has a USB -male connector 530.
  • the cable 500 contains an I2C interface 520.
  • the I2C interface 520 is used to communicate to a VESA compliant monitor.
  • the cable 500 is reversible, however the USB-male connection 530 needs to have a mating connector nearby.
  • the electronics are designed into a custom circuit that is small enough to fit inside a standard DM15M connector.
  • the processor within the connector is used to perform the task of communicating to the host via the USB interface and communicating to the monitor using the
  • the I2C/DDC2bi interface captures the colorimetric information from the display device.
  • the colorimetric information contains the chromatic description of the display primaries. If this information is known, a single sensitivity sensor may be used for measurement of the intensity of color primaries of the display.
  • FIG. 10 shows an embodiment of the present invention that incorporates two connections: USB/DDC2bi monitor control and a USB port 570 for monitor control.
  • FIG. 12 shows the connection diagram for this system.
  • the first connection is a USB / DDC2bi "smart" cable". This cable is used to sense and control information to the display device.
  • a second USB connection is utilized to communicate and control the mouse. This configuration is especially useful for systems that utilize 2 or more display systems. In this environment, a single mouse can be used to measure and adjust multiple monitors. Each additional monitor is attached to the USB bus using the "smart cable”.
  • the VGA standard cable 550 has an enable adapter 560 containing a USB-female type B connection 570.
  • FIG. 11 another variation features a VGA standard cable (DB15M) 550 with an enable adapter 600 that has a pigtail 620 off the enable adapter 600 with a USM-male connection 610.
  • the pigtail length can vary, although ten inches is used in the preferred embodiment.
  • FIG. 14 A schematic of the electronics in the smart cable is shown in FIG. 14.
  • the Cypress IC 700 is used to control the communications between the monitor, host, and mouse/calibrator. Signals from the host VGA connector are routed through Jl . Communications to the monitor are routed through J3. Connections to the USB are on J2 . In another embodiment communication to the mouse/calibrator can be handled directly through this processor at J4.
  • the power for the smart cable is derived from the host VGA connector. This is necessary to insure that DDC host to monitor communication occurs without any reliance upon the USB connection.
  • the processor When the processor is first powered, it allows pass thru communication between the host VGA and the VESA compliant display device. This is an essential part of the computer "boot" sequence.
  • the host software can then issue commands via the USB connection J2.
  • the EnableCable processor can send commands to the monitor or to an attached mouse/calibrator.
  • the processor parses each command to the monitor to insure that the specific commands described in the VESA MCCS specification are formatted properly. This prevents potential damage to the display as the result of an invalid or undocumented command.
  • the circuit board in this embodiment is capable of being used as a simple smart cable or as a smart cable + mouse /calibrator controller.
  • FIG.'s 12 and 13 are connection diagram depicting the connection of a smart cable with embedded calibrator. This configuration simplifies the cabling process.
  • the user or automated program In operation as a light sensor for a display, the user or automated program indicates to the host computer that a calibration is desired.
  • the computer invokes the necessary software routine and a display screen is provided instructing the user to place the light and color sensor onto the display along with any test parameters.
  • the computer software will invoke an appropriate color o patch or reference display.
  • the pointing device buttons can be used for interacting with the system software, and completing any number of measuring sequences.
  • the data from the light and color sensor is transmitted back to the host computer for evaluation.
  • the data is used to compute a calibration table by comparing expected color and 5 luminance values to the displayed color and luminance values.
  • the calibration data is then used to correct the display so that the system is optimized.
  • the system software can employ a variety of additional features and implementations.
  • Operation as a light sensor is under program control from the host CPU. If the host o software is instructed to read a series of color patches for calibration, the host computer would provide appropriate instructions. The software may require the operator to click a pointing device button or other input means to change modes. The user would position the pointing device over the color patch on the display with the aperture over the color patch. The software then reads the data from the sensor electronics, displays another color patch and continues the process until all 5 calibration data is obtained. When all the data is measured, the software again provides instructions to the user and the pointing device functions are returned to mouse mode. Various user interfaces may be necessary to abort measurements or switch back to pointing device mode.
  • the light-sensing system is used to measure illuminated displays so that associated software o can calibrate a display.
  • the light sensor is a light-to-frequency converter that outputs a string of pulses whose frequency is directly proportional to the amount of light striking the sensor.
  • the system microprocessor counts the pulses, formats the data, and sends the data to the host.
  • This embodiment may include a frequency-detect sensor to measure and monitor refresh rates.
  • This sensor is a light-to-voltage converter and is used by the microprocessor to sense monitor refresh. With this data, software can accurately calculate luminance or color from the object sensed.
  • Yet another embodiment incorporates three light sensors with tuned color filters. This enables the highly accurate measurement of color and luminance from the display.
  • This embodiment can use the existing microprocessor in the pointing device, but may use a separate dedicated microprocessor in the pointing device to read data from the three channels simultaneously. Using dual microprocessors requires a communications protocol and synchronization scheme to transfer data.

Abstract

An apparatus and method for performing light and color calibration utilizing a pointing device. The present invention is a light and color measuring system including a silicon photodiode IC (140), color optical filters (130), an infrared optical filter (120), and a sensor view port (70) for illuminated sources and/or reflective mediums, wherein the invention is packaged in the same physical package with a standard positional sensing mechanism including a mouse trackball (50), a horizontal encoder (100), a vertical encoder (110), and a communication cable for connecting the apparatus to a computer and a display device.

Description

LIGHT AND COLOR SENSING POINTING DEVICE
TECHNICAL FIELD OF THE INVENTION
The present invention relates generally to simple, convenient, and cost-effective color calibration, and more specifically to an apparatus and method to measure light and color data useful for color calibration, wherein the apparatus electronics are housed in a standard pointing device such as a mouse or pen.
BACKGROUND OF THE INVENTION
The color performance of most monitors or cathode ray tubes (CRT's), printers, cameras, video-recorders, and scanners interconnected with personal computers and work stations vary significantly. The manufacturers and designers of the equipment utilize components from different sources and use differing techniques that can lead to substantial degradation in performance when interconnected with other components. This occurs whenever devices incorrectly transpose color objects from one medium to another.
The increased demand for color images, coupled with the increase in computational power of desktop computers has lead to a need to make color measurements on the desktop. The increased use of the desktop computer to perform a multitude of tasks, leads to a proliferation of many different accessories on the desktop. It is a desirable feature to combine complimentary functions in a single device to conserve work space, power and interface connections. The measurement of color is a complex task. The complexity arises from the need to correlate the measurements made by an instrument with the impressions or sensations perceived by the human observer. The correlation is hampered by differences in absolute 5 sensitivity between the eye and instrument as well as other issues related to human perception. Objects are nomally measured using a different illuminant than the one used for viewing the objects. This factor further complicates the measurement process.
When light sources are temporally variant, and their effects are measured relative to l o human responses, it is necessary to carefully separate artifacts that may be detected by the instrument from artifacts which affect the human perception. One method of elimination of temporal variation is to electronically filter the variation out using well known electrical and analytical techniques.
15 For example, automated adjustment and calibration of a CRT while on the assembly line is a typical task which requires minimal measurement time. The monitor adjustments must be servoed by the measurement device and the time of measurement must be short. The monitor is essentially a flashing source, and if the colorimeter is not properly synchronized with the vertical refresh rate of the monitor, the measurements will be very unreliable.
20
Colorimetric analysis of colors on web presses during the production run of a newspaper or magazine is another industry that requires accurate color calibration. In these systems, it is often useful to use a strobe illuminator to "freeze" the movement of the web. This is done by flashing a source for a very short period. This flash effectively acts as shutter.
25
Another application of this technology is in the automatic calibration of hardcopy within a color copier. A test pattern is printed and examined by the sensor while still in the copier. Colorimeteric information is collected and sent back to a calibration subsystem to adjust the color balance of the media.
30 The advances and popularity in graphics design requires highly accurate and acessible calibration in order to ensure that the work created by the designer is properly transferred from one form to another. A simple calibration device ensures that the output product closely resembles the designed work in order to accomplish the 'what you se is what you get' product.
The prior art encompasses numerous color calibration techniques utilizing colorimeters, spectrophotometers, densitometers and similar color measuring devices. These systems generally are expensive and sophisticated devices utilizing customized hardware and software to make accurate color measurements. In most instances the color information is measured in factory and laboratory environments and used to create calibration tables for the device in order to produce accurate color outputs.
The need for user color calibration has been growing, as the user desires highly accurate color outputs. In U.S. Patent 5,684,582, a separate self-contained and hand-held spectrophotometer is described to permit more convenient color calibration.
In PCT patent application WO98/11410, substantially the same as U.S. Patent 5,963,333, a calibration sensor is used to measure reflective, transmissive, or self-luminance specimens. This device uses a plurality of light sources wherein each light source emits a different wavelength light source, in conjunction with a reference channel photodetector, sample channel photodetector, and a means for directing the light. The directing means uses an optical cap, a reflector cone, and a receptor piece to coordinate and direct light emissions. This patent discloses the use of a housing similar to a pointing device to house the circuitry of the invention, without incorporating positional mechanisms or circuitry in conjunction with the calibration hardware. This art introduces the concept of a measurement device housed in the form factor of a pointing device.
The prior art has also introduced optical elements into pointing devices in order to improve performance over mechanical pointing devices. The term pointing devices is intended to encompass all the possible embodiments that can be perform a positioning function, such as a mouse. For example, an electro-optical mouse is disclosed in U.S. Patent 4,364,035, wherein the non-mechanical mouse uses electro-magnetic energy transmitted between the mouse and the surface to provide reference positional information. In U.S. Patent 5,288,993, a photosensitive array and is used in conjunction with a speckled ball illuminated with diffuse light to determine the
5 movement of the ball in order to move the cursor. Other pointing devices using photodetector arrays are disclosed in U.S. Patent 5,907,152, U.S. Patent 5,703,356, and U.S. Patent 5,854,484.
A commercial implementation of an advanced optical sensing pointing device is the Microsoft IntelliMouse. This device uses an optical sensor to replace the standard mouse ball o system. The IntelliMouse incorporates a digital camera to take pictures of the surface and processes movement based on these picture images.
In each of these patents, relating to the general field of pointing devices, and the
IntelliMouse, the sole function of the optical sensing element is to eliminate the mechanical sensing 5 means and utilize optical technology to provide accurate cursor control. There is no discussion or embodiment intended or designed for measurement of light or color data for purposes of calibration.
The problem with prior art devices is that the functionality of positional input for desktop o computer use and light/color measurement requires independent devices. While almost all users employ a mouse, a calibration device is not as commonplace and systems function with less than optimal color performance. What is needed is a single device for control of displayed cursor position, control of display color accuracy, and generation of profiles for other peripherals. This single device should be simple to incorporate into existing mouse designs and co-exist with 5 positional hardware and be cost-effective to manufacture and market. This device should also be simple to use and provide fast and accurate calibration of the calibrated devices.
0 SUMMARY OF THE INVENTION
The present apparatus performs light and color measurement functions concurrently with positional sensing functionality. The positional sensing can be mechanical, such as ball and track implementations or via the optical sensing positional technology. The present invention provides for a package for light measurement and to the microprocessor firmware that performs light/color measurements and the sensing of X/Y position (like a computer mouse) for desktop computer systems. A single microprocessor can be used for both applications, or separate microprocessors can be utilized. The light/color measurements are intended to include computer displays (including, but not limited to, Cathode Ray Tube (CRT) devices, Liquid Crystal Display (LCD) panels, and plasma screen displays) for display calibration, and the measurement of color from reflective material (such as printed matted) for printer, scanner and digital camera calibration. A significant piece of the invention deals with the ability to perform these functions in a small, ergonomic form factor and to execute these functions concurrently, interchangeably, and without reconfiguration of the device.
Prior light/color sensing instruments for displays such as those from Sequel Imaging, X- Rite, and Minolta use separate color sensing devices. U.S. Patent 5,892,585 describes color measurement techniques. Positional optical sensing technology for desktop mouse devices is embodied in devices such as those from Microsoft and Logitech. However, the present invention combines these two technologies into a single device and allows for a cost-effective duai function mouse.
The present invention is a color-measuring device for emitted and/or reflected light packaged with a positional sensing mechanism in a physical package such as a standard computer mouse. One embodiment of the invention uses a ball for positional sensing and incorporates an aperture (either behind of or in front of the ball) through which the light sensing mechanism operates. Thus, the invention provides the standard functions of desktop computer mouse but also provides functionality as a monitor calibrator and/or a reflective densitometer/colorimeter. Optical positional sensing devices do not employ mechanical positional hardware, and in another embodiment the present invention can be implemented with the optical sensing pointing device. In this embodiment, it is possible for the unit to use a single microprocessor and a single aperture.
The device contains a microprocessor and electronics for communication to a host CPU.
This microprocessor interfaces the positional measurement subsystem and the light-sensing subsystem, either in a single chip or two chips. The position sensing subsystem and the light sensing subsystem may contain their own microprocessors as necessary for effective operation of the subsystem. The system microprocessor performs the functions of data acquisition from the positional and light sensing subsystems, processes this data as necessary to conform required host communications protocols, transmits data to the host desktop CPU, and receives/interprets commands from the host for operation of the invention's several functions.
Operation of the positional sensors and light sensors may be combined for use in measuring reflective targets. In these instances, the position of the light sensor on the target is necessary information for the host measurement software to determine which color patch being measured.
The invention is meant to be adaptable to existing mouse products and packaging. Thus, the main technology of the invention is embodied in the microprocessor firmware to handle the various input mechanisms and in the housing and operation of the light sensor to achieve desired accuracy in a non-optimal package.
The invention extends the typical positional sensing functionality of the computer mouse to include measurement of light-emitting displays, color/density measurement of reflective material. These functional extensions are enabled through the incorporation of multiple, specialized sensor subsystems whose control and data acquisition is provided by a single microprocessor.
The design of the physical package that incorporates the present invention has significant economic and marketable factors. The present invention can be easily incorporated into the existing mouse shells, where there is physical room for the components. Certain manufacturers already incorporate electronics in mouse designs that can be easily tailored to interface with the light and color sensing electronics.
Present mouse designs represent many years of manufacturing expertise and substantial capital expenditures. The mouse designs are ergonomic and configured for aesthetic appeal. In order to make the light and color implementation practical, the components and electronics fits into existing designs to take advantage of the well-known designs.
There is an aperture opening on the pointing device that is covered by an optically clear piece of plastic or glass, forming an aperture window, to prevent accidental damage to the sensor unit. In the preferred embodiment, a shielded aperture window allows restricts interfering light sources. Stray light that arrives from sources other than the desired emissions increases the error rates and otherwise produces inaccurate measurements. An alternative embodiment uses a retractable shield with a spring contact. The spring provides pressure on the collar to maintain a tight fit against the object being sensed. The aperture window is prone to dust buildup, and should be cleaned prior to each use.
One embodiment of the light and color sensing invention is employed in the mechanical ball position sensing system. A ball rotating between two slotted wheels, one in the horizontal (x) direction and one in the vertical direction (y), through which an infrared light illuminates. An infrared light detector senses the on/off illumination level through the slotted wheel. In another embodiment, an illumination source in the mouse illuminates a decoder pad, and a light sensor in the mouse detects the reflection and the two-dimensional movement (x-y) is derived. Still another embodiment uses the same light sensor for both position detection and light measurement, both illuminated and not illuminated.
Optical sensing pointing devices can be retrofit to include the necessary elements of the present invention and allow both optical position sensing as well as light and color sensing. Yet another embodiment incorporates an imaging sensor that is used both for analysis of a surface for motion detection and analysis of an illumination for color measurement. When used as a position-sensing device, the 2 dimensional data detected by the sensor is stored and compared with previous data to detect position information. When used as a light-sensing device, the 2-
5 dimensional data detected by the sensor can be pixel averaged to provide a low noise measurement of the average illumination across the detector.
And another embodiment adds a light source for measurement of reflective materials. The light source can be a LED or other illuminating device. Typically, the source is mounted to o illuminate at a 45-degree angle with the reflected light collected at 90 degrees by the sensors. This embodiment may also use a separate dedicated microprocessor to process the data. Synchronization and communications protocol may be required to fully enable this variation.
In the simplest form, the light sensing mechanism consists of a single light sensor with filter. 5 The light sensor views the display under measurement through an aperture in front of or behind the trackball. The aperture is enclosed on the external underside of the mouse by a raised rib of plastic material that also serves to stabilize the mouse horizontally with respect to the desktop during positional measurements.
0 The light sensor may be expanded to multiple sensors to increase accuracy for measurement of color from a display or surface. In this embodiment, the sensors are mated with tuned color filters to enable accurate color measurement of the display. In some embodiments, light pipes may be used to transmit the light from the aperture to the sensors.
5 The light sensor may be further expanded to allow for measurement of both position and intensity information. This would be analogous to using a miniature digital camera to capture the scene characteristics. The digital scene is then analyzed either for position or average value.
A further embodiment of the light-sensing mechanism introduces a light source for o illumination of material under the aperture. The light source is controlled by the microprocessor. A microprocessor interfaces each of the sensing mechanisms and reads their output, processes the sensor data as necessary, and transmits the data to the host central processing unit (CPU) via a communications port. The host CPU sends commands to the microprocessor to ir tiate/terminate a function or to check status of a sensor or function.
The base embodiment of the microprocessor connects the output pins of the sensors to the input/output (I/O) pins of the microprocessor. A larger embodiment includes an electronically erasable programmable read-only memory (EEPROM) or some other mechanism for storing data such as characterization data of the light sensors or additional program instructions/data for use by the microprocessor.
The microprocessor may communicate to the host CPU via several methods. One embodiment uses a serial, cabled protocol such as RS-232, ADB, or USB. Another embodiment uses infrared transmission or radio transmission to the host.
The USB communication protocol is a standard that maximizes the efficiency of the present invention and makes the invention cost effective and easily implemented. The color and light sensor mouse electronics can be integrated into the USB mouse and provide the dual function mouse, especially for higher end PC's and work stations that require color calibration.
Modern computer display devices contain detailed colorimetric information relating to the color properties of the display device. The format of the data describing these properties is specified by the Video Electronic Standards Association (VESA). In addition to this basic information, the protocol for capturing this information is also well specified. The communication structure of the current invention makes use of these standards to allow for cost effective and compact communication.
The present invention can also be used as a densitometer to improve the color and luminance of printed matter. The user would invoke the software routine to commence calibration, and instruct the user to place the light and color sensor onto the printed matter. The printed matter would already consist of a test pattern. The sensor would output the data back to the computer to create calibration data table.
The start/stop instructions as well as any additional features or functions can be easily implemented using the mouse buttons. An alternative embodiment allows the software to invoke the calibration procedures on a time interval basis. The software can be resident firmware embedded into the microprocessor, software resident on the host computer, or a combination of the two.
A software package can work in conjunction with the light and color sensor mouse to provides an easy user interface. The results of the calibration can be stored in memory of the device and used to correct the errors.
The pointing device electronics and the light/color sensing electronics can be separate or combined, depending upon the availability of access to the existing position sensing electronics. In the mechanical position sensing variations, such as the track ball, the actual components of the light and color sensing circuits have to be physically separated inside the housing of the pointing device. The optical position sensing varieties employ similar hardware, and the addition of the light and color sensing electronics can be physically separated or combined within one external aperture.
A microprocessing means is central to the functionality of the present invention. The microprocessor interfaces each of the sensing mechanisms and reads their output, processes the sensor data as necessary, and transmits the data to the host central processing unit (CPU) via a communications port. The host CPU sends commands to the microprocessor to initiate/terminate a function or to check status of a sensor or function.
The base embodiment of the microprocessor connects the output pins of the sensors to the input/output (I/O) pins of the microprocessor. A larger embodiment includes an electronically erasable programmable read-only memory (EEPROM) or some other mechanism for storing data such as characterization data of the light sensors or additional program instructions/data for use by the microprocessor. The microprocessor may communicate to the host CPU via several methods. One embodiment uses a serial, cabled protocol such as RS-232, ADB, or USB. Another embodiment uses infrared transmission or radio transmission to the host.
The USB communication protocol is a standard that maximizes the efficiency of the present 5 invention and makes the invention cost effective and easily implemented. The color and light sensor mouse electronics can be integrated into the USB mouse and provide the dual function mouse, especially for higher end PC's and work stations that require color calibration.
Another variation of the present invention includes a separate light source for illuminating o the object to be measured, such as for reflective measurements. The light source can be a simple light emitting diode (LED) or similar device that can be located within the compartment. Multiple LED's having different color could be employed to provide more accurate calibration. The viewport would have a separating means to prevent/limit the light source from being internally detected. The light source would help illuminate the objects to be measured, especially objects 5 lacking independent light sources.
One embodiment of an x-y position sensing mechanism uses a ball rotating two slotted wheels, one in the horizontal direction and one in the vertical direction, through which an infrared light illuminates. An infrared light detector senses the on/off illumination level through the slotted o wheel. In another embodiment, the mouse is positioned on a decoder pad. An illumination source in the mouse illuminates the decoder pad. A light sensor detects the reflection and the two- dimensional movement is derived.
Still another embodiment uses the above method of position detection, yet uses the same 5 light sensor for both position detection and light measurement, both illuminated and emissive.
Still another embodiment uses a two dimensional sensor to detect position and intensity information from sources that are illuminated or emissive. The light sensing system of the present invention measures illuminated devices, such as computer displays, so that associated software can calibrate a display, scanner, or other object for accurate color reproduction. The basic subsystem consists of a single light sensor mounted within the sensor housing. The sensor is covered by a photopic glass and wired directly to the I/O pins of the system microprocessor. Upon receipt of the appropriate command, the system microprocessor ignores input from the position indicating system and collects data from the light sensor.
The light sensor is a light-to-frequency converter that outputs a string of pulses whose frequency is directly proportional to the amount of light striking the sensor. The system microprocessor counts the pulses, formats the data, and sends the data to the host. The device returns to "mouse-mode" upon receipt of the appropriate command from the host computer.
In another embodiment, EEPROM memory is added, and stores data about the transfer function of the sensors and is used to calibrate the sensor to a known standard. The calibration enables software to calculate an absolute color coordinate or an absolute luminance.
Another embodiment includes a frequency-detect sensor to measure and monitor refresh rates. This sensor is a light-to-voltage converter and is used by the microprocessor to sense monitor refresh. With this data, software can accurately calculate luminance or color from the object sensed.
Yet another embodiment incorporates three light sensors with tuned color filters. This enables the highly accurate measurement of color and luminance from the display. This embodiment can use the existing microprocessor in the mouse, but may use a separate dedicated microprocessor in the mouse to read data from the three channels simultaneously. Using dual microprocessors requires a communications protocol and synchronization scheme to transfer data.
And another embodiment adds a light source for measurement of reflective materials. The light source can be a LED or other illuminating device. Typically, the source is mounted to illuminate at a 45-degree angle with the reflected light collected at 90 degrees by the sensors. This embodiment may also use a separate dedicated microprocessor to process the data.
Synchronization and communications protocol may be required to fully enable this variation.
In the simplest form, the light sensing mechanism consists of a single light sensor with filter. The light sensor views the display under measurement through an aperture in front of or behind the trackball or CCD. The aperture is enclosed on the external underside of the mouse by a raised rib of plastic material that also serves to stabilize the mouse horizontally with respect to the desktop during positional measurements.
The light sensor may be expanded to multiple sensors to increase accuracy for measurement of color from a display or surface. In this embodiment, the sensors are mated with tuned color filters to enable accurate color measurement of the display. In some embodiments, light pipes may be used to transmit the light from the aperture to the sensors.
The light sensor may be further expanded to multiple sensors to allow for 2-dimensional pattern analysis as well as intensity measurement.
A further embodiment of the light-sensing mechanism introduces a light source for illumination of material under the aperture. The light source is controlled by the microprocessor.
The microprocessor may communicate to the host CPU via several methods. One embodiment uses a serial, cabled protocol such as RS-232, ADB, or USB. Another embodiment uses infrared transmission or radio transmission to the host.
The USB communication protocol is a recent standard that maximizes the efficiency of the present invention and makes the invention cost effective and easily implemented. The color and light sensor mouse electronics can be integrated into the USB mouse and provide the dual function mouse, especially for higher end PC's and work stations that require color calibration.
As an example of the system as a light sensor for a display, the user indicates to the host computer that a calibration is desired. The computer invokes the necessary software routine and a display screen is provided instructing the user to place the light and color sensor onto the display along with any test parameters. The computer software will invoke an appropriate color patch or reference display. The mouse buttons can be used for interacting with the system software, and completing any number of measuring sequences.
5
The data from the light and color sensor is transmitted back to the host computer for evaluation. The data is used to compute a calibration table by comparing expected color and luminance values to the displayed color and luminance values. The calibration data is then used to correct the display so that the system is optimized. The system software can employ a variety of o additional features and implementations.
The present invention can also be used as a densitometer to improve the color and luminance of printed matter. The user would invoke the software routine to commence calibration, and instruct the user to place the light and color sensor onto the printed matter. The printed matter 5 would already consist of a test pattern. The sensor would output the data back to the computer to create calibration data table.
The start stop instructions as well as any additional features or functions can be easily implemented using the mouse buttons. An alternative embodiment allows the software to invoke 0 the calibration procedures on a time interval basis. The software can be resident firmware embedded into the microprocessor, software resident on the host computer, or a combination of the two.
A software package can work in conjunction with the light and color sensor mouse to 5 provides an easy user interface. The results of the calibration can be stored in memory of the device and used to correct the errors.
In one embodiment, the connection between the light and color sensing pointing device and the host computer is a USB cable that includes a microprocessor. The microprocessor manages the o communications between the pointing device, the host system, and the display system. Modern display systems contain communication sub systems to allow for transmission of the display device color characteristics. Knowledge of this information allows use of a single color sensitivity sensor to detect the relative amplitude of the individual color display primaries. This enables calculation of display color temperature. The microprocessor in the USB cable translates commands to monitor
5 and drives communication lines on the display system. In the current embodiment the communication lines on a standard VGA connector are intercepted by this microprocessor. The microprocessor utilizes the VESA (Video Electronics Standards Association) standards DDC/CI and MCCS to communicate information to the monitor. Commands may be sent via the USB interface directly to the Display Device. Display devices that adhere to the MCCS standard can be l o digitally adjusted via commands sent thru this cable.
In one embodiment there is a single microprocessor and the light and color sensor utilize spare pins on the existing microprocessor. This keeps manufacturing costs low and allows for an inexpensive dual function product.
15
In operation, software instructions could initiate the calibration, or the user could initiate the calibration process by pressing an icon or executing the applicable software. The software would provide instructions to the user to place the light and color sensor mouse on the object to be calibrated, such as the CRT.
20
In the CRT example, the user would place the mouse onto the CRT screen and hold the mouse there flush against the CRT until the calibration was completed. A test pattern is initiated by the program, and the light and color sensor mouse would measure and store the results. The results would be used to form a calibration table to correct the CRT. The user may be instructed to 25 move the mouse across the CRT in certain situations, but normally a single position would be sufficient.
For printed matter, the user would be instructed to place the mouse on the printed matter. The printed matter could be a test print specifically for the calibration purposes. The calibration 3 o data recorded by the light and color sensor mouse would be recorded and a calibration table formed to correct the printer or web. The measured results could be compared to a standard, or compared to results from the CRT display or to the results of another printer matter measurement.
Scanners, digital cameras, and video units could be tested in a similar fashion, whereby the 5 data measured is compared to a reference measurement or to another calibrated reference and a calibration table is formed to correct the device.
The photodiode sensor unit is typically a silicon integrated circuit, with a connection to the mouse microprocessor for power and for communicating the measurement results to a host l o computer. The power source can also be obtained from a battery, photovoltaic source, or from a separate microprocessor. The photodiode sensor is not required when the light and color sensing elements are installed in conjunction with the optical position sensing pointing device.
A further embodiment of the invention includes operation as a densitometer for reflective
15 materials. When the host CPU is instructed to read color patches on a printed target, a message would be provided to the user to position the mouse over the printed matter and signal when done.
After the software makes the measurements instructions are provided to move to a different patch or to drag the mouse over the color patches. The different patch sections can be differentiated by the user or by the software that calculates the position of the mouse.
20
In one embodiment, the connection between the light and color sensmg pointing device and the host computer is a USB cable that includes a microprocessor. The microprocessor manages the communications between the pointing device and the host system.
25 An object includes a pointing device for measuring x-y position and emitted light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means has an inner sensor compartment with a sensor viewport, and the position sensing means senses a set of x-y position data. There is an infrared optical filter located within the inner sensor compartment, wherein a first side of the infrared optical filter is located adjacent the sensor
30 viewport. In this embodiment there is a photodiode integrated circuit, or equivalent, for measuring a set of readings, wherein the photodiode is located adjacent the infrared optical filter on a second side, and wherein the photodiode is connected to a power source. A computing means is used for processing the set of readings, and there is a means of communicating the set of readings and the set of x-y position data to a host computer.
Further objects include a pointing device, wherein the set of readings is photometric data. Another object is for a pointing device, further comprising a color optical filter located within the inner sensor compartment, wherein the color optical filter is positioned between the infrared optical filter and the photodiode. In this latter variation, the system is capable of measuring a set of o readings with colorimetric data. The system can include a plurality of color optical filters located within the inner compartment, wherein the plurality of color optical filters are positioned adjacent the second side of the infrared optical filter.
The pointing device can vary, and in some embodiments the position sensing means is 5 mechanical. Other pointing device utilize position sensing means that are an optical system. In the preferred embodiment the pointing device is a computer mouse.
The pointing device requires a power source, and the power can be selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic o source in the mouse, and a photovoltaic means.
An additional object of the pointing device, further comprising a means of switching between the sensor means and the position sensing means. The switching can be automated by a software routine or by operator intervention such as clicking a mouse button. 5
Another object of the invention is a pointing device for measuring x-y position and reflected light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means has an inner sensor compartment with a sensor viewport, and wherein the position sensing means senses a set of x-y position data. This embodiment for reflective surfaces requires an 0 illumination source adjacent the sensor viewport. There is an infrared optical filter located within the inner sensor compartment, wherein a first side of the infrared optical filter is located adjacent the sensor viewport. Also included is a photodiode integrated circuit, or equivalent, for measuring a set of readings, wherein the photodiode is located adjacent the infrared optical filter on a second side, and wherein the photodiode is connected to a power source. There is a computing means for
5 processing the set of readings, and a means of communicating the set of readings and the set of x-y position data to a host computer.
Further objects include a pointing device, wherein the set of readings is photometric data. Another object is for a pointing device, further comprising a color optical filter located within the l o inner sensor compartment, wherein the color optical filter is positioned between the infrared optical filter and the photodiode. In this latter variation, the system is capable of measuring a set of readings with colorimetric data. The system can include a plurality of color optical filters located within the inner compartment, wherein the plurality of color optical filters are positioned adjacent the second side of the infrared optical filter.
15
The pointing device can vary, and in some embodiments the position sensing means is mechanical. Other pointing device utilize position sensing means that are an optical system. In the preferred embodiment the pointing device is a computer mouse.
20 The pointing device requires a power source, and the power can be selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic source in the mouse, and a photovoltaic means.
An additional object of the pointing device, further comprising a means of switching 25 between the sensor means and the position sensing means. The switching can be automated by a software routine or by operator intervention such as clicking a mouse button.
An additional object is a pointing device, wherein the illuminated source, such as LED's, is positioned at a 45 degree angle to the sensor viewport.
30 An object of the invention is a pointing device for measuring x-y position and emitted light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means and the position sensing means are in an inner compartment having a lens, and wherein the position sensing means senses a set of x-y position data. In this combined and integrated system, there is an infrared optical filter located within the inner compartment, wherein a first side of the infrared optical filter is located adjacent the lens. There exists a a means of measuring a set of light readings, typically by using a CCD camera. A computing means is used for processing the set of light readings, and there is a means of communicating the set of light readings and the set of x-y position data to a host computer.
Further objects are within the scope of the invention, including a pointing device wherein the set of light readings is photometric data. Also there is a pointing device, further comprising a color optical filter located within the inner compartment, wherein the color optical filter is adjacent the second side of the infrared optical filter. In this latter embodiment, the system is capable of measuring a set of light readings for colorimetric data.
The position sensing devices includes the position sensing means that is a CCD system. Further, wherein the pointing device is a computer mouse. The power source for the system is selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic source in said mouse, and a photovoltaic means.
An additional object is a pointing device, further comprising a means of switching between the sensor means and the position sensing means.
An object of the invention is a pointing device for measuring x-y position and reflected light, comprising a housing containing a sensor means and a position sensing means, wherein the sensor means and the position sensing means are in an inner compartment having a lens, and wherein the position sensing means measures a set of x-y position data. There is an illumination source adjacent the lens, with an an infrared optical filter located within the inner compartment, with a first side of the infrared optical filter located adjacent the lens. The system has a means of measuring a set of light readings, and a computing means for processing the set of light readings.
Finally, there is a means of communicating the set of light readings and the set of x-y position data to a host computer.
Further objects are within the scope of the invention, including a pointing device wherein the set of light readings is photometric data. Also there is a pointing device, further comprising a color optical filter located within the inner compartment, wherein the color optical filter is adjacent the second side of the infrared optical filter. In this latter embodiment, the system is capable of measuring a set of light readings for colorimetric data.
The position sensing devices includes the position sensing means that is a CCD system. Further, wherein the pointing device is a computer mouse. The power source for the system is selected from the group consisting of a battery, a direct connection to a host computer, a connection to an electronic source in said mouse, and a photovoltaic means.
An additional object is a pointing device, further comprising a means of switching between the sensor means and the position sensing means. Yet another object is a pointing device, wherein the illuminated source is positioned at a 45 degree angle to the lens.
Yet a further object of the invention is a method of calibrating a color dependent source using a pointing device comprising the steps of activating a calibration software module, placing the pointing device onto a surface to be calibrated, measuring a set of color characteristics of the pointing device, generating a calibration table using the set of color characteristics, transmitting the calibration table to a memory storage device, returning the pointing device to a position sensing state.
Other associated objects include a method of calibrating a color dependent source, wherein the memory storage device is a host computer. And, wherein the calibration software is resident in a microprocessor of the mouse. An object of the invention is a communication cable with integrated processing means for connecting a host computer to a display device, comprising a first cable connecting the host computer to the display device, where the cable has a processing means. There is a second cable connecting from the host computer to the processing means of the first cable, wherein the
5 processing means controls communications between the host computer and the display device.
An additional object is a communication cable with integrated processing means wherein the first cable is a VGA cable for normal connection between the host computer and the display device. Furthermore, the second cable is a USB cable, and wherein the processing means l o transfers control of the display device to the second cable.
Further object includes a communication cable with integrated processing means, further comprising a calibration module connected to the processing means of the first cable. Additionally, the calibration module is also a position sensing mouse in the preferred embodiment.
15
A further object is a communication cable with integrated processing means, further comprising a hub for making multiple connections. The USB hub connects to the host computer and has multiple ports for connecting to calibration modules and other display devices through the smart cable.
20
There are many benefits of the embodiments which imbed processor electronics and protocol conversion circuits into the existing computer system cable arrangements. These benefits include the simplification and reduction in system cost it presents to the end user. One cable with built in electronics requires no software / system integration. The cost of 25 multiple cables is reduced.
Integrated cable processing allows access and manipulation of advanced computer controlled features existent within peripherals (i.e. the monitor) without total system integration. That is, the operating system and host CPU hardware only need support standard VGA features. The communication channel present in the cable allows access to computer controlled features not supported in all CPU / operating system vendors.
Furthermore, in the event of EMI transmissions, which must be minimized to meet commercial standards exist, they can be shielded within the cable itself. In fact, components can be shielded from one another as well as the environment if required. Accomplishing this shielding within the same devices simplifies conformance to commercial standards. Additionally, this smart cable allows access to commands which peripherals support which the operating system does not. A different software driver is not required for each different operating system, it is only necessary to adhere to a standard communications protocol.
Still other objects and advantages of the present invention will become readily apparent to those skilled in this art from the following detailed description, wherein only a preferred embodiment of the invention is described, simply by way of illustration of the best mode contemplated for carrying out the invention. As will be realized, the invention is capable of other and different embodiments, and its several details are capable of modifications in various obvious respects, all without departing from the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 (a) Top view of a light and color sensing mouse with light sensor
5 FIG. 1(b) Bottom view of a light and color sensing mouse with light sensor for a trackball position system
FIG. 2 Cutaway diagram of system components of light and color sensing mouse
l o FIG. 3 Basic block diagram showing the interconnection of the components
FIG. 4 Bottom view of a light and color sensing mouse with light sensor for an optical sensor mouse
15 FIG. 5 Cutaway diagram of system components of light and color sensing mouse for an optical sensor positioning system
FIG. 6(a) Cutaway diagram of system components of light and color sensing mouse for an optical sensor mouse
20
FIG. 6(b) Cutaway diagram of system components of light and color sensing mouse for an optical sensor mouse
FIG. 7 Cutaway diagram illustrating angled positioning of illumination source
25
FIG. 8(a) Smart cable showing monitor cable with USB pigtail and circuit
FIG. 8(b) USB circuit with wiring for smart cable
3 o FIG. 9 Adapter for VGA cable with USB female port FIG. 10 Adapter for VGA cable with USB male port
FIG. 11 System connection diagram showing a smart cable with integral mouse/calibrator attached
FIG. 12 System connection diagram showing smart cable for communication to the monitor and a separate USB mouse calibrator
FIG. 13 Schematic Diagram of smart cable processor
DESCRIPTION OF THE PREFERRED EMBODIMENT
In FIG. 1(a), a top view of a standard computer mouse 10 is shown. A cable 20 is attached to one end of the mouse 10 to transmit the coordinate and command and position signals from the mouse. Normally, the position signals result from the user moving the mouse and the circuitry measuring the movement and producing a corresponding signal to move the cursor on a monitor or other type display. The mouse typically has at least one click sensor 30 that allows the operator to interface with the computer. The aesthetic design of the mouse 10 as well as the location of the cable 20 and the click sensors 30 vary according to the manufacturer.
FIG. 1(b) illustrates the bottom view of a ball type mouse 10, showing the mouse trackball
50, and the ball aperture opening 60. The light and color sensing hardware fits within a standard mouse 10, wherein the optical sensor viewport 70 is accessed via the viewport aperture 80. The viewport aperture 80 is designed to limit extraneous light from the sensor optical sensor viewport 70, as extraneous light interferes with the accuracy and efficiency of the sensing electronics.
The viewport aperture 80 opening may be covered by an optically clear piece of plastic or glass, forming the optical sensor viewport 70, to prevent accidental damage to the sensor unit. In the preferred embodiment, a shielded viewport aperture 80 allows for the desired light emission but restricting interfering light sources. Stray light that arrives from sources other than the desired emissions increase the error rates and otherwise produce inaccurate measurements.
To shield the sensors from stray light, a collar, ring, or sleeve 65 is fitted to the viewport aperture 80 as shown in FIG. 2(a). This collar 65 is made of hard rubber or plastic and also can serve as a stabilizer skid for the trackball when being used as a mouse. The depth of the collar can vary but should be adequate to form a seal when placed on the object to be sensed. Alternatively, a rubber seal or O-ring 67 can serve as the shield, as depicted in FIG. 2(b).
An alternative retractable shield embodiment is shown in FIG. 2(c) and FIG. 2(d). In these embodiments, the optical sensor viewport 70 uses a retractable shield 71 with a spring actuator 72. The spring provides pressure on the collar 65 to maintain a tight fit against the surface to be sensed
73. The viewport aperture 80 is prone to dust buildup, and should be cleaned prior to use.
The inner components of the light and color sensing elements for the track ball mouse are 5 shown in FIG. 3. The mouse trackball 50 is encased within a horizontal encoder 100 and a vertical encoder 120. The encoders are used to accurately determine the x-y position. The sensor viewport 70 typically has an internal compartment 150 that retains the optical elements. An infrared optical filter 120 is placed within the internal compartment 150, followed by one or more color optical filters 130. Finally, a photodiode integrated circuit (IC) 140 or similar light measuring device l o electronically connects the optical elements with the electronic circuits.
There can be one or more optical filters 130, depending on the accuracy and the implementation. Initial research has indicated that a single green filter is sufficient for most cases, eliminating the extra cost and manufacturing costs associated with multiple filters. In addition, the
15 color filters can be eliminated completely to produce a photometric calibration unit that is useful in certain applications that do not require the extra color sensing functionality.
FIG. 4 is a basic block diagram illustrating the interconnection of the various elements of the present invention. A host computer 200 can be any type of personal computer, laptop or
20 workstation. Essentially, any device with a controller can be a host computer. The host communication interface 210 is typically a thin cable connecting the position sensing electronics
220 to the host computer 200.
The processing electronics 220 encompasses both the typical pointing device electronics as 25 well as the light and color sensing electronics. The pointing device electronics generates horizontal and vertical positioning inputs 230 that are processed by the processing electronics 220. The light and color sensing electronics comprises light sensing inputs 240 and a light sensing subsystem 260. There may be an illumination source 250 to provide for measuring light and color characteristics for reflective surfaces rather than self-illuminated source. Sensor characterization data 270 is used 30 by the processing electronics 220 to aid the computer 200 in producing accurate object transfer. FIG. 5 illustrates an optical position sensor mouse incoφorating a CCD 300, such as the IntelliMouse system. The CCD 300 is a CMOS digital camera that processes pictures at a high rate and 'measures' x-y relationships by comparing the pictures as the mouse is moved. In this 5 preferred embodiment, the electronics of the CCD system can be shared with the light and color sensing electronics to reduce cost and add the benefits of color measuring to the position sensing functions of the pointing device.
The CCD 300 is contained within an aperture opening 310 that provides an outer surface o rim and retains the lens 320. The lens 320 is slightly recessed to prevent damage and to reduce dirt buildup and limit scratching of the lens 320. In this embodiment there is a physical separation between the CCD unit and the light and color measurement unit. The electronic circuitry can be separate or combined.
5 FIG. 6 shows a cutaway illustration of the internal elements of the CCD position system and the light and color sensing system. The CCD 300 is mounted within a CCD compartment 330 and is in close proximity to the lens 320. The individual elements of the light and color measuring system comprises the infrared optical filter placed into the compartment 150, followed by one or more color optical filters. The color optical filters are not necessary, but the device will only be 0 capable of making photometric measurements with the color optical filters 130. A photodiode IC 140 is the last component in the compartment 150 and communicates to the mouse processing electronics, as does the CCD 300.
A combined CCD position sensing system and light and color measuring system are 5 combined in a single compartment in FIG. 7(a). The compartment 400 is suitable adjusted to retain the elements of the combined system. An infrared optical filter 410 is placed nearest to the lens 440. A color optical filter 420 is placed after the infrared filter. If the color filter is eliminated, only photometric measurements can be taken. There may be a plurality of optical filter to allow a wider range of calibration as is well known in the art and described in US Patent 5,892,585. The CCD sensor 430 is placed on top of the other filter(s) and takes pictures in the same fashion as previously indicated. The filters do not interfere with the positional sensing functions.
A side view of the placement of the elements is shown in FIG. 7(b). The compartment 400 houses the infrared optical filter 410, the optional color filter(s) 420, and the CCD 430. The lens 440 allows the camera to take the pictures for position sensing independent of the light and color components.
In order to measure objects that are not illuminated like a monitor, the light and color sensing pointing device must generate an independent light source. In a preferred embodiment of FIG. 8, light emitting diodes (LED's) 500 are installed into the compartment wall 510. In one embodiment, there is a ledge 520 on which the filters and CCD rests, and the lens 530 is retained at the lower end of the compartment 510. The LED's 500 are angled in the preferred embodiment, preferably at approximately 45 degrees. The source is mounted to illuminate at a 45-degree angle with the reflected light collected at 90 degrees by the sensors. In another embodiment the lens 530 is also placed on the ledge 520 along with the other components.
FIG. 9 shows one connection strategy that is employed the by the present invention. The basic interface connection 500 is via the USB bus. On end of the cable 510 is connected to the central processing unit (CPU), while the other end 520 is connected to the monitor . A third connection is branched off from the CPU end and has a USB -male connector 530. The cable 500 contains an I2C interface 520. The I2C interface 520 is used to communicate to a VESA compliant monitor. The cable 500 is reversible, however the USB-male connection 530 needs to have a mating connector nearby. In the preferred embodiment the electronics are designed into a custom circuit that is small enough to fit inside a standard DM15M connector.
In this embodiment, the processor within the connector is used to perform the task of communicating to the host via the USB interface and communicating to the monitor using the
DDC2bi protocol as specified by VESA. The I2C/DDC2bi interface captures the colorimetric information from the display device. The colorimetric information contains the chromatic description of the display primaries. If this information is known, a single sensitivity sensor may be used for measurement of the intensity of color primaries of the display.
FIG. 10 shows an embodiment of the present invention that incorporates two connections: USB/DDC2bi monitor control and a USB port 570 for monitor control. FIG. 12 shows the connection diagram for this system. The first connection is a USB / DDC2bi "smart" cable". This cable is used to sense and control information to the display device. A second USB connection is utilized to communicate and control the mouse. This configuration is especially useful for systems that utilize 2 or more display systems. In this environment, a single mouse can be used to measure and adjust multiple monitors. Each additional monitor is attached to the USB bus using the "smart cable". The VGA standard cable 550 has an enable adapter 560 containing a USB-female type B connection 570.
In FIG. 11, another variation features a VGA standard cable (DB15M) 550 with an enable adapter 600 that has a pigtail 620 off the enable adapter 600 with a USM-male connection 610. The pigtail length can vary, although ten inches is used in the preferred embodiment.
A schematic of the electronics in the smart cable is shown in FIG. 14. The Cypress IC 700 is used to control the communications between the monitor, host, and mouse/calibrator. Signals from the host VGA connector are routed through Jl . Communications to the monitor are routed through J3. Connections to the USB are on J2 . In another embodiment communication to the mouse/calibrator can be handled directly through this processor at J4. The power for the smart cable is derived from the host VGA connector. This is necessary to insure that DDC host to monitor communication occurs without any reliance upon the USB connection. When the processor is first powered, it allows pass thru communication between the host VGA and the VESA compliant display device. This is an essential part of the computer "boot" sequence. After booting up, the host software can then issue commands via the USB connection J2. Based upon the commands, the EnableCable processor can send commands to the monitor or to an attached mouse/calibrator. The processor parses each command to the monitor to insure that the specific commands described in the VESA MCCS specification are formatted properly. This prevents potential damage to the display as the result of an invalid or undocumented command. The circuit board in this embodiment is capable of being used as a simple smart cable or as a smart cable + mouse /calibrator controller. FIG.'s 12 and 13 are connection diagram depicting the connection of a smart cable with embedded calibrator. This configuration simplifies the cabling process.
5
In operation as a light sensor for a display, the user or automated program indicates to the host computer that a calibration is desired. The computer invokes the necessary software routine and a display screen is provided instructing the user to place the light and color sensor onto the display along with any test parameters. The computer software will invoke an appropriate color o patch or reference display. The pointing device buttons can be used for interacting with the system software, and completing any number of measuring sequences.
The data from the light and color sensor is transmitted back to the host computer for evaluation. The data is used to compute a calibration table by comparing expected color and 5 luminance values to the displayed color and luminance values. The calibration data is then used to correct the display so that the system is optimized. The system software can employ a variety of additional features and implementations.
Operation as a light sensor is under program control from the host CPU. If the host o software is instructed to read a series of color patches for calibration, the host computer would provide appropriate instructions. The software may require the operator to click a pointing device button or other input means to change modes. The user would position the pointing device over the color patch on the display with the aperture over the color patch. The software then reads the data from the sensor electronics, displays another color patch and continues the process until all 5 calibration data is obtained. When all the data is measured, the software again provides instructions to the user and the pointing device functions are returned to mouse mode. Various user interfaces may be necessary to abort measurements or switch back to pointing device mode.
The light-sensing system is used to measure illuminated displays so that associated software o can calibrate a display. In one embodiment, the light sensor is a light-to-frequency converter that outputs a string of pulses whose frequency is directly proportional to the amount of light striking the sensor. The system microprocessor counts the pulses, formats the data, and sends the data to the host. This embodiment may include a frequency-detect sensor to measure and monitor refresh rates. This sensor is a light-to-voltage converter and is used by the microprocessor to sense monitor refresh. With this data, software can accurately calculate luminance or color from the object sensed.
Yet another embodiment incorporates three light sensors with tuned color filters. This enables the highly accurate measurement of color and luminance from the display. This embodiment can use the existing microprocessor in the pointing device, but may use a separate dedicated microprocessor in the pointing device to read data from the three channels simultaneously. Using dual microprocessors requires a communications protocol and synchronization scheme to transfer data.
As will be realized, the invention is capable of other and different embodiments and its several details are capable of modifications in various obvious respects, all without departing from the essence of the invention.

Claims

CLAIMS We claim:
1. A pointing device for measuring x-y position and emitted light, comprising: a housing containing a sensor means and a position sensing means, wherein said sensor means has an inner sensor compartment with a sensor viewport, and wherein said position sensing means senses a set of x-y position data; an infrared optical filter located within said inner sensor compartment, wherein a first side of said infrared optical filter is located adjacent said sensor viewport ; a photodiode integrated circuit for measuring a set of readings, wherein said photodiode is located adjacent said infrared optical filter on a second side, and wherein said photodiode is connected to a power source; a computing means for processing said set of readings; and a means of communicating said set of readings and said set of x-y position data to a host computer.
2. A pointing device according to claim 1, wherein said set of readings is photometric data.
3. A pointing device according to claim 1, further comprising one or more color optical filters located within said inner sensor compartment, wherein said color optical filters are positioned between said infrared optical filter and said photodiode.
4. A pointing device according to claim 3, wherein said set of readings is colorimetric data.
5. A pointing device according to claim 1 wherein said position sensing means is mechanical.
6. A pointing device according to claim 1 wherein said position sensing means is an optical system.
7. A pointing device according to claim 1 wherein said pointing device is a computer mouse.
8. A pointing device according to claim 1, further comprising a means of switching between said sensor means and said position sensing means.
9. A pointing device for measuring x-y position and reflected light, comprising: a housing containing a sensor means and a position sensing means, wherein said sensor means has an inner sensor compartment with a sensor viewport, and wherein said position sensing means senses a set of x-y position data; an illumination source adjacent said sensor viewport; an infrared optical filter located within said inner sensor compartment, wherein a first side of said infrared optical filter is located adjacent said sensor viewport; a photodiode integrated circuit for measuring a set of readings, wherein said photodiode is located adjacent said infrared optical filter on a second side, and wherein said photodiode is connected to a power source; a computing means for processing said set of readings; and a means of communicating said set of readings and said set of x-y position data to a host computer.
10. A pointing device according to claim 9, wherein said set of readings is photometric data.
11. A pointing device according to claim 9, further comprising one or more color optical filters located within said inner sensor compartment, wherein said color optical filters are positioned between said infrared optical filter and said photodiode.
12. A pointing device according to claim 11, wherein said set of readings is colorimetric data.
13. A pointing device according to claim 9, wherein said position sensing means is mechanical.
14. A pointing device according to claim 9, wherein said position sensing means is optical.
15. A pointing device according to claim 9, wherein said pointing device is a computer mouse.
16. A pointing device according to claim 9, further comprising a means of switching between said sensor means and said position sensing means.
17. A pointing device according to claim 9, wherein said illuminated source is positioned at a 45 degree angle to said sensor viewport.
18. A pointing device for measuring x-y position and emitted light, comprising: a housing containing a sensor means and a position sensing means, wherein said sensor means and said position sensing means are in an inner compartment having a lens, and wherein said position sensing means senses a set of x-y position data; an infrared optical filter located within said inner compartment, wherein a first side of said infrared optical filter is located adjacent said lens; a means of measuring a set of light readings; a computing means for processing said set of light readings; and a means of communicating said set of light readings and said set of x-y position data to a host computer.
19. A pointing device according to claim 18, wherein said set of light readings is photometric data.
20. A pointing device according to claim 18, further comprising one or more color optical filters located within said inner compartment, wherein said color optical filters are adjacent said second side of said infrared optical filter.
21. A pointing device according to claim 20, wherein said set of light readings is colorimetric data.
22. A pointing device according to claim 18, wherein said position sensing means is a CCD system.
23. A pointing device according to claim 18, wherein said pointing device is a computer mouse.
24. A pointing device according to claim 18, further comprising a means of switching between said sensor means and said position sensing means.
25. A pointing device for measuring x-y position and reflected light, comprising: a housing containing a sensor means and a position sensing means, wherein said sensor means and said position sensing means are in an inner compartment having a lens, and wherein said position sensing means measures a set of x-y position data; an illumination source adjacent said lens; an infrared optical filter located within said inner compartment, wherein a first side of said infrared optical filter is located adjacent said lens; a means of measuring a set of light readings; a computing means for processing said set of light readings; and a means of communicating said set of light readings and said set of x-y position data to a host computer.
26. A pointing device according to claim 25, wherein said set of light readings is photometric data.
27. A pointing device according to claim 25, further comprising one or more color optical filters located within said inner compartment, wherein said color optical filters are positioned adjacent said second side of said infrared optical filter.
28 A pointing device according to claim 27, wherein said set of readings is colorimetric data.
29. A pointing device according to claim 25, wherein said position sensing means is a CCD system.
30. A pointing device according to claim 25, wherein said pointing device is a computer mouse.
31. A pointing device according to claim 25, further comprising a means of switching between said sensor means and said position sensing means.
32. A pointing device according to claim 25, wherein said illuminated source is positioned at a 45 degree angle to said lens.
33. A method of calibrating a color dependent source using a position sensing pointing device comprising the steps: activating a calibration software module; placing said pointing device onto a surface to be calibrated; measuring a set of color characteristics of said pointing device; generating a calibration table using said set of color characteristics; transmitting said calibration table to a memory storage device; returning said pointing device to a position sensing state.
34. A method of calibrating a color dependent according to claim 33, wherein said calibration software is resident in a microprocessor of said mouse.
35. A communication cable with integrated processing means for connecting a host computer to a display device, comprising: a first cable connecting said host computer to said display device, where said cable has a processing means; a second cable connecting from said host computer to said processing means of said first cable, wherein said processing means controls communications between said host computer and said display device.
36. A communication cable with integrated processing means according to claim 35, wherein said first cable is a VGA cable for normal connection between said host computer and said display device.
37. A communication cable with integrated processing means according to claim 35, wherein said second cable is a USB cable, and wherein said processing means transfers control of said display device to said second cable.
38. A communication cable with integrated processing means according to claim 35, further comprising a calibration module connected to said processing means of said first cable. 5
39. A communication cable with integrated processing means according to claim 38, wherein said calibration module is a position sensing mouse.
40. A communication cable with integrated processing means according to claim 35, further o comprising a hub for making multiple connections.
PCT/US2000/001229 1999-01-19 2000-01-19 Light and color sensing pointing device WO2000042595A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU24156/00A AU2415600A (en) 1999-01-19 2000-01-19 Light and color sensing pointing device
US09/618,680 US6738856B1 (en) 1999-01-19 2000-07-19 External display peripheral for coupling to a universal serial bus port or hub on a computer

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11627099P 1999-01-19 1999-01-19
US60/116,270 1999-01-19

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US48769400A Continuation 1999-01-19 2000-01-19

Publications (1)

Publication Number Publication Date
WO2000042595A1 true WO2000042595A1 (en) 2000-07-20

Family

ID=22366196

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/001229 WO2000042595A1 (en) 1999-01-19 2000-01-19 Light and color sensing pointing device

Country Status (2)

Country Link
AU (1) AU2415600A (en)
WO (1) WO2000042595A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6262804B1 (en) 2000-02-04 2001-07-17 X-Rite, Incorporated Handheld color measurement instrument
EP1331570A1 (en) * 2002-01-18 2003-07-30 Hewlett-Packard Company Data processing system and method for controlling display devices
US6825919B2 (en) 2000-02-04 2004-11-30 X-Rite, Incorporated Handheld color measurement instrument
US7426029B2 (en) 2005-08-31 2008-09-16 Microsoft Corporation Color measurement using compact device
US7573620B2 (en) 2005-09-01 2009-08-11 Microsoft Corporation Gamuts and gamut mapping
US7822270B2 (en) 2005-08-31 2010-10-26 Microsoft Corporation Multimedia color management system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4804949A (en) * 1987-03-20 1989-02-14 Everex Ti Corporation Hand-held optical scanner and computer mouse
US5428368A (en) * 1992-09-30 1995-06-27 Grant; Alan H. Combination mouse and track ball unit
US5684582A (en) * 1994-03-18 1997-11-04 Lucid Technologies, Inc. Spectrophotometry
US5703356A (en) * 1992-10-05 1997-12-30 Logitech, Inc. Pointing device utilizing a photodetector array

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4804949A (en) * 1987-03-20 1989-02-14 Everex Ti Corporation Hand-held optical scanner and computer mouse
US5428368A (en) * 1992-09-30 1995-06-27 Grant; Alan H. Combination mouse and track ball unit
US5703356A (en) * 1992-10-05 1997-12-30 Logitech, Inc. Pointing device utilizing a photodetector array
US5684582A (en) * 1994-03-18 1997-11-04 Lucid Technologies, Inc. Spectrophotometry

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6262804B1 (en) 2000-02-04 2001-07-17 X-Rite, Incorporated Handheld color measurement instrument
US6825919B2 (en) 2000-02-04 2004-11-30 X-Rite, Incorporated Handheld color measurement instrument
EP1331570A1 (en) * 2002-01-18 2003-07-30 Hewlett-Packard Company Data processing system and method for controlling display devices
US7426029B2 (en) 2005-08-31 2008-09-16 Microsoft Corporation Color measurement using compact device
US7822270B2 (en) 2005-08-31 2010-10-26 Microsoft Corporation Multimedia color management system
US7573620B2 (en) 2005-09-01 2009-08-11 Microsoft Corporation Gamuts and gamut mapping

Also Published As

Publication number Publication date
AU2415600A (en) 2000-08-01

Similar Documents

Publication Publication Date Title
CA2265534C (en) Color sensor
US7812818B2 (en) Inertial sensing method and system
EP2026170B1 (en) Position detecting device
US20050258344A1 (en) Optical reflection sensor
US8102377B2 (en) Portable interactive media presentation system
US20140231625A1 (en) Optical sensor apparatus and image sensing apparatus integrating multiple functions
US20100239137A1 (en) Two Dimensional Imaging of Reacted Areas On a Reagent
US8987656B2 (en) Optical finger navigation device having an integrated ambient light sensor and electronic system comprising the same
CN103869973A (en) Sensing device and sensing method
US8937593B2 (en) Interactive projection system and method for calibrating position of light point thereof
US7633050B2 (en) Optics assembly for color measurement system
US20020148983A1 (en) Displacement sensor
US10699442B2 (en) Articulated arm coordinate measuring machine having a color laser line probe
WO2000042595A1 (en) Light and color sensing pointing device
US20220128659A1 (en) Electronic device including sensor and method of operation therefor
US8422016B2 (en) Non-contact and contact color sensor device
US6362886B2 (en) Portable color measuring device
WO2007020549A2 (en) Method of calibrating a control system for controlling a device
US11550408B1 (en) Electronic device with optical sensor for sampling surfaces
Mei Understanding Optical Mice
US11747207B2 (en) Optical sensor system to identify objects and their movement
GB2515067A (en) A System and Method for Sensor and Image Processing
JP2006019901A (en) Visual sensor
CN102809432A (en) Portable photoelectric color photometer
JP2018132354A (en) Device, method, and system for correcting color measurement

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase