WO2000014947A2 - Image communication apparatus - Google Patents

Image communication apparatus Download PDF

Info

Publication number
WO2000014947A2
WO2000014947A2 PCT/IL1999/000475 IL9900475W WO0014947A2 WO 2000014947 A2 WO2000014947 A2 WO 2000014947A2 IL 9900475 W IL9900475 W IL 9900475W WO 0014947 A2 WO0014947 A2 WO 0014947A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
communication apparatus
sensor
vehicle
image sensor
Prior art date
Application number
PCT/IL1999/000475
Other languages
French (fr)
Other versions
WO2000014947A3 (en
Inventor
Zvi Lapidot
Original Assignee
Zvi Lapidot
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zvi Lapidot filed Critical Zvi Lapidot
Priority to JP2000569566A priority Critical patent/JP2002524980A/en
Priority to AU54422/99A priority patent/AU5442299A/en
Priority to EP99940449A priority patent/EP1177675A2/en
Publication of WO2000014947A2 publication Critical patent/WO2000014947A2/en
Publication of WO2000014947A3 publication Critical patent/WO2000014947A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/14Payment architectures specially adapted for billing systems
    • G06Q20/145Payments according to the detected use or quantity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/22Payment schemes or models
    • G06Q20/24Credit schemes, i.e. "pay after"
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07BTICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
    • G07B15/00Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
    • G07B15/02Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00Cash registers
    • G07G1/0036Checkout procedures
    • G07G1/0045Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
    • G07G1/0054Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles
    • G07G1/0063Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G1/00Cash registers
    • G07G1/12Cash registers electronically operated
    • G07G1/14Systems including one or more distant stations co-operating with a central processing unit
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07GREGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
    • G07G3/00Alarm indicators, e.g. bells
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B7/00Radio transmission systems, i.e. using radiation field
    • H04B7/24Radio transmission systems, i.e. using radiation field for communication between two or more posts
    • H04B7/26Radio transmission systems, i.e. using radiation field for communication between two or more posts at least one of which is mobile
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00137Transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/19Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
    • H04N1/195Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
    • H04N1/19594Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays using a television camera or a still video camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21Intermediate information storage
    • H04N1/2104Intermediate information storage for one or a few pictures
    • H04N1/2112Intermediate information storage for one or a few pictures using still video cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the present invention relates to communications apparatus and methods generally and more particularly to image communications.
  • Imaging systems employ separate discrete components for image acquisition, storage, processing and transmission. As a result, imaging systems presently in use are relatively large and expensive.
  • the present invention seeks to provide integrated imaging systems which are relatively small and inexpensive and which may be used in applications which were heretofore not practicable due to the size and cost of existing systems.
  • an image communication apparatus including an image sensor, an image processor, receiving image data from said image sensor, and an output port providing a processed image data output from said image processor, characterized in that the image sensor, the image processor and the output port are all embodied on a single integrated circuit chi .
  • the image communication apparatus also includes a memory for storing at least one of the image data and the processed image data, the memory being embodied together with the image sensor, the image processor and the output port on said single integrated circuit chip. Additionally or alternatively the image communication also including a modem coupled to the output port for communicating the processed image data, the modem being embodied together with the image sensor, the image processor and the output port on the single integrated circuit chip.
  • the image communication apparatus also comprises a wireless transmitter for communicating said processed image data, the wireless transmitter being embodied together with the image sensor, the image processor and said output port on the single integrated circuit chip.
  • the image communication apparatus also includes a wireless receiver, the wireless receiver being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
  • an image communication apparatus including an image sensor a transmitter, functioning as at least part of a node of an wireless audio communications network, the transmitter being operative for communicating image data from the image sensor along the wireless audio communications network, an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event.
  • the image communication apparatus also includes a receiver, functioning as at least part of a node of an wireless audio communications network, the receiver being operative for communicating along the wireless audio communications network.
  • the image communication apparatus also includes a modem coupled at least to the transmitter.
  • the wireless audio communications network is a cellular telephone network.
  • the wireless audio communications network is a cellular radio network.
  • the wireless audio communications network is a pager network.
  • the wireless audio communications network is a satellite communication network.
  • the event is an event detected by the image sensor.
  • the event may be receipt of an actuation input from an external source via said wireless audio network.
  • the actuation input is an interrogation input.
  • system also comprises an image analyzer receiving image data and providing an image analysis output.
  • the image analysis output is supplied to said transmitter for transmission along said wireless audio network.
  • the image analysis output is supplied to the automatic communications actuator for indicating an event.
  • the image analyzer comprises a dynamic event recognizer which recognizes the occurrence of a predetermined dynamic event.
  • the image analysis output includes a notification of occurrence of a predetermined dynamic event.
  • the image analysis output includes an indication of the identity of a participant in a predetermined dynamic event sensed by said image sensor.
  • the identity of a participant comprises identification of an inanimate object.
  • At least the image sensor forms part of an image communication assembly including an image sensor, an image processor, receiving image data from said image sensor, and an output port providing a processed image data output from said image processor, characterized in that the image sensor, said image processor and said output port are all embodied on a single integrated circuit chip.
  • Still further in accordance with a preferred embodiment of the present invention also comprising a memory for storing at least one of said image data and said processed image data, said memory being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
  • a modem coupled to said output port for communicating said processed image data, said modem being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
  • the wireless transmitter for communicating the processed image data, the wireless transmitter being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
  • wireless receiver the wireless receiver being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
  • the image analysis output provides image data representing part of an image sensed by the image sensor.
  • part of the image is selected by the image analysis output based on its image content.
  • the image analysis output provides information derived by the image analyzer from the image sensed by said image sensor.
  • the image communication apparatus also includes a data compressor for compressing data provided by the image sensor prior to transmission thereof.
  • a traffic monitoring system includes an image communication apparatus wherein at least one image sensor is directed to a traffic scene and traffic information is communicated to a location remote from the traffic scene.
  • the image communication apparatus includes a plurality of image communication units located at disparate locations also comprising at least one local unit operative to receive traffic information from said plurality of image communication units and to transmit said information to a central unit.
  • a traffic monitoring system being operative to communicating an indication of speed of vehicles at a traffic scene.
  • a traffic monitoring system being operative to communicate an indication of the distance separating adjacent vehicles at a traffic scene.
  • a traffic violation report generator operative in response to communication of information derived from an image sensed by said image sensor.
  • a parking space availability indicator operative in response to communication of information derived from an image sensed by said image sensor.
  • an automatic remote meter reading system including an image communication apparatus wherein at least one image sensor is in sensing relationship with an indicator of a meter requiring reading and information derived from said image sensor is communicated to a location remote from the meter.
  • the image communication apparatus includes a plurality of image communication units located at disparate locations also comprising at least one local unit operative to receive meter reading information from said plurality of image communication units and to transmit said information to a central unit.
  • the at least one local unit communicates with the central unit via a wireless audio communications network.
  • an automatic verification system for use with shopping carts including a data entry assembly mounted on a shopping cart, a sensor monitoring entry of objects into the shopping cart, and an indicator coupled to the sensor for indicating entry of objects into the shopping card in the absence of entry of data regarding such objects using the data entry assembly.
  • the sensor monitoring entry of objects into the shopping cart is operative also to monitor removal of objects from the shopping cart and the indicator is also operative to indicating removal of objects from said shopping card.
  • the senor is operative to provide an image output to a control center for further analysis when the sensor is unable to positively identify a product.
  • control center includes automatic image analysis equipment as well as human operated image analysis equipment permitting human classification of images which may contain products.
  • the data entry assembly and the sensor both employ a single optical input device.
  • an automatic accident reporting system including a vehicle mounted pre-collision sensor for sensing an impending collision, a vehicle mounted collision sensor for sensing a vehicle impact exceeding a predetermined impact threshold and a vehicle mounted communicator coupled to the vehicle mounted pre-collision sensor and to the vehicle mounted collision sensor for communicating the existence of a vehicle air bag actuation event to a remote location and providing an indication of the location of the vehicle at the time of the actuation event.
  • the communicator defines a node on a cellular communications system which automatically indicates the location of the vehicle.
  • the communicator is coupled to a GPS which automatically indicates the location of the vehicle.
  • an automatic accident reporting system including a vehicle mounted pre-collision sensor for sensing an impending collision, a vehicle mounted collision sensor for sensing a vehicle impact exceeding a predetermined impact threshold and a vehicle mounted communicator coupled to the vehicle mounted pre-collision sensor and to the vehicle mounted collision sensor for communicating the existence of the vehicle impact to a remote location and providing an indication of the location of the vehicle at the time of the vehicle impact.
  • the communicator defines a node on a cellular communications system which automatically indicates the location of the vehicle.
  • the communicator is coupled to a GPS which automatically indicates the location of the vehicle.
  • a parking monitoring system including parking monitors indicating the presence or identity of vehicles parked in predetermined locations and a billing system receiving information from the parking monitors for charging users parking fees based on that information.
  • a parking monitoring system including parking monitors indicating the identity of vehicles parked in predetermined locations, a payment receipt system for receiving payment from users whose vehicles are parked in the predetermined locations and a payment verification system receiving information from the parking monitors and from the payment receipt system for enforcement of payment of users parking fees based on information from the parking monitors.
  • Fig. 1 is a simplified illustrative drawing of an integrated imaging system formed on a single integrated circuit chip in accordance with a preferred embodiment of the present invention
  • Figs. 2A, 2B and 2C illustrate the structure and operation of traffic monitoring systems constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
  • Fig. 3 illustrates the structure and operation of another traffic monitoring system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including an integrated imaging system of the type illustrated in Fig. 1;
  • Figs. 4A & 4B illustrate the structure and operation of a collision monitoring and notification system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
  • Fig. 5 illustrates the structure and operation of an electric meter reading system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
  • Figs. 6A & 6B illustrate the structure and operation of a parking monitoring system constructed and operative in accordance with two alternative embodiments of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
  • Figs. 7A and 7B illustrate the structure and operation of an automated supermarket checkout system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
  • Fig. 8 is a simplified block diagram illustration of the structure and operation of part of the traffic monitoring systems of Figs. 2A - 2C;
  • Fig. 9 is a simplified block diagram illustration of the structure and operation of another part of the traffic monitoring systems of Figs. 2A - 2C;
  • Fig. 10 is a simplified block diagram illustration of the structure and operation of part of the traffic monitoring system of Fig. 3;
  • Fig. 11 is a simplified block diagram illustration of the structure and operation of part of the collision monitoring system of Fig. 4;
  • Fig. 12 is a simplified block diagram illustration of the structure and operation of part of the meter reading system of Fig. 5;
  • Fig. 13 is a simplified block diagram illustration of the structure and operation of part of the parking monitoring system of Fig. 6;
  • Fig. 14 is a simplified block diagram illustration of the structure and operation of part of the automated supermarket checkout system of Figs. 7A and 7B.
  • Fig. 1 is a simplified illustrative drawing of an integrated imaging system 10 formed on a single integrated circuit chip 12 in accordance with a preferred embodiment of the present invention.
  • the integrated imaging system 10 comprises an image sensor 14, such as a 2 dimensional CMOS sensor, such as a sensor commercially available from semiconductor suppliers, such as Tower Semiconductor Ltd., Intel & Hyundai. It is appreciated that the CMOS may also include analog processing functions.
  • the system 10 also comprises an image processor 16, receiving image data from the image sensor 14.
  • CMOS image processors are commercially available from Texas Instruments under the name of TMS 320Clx and from Motorola, under the name of DSP561xx.
  • the image processor 16 is preferably coupled to an output port 18, which provides a processed image data output from the image processor 16.
  • the image sensor 14, the image processor 16 and the output port 18 are all embodied on a single integrated circuit chip.
  • the single integrated circuit chip 12 also preferably comprises a memory 20 for storing at least one of the image data and the processed image data.
  • the single integrated circuit chip 12 also preferably comprises a modem 22 coupled to the output port 18 for communicating the processed image data.
  • CMOS modems are avail- able from Motorola under the name of MC145442 and MC145443.
  • a wireless transmitter 24 for communicating the processed image data, the wireless transmitter 24 being embodied together with the image sensor 14, the image processor 16, the output port 18, and modem 22 on the single integrated circuit chip 12.
  • the image communication apparatus of Fig. 1 may also include a wireless receiver 26, the wireless receiver 26 being embodied together with a modem 22, an input port 27, the image sensor 14, the image processor 16 and the output port 18 on the single integrated circuit chip 12.
  • the receiver 26 is preferably employed to receive control inputs from an external source which govern the operation of the remaining components of the chip 12.
  • Transmitter 24 and receiver 26 may share a single antenna, such as an internal antenna 28 or may employ separate antennas. External antennas (not shown) may be employed with the transmitter 24 or the receiver 26.
  • Figs. 2A, 2B and 2C illustrate the structure and operation of traffic monitoring systems constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1.
  • Fig. 2A illustrates a system wherein static traffic control devices, such as stop signs 100 and traffic lights 102 are provided with imaging systems, preferably of the general type described hereinabove with respect to Fig. 1.
  • an imaging system 104 associated with a stop sign 100 senses when a vehicle passes without stopping and also senses the identity of the vehicle.
  • an imaging system 106 associated with a traffic light 102, senses when a vehicle passes without stopping for a red light and also senses the identity of the vehicle.
  • the imaging systems 104 and 106 transmit information regarding traffic violations to a control center 108 which provides output indications of the existence and type of a traffic violation and an indication of the identity of the vehicle, typically in the form of a photograph 110 of the vehicle license plate.
  • the traffic monitoring system of Fig. 2A is one example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 104 or 106, and a transmitter, preferably incorporated in system 104 or 106, functioning as at least part of a node of an wireless audio communications network for communicating image data from the image sensor along the wireless audio communications network.
  • the system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event, in this case a traffic violation.
  • system 104 operating as a stop sign monitor, includes image acquisition circuitry 120, such as image sensor 14 (Fig. 1) as well as dynamic and static image analysis circuits 122 and 124, both of which may be em- bodied in image processor 16 (Fig. 1).
  • image acquisition circuitry 120 such as image sensor 14 (Fig. 1)
  • dynamic and static image analysis circuits 122 and 124 both of which may be em- bodied in image processor 16 (Fig. 1).
  • the dynamic image analysis circuit 122 typically detects an event by analyzing several images, and thus may detect the failure of a driver to stop at a stop sign.
  • the static image analysis circuit 124 which need not necessarily form part of the stop sign monitor, typically detects the identity of a vehicle committing a traffic offense, such as running a stop sign.
  • the outputs of circuits 122 and 124 are provided to respective event detection and feature extraction circuits 126 and 128, both of which may be embodied in image processor 16 (Fig.
  • the output of event detection circuit 126 may be used as a trigger input to an automatic communications actuator 130 which provides an actuation output to an output port 132, which may be embodied in output port 18 (Fig. 1).
  • Output port 132 typically receives a traffic violation message from a message generator 134, which receives inputs from event detection circuit 126 and feature extraction circuit 128.
  • the traffic violation message is transmitted preferably via a modem 136, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 138, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 140, of which transmitter 24 is preferably a node thereof.
  • the wireless audio communications network 140 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
  • Control center 108 typically comprises an RF receiver 150 which outputs via a modem 142 to message analysis circuitry 152. Outputs of circuitry 152 may be provided to an image display 154 which may be monitored by an operator who may enter data displayed thereon via a data entry port 156 to a control computer 157.
  • Feature processing circuitry 158 receives an output from message analysis circuitry 152. In the case where feature extraction circuitry 128 is not present as part of the stop sign monitoring circuitry 104, such feature extraction circuitry may form part of the feature processing circuitry 158. If feature extraction circuitry 128 is provided as part of the stop sign monitor 104, the extracted feature information transmitted by the stop sign monitoring circuitry may be further processed in circuitry 158. The output of feature processing circuitry 158 is transmitted to control computer 157. The control computer 157 may provide traffic violation reports as desired.
  • Fig. 9 is a simplified block diagram illustration of the operation of another part of the traffic monitoring systems of Figs. 2A - 2C.
  • system 106 operating as a traffic light monitor, includes image acquisition circuitry 220, such as image sensor 14 (Fig. 1) as well as dynamic and static image analysis circuits 222 and 224, both of which may be embodied in image processor 16 (Fig. 1).
  • the dynamic image analysis circuit 222 typically detects an event by analyzing several images, and thus may detect the failure of a driver to stop at a red light.
  • system 106 typically comprises an input port 225 which receives an external signal, such as a signal indicating that the traffic light is red.
  • Input port 225 may be an RF receiver or alternatively a receiver port for receiving a red light signal via a wired connection.
  • input port 225 may be obviated, in a case where the traffic light is within the field of view of image sensor 14, which has the capability of detecting its status.
  • the static image analysis circuit 224 which need not necessarily form part of the traffic light monitor, typically detects the identity of a vehicle committing a traffic offense, such as running a traffic light.
  • the outputs of circuits 222 and 224 are provided to respective event detection and feature extraction circuits 226 and 228, both of which may be embodied in image processor 16 (Fig. 1).
  • the output of event detection circuit 226 may be used as a trigger input to an automatic communications actuator 230 which provides an actuation output to an output port 232, which may be embodied in output port 18 (Fig. 1). Alternatively, where an input port 225 is provided, the output of input port 225 may provide a trigger input.
  • Output port 232 typically receives a traffic violation message from a message generator 234, which receives inputs from event detection circuit 226 and feature extraction circuit 228.
  • the traffic violation message is transmitted preferably via a modem 236, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 238, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 240, of which transmitter 24 is preferably a node thereof.
  • the wireless audio communications network 240 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
  • Control center 108 typically comprises an RF receiver 250 which outputs via a modem 242 to message analysis circuitry 252. Outputs of circuitry 252 may be provided to an image display 254 which may be monitored by an operator who may enter data displayed thereon via a data entry port 256 to a control computer 257.
  • Feature processing circuitry 258 receives an output from message analysis circuitry 252. In the case where feature extraction circuitry 228 is not present as part of the traffic light monitoring circuitry, such feature extraction circuitry may form part of the feature processing circuitry 258. If feature extraction circuitry 228 is provided as part of the traffic light monitor, the extracted feature information transmitted by the traffic light monitoring circuitry may be further processed in circuitry 258. The output of feature processing circuitry 258 is transmitted to control computer 257. The control computer 257 may provide traffic violation reports as desired.
  • Fig. 2A illustrates a situation wherein automatic feature extraction circuitry is either not present or has failed to identify a vehicle.
  • the control center receives an image of the license plate of the vehicle and provides an image output thereof together with a traffic violation report.
  • feature extraction circuitry 128 or 228 is present in systems 104 and/or 106 thus providing an information output of the vehicle license number for transmission to the control center 108.
  • the control center may thus automatically provide an integrated violation report 209 incorporating the vehicle license number, as indicated in Fig. 2B.
  • feature extraction circuitry 128 or 228 is present in systems 104 and/or 106 thus providing an information output of the vehicle license number for transmission to the control center 108.
  • An image of the vehicle license plate is also transmitted to the control center.
  • the control center 108 thus automatically provides an integrated violation report 211 incorporating the vehicle license number, and a photograph of the license plate and part of the vehicle.
  • Fig. 3 which illus- trates the structure and operation of a traffic monitoring system constructed and operative in accordance with another preferred embodiment of the present invention which detects vehicle speed and tailgating and preferably includes integrated imaging systems of the type illustrated in Fig. 1.
  • Fig. 3 illustrates a system wherein traffic monitors 300 containing imaging systems 302, preferably of the general type described hereinabove with respect to Fig. 1 are located along a roadway. As seen in Fig. 3, each imaging system 302 senses the speed of a passing vehicle and also senses the distance between the vehicle and the vehicle ahead of it as well as the identity of each vehicle.
  • the imaging systems 302 transmit information regarding traffic violations to a control center 308 which provides output indications 312 of the existence and type of a traffic violation and an indication of the identity of the vehicle, typically including a photograph 310 of the vehicle license plate.
  • the photograph 310 may form part of an integrated traffic violation report 312.
  • the traffic monitoring system of Fig. 3 is another example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 302, and a transmitter, also preferably incorporated in system 302, functioning as at least part of a node of a wireless audio communications network for communicating image data from the image sensor along the wireless audio communications network.
  • the system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event, in this case a traffic violation.
  • Fig. 10 is a simplified block diagram illustration of the operation of part of the traffic monitoring system of Fig. 3. It may be seen from a consideration of Fig.
  • system 302 operating as a speed and tailgating monitor, includes image acquisition circuitry 320, such as image sensor 14 (Fig. 1 ) as well as dynamic and static image analysis circuits 322 and 324, both of which may be embodied in image processor 16 (Fig. 1).
  • image acquisition circuitry 320 such as image sensor 14 (Fig. 1 )
  • dynamic and static image analysis circuits 322 and 324 both of which may be embodied in image processor 16 (Fig. 1).
  • the dynamic image analysis circuit 322 typically detects an event by analyzing several images, and thus may detect vehicle speed.
  • the static image analysis circuit 324 typically detects the distance between a vehicle and the vehicle preceding it as well as the identity of a vehicle committing a traffic offense, such as speeding or tailgating.
  • the outputs of circuits 322 and 324 are provided to event detection circuit 326 and the output of circuit 324 is additionally provided to feature extraction circuit 328, both of which may be embodied in image processor 16 (Fig.
  • Event detection circuit 326 preferably receives both a vehicle speed input and an input indicating the distance between a vehicle and the vehicle preceding it. Inasmuch as tailgating is a function of both vehicle speed and the distance between a vehicle and the vehicle preceding it, circuit 326 employs both inputs to provide an output indication of a tailgating event.
  • the output of event detection circuit 326 may be used as a trigger input to an automatic communications actuator 330 which provides an actuation output to an output port 332, which may be embodied in output port 18 (Fig. 1).
  • Output port 332 typically receives a traffic violation message from a message generator 334, which receives inputs from event detection circuit 326 and feature extraction circuit 328.
  • messages may be stored in a memory at the monitor and transmitted only at predetermined times or in response to received interrogation inputs. This is also true for the embodiment of Figs. 2A - 2C and for all of the other embodiments of the present invention, where appropriate.
  • the traffic violation message is transmitted preferably via a modem 336, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 338, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 340, of which transmitter 24 is preferably a node thereof.
  • the wireless audio communications network 340 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
  • Control center 308 typically comprises an RF receiver 350 which outputs via a modem 342 to message analysis circuitry 352. Outputs of circuitry 352 may be provided to an image display 354 which may be monitored by an operator who may enter data displayed thereon via a data entry port 356 to a control computer 357.
  • Feature processing circuitry 358 receives an output from message analysis circuitry 352.
  • the extracted feature information transmitted by the speed and tailgating monitoring circuitry may be further processed in circuitry 358.
  • the output of feature processing circuitry 358 is transmitted to control computer 357.
  • the control computer 357 may provide traffic violation reports as desired.
  • apparatus of Fig. 3 may be used for counting vehicles and for providing an output indication of traffic density.
  • Figs. 4A & 4B illustrate the structure and operation of a collision monitoring system constructed and operative in accordance with another preferred embodiment of the present invention which detects both the impending occurrence of a collision and the occurrence of the collision and may include integrated imaging systems of the type illustrated in Fig. 1.
  • Figs. 4A & 4B illustrate a system wherein a collision monitor 402 which may include an imaging system, preferably of the general type described hereinabove with respect to Fig. 1, is located within a vehicle.
  • the collision monitor may be a conventional accelerometer sensor which senses sudden deceleration upon impact or any other suitable sensor, such as an optical sensor of the type described in Fig. 1, for sensing the inflation of an air bag upon a collision. It is appreciated that an impact sensor forming part of an air bag actuation system may be employed for this purpose.
  • the collision monitor also preferably includes a location determination device such as a GPS or any other suitable device for enabling the location of the vehicle at the time of the impact to be known and communicated.
  • a location determination device such as a GPS or any other suitable device for enabling the location of the vehicle at the time of the impact to be known and communicated.
  • the determination of location of the vehicle at the time of the impact is carried out remote from the vehicle.
  • a pre-collision sensor 404 provides a pre-collision warning prior to an expected collision so as to ensure that a collision notification is received, notwithstanding possible disabling of the collision monitor 402 as the result of a collision. It is appreciated that the pre-collision sensor 404 may also be fitted at the rear of the vehicle.
  • the pre-collision sensor 404 typically comprises an optical system which correlates an image of a near object with the speed and direction of the vehicle and which may include integrated imaging systems of the type illustrated in Fig. 1.
  • the pre- collision monitor 404 preferably includes both an imaging system for sensing proximity of an object and either or both of a speed sensor and an acceleration sensor for determining that a collision with that object is imminent.
  • the pre-collision sensor 404 transmits, via a wireless communications link, information regarding the imminent occurrence of a collision to a central control unit 406.
  • the central control unit 406 awaits either confirmation from the collision monitor 402 that a collision has, in fact, occurred or alternatively a manually actuated signal from a driver that no collision has occurred. In the absence of either indication, the central control unit 406 preferably interrogates the collision monitor 402 as to the collision status of the vehicle. In the absence of an indication of normal vehicle operation or a manually actuated signal from a driver that no collision has occurred, the central control unit 406 treats the occurrence as a collision and proceeds as described hereinbelow.
  • the collision monitor 402 and the central control unit 406 operate in the following manner when a collision occurs.
  • a collision indication as well as information indicating the location of the vehicle at the time of the impact, preferably one which results in air bag inflation, is transmitted via a wireless communication link to the central control unit 406.
  • the central control unit 406 preferably dispatches a mobile assistance unit 408, such as an ambulance, to the scene of the impact.
  • the location of the vehicle at the time of the impact may be determined directly by the central control unit 406 without the location having been determined by an on-board locator.
  • the collision monitoring system of Figs. 4A & 4B may be another example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 402 and sensor 404, and a transmitter, also preferably incorporated in system 402 and sensor 404, functioning as at least part of a node of an wireless audio communications network for communicating image data from the image sensor along the wireless audio communications network.
  • the system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event, in this case a collision.
  • Fig. 11 is a simplified block diagram illustration of the operation of part of the collision monitoring system of Figs. 4A & 4B. It may be seen from a consideration of Fig. 11 that system 402 or sensor 404, operating as a collision monitor or an expected collision monitor respectively, includes event acquisition circuitry 420, such as image sensor 14 (Fig. 1) or an air bag actuator. An on-board locator, such as a GPS 422, monitors the current location of the vehicle and provides a location output to a message generator 424, which also receives an event occurrence input from event acquisition circuitry 420.
  • event acquisition circuitry 420 such as image sensor 14 (Fig. 1) or an air bag actuator.
  • An on-board locator such as a GPS 422
  • Event acquisition circuitry 420 also provides a trigger input to an automatic communications actuator 430 which provides an actuation output, typically via a modem unit, to a communications port, such as a cellular telephone 432.
  • a communications port such as a cellular telephone 432.
  • Cellular telephone 432 when actuated by the actuation output of actuator 430, provides a collision message or an expected collision message from message generator 424, which reports the actual or expected occurrence of a collision and the location of the vehicle at the time.
  • the collision message or expected collision message is transmitted preferably via a cellular telephone network 440, although alternatively it may be transmitted using a modem and an RF transmitter, which may be embodied in transmitter 24 (Fig. 1) via any other suitable wireless communication network, of which transmitter 24 is preferably a node thereof. It is appreciated that all or part of the circuitry of a cellular telephone 432 may be incorporated in the single integrated circuit chip of Fig. 1.
  • the wireless audio communications may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
  • Control center 406 typically comprises a cellular telephone 434 but may alternatively comprise an RF receiver which outputs via a modem.
  • the output of cellular telephone 434 or of the modem is supplied to message analysis circuitry 452.
  • Outputs of circuitry 452 may be provided to a control computer 444.
  • location information may be received by the control computer 444 from the cellular telephone network 440 or form any other suitable location information source.
  • the control computer may be automatically or semiautomatically operative to direct rescue personnel in mobile stations to the location of the sensed collision.
  • Fig. 5 illustrates the structure and operation of a meter reading system constructed and operative in accordance with another preferred embodiment of the present invention which reads the dials on a meter, such as electricity, gas water or other utility meter and preferably includes integrated imaging systems of the type illustrated in Fig. 1.
  • Fig. 5 illustrates a system wherein meter readers 500, each containing a imaging system 502, preferably of the general type described hereinabove with respect to Fig. 1, are located in suitable propinquity to utility meters 503 sought to be automatically read. As seen in Fig. 5, each imaging system 502 senses at least a portion of the face of the meter 503 which bears information to be read.
  • the imaging systems 502 transmit information obtained by sensing at least a portion of the face of the meter either directly or via a local control unit 507 to a control center 508 which provides output indications of the reading of each meter, typically in the form of a photograph 510 of at least part of the face of the meter, but preferably in terms of the information content of a dial on the meter.
  • connection between the imaging system 502 and the local control unit 507 may be via a wire connecting system, or via a wireless communication, which may be different from that between the local control 507 and the central control station 508.
  • the meter reading system of Fig. 5 is an additional example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 502, and a transmit- ter, also preferably incorporated in system 502, functioning as at least part of a node of an wireless communications network for communicating image data from the image sensor along the wireless communications network.
  • the system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless communications network at a predetermined time, such as at a given time on a given day of each month or alternatively in response to an interrogation input.
  • an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless communications network at a predetermined time, such as at a given time on a given day of each month or alternatively in response to an interrogation input.
  • the meter reading system of Fig. 5 may include an illumination unit for reading the meter 503 during all levels of ambient light.
  • Fig. 12 is a simplified block diagram illustration of the operation of part of the meter reading system of Fig. 5. It may be seen from a consideration of Fig. 12 that system 502, operating as a meter reader, includes image acquisition circuitry 520, such as image sensor 14 (Fig. 1 ) as well as image analysis circuitry 522, which may be embodied in image processor 16 (Fig. 1). The image analysis circuit 522 typically determines the information content of the image acquired by circuitry 520 by conventional alphanumeric recognition techniques.
  • An automatic communications actuator 530 provides an actuation output to an output port 532, which may be embodied in output port 18 (Fig. 1).
  • Actuator 530 may comprise a clock (not shown) which causes a meter readout to be transmitted at a predetermined time, with predetermined periodicity.
  • the actuator 530 may be operated in response to an wireless interrogation input received from an external source, such as a vehicle which passes alongside facilities having utility meters to be read for interrogation thereof.
  • Output port 532 typically receives a meter reading message from a message generator 534, which receives an input from image analysis circuitry 522.
  • meter reading messages may be stored in a memory at the meter monitor and transmitted only at predetermined times or in response to received interrogation inputs. This is also true for all appropriate embodiments of the invention.
  • the meter reading message is transmitted preferably via a modem 536, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 538, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 540, of which transmitter 24 is preferably a node thereof.
  • the wireless communications network 540 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
  • Control center 508 typically comprises an RF receiver 550 which outputs via a modem 542 to message analysis circuitry 552. Outputs of circuitry 552 may be provided to an image display 554 which may be monitored by an operator who may enter data displayed thereon via a data entry port 556 to a control computer 558.
  • Meter reading processing circuitry 560 receives an output from message analysis circuitry 552. The information content of the meter reading may be further processed by meter reading processor 560. The output from processor 560 and message analysis unit 552 are transmitted to the control computer 558, which may generate conventional utility bills.
  • Figs. 6A & 6B illustrate the structure and operation of a parking monitoring system constructed and operative in accordance with yet another preferred embodiment of the present invention which assists drivers in finding parking and preferably includes integrated imaging systems of the type illustrated in Fig. 1.
  • Fig. 6A illustrates a system wherein parking monitors 600, each containing a imaging system 602, preferably of the general type described hereinabove with respect to Fig. 1, are located in suitable propinquity to legal parking spaces sought to be monitored. As seen in Fig. 6A, each imaging system 602 senses whether a vehicle is parked in a given parking space adjacent thereto.
  • the imaging systems 602 transmit information obtained by sensing the presence of a vehicle at a given parking space over a given time duration, either directly or via a local control unit 604, to a control center 608 which provides output indications 653 of whether a given parking space is available. Imaging systems 602 may also transmit information identifying the vehicle which is parked in each space, such as an image of its license plate, or its license number. Billing is effected by the control center 608 based on the information received by it, which identifies the parked vehicle.
  • connection between the imaging system 602 and the local control unit 604 may be via a wire connecting system, or via a wireless communication, which may be different to that between the local control 604 and the central control station 608.
  • Fig. 6B illustrates an alternative embodiment of the system of Fig. 6A.
  • payment of parking charges is effected by the driver, preferably in one of the following ways:
  • the parking locations are individually designated and the driver indicates the parking location occupied by himself when making payment. This may be obviated when payment is made by the driver via a cellular telephone in a suitably GPS equipped vehicle.
  • individual parking monitors 625 or a regional parking monitor 627 may be used for enforcement purposes, to note vehicles which are parked without corresponding payment having been made.
  • the license plates of such vehicles may be photographed automatically. Alternatively or additionally, parking inspectors may be alerted.
  • the parking monitoring systems of Figs. 6A & 6B is a further example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in imaging system 602 and a transmitter, also preferably incorporated in imaging system 602, functioning as at least part of a node of an wireless communications network for communicating image data from the image sensor along the wireless communications network.
  • the system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless communications network at a predetermined time, such as every five minutes or in response to a change in status of a parking space, from free to occupied or vice versa, or in response to an interrogation method of checking the status of the parking space.
  • an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless communications network at a predetermined time, such as every five minutes or in response to a change in status of a parking space, from free to occupied or vice versa, or in response to an interrogation method of checking the status of the parking space.
  • Fig. 13 is a simplified block diagram illustration of the operation of part of the parking monitoring system of Fig. 6A.
  • system 602 operating as a parking monitor system, includes image acquisition circuitry 620, such as image sensor 14 (Fig. 1) as well as image analysis circuitry 622, which may be embodied in image processor 16 (Fig. 1 ) .
  • the image analysis circuitry 622 typically determines whether a vehicle is present in the field of view of the image sensor.
  • Feature extraction circuitry 624 may provide an output indication of the license number of a vehicle parked in a given location.
  • An automatic communications actuator 630 provides an actuation output to an output port 632, which may be embodied in output port 18 (Fig. 1).
  • Actuator 630 may comprise a clock which causes a parking availability output to be transmitted with predetermined periodicity.
  • the actuator 630 may be operated in response to sensed changes in the availability of the parking space being monitored or in response to an interrogation method of checking the status of the parking space.
  • Output port 632 typically receives a parking availability message, which may include identification of a vehicle parked in a given space over a given time duration, from a message generator 634, which receives an input from feature extraction circuitry 624.
  • parking availability messages may be stored in a memory at the parking monitoring system and transmitted only at predetermined times or in response to received actuation outputs. This is also true for all appropriate embodiments of the invention.
  • the parking availability message is transmitted preferably via a modem 636, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 638, which may be embodied in transmitter 24 (Fig. 1) via a wireless commu- nication network 640, of which transmitter 24 is preferably a node thereof.
  • the wireless audio communications network 640 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
  • the parking monitoring systems 600 and 625 may also be used for producing parking tickets for illegal parking.
  • Control center 608 typically comprises an RF receiver 650 which outputs via a modem 642 to message analysis circuitry 652. Outputs of circuitry 652 are preferably supplied to a operator console 654, a control computer 658, and a parking data processor 660.
  • the control computer 658 may have associated therewith a data entry device 661.
  • the operator console 654 may enable vehicle license plate numbers which are not automatically readable to be displayed to an operator who can enter them into the control computer via data entry device 661.
  • Parking data processor 660 preferably maintains a data base which monitors parking space availability. It cooperates with control computer 658 to provide parking availability information and billing output to drivers.
  • the parking availability information may be transmitted through a data output port 664 and a modem unit (not shown) via wireless network 640 or by any other suitable network, such as a satellite network or a cellular telephone network, to an image display 666, preferably located in a vehicle within the field of view of the driver.
  • the image display 666 may be the image display of a conventional vehicle mounted GPS 668 and may provide a dynamic map showing the locations of available parking spaces and directing a driver how to get to such locations. Communication with display 666 may take place via a conventional cellular telephone 670.
  • parking availability information may be provided to the driver in verbal form, via wireless audio communications network 640 or via any other suitable communications network.
  • Figs. 6A and 13 may also be employed to provide automatic billing for the use of parking spaces. This may be readily achieved by using vehicle identification information communicated to the central control unit 608 or by identification information derived from the image data, as described hereinabove, to generate parking bills.
  • this system may be part of a general automatic billing system.
  • FIG. 7A and 7B illustrate the structure and operation of an automated supermarket checkout system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1.
  • Figs. 7A and 7B illustrate a system wherein shopping carts 700 are each equipped with an imaging system 702, preferably of the general type described hereinabove with respect to Fig. 1, for sensing when an item is placed in the shopping cart 700 or removed from the shopping cart 700.
  • an imaging system 702 preferably of the general type described hereinabove with respect to Fig. 1, for sensing when an item is placed in the shopping cart 700 or removed from the shopping cart 700.
  • the imaging system 702 preferably is capable of distinguishing between insertion into the shopping cart of a stock item in respect of which payment is required to be made, and other elements which do not require payment, such as the empty hand of a shopper.
  • This distinguishing functionality may employ conventional image processing and recognition functionalities including neural networks or other decision functionalities.
  • a remote evaluation functionality is provided, whereby a decision as to the classification of the element inserted into the cart can be made either by an off-line automatic processor or by a human viewing an image of the element being inserted into the cart.
  • the imaging system 702 additionally may include a price reading functionality, such as a bar code reader. Alternatively or additionally, a separate price reading device 704 may be provided on each cart.
  • each imaging system 702 senses when an element, such as an item to be paid for, is placed in the shopping cart 700. If the price of the item is read either by imaging system 702 or by a separate price reading device 704, the price is recorded. If, however, an item is placed in the shopping cart without its price having been read, a warning indication is provided.
  • the imaging systems 702 and the price reading devices 704 transmit information obtained by sensing identification codes on products, optionally via a transceiver 706, to a control center 708 which provides an itemized grocery bill 710 and may automatically debit the customer's credit card.
  • Control center 708 may also operate an automatic gate which may permit egress of the customer from the supermarket with his purchases, without further inspection, when no warning indication has been provided and which, in the presence of a warning indication, requires that the shopping cart contents be verified.
  • control center 708 may be obviated and all of the foregoing functionality may be carried out by circuitry mounted on the cart 700 itself.
  • the functionality is actuated by sensing insertion of an element into the shopping cart.
  • an image of the element being inserted is provided to processing circuitry which may be either mounted on the cart 700 or located at a remote location, such as at the control center 708.
  • the processing circuitry analyzes the image and attempts to clearly distinguish between items to be paid for and other elements. When a determination is made that the element is an item to be paid for, the price reading and warning functionality described above is operated. If a determination is made that the element is clearly not an item to be paid for, the detected element insertion is ignored.
  • a recorded image 718 of the detected element insertion may be provided to a human operator at a remote location, such as at the control center 708, who may view the image 718 and make a suitable determination. This determination may be transmitted back to the shopping cart 700.
  • the automated supermarket checkout system of Figs. 7A and 7B may be a further example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 702, and a transmitter, also preferably incorporated in system 702, functioning as at least part of a node of an wireless communications network for communicating image data from the image sensor along the wireless communications network.
  • the system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the price data along the wireless communications network at a predetermined time, such as every five minutes, in response to placing each item in the cart, or when the customer approaches an exit.
  • Fig. 14 is a simplified block diagram illustration of the operation of part of the automated supermarket checkout system of Figs. 7A and 7B.
  • system 702 operating as an automated supermarket checkout system, includes image acquisition circuitry 720, such as image sensor 14 (Fig. 1) as well as dynamic analysis circuitry 722, which may be embodied in image processor 16 (Fig. 1).
  • the dynamic image analysis circuitry 722 typically determines whether an element is being placed in or removed from the shopping cart in the field of view of the image sensor and whether that element is an item to be paid for.
  • human intervention may be provided.
  • An event detector 724 receives an output from circuitry 722 and indicates whether item placement or removal is taking place.
  • Static image analysis circuitry 725 may provide an output indication of the price and identification of the product, based on a bar code or other suitable identifier. Circuitry 725 may be unable to provide a clear indication of the identification of the product. In such a case, it may provide an output which causes an image from image acquisition circuitry to be transmitted to control center 708.
  • An automatic communications actuator 730 provides an actuation output to an output port 732, which may be embodied in output port 18 (Fig. 1).
  • Actuator 730 may comprise a clock which causes an item entry or remov- al output to be transmitted with predetermined periodicity.
  • the actuator 730 may be operated in response to each entry or removal of an item from the shopping cart in response to an output indication from event detector 724 or to approach of the shopping cart to an exit.
  • Output port 732 typically receives an item entry or removal message, which may include identification of a item, from a message generator 734, which receives an input from event detector 724 as well as a product identification and price input from circuitry 725.
  • item entry or removal messages may be stored in a memory 735 at the imaging system 702 and transmitted only at predetermined times or in response to received actuation outputs. This is also true for all appropriate embodiments of the invention.
  • the item entry or removal messages are transmitted preferably via a modem 736, which may be embodied in modem 22 (Fig. 1) and a wireless transmitter 738, which may be embodied in transmitter 24 (Fig. 1) via a wireless communication network 740, of which transmitter 24 is preferably a node thereof.
  • Static image analysis circuitry 725 may be unable to provide a clear indication of the identification of the product. In such a case, it may provide an output which causes an image from image acquisition circuitry to be transmitted via the wireless communication network 740 to the control center 708 for further analysis .
  • the wireless communications network 740 may be any suitable type of wireless network.
  • Control center 708 typically comprises a wireless receiver 748 which outputs via a modem 750 to message analysis circuitry 752.
  • the analysis circuitry 752 transmits to the control computer 758 which provides a grocery bill 710 and may operate an exit gate 712.
  • the analysis circuitry 752 may provide an image output to a manned workstation 760, including a display 762, in order to enable an operator to make determinations of whether an element inserted into a shopping cart is an item to be paid for. Inputs provided by the operator are supplied to control computer 758, which may transmit appropriate information in a wireless manner back to a shopping cart.

Abstract

This invention discloses an image communication apparatus including an image sensor (14), an image processor (16) receiving image data from the image sensor, and an output port (18) providing a processed image data output from the image processor, characterized in that the image sensor (14), the image processor (16), and the output port (18) are all embodied on a single integrated circuit chip (12).

Description

IMAGE COMMUNICATION APPARATUS
FIELD OF THE INVENTION
The present invention relates to communications apparatus and methods generally and more particularly to image communications.
BACKGROUND OF THE INVENTION
Conventional imaging systems employ separate discrete components for image acquisition, storage, processing and transmission. As a result, imaging systems presently in use are relatively large and expensive.
SUMMARY OF THE INVENTION
The present invention seeks to provide integrated imaging systems which are relatively small and inexpensive and which may be used in applications which were heretofore not practicable due to the size and cost of existing systems.
There is thus provided in accordance with a preferred embodiment of the present invention, an image communication apparatus including an image sensor, an image processor, receiving image data from said image sensor, and an output port providing a processed image data output from said image processor, characterized in that the image sensor, the image processor and the output port are all embodied on a single integrated circuit chi .
Further in accordance with a preferred embodiment of the present invention, the image communication apparatus also includes a memory for storing at least one of the image data and the processed image data, the memory being embodied together with the image sensor, the image processor and the output port on said single integrated circuit chip. Additionally or alternatively the image communication also including a modem coupled to the output port for communicating the processed image data, the modem being embodied together with the image sensor, the image processor and the output port on the single integrated circuit chip.
Preferably the image communication apparatus also comprises a wireless transmitter for communicating said processed image data, the wireless transmitter being embodied together with the image sensor, the image processor and said output port on the single integrated circuit chip.
Additionally in accordance with a preferred embodiment of the present invention the image communication apparatus also includes a wireless receiver, the wireless receiver being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
There is also provided in accordance with another preferred embodiment of the present invention an image communication apparatus including an image sensor a transmitter, functioning as at least part of a node of an wireless audio communications network, the transmitter being operative for communicating image data from the image sensor along the wireless audio communications network, an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event.
Further in accordance with a preferred embodiment of the present invention the image communication apparatus also includes a receiver, functioning as at least part of a node of an wireless audio communications network, the receiver being operative for communicating along the wireless audio communications network.
Still further in accordance with a preferred embodiment of the present invention the image communication apparatus also includes a modem coupled at least to the transmitter.
Additionally in accordance with a preferred embodiment of the present invention the wireless audio communications network is a cellular telephone network.
Preferably the wireless audio communications network is a cellular radio network.
Moreover in accordance with a preferred embodiment of the present invention the wireless audio communications network is a pager network.
Additionally or alternatively the wireless audio communications network is a satellite communication network.
Still further in accordance with a preferred embodiment of the present invention the event is an event detected by the image sensor.
The event may be receipt of an actuation input from an external source via said wireless audio network.
Additionally or alternatively the actuation input is an interrogation input.
Further in accordance with a preferred embodiment of the present invention the system also comprises an image analyzer receiving image data and providing an image analysis output.
Preferably the image analysis output is supplied to said transmitter for transmission along said wireless audio network.
Additionally or alternatively the image analysis output is supplied to the automatic communications actuator for indicating an event.
Moreover in accordance with a preferred embodiment of the present invention the image analyzer comprises a dynamic event recognizer which recognizes the occurrence of a predetermined dynamic event.
Preferably the image analysis output includes a notification of occurrence of a predetermined dynamic event.
Still further in accordance with a preferred embodiment of the present invention the image analysis output includes an indication of the identity of a participant in a predetermined dynamic event sensed by said image sensor.
Moreover in accordance with a preferred embodiment of the present invention the identity of a participant comprises identification of an inanimate object.
Additionally in accordance with a preferred embodiment of the present invention at least the image sensor forms part of an image communication assembly including an image sensor, an image processor, receiving image data from said image sensor, and an output port providing a processed image data output from said image processor, characterized in that the image sensor, said image processor and said output port are all embodied on a single integrated circuit chip.
Still further in accordance with a preferred embodiment of the present invention also comprising a memory for storing at least one of said image data and said processed image data, said memory being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
Additionally in accordance with a preferred embodiment of the present invention also including a modem coupled to said output port for communicating said processed image data, said modem being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
Further in accordance with a preferred embodiment of the present invention also including a wireless transmitter for communicating the processed image data, the wireless transmitter being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
Still further in accordance with a preferred embodiment of the present invention also including a wireless receiver, the wireless receiver being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
Additionally or alternatively the image analysis output provides image data representing part of an image sensed by the image sensor.
Preferably part of the image is selected by the image analysis output based on its image content.
Additionally or alternatively the image analysis output provides information derived by the image analyzer from the image sensed by said image sensor.
Preferably the image communication apparatus also includes a data compressor for compressing data provided by the image sensor prior to transmission thereof.
Preferably a traffic monitoring system includes an image communication apparatus wherein at least one image sensor is directed to a traffic scene and traffic information is communicated to a location remote from the traffic scene.
Additionally or alternatively the image communication apparatus includes a plurality of image communication units located at disparate locations also comprising at least one local unit operative to receive traffic information from said plurality of image communication units and to transmit said information to a central unit.
Further in accordance with a preferred embodiment of the present invention being operative to communicate a count of vehicles at a traffic scene over time.
Still further in accordance with a preferred embodiment of the present invention a traffic monitoring system being operative to communicating an indication of speed of vehicles at a traffic scene.
Additionally in accordance with a preferred embodiment of the present invention a traffic monitoring system being operative to communicate an indication of the distance separating adjacent vehicles at a traffic scene.
Moreover in accordance with a preferred embodiment of the present invention and also including a traffic violation report generator operative in response to communication of information derived from an image sensed by said image sensor.
Preferably also including a parking space availability indicator operative in response to communication of information derived from an image sensed by said image sensor.
Additionally in accordance with a preferred embodiment of the present invention an automatic remote meter reading system including an image communication apparatus wherein at least one image sensor is in sensing relationship with an indicator of a meter requiring reading and information derived from said image sensor is communicated to a location remote from the meter.
Preferably the image communication apparatus includes a plurality of image communication units located at disparate locations also comprising at least one local unit operative to receive meter reading information from said plurality of image communication units and to transmit said information to a central unit.
Moreover according to a preferred embodiment of the present invention the at least one local unit communicates with the central unit via a wireless audio communications network.
There is also provided in accordance with yet another preferred embodiment of the present invention an automatic verification system for use with shopping carts including a data entry assembly mounted on a shopping cart, a sensor monitoring entry of objects into the shopping cart, and an indicator coupled to the sensor for indicating entry of objects into the shopping card in the absence of entry of data regarding such objects using the data entry assembly.
Further in accordance with a preferred embodiment of the present invention the sensor monitoring entry of objects into the shopping cart is operative also to monitor removal of objects from the shopping cart and the indicator is also operative to indicating removal of objects from said shopping card.
In accordance with a preferred embodiment of the present invention, the sensor is operative to provide an image output to a control center for further analysis when the sensor is unable to positively identify a product.
Preferably, the control center includes automatic image analysis equipment as well as human operated image analysis equipment permitting human classification of images which may contain products.
Preferably the data entry assembly and the sensor both employ a single optical input device.
There is also provided in accordance with a preferred embodiment of the present invention an automatic accident reporting system including a vehicle mounted pre-collision sensor for sensing an impending collision, a vehicle mounted collision sensor for sensing a vehicle impact exceeding a predetermined impact threshold and a vehicle mounted communicator coupled to the vehicle mounted pre-collision sensor and to the vehicle mounted collision sensor for communicating the existence of a vehicle air bag actuation event to a remote location and providing an indication of the location of the vehicle at the time of the actuation event. Further in accordance with a preferred embodiment of the present invention the communicator defines a node on a cellular communications system which automatically indicates the location of the vehicle.
Still further in accordance with a preferred embodiment of the present invention the communicator is coupled to a GPS which automatically indicates the location of the vehicle.
There is also provided according to another preferred embodiment of the present invention an automatic accident reporting system including a vehicle mounted pre-collision sensor for sensing an impending collision, a vehicle mounted collision sensor for sensing a vehicle impact exceeding a predetermined impact threshold and a vehicle mounted communicator coupled to the vehicle mounted pre-collision sensor and to the vehicle mounted collision sensor for communicating the existence of the vehicle impact to a remote location and providing an indication of the location of the vehicle at the time of the vehicle impact.
Additionally in accordance with a preferred embodiment of the present invention the communicator defines a node on a cellular communications system which automatically indicates the location of the vehicle.
Additionally or alternatively the communicator is coupled to a GPS which automatically indicates the location of the vehicle.
There is additionally provided in accordance with a preferred embodiment of the present invention a parking monitoring system including parking monitors indicating the presence or identity of vehicles parked in predetermined locations and a billing system receiving information from the parking monitors for charging users parking fees based on that information.
There is also provided in accordance with a preferred embodiment of the present invention a parking monitoring system including parking monitors indicating the identity of vehicles parked in predetermined locations, a payment receipt system for receiving payment from users whose vehicles are parked in the predetermined locations and a payment verification system receiving information from the parking monitors and from the payment receipt system for enforcement of payment of users parking fees based on information from the parking monitors.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be understood and appreciated more fully from the following detailed description, taken in conjunction with the drawings in which:
Fig. 1 is a simplified illustrative drawing of an integrated imaging system formed on a single integrated circuit chip in accordance with a preferred embodiment of the present invention;
Figs. 2A, 2B and 2C illustrate the structure and operation of traffic monitoring systems constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
Fig. 3 illustrates the structure and operation of another traffic monitoring system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including an integrated imaging system of the type illustrated in Fig. 1;
Figs. 4A & 4B illustrate the structure and operation of a collision monitoring and notification system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1; Fig. 5 illustrates the structure and operation of an electric meter reading system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
Figs. 6A & 6B illustrate the structure and operation of a parking monitoring system constructed and operative in accordance with two alternative embodiments of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
Figs. 7A and 7B illustrate the structure and operation of an automated supermarket checkout system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1;
Fig. 8 is a simplified block diagram illustration of the structure and operation of part of the traffic monitoring systems of Figs. 2A - 2C;
Fig. 9 is a simplified block diagram illustration of the structure and operation of another part of the traffic monitoring systems of Figs. 2A - 2C;
Fig. 10 is a simplified block diagram illustration of the structure and operation of part of the traffic monitoring system of Fig. 3;
Fig. 11 is a simplified block diagram illustration of the structure and operation of part of the collision monitoring system of Fig. 4;
Fig. 12 is a simplified block diagram illustration of the structure and operation of part of the meter reading system of Fig. 5;
Fig. 13 is a simplified block diagram illustration of the structure and operation of part of the parking monitoring system of Fig. 6; and
Fig. 14 is a simplified block diagram illustration of the structure and operation of part of the automated supermarket checkout system of Figs. 7A and 7B.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
Reference is now made to Fig. 1, which is a simplified illustrative drawing of an integrated imaging system 10 formed on a single integrated circuit chip 12 in accordance with a preferred embodiment of the present invention. Preferably, the integrated imaging system 10 comprises an image sensor 14, such as a 2 dimensional CMOS sensor, such as a sensor commercially available from semiconductor suppliers, such as Tower Semiconductor Ltd., Intel & Hyundai. It is appreciated that the CMOS may also include analog processing functions.
In accordance with a preferred embodiment of the present invention, the system 10 also comprises an image processor 16, receiving image data from the image sensor 14. CMOS image processors are commercially available from Texas Instruments under the name of TMS 320Clx and from Motorola, under the name of DSP561xx. The image processor 16 is preferably coupled to an output port 18, which provides a processed image data output from the image processor 16.
It is a particular feature of the present invention that the image sensor 14, the image processor 16 and the output port 18 are all embodied on a single integrated circuit chip.
In accordance with a preferred embodiment of the present invention, the single integrated circuit chip 12 also preferably comprises a memory 20 for storing at least one of the image data and the processed image data.
Additionally in accordance with a preferred embodiment of the present invention, the single integrated circuit chip 12 also preferably comprises a modem 22 coupled to the output port 18 for communicating the processed image data. Examples of CMOS modems are avail- able from Motorola under the name of MC145442 and MC145443. Further in accordance with a preferred embodiment of the present invention there is preferably provided a wireless transmitter 24 for communicating the processed image data, the wireless transmitter 24 being embodied together with the image sensor 14, the image processor 16, the output port 18, and modem 22 on the single integrated circuit chip 12.
The image communication apparatus of Fig. 1 may also include a wireless receiver 26, the wireless receiver 26 being embodied together with a modem 22, an input port 27, the image sensor 14, the image processor 16 and the output port 18 on the single integrated circuit chip 12. The receiver 26 is preferably employed to receive control inputs from an external source which govern the operation of the remaining components of the chip 12.
Transmitter 24 and receiver 26 may share a single antenna, such as an internal antenna 28 or may employ separate antennas. External antennas (not shown) may be employed with the transmitter 24 or the receiver 26.
It is a particular feature of the present invention that incorporation of the entire imaging system on a single chip provides a relatively compact and low cost imaging system which may be employed in applications heretofore unattainable.
Reference is now made to Figs. 2A, 2B and 2C, which illustrate the structure and operation of traffic monitoring systems constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1.
Fig. 2A illustrates a system wherein static traffic control devices, such as stop signs 100 and traffic lights 102 are provided with imaging systems, preferably of the general type described hereinabove with respect to Fig. 1. As seen in Fig. 2A, an imaging system 104, associated with a stop sign 100 senses when a vehicle passes without stopping and also senses the identity of the vehicle. Similarly an imaging system 106, associated with a traffic light 102, senses when a vehicle passes without stopping for a red light and also senses the identity of the vehicle. The imaging systems 104 and 106 transmit information regarding traffic violations to a control center 108 which provides output indications of the existence and type of a traffic violation and an indication of the identity of the vehicle, typically in the form of a photograph 110 of the vehicle license plate.
The traffic monitoring system of Fig. 2A is one example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 104 or 106, and a transmitter, preferably incorporated in system 104 or 106, functioning as at least part of a node of an wireless audio communications network for communicating image data from the image sensor along the wireless audio communications network. The system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event, in this case a traffic violation.
Reference is made in this connection to Fig. 8, which is a simplified block diagram illustration of the operation of part of the traffic monitoring systems of Figs. 2A - 2C. It may be seen from a consideration of Fig. 8 that system 104, operating as a stop sign monitor, includes image acquisition circuitry 120, such as image sensor 14 (Fig. 1) as well as dynamic and static image analysis circuits 122 and 124, both of which may be em- bodied in image processor 16 (Fig. 1). The dynamic image analysis circuit 122 typically detects an event by analyzing several images, and thus may detect the failure of a driver to stop at a stop sign.
The static image analysis circuit 124, which need not necessarily form part of the stop sign monitor, typically detects the identity of a vehicle committing a traffic offense, such as running a stop sign. The outputs of circuits 122 and 124 are provided to respective event detection and feature extraction circuits 126 and 128, both of which may be embodied in image processor 16 (Fig.
1).
The output of event detection circuit 126 may be used as a trigger input to an automatic communications actuator 130 which provides an actuation output to an output port 132, which may be embodied in output port 18 (Fig. 1). Output port 132 typically receives a traffic violation message from a message generator 134, which receives inputs from event detection circuit 126 and feature extraction circuit 128.
The traffic violation message is transmitted preferably via a modem 136, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 138, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 140, of which transmitter 24 is preferably a node thereof.
The wireless audio communications network 140 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
Control center 108 typically comprises an RF receiver 150 which outputs via a modem 142 to message analysis circuitry 152. Outputs of circuitry 152 may be provided to an image display 154 which may be monitored by an operator who may enter data displayed thereon via a data entry port 156 to a control computer 157.
Feature processing circuitry 158 receives an output from message analysis circuitry 152. In the case where feature extraction circuitry 128 is not present as part of the stop sign monitoring circuitry 104, such feature extraction circuitry may form part of the feature processing circuitry 158. If feature extraction circuitry 128 is provided as part of the stop sign monitor 104, the extracted feature information transmitted by the stop sign monitoring circuitry may be further processed in circuitry 158. The output of feature processing circuitry 158 is transmitted to control computer 157. The control computer 157 may provide traffic violation reports as desired.
Reference is now made to Fig. 9, which is a simplified block diagram illustration of the operation of another part of the traffic monitoring systems of Figs. 2A - 2C. It may be seen from a consideration of Fig. 9 that system 106, operating as a traffic light monitor, includes image acquisition circuitry 220, such as image sensor 14 (Fig. 1) as well as dynamic and static image analysis circuits 222 and 224, both of which may be embodied in image processor 16 (Fig. 1). The dynamic image analysis circuit 222 typically detects an event by analyzing several images, and thus may detect the failure of a driver to stop at a red light.
In contrast to system 104 (Fig. 8), system 106 typically comprises an input port 225 which receives an external signal, such as a signal indicating that the traffic light is red. Input port 225 may be an RF receiver or alternatively a receiver port for receiving a red light signal via a wired connection. Alternatively input port 225 may be obviated, in a case where the traffic light is within the field of view of image sensor 14, which has the capability of detecting its status.
The static image analysis circuit 224, which need not necessarily form part of the traffic light monitor, typically detects the identity of a vehicle committing a traffic offense, such as running a traffic light. The outputs of circuits 222 and 224 are provided to respective event detection and feature extraction circuits 226 and 228, both of which may be embodied in image processor 16 (Fig. 1).
The output of event detection circuit 226 may be used as a trigger input to an automatic communications actuator 230 which provides an actuation output to an output port 232, which may be embodied in output port 18 (Fig. 1). Alternatively, where an input port 225 is provided, the output of input port 225 may provide a trigger input. Output port 232 typically receives a traffic violation message from a message generator 234, which receives inputs from event detection circuit 226 and feature extraction circuit 228.
The traffic violation message is transmitted preferably via a modem 236, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 238, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 240, of which transmitter 24 is preferably a node thereof.
The wireless audio communications network 240 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
Control center 108 typically comprises an RF receiver 250 which outputs via a modem 242 to message analysis circuitry 252. Outputs of circuitry 252 may be provided to an image display 254 which may be monitored by an operator who may enter data displayed thereon via a data entry port 256 to a control computer 257.
Feature processing circuitry 258 receives an output from message analysis circuitry 252. In the case where feature extraction circuitry 228 is not present as part of the traffic light monitoring circuitry, such feature extraction circuitry may form part of the feature processing circuitry 258. If feature extraction circuitry 228 is provided as part of the traffic light monitor, the extracted feature information transmitted by the traffic light monitoring circuitry may be further processed in circuitry 258. The output of feature processing circuitry 258 is transmitted to control computer 257. The control computer 257 may provide traffic violation reports as desired.
It may be appreciated that Fig. 2A illustrates a situation wherein automatic feature extraction circuitry is either not present or has failed to identify a vehicle. In the embodiment of Fig. 2A, the control center receives an image of the license plate of the vehicle and provides an image output thereof together with a traffic violation report.
In the embodiment of Fig. 2B, feature extraction circuitry 128 or 228 is present in systems 104 and/or 106 thus providing an information output of the vehicle license number for transmission to the control center 108. The control center may thus automatically provide an integrated violation report 209 incorporating the vehicle license number, as indicated in Fig. 2B.
In the embodiment of Fig. 2C, feature extraction circuitry 128 or 228 is present in systems 104 and/or 106 thus providing an information output of the vehicle license number for transmission to the control center 108. An image of the vehicle license plate is also transmitted to the control center. Here the control center 108 thus automatically provides an integrated violation report 211 incorporating the vehicle license number, and a photograph of the license plate and part of the vehicle.
Reference is now made to Fig. 3 which illus- trates the structure and operation of a traffic monitoring system constructed and operative in accordance with another preferred embodiment of the present invention which detects vehicle speed and tailgating and preferably includes integrated imaging systems of the type illustrated in Fig. 1.
Fig. 3 illustrates a system wherein traffic monitors 300 containing imaging systems 302, preferably of the general type described hereinabove with respect to Fig. 1 are located along a roadway. As seen in Fig. 3, each imaging system 302 senses the speed of a passing vehicle and also senses the distance between the vehicle and the vehicle ahead of it as well as the identity of each vehicle.
The imaging systems 302 transmit information regarding traffic violations to a control center 308 which provides output indications 312 of the existence and type of a traffic violation and an indication of the identity of the vehicle, typically including a photograph 310 of the vehicle license plate. The photograph 310 may form part of an integrated traffic violation report 312.
The traffic monitoring system of Fig. 3 is another example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 302, and a transmitter, also preferably incorporated in system 302, functioning as at least part of a node of a wireless audio communications network for communicating image data from the image sensor along the wireless audio communications network. The system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event, in this case a traffic violation. Reference is made in this connection to Fig. 10, which is a simplified block diagram illustration of the operation of part of the traffic monitoring system of Fig. 3. It may be seen from a consideration of Fig. 10 that system 302, operating as a speed and tailgating monitor, includes image acquisition circuitry 320, such as image sensor 14 (Fig. 1 ) as well as dynamic and static image analysis circuits 322 and 324, both of which may be embodied in image processor 16 (Fig. 1). The dynamic image analysis circuit 322 typically detects an event by analyzing several images, and thus may detect vehicle speed.
The static image analysis circuit 324, typically detects the distance between a vehicle and the vehicle preceding it as well as the identity of a vehicle committing a traffic offense, such as speeding or tailgating. The outputs of circuits 322 and 324 are provided to event detection circuit 326 and the output of circuit 324 is additionally provided to feature extraction circuit 328, both of which may be embodied in image processor 16 (Fig.
1).
Event detection circuit 326 preferably receives both a vehicle speed input and an input indicating the distance between a vehicle and the vehicle preceding it. Inasmuch as tailgating is a function of both vehicle speed and the distance between a vehicle and the vehicle preceding it, circuit 326 employs both inputs to provide an output indication of a tailgating event.
The output of event detection circuit 326 may be used as a trigger input to an automatic communications actuator 330 which provides an actuation output to an output port 332, which may be embodied in output port 18 (Fig. 1). Output port 332 typically receives a traffic violation message from a message generator 334, which receives inputs from event detection circuit 326 and feature extraction circuit 328. Alternatively, messages may be stored in a memory at the monitor and transmitted only at predetermined times or in response to received interrogation inputs. This is also true for the embodiment of Figs. 2A - 2C and for all of the other embodiments of the present invention, where appropriate.
The traffic violation message is transmitted preferably via a modem 336, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 338, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 340, of which transmitter 24 is preferably a node thereof.
The wireless audio communications network 340 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
It is appreciated that suitable data compression may be employed in all embodiments of the invention for communication of data over the wireless audio communications network or any other communications network.
Control center 308 typically comprises an RF receiver 350 which outputs via a modem 342 to message analysis circuitry 352. Outputs of circuitry 352 may be provided to an image display 354 which may be monitored by an operator who may enter data displayed thereon via a data entry port 356 to a control computer 357.
Feature processing circuitry 358 receives an output from message analysis circuitry 352. The extracted feature information transmitted by the speed and tailgating monitoring circuitry may be further processed in circuitry 358. The output of feature processing circuitry 358 is transmitted to control computer 357. The control computer 357 may provide traffic violation reports as desired.
It is also appreciated that the apparatus of Fig. 3 may be used for counting vehicles and for providing an output indication of traffic density.
Reference is now made to Figs. 4A & 4B which illustrate the structure and operation of a collision monitoring system constructed and operative in accordance with another preferred embodiment of the present invention which detects both the impending occurrence of a collision and the occurrence of the collision and may include integrated imaging systems of the type illustrated in Fig. 1.
Figs. 4A & 4B illustrate a system wherein a collision monitor 402 which may include an imaging system, preferably of the general type described hereinabove with respect to Fig. 1, is located within a vehicle. The collision monitor may be a conventional accelerometer sensor which senses sudden deceleration upon impact or any other suitable sensor, such as an optical sensor of the type described in Fig. 1, for sensing the inflation of an air bag upon a collision. It is appreciated that an impact sensor forming part of an air bag actuation system may be employed for this purpose.
The collision monitor also preferably includes a location determination device such as a GPS or any other suitable device for enabling the location of the vehicle at the time of the impact to be known and communicated. Alternatively, if a cellular-type location system is employed, the determination of location of the vehicle at the time of the impact is carried out remote from the vehicle.
In accordance with a preferred embodiment of the present invention a pre-collision sensor 404 provides a pre-collision warning prior to an expected collision so as to ensure that a collision notification is received, notwithstanding possible disabling of the collision monitor 402 as the result of a collision. It is appreciated that the pre-collision sensor 404 may also be fitted at the rear of the vehicle.
The pre-collision sensor 404 typically comprises an optical system which correlates an image of a near object with the speed and direction of the vehicle and which may include integrated imaging systems of the type illustrated in Fig. 1. In this embodiment, the pre- collision monitor 404 preferably includes both an imaging system for sensing proximity of an object and either or both of a speed sensor and an acceleration sensor for determining that a collision with that object is imminent.
As shown in Fig. 4A, the pre-collision sensor 404 transmits, via a wireless communications link, information regarding the imminent occurrence of a collision to a central control unit 406. The central control unit 406 awaits either confirmation from the collision monitor 402 that a collision has, in fact, occurred or alternatively a manually actuated signal from a driver that no collision has occurred. In the absence of either indication, the central control unit 406 preferably interrogates the collision monitor 402 as to the collision status of the vehicle. In the absence of an indication of normal vehicle operation or a manually actuated signal from a driver that no collision has occurred, the central control unit 406 treats the occurrence as a collision and proceeds as described hereinbelow.
Preferably, as illustrated in Fig. 4B, the collision monitor 402 and the central control unit 406 operate in the following manner when a collision occurs. In response to an impact which exceeds a given threshold, a collision indication as well as information indicating the location of the vehicle at the time of the impact, preferably one which results in air bag inflation, is transmitted via a wireless communication link to the central control unit 406. The central control unit 406 preferably dispatches a mobile assistance unit 408, such as an ambulance, to the scene of the impact. Alternatively, the location of the vehicle at the time of the impact, may be determined directly by the central control unit 406 without the location having been determined by an on-board locator.
The collision monitoring system of Figs. 4A & 4B may be another example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 402 and sensor 404, and a transmitter, also preferably incorporated in system 402 and sensor 404, functioning as at least part of a node of an wireless audio communications network for communicating image data from the image sensor along the wireless audio communications network. The system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless audio communications network in response to occurrence of an event, in this case a collision.
Reference is made in this connection to Fig. 11, which is a simplified block diagram illustration of the operation of part of the collision monitoring system of Figs. 4A & 4B. It may be seen from a consideration of Fig. 11 that system 402 or sensor 404, operating as a collision monitor or an expected collision monitor respectively, includes event acquisition circuitry 420, such as image sensor 14 (Fig. 1) or an air bag actuator. An on-board locator, such as a GPS 422, monitors the current location of the vehicle and provides a location output to a message generator 424, which also receives an event occurrence input from event acquisition circuitry 420.
Event acquisition circuitry 420 also provides a trigger input to an automatic communications actuator 430 which provides an actuation output, typically via a modem unit, to a communications port, such as a cellular telephone 432. Cellular telephone 432, when actuated by the actuation output of actuator 430, provides a collision message or an expected collision message from message generator 424, which reports the actual or expected occurrence of a collision and the location of the vehicle at the time.
The collision message or expected collision message is transmitted preferably via a cellular telephone network 440, although alternatively it may be transmitted using a modem and an RF transmitter, which may be embodied in transmitter 24 (Fig. 1) via any other suitable wireless communication network, of which transmitter 24 is preferably a node thereof. It is appreciated that all or part of the circuitry of a cellular telephone 432 may be incorporated in the single integrated circuit chip of Fig. 1.
The wireless audio communications may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
Control center 406 typically comprises a cellular telephone 434 but may alternatively comprise an RF receiver which outputs via a modem. The output of cellular telephone 434 or of the modem is supplied to message analysis circuitry 452. Outputs of circuitry 452 may be provided to a control computer 444. In the case where a GPS or equivalent on-board locator is not provided as part of the system 402, location information may be received by the control computer 444 from the cellular telephone network 440 or form any other suitable location information source.
The control computer may be automatically or semiautomatically operative to direct rescue personnel in mobile stations to the location of the sensed collision.
Reference is now made to Fig. 5 which illustrates the structure and operation of a meter reading system constructed and operative in accordance with another preferred embodiment of the present invention which reads the dials on a meter, such as electricity, gas water or other utility meter and preferably includes integrated imaging systems of the type illustrated in Fig. 1.
Fig. 5 illustrates a system wherein meter readers 500, each containing a imaging system 502, preferably of the general type described hereinabove with respect to Fig. 1, are located in suitable propinquity to utility meters 503 sought to be automatically read. As seen in Fig. 5, each imaging system 502 senses at least a portion of the face of the meter 503 which bears information to be read.
The imaging systems 502 transmit information obtained by sensing at least a portion of the face of the meter either directly or via a local control unit 507 to a control center 508 which provides output indications of the reading of each meter, typically in the form of a photograph 510 of at least part of the face of the meter, but preferably in terms of the information content of a dial on the meter.
It is appreciated that the connection between the imaging system 502 and the local control unit 507 may be via a wire connecting system, or via a wireless communication, which may be different from that between the local control 507 and the central control station 508.
The meter reading system of Fig. 5 is an additional example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 502, and a transmit- ter, also preferably incorporated in system 502, functioning as at least part of a node of an wireless communications network for communicating image data from the image sensor along the wireless communications network.
The system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless communications network at a predetermined time, such as at a given time on a given day of each month or alternatively in response to an interrogation input.
It is appreciated that an advantage of the present system illustrated in Fig. 5 is that the system allows for reading of existing utility meters without the need to change the meters.
Additionally it is appreciated that the meter reading system of Fig. 5 may include an illumination unit for reading the meter 503 during all levels of ambient light.
Reference is made in this connection to Fig. 12, which is a simplified block diagram illustration of the operation of part of the meter reading system of Fig. 5. It may be seen from a consideration of Fig. 12 that system 502, operating as a meter reader, includes image acquisition circuitry 520, such as image sensor 14 (Fig. 1 ) as well as image analysis circuitry 522, which may be embodied in image processor 16 (Fig. 1). The image analysis circuit 522 typically determines the information content of the image acquired by circuitry 520 by conventional alphanumeric recognition techniques.
An automatic communications actuator 530 provides an actuation output to an output port 532, which may be embodied in output port 18 (Fig. 1). Actuator 530 may comprise a clock (not shown) which causes a meter readout to be transmitted at a predetermined time, with predetermined periodicity. Alternatively, the actuator 530 may be operated in response to an wireless interrogation input received from an external source, such as a vehicle which passes alongside facilities having utility meters to be read for interrogation thereof.
Output port 532 typically receives a meter reading message from a message generator 534, which receives an input from image analysis circuitry 522.
Alternatively, meter reading messages may be stored in a memory at the meter monitor and transmitted only at predetermined times or in response to received interrogation inputs. This is also true for all appropriate embodiments of the invention.
The meter reading message is transmitted preferably via a modem 536, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 538, which may be embodied in transmitter 24 (Fig. 1) via a wireless audio communication network 540, of which transmitter 24 is preferably a node thereof.
The wireless communications network 540 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
Control center 508 typically comprises an RF receiver 550 which outputs via a modem 542 to message analysis circuitry 552. Outputs of circuitry 552 may be provided to an image display 554 which may be monitored by an operator who may enter data displayed thereon via a data entry port 556 to a control computer 558.
Meter reading processing circuitry 560 receives an output from message analysis circuitry 552. The information content of the meter reading may be further processed by meter reading processor 560. The output from processor 560 and message analysis unit 552 are transmitted to the control computer 558, which may generate conventional utility bills. Reference is now made to Figs. 6A & 6B which illustrate the structure and operation of a parking monitoring system constructed and operative in accordance with yet another preferred embodiment of the present invention which assists drivers in finding parking and preferably includes integrated imaging systems of the type illustrated in Fig. 1.
Fig. 6A illustrates a system wherein parking monitors 600, each containing a imaging system 602, preferably of the general type described hereinabove with respect to Fig. 1, are located in suitable propinquity to legal parking spaces sought to be monitored. As seen in Fig. 6A, each imaging system 602 senses whether a vehicle is parked in a given parking space adjacent thereto.
The imaging systems 602 transmit information obtained by sensing the presence of a vehicle at a given parking space over a given time duration, either directly or via a local control unit 604, to a control center 608 which provides output indications 653 of whether a given parking space is available. Imaging systems 602 may also transmit information identifying the vehicle which is parked in each space, such as an image of its license plate, or its license number. Billing is effected by the control center 608 based on the information received by it, which identifies the parked vehicle.
It is appreciated that the connection between the imaging system 602 and the local control unit 604 may be via a wire connecting system, or via a wireless communication, which may be different to that between the local control 604 and the central control station 608.
Fig. 6B illustrates an alternative embodiment of the system of Fig. 6A. In the embodiment of Fig. 6B, payment of parking charges is effected by the driver, preferably in one of the following ways:
Via a cellular telephone in connection with an automatic telephone actuated billing center 610; or By inserting money or a debit or charge card or a credit card in a local parking monitor 612 located in the vicinity of the parking location.
Preferably, the parking locations are individually designated and the driver indicates the parking location occupied by himself when making payment. This may be obviated when payment is made by the driver via a cellular telephone in a suitably GPS equipped vehicle.
In the embodiment of Fig. 6B, individual parking monitors 625 or a regional parking monitor 627, each preferably including an imaging system 602, may be used for enforcement purposes, to note vehicles which are parked without corresponding payment having been made. The license plates of such vehicles may be photographed automatically. Alternatively or additionally, parking inspectors may be alerted.
The parking monitoring systems of Figs. 6A & 6B is a further example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in imaging system 602 and a transmitter, also preferably incorporated in imaging system 602, functioning as at least part of a node of an wireless communications network for communicating image data from the image sensor along the wireless communications network.
The system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the image data from the image sensor along the wireless communications network at a predetermined time, such as every five minutes or in response to a change in status of a parking space, from free to occupied or vice versa, or in response to an interrogation method of checking the status of the parking space.
Reference is made in this connection to Fig. 13, which is a simplified block diagram illustration of the operation of part of the parking monitoring system of Fig. 6A. It may be seen from a consideration of Fig. 13 that system 602, operating as a parking monitor system, includes image acquisition circuitry 620, such as image sensor 14 (Fig. 1) as well as image analysis circuitry 622, which may be embodied in image processor 16 (Fig. 1 ) . The image analysis circuitry 622 typically determines whether a vehicle is present in the field of view of the image sensor. Feature extraction circuitry 624 may provide an output indication of the license number of a vehicle parked in a given location.
An automatic communications actuator 630 provides an actuation output to an output port 632, which may be embodied in output port 18 (Fig. 1). Actuator 630 may comprise a clock which causes a parking availability output to be transmitted with predetermined periodicity. Alternatively, the actuator 630 may be operated in response to sensed changes in the availability of the parking space being monitored or in response to an interrogation method of checking the status of the parking space.
Output port 632 typically receives a parking availability message, which may include identification of a vehicle parked in a given space over a given time duration, from a message generator 634, which receives an input from feature extraction circuitry 624.
Alternatively, parking availability messages may be stored in a memory at the parking monitoring system and transmitted only at predetermined times or in response to received actuation outputs. This is also true for all appropriate embodiments of the invention.
The parking availability message is transmitted preferably via a modem 636, which may be embodied in modem 22 (Fig. 1) and an RF transmitter 638, which may be embodied in transmitter 24 (Fig. 1) via a wireless commu- nication network 640, of which transmitter 24 is preferably a node thereof.
The wireless audio communications network 640 may be a cellular telephone network, a cellular radio network, a pager network, a satellite communication network, any combination of the foregoing or any other suitable type of wireless network.
It is appreciated that the parking monitoring systems 600 and 625 may also be used for producing parking tickets for illegal parking.
Control center 608 typically comprises an RF receiver 650 which outputs via a modem 642 to message analysis circuitry 652. Outputs of circuitry 652 are preferably supplied to a operator console 654, a control computer 658, and a parking data processor 660. The control computer 658 may have associated therewith a data entry device 661. The operator console 654 may enable vehicle license plate numbers which are not automatically readable to be displayed to an operator who can enter them into the control computer via data entry device 661.
Parking data processor 660 preferably maintains a data base which monitors parking space availability. It cooperates with control computer 658 to provide parking availability information and billing output to drivers. The parking availability information may be transmitted through a data output port 664 and a modem unit (not shown) via wireless network 640 or by any other suitable network, such as a satellite network or a cellular telephone network, to an image display 666, preferably located in a vehicle within the field of view of the driver. The image display 666 may be the image display of a conventional vehicle mounted GPS 668 and may provide a dynamic map showing the locations of available parking spaces and directing a driver how to get to such locations. Communication with display 666 may take place via a conventional cellular telephone 670. Alternatively or additionally, parking availability information may be provided to the driver in verbal form, via wireless audio communications network 640 or via any other suitable communications network.
It is appreciated that the system of Figs. 6A and 13 may also be employed to provide automatic billing for the use of parking spaces. This may be readily achieved by using vehicle identification information communicated to the central control unit 608 or by identification information derived from the image data, as described hereinabove, to generate parking bills.
It is appreciated that this system may be part of a general automatic billing system.
Reference is now made to Figs. 7A and 7B, which illustrate the structure and operation of an automated supermarket checkout system constructed and operative in accordance with a preferred embodiment of the present invention and preferably including integrated imaging systems of the type illustrated in Fig. 1.
Figs. 7A and 7B illustrate a system wherein shopping carts 700 are each equipped with an imaging system 702, preferably of the general type described hereinabove with respect to Fig. 1, for sensing when an item is placed in the shopping cart 700 or removed from the shopping cart 700.
The imaging system 702 preferably is capable of distinguishing between insertion into the shopping cart of a stock item in respect of which payment is required to be made, and other elements which do not require payment, such as the empty hand of a shopper. This distinguishing functionality may employ conventional image processing and recognition functionalities including neural networks or other decision functionalities.
In accordance with a preferred embodiment of the invention, a remote evaluation functionality is provided, whereby a decision as to the classification of the element inserted into the cart can be made either by an off-line automatic processor or by a human viewing an image of the element being inserted into the cart.
The imaging system 702 additionally may include a price reading functionality, such as a bar code reader. Alternatively or additionally, a separate price reading device 704 may be provided on each cart.
As seen in Figs. 7A and 7B, each imaging system 702 senses when an element, such as an item to be paid for, is placed in the shopping cart 700. If the price of the item is read either by imaging system 702 or by a separate price reading device 704, the price is recorded. If, however, an item is placed in the shopping cart without its price having been read, a warning indication is provided.
The imaging systems 702 and the price reading devices 704 transmit information obtained by sensing identification codes on products, optionally via a transceiver 706, to a control center 708 which provides an itemized grocery bill 710 and may automatically debit the customer's credit card. Control center 708 may also operate an automatic gate which may permit egress of the customer from the supermarket with his purchases, without further inspection, when no warning indication has been provided and which, in the presence of a warning indication, requires that the shopping cart contents be verified.
It is appreciated that in an alternative embodiment of the invention, the control center 708 may be obviated and all of the foregoing functionality may be carried out by circuitry mounted on the cart 700 itself.
In accordance with an embodiment of the present invention wherein functionality for distinguishing between insertion into the shopping cart of a stock item in respect of which payment is required to be made, and other elements, such as the empty hand of a shopper is provided, the functionality is actuated by sensing insertion of an element into the shopping cart.
Upon insertion of an element, an image of the element being inserted is provided to processing circuitry which may be either mounted on the cart 700 or located at a remote location, such as at the control center 708. The processing circuitry analyzes the image and attempts to clearly distinguish between items to be paid for and other elements. When a determination is made that the element is an item to be paid for, the price reading and warning functionality described above is operated. If a determination is made that the element is clearly not an item to be paid for, the detected element insertion is ignored.
If however, the processing circuitry is unable to make a clear determination, a recorded image 718 of the detected element insertion may be provided to a human operator at a remote location, such as at the control center 708, who may view the image 718 and make a suitable determination. This determination may be transmitted back to the shopping cart 700.
It is appreciated that the functionality described hereinabove with respect to insertion of elements, including stock items, into a shopping cart may be operated in a similar manner to deal with removal of such elements.
The automated supermarket checkout system of Figs. 7A and 7B may be a further example of an image communication system constructed and operative in accordance with a preferred embodiment of the present invention and including an image sensor, incorporated in system 702, and a transmitter, also preferably incorporated in system 702, functioning as at least part of a node of an wireless communications network for communicating image data from the image sensor along the wireless communications network. The system preferably also includes an automatic communications actuator operative to automatically operate the transmitter to communicate the price data along the wireless communications network at a predetermined time, such as every five minutes, in response to placing each item in the cart, or when the customer approaches an exit.
Reference is made in this connection to Fig. 14, which is a simplified block diagram illustration of the operation of part of the automated supermarket checkout system of Figs. 7A and 7B. It may be seen from a consideration of Fig. 14 that system 702, operating as an automated supermarket checkout system, includes image acquisition circuitry 720, such as image sensor 14 (Fig. 1) as well as dynamic analysis circuitry 722, which may be embodied in image processor 16 (Fig. 1). The dynamic image analysis circuitry 722 typically determines whether an element is being placed in or removed from the shopping cart in the field of view of the image sensor and whether that element is an item to be paid for. As noted above with reference to Fig. 7B, human intervention may be provided.
An event detector 724 receives an output from circuitry 722 and indicates whether item placement or removal is taking place. Static image analysis circuitry 725 may provide an output indication of the price and identification of the product, based on a bar code or other suitable identifier. Circuitry 725 may be unable to provide a clear indication of the identification of the product. In such a case, it may provide an output which causes an image from image acquisition circuitry to be transmitted to control center 708.
An automatic communications actuator 730 provides an actuation output to an output port 732, which may be embodied in output port 18 (Fig. 1). Actuator 730 may comprise a clock which causes an item entry or remov- al output to be transmitted with predetermined periodicity. Alternatively, the actuator 730 may be operated in response to each entry or removal of an item from the shopping cart in response to an output indication from event detector 724 or to approach of the shopping cart to an exit.
Output port 732 typically receives an item entry or removal message, which may include identification of a item, from a message generator 734, which receives an input from event detector 724 as well as a product identification and price input from circuitry 725.
Alternatively, item entry or removal messages may be stored in a memory 735 at the imaging system 702 and transmitted only at predetermined times or in response to received actuation outputs. This is also true for all appropriate embodiments of the invention.
The item entry or removal messages are transmitted preferably via a modem 736, which may be embodied in modem 22 (Fig. 1) and a wireless transmitter 738, which may be embodied in transmitter 24 (Fig. 1) via a wireless communication network 740, of which transmitter 24 is preferably a node thereof.
Static image analysis circuitry 725 may be unable to provide a clear indication of the identification of the product. In such a case, it may provide an output which causes an image from image acquisition circuitry to be transmitted via the wireless communication network 740 to the control center 708 for further analysis .
The wireless communications network 740 may be any suitable type of wireless network.
It is appreciated that suitable data compression may be employed in all embodiments of the invention for communication of data over the wireless communications network 740 or any other communications network. Control center 708 typically comprises a wireless receiver 748 which outputs via a modem 750 to message analysis circuitry 752. The analysis circuitry 752 transmits to the control computer 758 which provides a grocery bill 710 and may operate an exit gate 712.
In accordance with one embodiment of the present invention, the analysis circuitry 752 may provide an image output to a manned workstation 760, including a display 762, in order to enable an operator to make determinations of whether an element inserted into a shopping cart is an item to be paid for. Inputs provided by the operator are supplied to control computer 758, which may transmit appropriate information in a wireless manner back to a shopping cart.
It will be appreciated by persons skilled in the art that the present invention is not limited to what has been particularly shown and described hereinabove. Rather the scope of the present invention includes modifications and variations of the features described hereinabove which would occur to a person of ordinary skill in the art upon reading the foregoing description and which are not in the prior art.

Claims

C L A I M S
1. Image communication apparatus comprising: an image sensor; an image processor, receiving image data from said image sensor; and an output port providing a processed image data output from said image processor, characterized in that: said image sensor, said image processor and said output port are all embodied on a single integrated circuit chip.
2. Image communication apparatus according to claim 1 and also comprising a memory for storing at least one of said image data and said processed image data, said memory being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
3. Image communication apparatus according to claim 1 or claim 2 and also comprising a modem coupled to said output port for communicating said processed image data, said modem being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
4. Image communication apparatus according to any of the preceding claims and also comprising a wireless transmitter for communicating said processed image data, said wireless transmitter being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
5. Image communication apparatus according to any of the preceding claims and also comprising a wireless receiver, said wireless receiver being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
6. Image communication apparatus comprising: an image sensor; a transmitter, functioning as at least part of a node of an wireless audio communications network, said transmitter being operative for communicating image data from said image sensor along said wireless audio communications network; an automatic communications actuator operative to automatically operate said transmitter to communicate said image data from said image sensor along said wireless audio communications network in response to occurrence of an event.
7. Image communication apparatus according to claim 6 and also comprising: a receiver, functioning as at least part of a node of an wireless audio communications network, said receiver being operative for communicating along said wireless audio communications network.
8. Image communication apparatus according to either of claims 6 and 7 and also comprising a modem coupled at least to said transmitter.
9. Image communication apparatus according to any of claims 6 - 8 and wherein said wireless audio communications network is a cellular telephone network.
10. Image communication apparatus according to any of claims 6 - 8 and wherein said wireless audio communications network is a cellular radio network.
11. Image communication apparatus according to any of claims 6 - 8 and wherein said wireless audio communi- cations network is a pager network.
12. Image communication apparatus according to any of claims 6 - 8 and wherein said wireless audio communications network is a satellite communication network.
13. Image communication apparatus according to any of claims 6 - 12 and wherein said event is an event detected by said image sensor.
14. Image communication apparatus according to any of claims 6 - 12 and wherein said event is receipt of an actuation input from an external source via said wireless audio network.
15. Image communication apparatus according to claim 14 and wherein said actuation input is an interrogation input.
16. Image communication apparatus according to any of claims 6 - 15 and also comprising an image analyzer receiving image data from said image and providing an image analysis output.
17. Image communication apparatus according to claim 16 and wherein said image analysis output is supplied to said transmitter for transmission along said wireless audio network.
18. Image communication apparatus according to claim 16 or claim 17 and wherein said image analysis output is supplied to said automatic communications actuator for indicating an event.
19. Image communication apparatus according to claim 16 and wherein said image analyzer comprises a dynamic event recognizer which recognizes the occurrence of a predetermined dynamic event.
20. Image communication apparatus according to claim 19 and wherein said image analysis output includes a notification of occurrence of a predetermined dynamic event.
21. Image communication apparatus according to claim 19 or 20 and wherein said image analysis output includes an indication of the identity of a participant in a predetermined dynamic event sensed by said image sensor.
22. Image communication apparatus according to claim 21 and wherein the identity of a participant comprises identification of an inanimate object.
23. Image communication apparatus according to any of claims 6 - 22 and wherein at least said image sensor forms part of an image communication assembly including: an image sensor; an image processor, receiving image data from said image sensor; and an output port providing a processed image data output from said image processor, characterized in that: said image sensor, said image processor and said output port are all embodied on a single integrated circuit chip.
24. Image communication apparatus according to claim 23 and also comprising a memory for storing at least one of said image data and said processed image data, said memory being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
25. Image communication apparatus according to claim 23 or claim 24 and also comprising a modem coupled to said output port for communicating said processed image data, said modem being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
26. Image communication apparatus according to any of the preceding claims 23 - 25 and also comprising a wireless transmitter for communicating said processed image data, said wireless transmitter being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
27. Image communication apparatus according to any of the preceding claims 23 - 26 and also comprising a wireless receiver, said wireless receiver being embodied together with said image sensor, said image processor and said output port on said single integrated circuit chip.
28. Image communication apparatus according to any of claims 16 - 22 and wherein said image analysis output provides image data representing part of an image sensed by the image sensor.
29. Image communication apparatus according to claim 28 and wherein the part of the image is selected by the image analysis output based on its image content.
30. Image communication apparatus according to any of claims 16 - 22, 28 and 29 and wherein said image analysis output provides information derived by the image analyzer from said image sensed by said image sensor.
31. Image communication apparatus according to any of the preceding claims and also comprising a data compressor for compressing data provided by said image sensor prior to transmission thereof.
32. A traffic monitoring system including image communication apparatus according to any of the preceding claims wherein at least one image sensor is directed to a traffic scene and traffic information is communicated to a location remote from the traffic scene.
33. A traffic monitoring system according to claim 32 and wherein said image communication apparatus comprises a plurality of image communication units located at disparate locations also comprising at least one local unit operative to receive traffic information from said plurality of image communication units and to transmit said information to a central unit.
34. A traffic monitoring system according to claim 32 or claim 33 and being operative to communicate a count of vehicles at a traffic scene over time.
35. A traffic monitoring system according to any of claims 32 - 34 and being operative to communicating an indication of speed of vehicles at a traffic scene.
36. A traffic monitoring system according to any of claims 32 - 35 and being operative to communicate an indication of the distance separating adjacent vehicles at a traffic scene.
37. A traffic monitoring system according to any of claims 32 - 36 and also comprising a traffic violation report generator operative in response to communication of information derived from an image sensed by said image sensor .
38. A traffic monitoring system according to any of claims 32 - 36 and also comprising a parking space availability indicator operative in response to communication of information derived from an image sensed by said image sensor.
39. An automatic remote meter reading system comprising image communication apparatus according to any of the preceding claims 1 - 31 wherein at least one image sensor is in sensing relationship with an indicator of a meter requiring reading and information derived from said image sensor is communicated to a location remote from the meter.
40. An automatic remote meter reading system according to claim 39 and wherein said image communication apparatus comprises a plurality of image communication units located at disparate locations also comprising at least one local unit operative to receive meter reading information from said plurality of image communication units and to transmit said information to a central unit.
41. An automatic verification system for use with shopping carts comprising: a data entry assembly mounted on a shopping cart; a sensor monitoring entry of objects into said shopping cart; and an indicator coupled to said sensor for indicating entry of objects into said shopping card in the absence of entry of data regarding such objects using said data entry assembly.
42. An automatic verification system for use with shopping carts according to claim 41 and wherein said sensor monitoring entry of objects into said shopping cart is operative also to monitor removal of objects from said shopping cart and said indicator is also operative to indicating removal of objects from said shopping card.
43. An automatic verification system according to either of claims 41 and 42 and wherein said data entry assembly and said sensor both employ a single optical input device.
44. An automatic verification system according to any of claims 41 - 43 and wherein said sensor is operative to provide an image output to a control center for further analysis when the sensor is unable to positively identify a product.
45. An automatic verification system according to claim 44 and wherein said control center includes automatic image analysis equipment as well as human operated image analysis equipment permitting human classification of images which may contain products.
46. An automatic accident reporting system comprising: a vehicle mounted pre-collision sensor for sensing an impending collision; a vehicle mounted collision sensor for sensing actuation of a vehicle air bag; and a vehicle mounted communicator coupled to said vehicle mounted pre-collision sensor and said vehicle mounted collision sensor for communicating the existence of a vehicle air bag actuation event to a remote location and providing an indication of the location of the vehicle at the time of the actuation event.
47. An automatic accident reporting system according to claim 46 and wherein said communicator defines a node on a cellular communications system which automatically indicates the location of the vehicle.
48. An automatic accident reporting system according to claim 45 or claim 46 and wherein said communicator is coupled to a GPS which automatically indicates the location of the vehicle.
49. An automatic accident reporting system comprising: a vehicle mounted pre-collision sensor for sensing an impending collision; a vehicle mounted collision sensor for sensing a vehicle impact exceeding a predetermined impact threshold; and a vehicle mounted communicator coupled to said vehicle mounted pre-collision sensor and to said vehicle mounted collision sensor for communicating the existence of said vehicle impact to a remote location and providing an indication of the location of the vehicle at the time of the vehicle impact.
50. An automatic accident reporting system according to claim 49 and wherein said communicator defines a node on a cellular communications system which automatically indicates the location of the vehicle.
51. An automatic accident reporting system according to claim 49 or claim 50 and wherein said communicator is coupled to a GPS which automatically indicates the location of the vehicle.
52. A system according to either of claims 33 and 40 and wherein said at least one local unit communicates with said central unit via a wireless audio communications network.
53. A parking monitoring system comprising: parking monitors indicating the identity of vehicles parked in predetermined locations; and a billing system receiving information from said parking monitors for charging users parking fees based on said information.
54. A parking monitoring system comprising: parking monitors indicating the presence of vehicles parked in predetermined locations; a payment receipt system for receiving payment from users whose vehicles are parked in said predetermined locations; and a payment verification system receiving information from said parking monitors and from said payment receipt system for enforcement of payment of users parking fees based on information from said parking monitors.
55. A parking monitoring system comprising: a payment receipt system for receiving, via a mobile telephone network, payment from users whose vehicles are parked in predetermined locations; and a payment verification system including a central display displaying information received from said payment receipt system for enforcement of payment of users parking fees in respect of multiple ones of said predetermined locations.
PCT/IL1999/000475 1998-09-04 1999-09-01 Image communication apparatus WO2000014947A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2000569566A JP2002524980A (en) 1998-09-04 1999-09-01 Image communication device
AU54422/99A AU5442299A (en) 1998-09-04 1999-09-01 Image communication apparatus
EP99940449A EP1177675A2 (en) 1998-09-04 1999-09-01 Image communication apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IL12607298A IL126072A0 (en) 1998-09-04 1998-09-04 Image communication apparatus
IL126072 1998-09-04

Publications (2)

Publication Number Publication Date
WO2000014947A2 true WO2000014947A2 (en) 2000-03-16
WO2000014947A3 WO2000014947A3 (en) 2000-12-21

Family

ID=11071937

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL1999/000475 WO2000014947A2 (en) 1998-09-04 1999-09-01 Image communication apparatus

Country Status (5)

Country Link
EP (1) EP1177675A2 (en)
JP (1) JP2002524980A (en)
AU (1) AU5442299A (en)
IL (1) IL126072A0 (en)
WO (1) WO2000014947A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002024994A (en) * 2000-07-12 2002-01-25 Equos Research Co Ltd Method and system for transmitting information

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4684991A (en) * 1983-03-15 1987-08-04 Robert Forchheimer Device for an array of photo diodes arranged in a matrix
US5153421A (en) * 1991-11-04 1992-10-06 Xerox Corporation Architecture for analog and digital image sensor arrays
US5561458A (en) * 1994-01-28 1996-10-01 Polaroid Corporation Electronic imaging module for reversibly converting a photographic camera into an electronic imaging camera
US5893037A (en) * 1994-12-09 1999-04-06 Eastman Kodak Company Combined electronic/silver-halide image capture system with cellular transmission capability

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4684991A (en) * 1983-03-15 1987-08-04 Robert Forchheimer Device for an array of photo diodes arranged in a matrix
US5153421A (en) * 1991-11-04 1992-10-06 Xerox Corporation Architecture for analog and digital image sensor arrays
US5561458A (en) * 1994-01-28 1996-10-01 Polaroid Corporation Electronic imaging module for reversibly converting a photographic camera into an electronic imaging camera
US5893037A (en) * 1994-12-09 1999-04-06 Eastman Kodak Company Combined electronic/silver-halide image capture system with cellular transmission capability

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002024994A (en) * 2000-07-12 2002-01-25 Equos Research Co Ltd Method and system for transmitting information

Also Published As

Publication number Publication date
JP2002524980A (en) 2002-08-06
EP1177675A2 (en) 2002-02-06
IL126072A0 (en) 1999-05-09
AU5442299A (en) 2000-03-27
WO2000014947A3 (en) 2000-12-21

Similar Documents

Publication Publication Date Title
US7104447B1 (en) Parking meters, systems and methods of parking enforcement
KR100347998B1 (en) Apparatus and method for registering a car at the road tollhouse
US6263316B1 (en) Automated process for retailing to a vehicle occupant
US7091880B2 (en) Licensed driver detection for high occupancy toll lane qualification
US7114651B2 (en) Method for control of parked vehicles
US20230127521A1 (en) System for monitoring arrival of a vehicle at a given location and associated methods
US20050088320A1 (en) System for registering and tracking vehicles
KR20060088085A (en) System for expose a unlawful parking of a handicapped person's private parking zone
US20040037469A1 (en) Object-oriented control of information and advertisement supports
US20180374278A1 (en) Payment terminal, management system of a product and/or associated service, and method for collecting the corresponding data
JP2915748B2 (en) Toll collection system for toll roads
KR101259875B1 (en) Getting off system in bus and operating method thesame
CN100456334C (en) Interactive monitoring system of integrated vehicle chip card
WO1996038819A1 (en) A device and a system, carried by a vehicle, for remote communication in an establishment
Murdan et al. Low‐cost bus seating information technology system
US11455838B2 (en) System for monitoring arrival of a vehicle at a given location and associated methods
JP2004133616A (en) Toll collecting/receiving system and toll collecting/receiving method
WO2000014947A2 (en) Image communication apparatus
CZ20033527A3 (en) Identification system for verifying an authorization for access to an object, or use of an object, in particular a motor vehicle
JP3089081B2 (en) Toll collection system
JPH08180229A (en) Charge collecting system
KR20090001774U (en) . Toll Charging System and Use Method
JP2000030089A (en) Automatic ticket examining device
JPH08235490A (en) Automatic toll collecting system
KR100374390B1 (en) System for a parking charge accurate function

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AL AM AT AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ CZ DE DE DK DK DM EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AL AM AT AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ CZ DE DE DK DK DM EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
ENP Entry into the national phase

Ref country code: JP

Ref document number: 2000 569566

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 1999940449

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1999940449

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWE Wipo information: entry into national phase

Ref document number: 09786525

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 1999940449

Country of ref document: EP