WO2006046234A2 - System and apparatus for multi media surveillance - Google Patents

System and apparatus for multi media surveillance Download PDF

Info

Publication number
WO2006046234A2
WO2006046234A2 PCT/IL2005/001108 IL2005001108W WO2006046234A2 WO 2006046234 A2 WO2006046234 A2 WO 2006046234A2 IL 2005001108 W IL2005001108 W IL 2005001108W WO 2006046234 A2 WO2006046234 A2 WO 2006046234A2
Authority
WO
WIPO (PCT)
Prior art keywords
mss
video
driver
sub
network
Prior art date
Application number
PCT/IL2005/001108
Other languages
French (fr)
Other versions
WO2006046234A3 (en
Inventor
Yoram Segel
Original Assignee
Magal Security Systems Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magal Security Systems Ltd. filed Critical Magal Security Systems Ltd.
Publication of WO2006046234A2 publication Critical patent/WO2006046234A2/en
Publication of WO2006046234A3 publication Critical patent/WO2006046234A3/en

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/14—Central alarm receiver or annunciator arrangements
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19606—Discriminating between target movement or movement in an area of interest and other non-signicative movements, e.g. target movements induced by camera shake or movements of pets, falling leaves, rotating fan
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19608—Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19613—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19654—Details concerning communication with a camera
    • G08B13/19656—Network used to communicate with a camera, e.g. WAN, LAN, Internet
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19665—Details related to the storage of video surveillance data
    • G08B13/19667—Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19665—Details related to the storage of video surveillance data
    • G08B13/19676—Temporary storage, e.g. cyclic memory, buffer storage on pre-alarm
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19678—User interface
    • G08B13/19682—Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19678—User interface
    • G08B13/19686—Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19678—User interface
    • G08B13/19689—Remote control of cameras, e.g. remote orientation or image zooming control for a PTZ camera
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19678—User interface
    • G08B13/19691—Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
    • G08B13/19693—Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound using multiple video sources viewed on a single or compound screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways

Definitions

  • the present invention relates to security systems and apparatus. Specifically, embodiments of the present invention relate to interactive multi surveillance security systems and apparatus, capable of functioning in an integrated fashion without requiring a central server.
  • Typical multiple-unit security systems that enable multi-purpose surveillance often have centralized architectures, for example, a control room from which the security system may be operated and controlled.
  • each sensor or input device generally requires a separate computing unit to process recorded data and communicate with a main controller.
  • each unit In systems where there are multiple input units, each unit generally connects to the main controller.
  • the main server located at the control room. Further such architectures are typically plagued by integration problems, excessive connection requirements, engineering challenges, expense and size of equipment, and zealous maintenance of the equipment.
  • today's security systems may require one or more of the following components: Digital recorder, Storage unit, Video Matrix, Quad splitter, Fiber optic transceivers, PTZF console controller, Video motion sensor, User workstation, Network accessories (hubs, switches and routers), Alarm switchboard, Intercom, Videoconference system, Panic buttons.
  • Digital recorder Storage unit
  • Video Matrix Quad splitter
  • Fiber optic transceivers PTZF console controller
  • Video motion sensor User workstation
  • Network accessories hubs, switches and routers
  • Alarm switchboard Alarm switchboard
  • Intercom Intercom
  • Videoconference system Panic buttons.
  • Fig. IA is a schematic illustration of a Multimedia Surveillance System and a plurality of connected features, according to some embodiments of the present invention
  • Fig. IB is a schematic illustration of a Multimedia Surveillance System, showing a plurality of internal components, according to some embodiments of the present invention
  • Fig. 2A is a schematic illustration of three sub-systems in a Multimedia Surveillance System, according to some embodiments of the present invention.
  • FIG. 2B is a schematic illustration of various data stream paths in a Multimedia Surveillance System, according to some embodiments of the present invention
  • Fig. 3 is a schematic illustration depicting an example of a video inspection implementation using a Multimedia Surveillance System, according to some embodiments of the present invention
  • Fig. 4 is a graphical illustration of a Multimedia Surveillance System, showing a plurality of external sockets, for connecting a plurality of external components, according to some embodiments of the present invention
  • FIGs. 5 A and 5 B are schematic illustrations of a Multimedia Surveillance System network topology, according to some embodiments of the present invention.
  • Fig. 6 is a schematic illustration of a video clip player implementation using a Multimedia Surveillance System, according to some embodiments of the present invention
  • Fig. 7 is a graphic illustration depicting an example of a graphical user interface, according to some embodiments of the present invention.
  • an Interactive Real Time Multimedia Surveillance System (herein “Multimedia Surveillance System” or “MSS”) is provided, which enables interactive real time multimedia surveillance for security applications and general-purpose closed circuit television (CCTV) systems.
  • the MSS may include multiple input units, to enable inputting of any type of existing sensing data, and may enable multiple users to simultaneously view, analyze in real time, transmit, respond, record, playback, search, manage, debrief and archive etc. data in a secured and redundant manner.
  • MSS may perform independent processes including: video/audio compressing, audio/video transmission, digital recording of audio, video, and data, content analysis algorithms (e.g., professional video motion detection), digital/analog acquisition, data transfer over multiple network types (LAN, WAN) independent on the physical connection (e.g., lObaseT, Fiber Optic, ADSL, PSTN, Cellular, wireless, satellites etc.), Network Management (e.g., Hacker protection, Find cut position, Redundant routs, Bandwidth control etc.), operating with network accessories (e.g., Switches, Routers etc.), synchronized playback of video and audio, digital audio and video switching, videophone, Intercom usage, Announce System usage, Access Control, Building Management, Redundant units usage, Hot backups, and integration to external computerized systems etc., or combinations thereof. At least these functionalities or combinations thereof may be included in a single box or apparatus, for example, of two 19" Units.
  • content analysis algorithms e.g., professional video motion detection
  • the MSS may include all the functions and components of a CCTV system and multimedia surveillance system into a single box and may reduce the integration time required to achieve a complete modular solution, reduce the uncertainty of pre-planning, reduce the price of the overall surveillance system and network costs, minimizing installation time and cost of cables/fibers, providing full data and network redundancy (e.g., no single point of failure), providing shared resources over a distributed topology, creating tailor made modules for customer needs, and other suitable functions.
  • multiple MSSs may be distributed around one or more sites.
  • Fig. IA illustrates a MSS and a plurality of connected features, according to some embodiments of the present invention.
  • a MSS may be connected, for example, to various surveillance components which are the building blocks of integrated security projects.
  • a MSS 100 may be connected to input units including microphones 101, cameras 103, fence sensors 104, light source(s) 105, mouse 106, keyboard 107, remote control 109 etc., and may be connected to output units including video monitor 111, VGA 113, speakers 115 etc.
  • Fig. IB is a schematic illustration of a MSS 100, showing a plurality of internal components, according to some embodiments of the present invention.
  • MSS 100 may include, for example, one or more of a workstation, videophone, intercom, audio recorder, server, VMD, digital recorder, PZTF controller, video switcher, Quad Splitter, Ethernet Switch, video splitter, video recorder, alarm signal unit, fiber optic transceiver, call center, Video Transceiver, and data storage.
  • MSS may include other components or combinations of components that may enable, for example, the functionality that may be implemented by one or more of a Digital recorder, Storage unit, Video Matrix, Quad splitter, Fiber optic transceivers, PTZF console controller, Video motion sensor, User workstation, Network accessories (Hubs, Switches and routers), Alarm switchboard, Intercom, Videophone system, Panic buttons etc. Other components or combinations of components may be used.
  • MSS 100 may include an Input sub-system 205, an Output sub-system 215, and a Processing sub-system 225.
  • the input sub- system 205 may include, for example, one or more input streams and one or more DSP encoders to encode the input streams.
  • Input sub-system 205 may include video inputs, for example cameras 103, audio inputs, for example microphones 101, serial transmission, for example RS232, analog/discrete input sources, and other suitable I/O streams.
  • the input data for example signals, may be compressed for streaming and recording purposes.
  • the input sub-system may include, for example, 8x TTL Inputs, 8x Dry Contact
  • the input sub-system 205 may include, for example: 2x USB ports, PS/2 mouse, PS/2 keyboard, Removable H.D, and VGA adaptor.
  • Software modules may be included to enable Compression, for example, MPEG4 4CIF / Dl 25 Fps, H.263 CIF 25/30
  • Fps CIF, 2CIF and Dl resolution
  • Programmable Bit rate Frame rate and Resolution
  • Variable sub zone resolution and frame rate Software applications may include, for example, Outdoor Video Motion Detection and tracking, User Work Station Digital Recorder (Audio and Video), Video and Audio Switcher, Video Quad, Intercom, Videophone, Loudspeaker System, Answering Machine, Communication Infrastructure Services, Video, Audio, TTL and RS232 Server.
  • Other components, numbers of components, and combinations of components may be used.
  • the output sub-system 215 may include, for example, one or more output streams and one or more DSP Decoders to decode output data.
  • Output sub-system 215 may receive compressed data from the PC section, decode the data according to its type, and transfer the data to the video monitors 111, speaker 115, or other output ports.
  • the input and output sections may be built as clusters of DSPs, which may encode and decode the data streams.
  • these DSPs may be used as a platform for sophisticated algorithms such as Video Motion Detection or other suitable algorithms.
  • Other output components or combinations of components may be used.
  • the Processing sub-system 225 may include, for example, a processor and suitable memory, network and communication components.
  • Processing sub-system 225 may acquire compressed data streams and may forward them to one or more selected destinations. For example, data may be recorded in local memory (e.g., on a local disk), and subsequently transferred via a network to another MSS or to an external PC. The data stream may additionally or alternatively be transferred to the output section for decoding and display.
  • the PC sub-system 225 may serve as a platform for the main management application, including the user workstation.
  • the PC sub-system 225 may further include Management Software modules, for example, Distributed SQL database (No central Server), Changeable parameter set per item (Trigger and Calendar), Programmable Macro, Programmable Turing (Switch sources to targets), Recorders, players and archive management, Virtual Sensors (Logic combinations), Graphic user interface (GUI) etc.
  • the GUI may include, for example, predictable menus, colored maps, multi languish Log event, and Displays of MSS topology maps etc.
  • the PC sub-system 225 may further include item software modules (e.g., drivers), for example, item application software, including: CAM - Camera encoder driver; MIC -
  • item software modules e.g., drivers
  • item application software including: CAM - Camera encoder driver; MIC -
  • Microphone encoder driver SPK - Speaker decoder driver; MON - Monitor decoder driver; TTLIN - Dry contacts inputs driver; TTLOUT - Dry contact output driver; ANAIN - Analog inputs driver; ANAOUT - Analog outputs driver; FENCE - Fence triggers driver; PTZF - Pan, Tilt, Zoom Focus control driver; USR - Users management driver; VMD - Video Motion and Detection algorithm driver; REC - Digital recorder driver; PLY - Video and audio player driver; TRK - Tracker algorithm via GPS driver; DMSI - Digital Matrix Switch for I/O driver; DMSS - Digital Matrix Switch for Serial RS232 driver; TUR - Global Macro driver; UWS - User Workstation driver; VOB - Virtual Object driver; POI - Point Of Interest - Group of item management driver; and EXT - External.
  • the PC sub-system 225 may further include audio components, for example, 8x Microphone/Line Inputs, PC Microphone and Auxiliary Inputs, and Speaker Output. Other audio components, numbers of components, and combinations of components may be used.
  • the PC sub-system 225 may further include video components, for example, video inputs, video outputs, VGA output, and graphic overlays.
  • video components for example, video inputs, video outputs, VGA output, and graphic overlays.
  • an MSS may include 8x NTSC/PAL Video Inputs (AV/S-Video), 8x NTSC/PAL Loops back Video Outputs (AV), NTSC/PAL Video Output, providing a display of up to 4 Dl streams simultaneously (AV/S- Video), VGA Output, for example, to display of up to 4 Dl streams simultaneously, and 2x Colored Graphic Overlays (704x576x4).
  • Other video components, numbers of components, and combinations of components may be used. Any professional would understand that the video capabilities might include also the ability to convert PAL to NTSC and vise versa and also to get PAL and to output from one port PAL and from the other NTSC.
  • the PC sub-system 225 may further include communication components, for example, Support Close Ring Network topology, 2x Fiber Optic transceivers (Fast Ethernet Switch), 4x RJ-45 (Fast Ethernet Switch), RJ-45 (Fast Ethernet Host Nic), 2x Serial port (COMl, COM2), ADSL modem. Other communication components, numbers of components, and combinations of components may be used.
  • Communication components for example, Support Close Ring Network topology, 2x Fiber Optic transceivers (Fast Ethernet Switch), 4x RJ-45 (Fast Ethernet Switch), RJ-45 (Fast Ethernet Host Nic), 2x Serial port (COMl, COM2), ADSL modem.
  • Other communication components, numbers of components, and combinations of components may be used.
  • the PC sub-system may further include peripheral devices, for example, fences and such fences sensors (currently known under the trade marks of the applicant as DTR, Yael, Barricade, Intelliflex etc.), PTZF camera or other suitable peripheral devices. Other peripheral devices or combinations of devices may be used.
  • peripheral devices for example, fences and such fences sensors (currently known under the trade marks of the applicant as DTR, Yael, Barricade, Intelliflex etc.), PTZF camera or other suitable peripheral devices.
  • Other peripheral devices or combinations of devices may be used.
  • MSS 100 may enable streaming of data from sources (e.g., microphones 101, video cameras 103, video players etc.) to one or more targets or destinations (e.g., monitors 111, speakers 115, video recorders etc.).
  • An input source for example a video camera 103, microphone 101, RS323 input, PPL in, analog in, a user, a video player etc., may send a data stream to multiple targets, for example a monitor 111, speaker 115, PPL out, analog out, RS232, video recorder etc., by initially streaming the input data to the MSS memory exchange 117.
  • Each data type may be stored in a separate memory layer.
  • the memory exchange may transfer the data to a local disk (e.g., hard disk) 119, and once such data is stored, the memory exchange may upload the data to a network 121, and/or may communicate the data to one or more targets.
  • a local disk e.g., hard disk
  • a video player for example, a clip of which may be viewed in various ways, re-winded, forwarded, edited etc., it may be logical to send a data stream containing such a clip to one target only.
  • MSS 100 may have an automatic player system that will use a free player to upload a video file to a target once requested.
  • MSS 100 may have a manual player system that may use a pre-defined player to play a designated clip. For example, a player may be designated to play a particular clip every hour, for example, an alert or message played in a loop. In this way, MSS 100 may use automatic players to play clips generated by alarms etc., but may additionally have dedicated players to play clips in loops. For example, by defining a player as manual but not specifying particular clip names with a player, the player may, when activated, play the newest clip recorded in a memory in a loop. In some embodiments a MSS may have, for example, 64 players, or any other number of players.
  • MSS 100 may include Video signal features.
  • each video channel may accept composite video signals to EIA
  • Standard RS-170 and Standard M/NTSC 525-line/60 Hz
  • Standard PAL 625-line/50
  • the nominal signal may be 1 V p-p into a 75 ⁇ termination, with a signal to noise ratio of at least 50 decibels.
  • Each video input may use chassis-isolated, BNC type connectors or S- video connectors.
  • the MSS may obtain all video synchronization from the composite video input signals. There may be no requirement for synchronization between channels.
  • the MSS may accept and monitor eight (8) TTL inputs with built in pull-up resistors and 8 analog inputs (-5V to 5V). Other video signal features or combinations of features may be implemented.
  • MSS 100 may include Video Input/Output features.
  • the MSS may provide the following video inputs and outputs at the following levels at one or more connections: Input: 30/25 FPS, Dl resolution at 50Kbps till 4Mb ⁇ s (may also support CIF and 2CIF); Analog Video Output: 30/25 FPS, Dl resolution at 50Kbps till 4Mb ⁇ s (may also support CIF and 2CIF); VGA Video Output: 30/25 FPS, 2CIF resolution at 50Kbps till 4Mb ⁇ s (may also support CIF); Full motion (25/30 fps) Quad display on analog and VGA monitor: Up to 8 video streams simultaneously at 200Kbps till 32Mbps.
  • the MSS may provide at least 2 colored graphic overlays (255 x 340 x 4) on Dl display.
  • the MSS may support dynamic bit-rate throughput of 50Kbps-48Mbps per unit.
  • the overall video latency may be less then 500msec.
  • Other video input/output features or combinations of features may be implemented.
  • MSS 100 may include Video Switching features.
  • the MSS may employ virtual audio and video connection capabilities for unlimited connection combinations.
  • the built-in Matrix switcher may provide PTZF control over the network with limited delays (80 - 250 ms). Programmable tours for switching between cameras and color overlay over analog and VGA displays (full or quad).
  • the MSS may generate alarms when there is a video fail or when a camera is covered.
  • the built-in alarm-tour may enable the simultaneous presentation of alarm pictures and video clips of multiple events base on the shared resource algorithm. Other video switching features or combinations of features may be implemented.
  • MSS 100 may include Output Contacts. For example, eight dry contacts (NO/NC) and 8 analog outputs (-5V to 5V). Other numbers or types of contacts may be used.
  • MSS 100 may include audio inputs. For example, the MSS may provide 8 audio inputs with a sample rate of 8Khz, 8 bps, an input impedance of 15Kohm, an output impedance of 620 ohm, a bandwidth of 30Hz - 4KHz and a microphone gain of 25 MSS. Other numbers or types of audio inputs may be used.
  • MSS 100 may include audio connectors.
  • an MSS may include 8 x PLL microphone inputs (Voice over IP); 8 x PLL line inputs (Voice over IP); 1 x PLL PC Microphone (known by the trade mark SoundBlaster); 1 X PLL Auxiliary Input (SoundBlaster); 1 X PLL Speaker output (Mix between Voice over IP and SoundBlaster).
  • MSS 100 may include a storage feature. For example, two or more 500 Gbyte, IDE hard disks or other H.D. type connection such as Serial ATA USB etc. may enable recording a frame rate of 240 FPS at a resolution of Dl, per unit on a bit stream of 32 Mbps for 125 hours of continuous recording. The streams may be received from local components or remote components via a network. Other alarm storage features may be used.
  • MSS 100 may provide, for example, the following User Workstation and Security Management System (UWSMS) features: providing the operator with the state of the sensors on the site (e.g., alarm state, neutralize, etc.); enabling the operator to activate the sensors (e.g., reset an alarm, neutralize a sector, etc.), optionally remotely; enabling the operator to control the video flow on the site (e.g., determine on which monitor which camera will be displayed); enabling the operator to carry out debriefing, play clips from the archive and more; providing audio messages and instruction lists on how to act in case of an alarm; providing programming of the site components (e.g., setting each sensor characteristics) during system operation.
  • UWSMS User Workstation and Security Management System
  • a graphic management and control method may be provided to enable managing of a security site with a large number of components (e.g., cameras, monitors, sensors, etc.) to provide rapid access to some or all of the site components, and receiving indication of location, state, and the calibrated parameters.
  • components e.g., cameras, monitors, sensors, etc.
  • a MSS unit may be operated as a user workstation, and/or may be used to manage a network (e.g., cameras, sensors, monitors, other MSS, user workstations, users, etc. that belong to one or more MSS units) according to user password.
  • the number of user workstations operating simultaneously may be increase up to 128 users by adding new unit.
  • the user workstation may include, for example, maps, tables, direct access buttons, operation menus, user instructions, icons and more.
  • the UWSMS may include a "Foreseeing desired menu" or "predictive" characteristic, for example, by displaying a changing menu according to user activity, while "foreseeing" what action the user may likely execute.
  • the menus may be relatively small and the user may not have to scroll through long lists in order to find desired action.
  • Selection of a sensor may display the set of commands that may be used for the specific sensor, selection of an alarm line from the alarm table, for example, may display the actions that may be carried out, for example, reset, play clips and more.
  • the user may generally set a default operation for UWSMS features, for example, to determine what will happen when a function is chosen, for example, double-clicked on. For example, a user may define that when a camera icon is double clicked on, it may display its image on a default monitor.
  • the UWSMS may include customizable Types/items/status. For example, there may be numerous (e.g., 7) different types of item status, depicted according to different colors, one for each type of status.
  • Light gray may indicate an inactive status (e.g., hardware does not exist); Dark gray may indicate a disable status (e.g., hardware exists but is not available); Green may indicate an active status; Red may indicate an intruder alarm status; Yellow may indicate a malfunction status; Black may indicate a blocking status; White may indicate a system message; Brown may indicate General alarm status; Blue status may indicate that the alarm cause has disappeared. Other statuses or color indications of statuses may be used.
  • Each item in the UWSMS may be identified by at least the following three parameters: MSS number; Type number; ID number.
  • the MSS number may depict in which of the MSS units the item is located.
  • the type number may depict what type the item is (CAM, MIC, USR etc.) and the ID number may be the number of the item inside the MSS unit, e.g. If the MSS unit has 8 cameras then the ID may very from 0 to 7.
  • Global actions are actions that may have to be carried out on all the MSSs in the UWSMS at the same time.
  • the UWSMS may include some global actions such as, for example, Touring.
  • a Load Set Table (LST) may provide a list of programmable features (e.g. brightness and contrast for a camera) and/or a group of item features called a Sub-Set for every item. Every item may have many different Sub-Sets where each set may be loaded (e.g., attach the Sub- Set to the item) manually by the user or automatically by the LST.
  • a Global-Set may be a list of lines that specifies which item is needed to have a new Sub-Set and what Sub-Set it may be (e.g.
  • the Global-Set may be Day, Night, Clouds mode, Switch of smoke detection etc.).
  • the LST algorithm may include details of when a certain Global-Set is brought on line, for example, according to a certain schedule (e.g., from a calendar) or according to a certain event (door was opened) etc.
  • An item activated may be according to its Sub-Set, which may be included in the Global-Set that was loaded via the LST.
  • the LST belongs to a particular MSS, and may operate independently so that each MSS is its own server.
  • Each processor e.g., Intel's Pentium
  • the parallel LST algorithms may be executed at the same time because the NTP server may synchronize all of the MSS units.
  • MSS 100 may include Virtual Objects (VOBs), which may be virtual items that describe underlying hardware and states of related items, for example, neighboring MSSs, cameras etc., but have no actual hardware. VOBs may therefore function as shortcuts or pointers to other items to describe the states of these items, and may influence the behavior of these items. Every item may have multiple states (e.g., security status defined by colors, as described in detail herein), and MSS 100 may provide different logical sentences or combinations of sentences to define these states and determine behavior of various items in
  • VOBs Virtual Objects
  • Every item may have multiple states (e.g., security status defined by colors, as described in detail herein), and MSS 100 may provide different logical sentences or combinations of sentences to define these states and determine behavior of various items in
  • MSS 100 For example, a logical statement may be, "if camera 22 has color brown AND recorder 32 is NOT yellow THEN VOB is black.”
  • a timer may be provided by which a logical sentence may incorporate a time dimension. For example, "VOB is red IF door is left open for x seconds".
  • a VOB may have an alarm list that may be used as a trigger to start a recording, and/or to be marked as a trigger to the Loading Set Table.
  • a VOB may be configured to generate an alarm only if there is an alarm from a monitored area (e.g., a security fence) together with an alarm from a VMD system.
  • the VOB may allow serving as trigger to the LST. For example, the minimum size for detection of the VMD system may be changed.
  • Examples of objects that may be VOBs in MSS 100 include: CAM, PTZF, POI, UWS, DB, MIC 5 VMD, TTL, DMSS, DMSI, AIN, OUT, FNC, TRK, EXT, VOB, USR etc.
  • every VOB State has one or more logical sentences (e.g., 5 states will have 5 sentences).
  • the VOB checks the respective logical sentences.
  • the first logic sentences state that returns a TRUE value may become the new VOB state.
  • the states may have a 'Time' field in the logical sentences database that serves as a timer.
  • the fields may define the time it takes for the system to update the VOB states.
  • the system may scan the VOB according to the order of the VOBs in the database to update their states.
  • a child object (members of VOB) may not be used outside of the VOB as a stand alone for the users that the VOB belong to, but a child object may be used as stand- alone for other users which have not used it inside the VOB.
  • the child objects configuration setup may be changed by the Loading Set Table. Child objects may or may not blink on an enhanced map during alarm interrupts.
  • Commands may be performed on child objects, only if the user selects the VOB and then, from the information table, selects the child object. Choosing one of the lines in the information table may display, in the outlook menu, the child object menu, and the child object's position on the map. If the child object is one of the "drag and drop" objects, such as camera, the user may be able to drag the child object and to drop it on a selected target.
  • VOB states may include, for example: Disabled, Alarmed, Operative, Inactive, and Malfunctioned.
  • a VOB may have unique icons and sounds. All state changes and actions performed on child objects may be logged.
  • Child object State is any of the child object available states.
  • the child object states may be difference from the VOB states.
  • the 'Time' defines the minimum duration of the state. If 'Time' ends and the logic sentence state is still 'True', then the VOB state will remain unchanged until the next child object state change.
  • VMDl (Disable) return TRUE only if the VMDl is not in Disable state. Any other states will return TRUE.
  • MSS 100 may include Points Of interest (POIs), which are sub-classes of a VOB, and relate to items in MSS 100 and have influence over the behavior of these items.
  • POIs Points Of interest
  • this command may be generated on related items or groups of items. For example, if a POI is displayed on a monitor this may cause, for example, camera 1 to connect to monitor 1 and may likewise cause all cameras to connect to their default monitors.
  • pressing on the POI may open its slide (map with all of his objects) and the Information table may show all of the alarms that belong to the POI child objects.
  • the object name in the Information table line may be the child objects names, while the object name in the VOB it may be the VOB name.
  • POIs may have different usages, for example, grouping together some objects that are physical close to each other (e.g., sensors in the same room). VOB may be used to group together some objects that can be far from each other but have some logical connection between them.
  • the MSS may include Graphic Layer software, which may have the capability to display selected icons that have a common denominator on the maps. Such a filtering of icons may enable, for example, simple operation of a site with many icons. For example, a graphic layer with only the alarmed icons may be selected for display.
  • the MMS may include software for enabling managing a large number of users, for example, with different authorizations, where the different authorization means that a different group of activities may be implemented by the user.
  • Each user may receive a personal configuration definition that includes a list of dedicated authorizations per user. For example, not every user may be authorized to neutralize sensors.
  • a login password may be requested.
  • the entry of a suitable user name and password may allow the user to enter the system. Actions executed may be recorded by the system.
  • the MSS may include Video Motion Detection (VMD) software (e.g., DTS-1000, manufactured by the applicant).
  • VMD Video Motion Detection
  • DTS-1000 manufactured by the applicant
  • motion detection based on the VMD software, or other VMD systems, may be used.
  • the MSS may have, for example, 25,334 detection cells per camera; a processing rate 15 fps to 25 fps per camera; and 3D operation (e.g., topographical map).
  • the MSS software may use detection and masking, for example, to detect holes in the ground, hills, structures etc.
  • a detection area may be more than 3,000 square meters (30m X 100M), or may have other dimensions.
  • a dedicated algorithm for harsh external conditions may be used, for example, that includes advanced filters for filtering out rain, camera post movement, shadows, clouds, tree and bushes movement, disregarding birds and small animals etc.
  • Algorithms may also be used to define one or more selected areas of Interest, for example, by defining a particular area where monitoring may be executed, and one or more particular areas where monitoring may be ignored.
  • the detection software may provide simultaneous handling of multiple events, for example, simultaneous detection of six intruders for each camera.
  • the software may enable marking of each separate event, for example, each intruder, in a different color.
  • the software may enable different detection parameters for each camera to be separately defined, for example, to select the speed, direction, size etc. of a camera.
  • a group of parameters may be able to be changed separately according to a calendar, for example, to detect different event types during the day and night respectively (e.g., people may be able to be detected by day and trucks by night).
  • the MSS may be configured to enable a different sensitivity threshold to be set for each area in an image. Additionally or alternatively a different focus threshold may be set for each area in the image, to filter out constant movements in the image.
  • This characteristic may enable, for example, detection and an intruder on the background of moving bushes in the wind, using, for example, VMD processing on recorded video.
  • This characteristic may enable smart searches, for example, showing all the cases where a door was opened; saving the intruder's route in a manner that is synchronized with the recorded clip, for example, to enable viewing of a recording in order to display or remove the movement route (e.g., if the route is covering vital data, it may be removed); storing of a very high-quality-briefing images of the exact moment of the alarm, which may be used as evidence in the courtroom; surgical viewing and algorithm performance during detection activity. For example, a technician window and interim images with various filters may be provided.
  • the software may enable the activation of one or more algorithms on each image separately as if they are fed continuously, and may then analyze the detection results.
  • the principle of the VDM 's algorithm is that the system studies the background and any changes in comparison to a known background consider being a suspected target.
  • the system analyses the target behavior namely - the system analysis the target's pattern of movement.
  • the algorithm one can defined a list of arbitrarily areas (e.g., A, B, C, D).
  • the VMD could be global namely based on global coordinates. Therefore, enabling the system to acquire target through first camera and transmit the target to a second camera for farther tracking.
  • the global coordination basis of the system provides also the capability to present the target path on a video output and on the site map.
  • the system enable the allocation of a PTZF camera to toward the target in a manner that the target appear in the center of the picture and navigate the camera movement while tracking the target as it appears constantly in the center of the picture.
  • the system enables first alarm upon appearing of a target but also provide the operator for marking the target as a legitimate one (and therefore canceling any farther alarms and substantially reducing the falls alarms while the now "friendly" target continue movement between the different cameras).
  • the system provide for the operation of up to 32 VMD different channels on the same camera, in a manner that enable different parameters analysis of the same target (e.g., one channel for target crawling detection, second channel for cloud detection, third channel for static subj ects)
  • the MSS may enable data recording using multiple modes for each input device, e.g. camera, and may enable operation in multiple modes.
  • a video recorder VCR
  • a digital recorder may generally have an individual recorder unit per input video source and a player unit that may play data to unlimited number of players
  • a MSS may be used for recording from one or more sources and/or playing to one or more destinations.
  • a MSS may enable recording channels independently of the number of inputs sources (video and audio).
  • each MSS there may be multiple recorders (e.g., 64) that may be divided to sub groups where some of them may be used as local recorders, and others may be used to generate backup clips of other recorders from other MSS units.
  • a MSS network may be used, for example, to record the same source on multiple clips, where each clip has different features such as frame rate, bit rate, size etc.
  • the MSS may include Digital
  • the recording format may be MPEG4/H263/H264
  • the storage may be shared and distributed storage (e.g., each MSS may have its own movie archive that may allow each camera to have a storage space that may be locally controlled).
  • the cameras may be local ones or located anywhere on the network, and the MSS may be capable of simultaneous recording and viewing of live video or recorded movies.
  • the MSS may be capable of dynamic change of recording, for example, up to 30 fps at a resolution of Dl (4CIF) per camera.
  • the MSS may be capable of dynamic allotment, for example, up to 8Mbps per camera.
  • the MSS may include online storage, for example, a 250 GB removable hard disk may be installed in the MSS unit that may enable recording at a frame rate of 30 fps at a resolution of 4 CIF, per camera at a Bit stream of 0.5 Mbps for 142 hours of continuous recording.
  • the recording configuration may be set for each camera separately. Multiple recording may be performed (on the same unit or on different units) for the same camera at the same time with different recording parameters.
  • the recording system may support multiple modes of operation, optionally for each camera or alternative input device.
  • each camera In a manual mode of operation, where the operator may initiate the recording, each camera may have a maximum recording time set, such that when this time ends, the system may stop recording.
  • the recording system may support lapse mode of operation, where each X frame may record a Y frame. Each camera may have a maximum recording time set which may be managed in a loop.
  • the recording system may support event mode of operation, where an event may generate predetermined alarms and system events that may cause the recording of a clip with a preset length. The number of clips may be predetermined and may be FIFO managed.
  • the recording system may support delay mode, wherein recorded movies may be continuously viewed even while recording new clips.
  • a movie may be recorded in a loop, thereby enabling the display of the clip with a delay to the real-time, as can be seen with reference to Fig. 3.
  • This may enable, for example, seeing an event after it has happened, to help a security personnel focus on the event and distinguish changes at a target in two or more time intervals.
  • the delay may enable a security personnel to see an object (e.g., an image of a person) at two moments simultaneously (e.g., see the person live, and see the clip of the same person x seconds before, enabling detection of changes to the object.
  • two or more cameras may be used to record in multiple events. For example, one camera may record a location in delayed mode, and a second camera may record a location in event mode. Security personnel may be able to utilize the video data from both these modes simultaneously.
  • the MSS may record clips all the time in a loop, at a low frame rate.
  • the system may continue to record for a certain period a post alarm, and may then close the clip and may start to record a new clip (pre/post alarm recording).
  • the recording system may support delay mode of operation, where a continuous viewing of recorded movies may be provided, while recording new clips. The movie may be recorded in a loop. This option may enable display of the outside world with a selected delay relative to the current-time.
  • the MSS may include Debriefing and Video Clip Playback features, including, for example, multi-user operation, where the number of simultaneous viewers may be unlimited (depending on network bandwidth) and each one may have his/her own player control.
  • Locating clips in the database may be enabled according to selected criteria, for example, name, hour date, alarm type, sensor or recording type.
  • Clips may be played on a VGA monitor and/or external video monitor in, for example, one or more of the following configurations: full-screen, in place of site map, monitor divided into quarters, where each quarter can be selected separately. There may be full control of play back mode, including forward, reverse, fast forward, fast reverse, stop, freeze frame and more.
  • the system may enable playing in a continuous loop, navigating in the recorded clip, viewing of an event in the recording that occurred at a selected hour.
  • the system may enable playing the same clip (with one control) simultaneously on a number of monitors around the site, may enable connecting a player to the VMD in order to carry out post search on a recorded clip, may enable connecting a player to a remote unit in order to edit recordings or duplicate a recording, and/or may provide automatic operation of a player, dependent on system events (e.g., during an alarm, the alarm clip can be viewed in a loop mode).
  • the MSS may include Closed Circuit TV (CCTV) features including, for example, compression using MPEG4 format; full Dl resolution at a rate of 30 fps NTSC per channel; a setup including a dynamic determination option of compression characteristics, according to calendar alarms (e.g., frame rate, bandwidth, resolution and more); transmission using communication protocols for an Ethernet network (e.g., TCP/IP, UTP, and RTP); full Dl display at a rate of 25/30 fps per channel, with, for example, a Dl encoder on each monitor or simultaneous display of four (4) cameras at a rate of 30 fps for each camera for each one of displayed at CIF resolution on each monitor; a color graphic generator on the video signal at a resolution of Dl that may enable an overlay writing, display areas of interest and show tracking of intruders movements etc.
  • CCTV Closed Circuit TV
  • the CCTV functionality may enable a different display to be viewed on each monitor quarter (quad display).
  • the overlay writing may be independent of the video signal and may not influence video quality.
  • the writing may be removed or added when required.
  • the CCTV functionality may further include a duplication of sources, enabling an operator to view the same camera input and various monitors simultaneously.
  • a further CCTV function may be video touring, wherein cameras may be dynamically attached to monitors, according to a preset scenario, during normal conditions or when an alarm is generated.
  • the MSS may include installation features, for example, mounting the basic MSS chassis using rack mounting or on tabletop; accommodating all power, alarm, video and control cabling at the rear of the MSS chassis; enabling the basic MSS chassis may operate from a power source such as 105 - 125 VAC, 60 Hz or 210 - 250 VAC, 50 Hz; enabling the MSS to operate within a range of environmental conditions, including temperatures between 5° and 50° C (41° and 112° F), relative humidity levels between 20% and 85%, and non-condensing environments. The MSS may operate in other environmental conditions.
  • the MSS may include maintenance functional features, for example, removal and replacement of MSS Boards, by removing the cover of the chassis; limited failure effects, since the failure of one camera channel may not have any effect on the other camera channels within the MSS chassis; scheduled maintenance, for example, to verify the time and date display, clean the lens or the front glass of the camera housings, remove any new grown vegetation to prevent nuisance alarms, adjust the parameter sets for seasonal changes, perform system tests and verify camera views and audio levels, check the hard disk for unnecessary files, execute a scandisk and defrag the hard disk.
  • maintenance functional features for example, removal and replacement of MSS Boards, by removing the cover of the chassis
  • limited failure effects since the failure of one camera channel may not have any effect on the other camera channels within the MSS chassis
  • scheduled maintenance for example, to verify the time and date display, clean the lens or the front glass of the camera housings, remove any new grown vegetation to prevent nuisance alarms, adjust the parameter sets for seasonal changes, perform system tests and verify camera views and audio levels, check the hard disk for unnecessary files, execute
  • the MSS may be manufactured in accordance with ISO 9001, version 2000 standards, or other suitable quality and/or safety standards.
  • the MSS may include performance features, for example, the MSS may have been performance tested under a variety of typical environmental conditions.
  • the MSS may provide a minimum probability of detection (PD) of 97% with a 95% confidence factor, averaged over a test period of 50 days.
  • PD minimum probability of detection
  • a copy of the test report may be provided to verify compliance.
  • FIG. 4 is a graphical illustration of a MSS, showing a plurality of external sockets, for connecting a plurality of external components, according to some embodiments of the present invention.
  • a Complete Security System (CSS) 510 may include a network of distributed MSSs 100 (herein "MSS network") connected through, for example, a fiber optic LAN 512 (e.g., each MSS may have Built-in FO transmitters). Each MSS may be a stand-alone unit or be connected to neighbor MSSs.
  • the MSS network may create a loop, circle, or other architecture, for example, enabling data transmission from any point to any point using at least two different routes. Distributed network architecture of this type may thereby enable inherent backup for data storage, system management, command generation etc.
  • the MSS network may include any number of MSS units.
  • a MMS network may enable operation of multiple MMS units such that the MMS units operate as a single expanded MSS unit, or a plurality of expanded MSS units, with resource sharing capabilities.
  • an expanded MSS may enable: connecting a microphone to one MSS unit and recording data input to the microphone at another MSS unit; performing a VMD algorithm at one unit, from data received at a camera that is connected to another unit; configure all or selected MSS units from any MSS unit; setup the units to operate as field units, user workstations and/or both; controlling all the MSS units and their elements, alarm signals etc. from any workstation. Integration of multiple MSSs may be based on software setup instead of complex wiring and dedicated protocols.
  • an alarm trigger from a TTL in one unit can be sent to a PTZF camera in another unit to force the camera to move and display the alarmed zone.
  • a malfunction in a camera may be programmed to generate a global scenario such that many sources may be connected to many targets.
  • Many MSSs together may serve as one powerful MSS with storage and computation power derived from a combination of the respective system components, without a central server.
  • the ability to integrate a plurality of MSS units into one synergetic machine may be based on the principles of Distributed database and Synchronization of a collection of asynchronous units.
  • the principles may be achieved by global actions enabled my modules such as a time synchronization module and a Propagator module.
  • a NTP (Network Time protocol) server may be in charge of the clock synchronization of all the MSSs in the system. Since multiple features, accessories, applications etc. may be placed in any MSS in the system, it is important that all the MSSs run on the same clock so that all the items in the system can communicate at the same time allowing correct and smooth operation.
  • the Propagator may include a mechanism to update that data in the system. Each MSS has a timer, which may allow the data update from one machine to another, when the time set in the timer is reached.
  • Every MSS may have its own storage and processors that can be shared with all the other MSSs, thereby providing an "All for one and one for all" network architecture. Accordingly a MSS based security system (e.g., a MSS network) may become more powerful, reliable, and secure the more MSSs are used.
  • the data flow, system management and implementation of system algorithms may operate simultaneously using, for example, parallel processing techniques.
  • Every MSS in the MSS network can be used as a user workstation and may enable an operator to control all the other MSSs.
  • the network When adding MSSs to the network, the network may be automatically configured to incorporate the new MSS(s).
  • the MSS network may therefore incorporate a fault tolerance that meets at least RAID (Redundant Array of Independent Disks) 1 requirements.
  • At least one MSS in the MSS network may be equipped with dedicated algorithms to perform specialist functions, for example, OCR 5 face recognition, motion recognition and/or other required functions.
  • Each MSS may have, for example, a DSP to perform the required processing for the required functions.
  • an MSS may not be equipped with the necessary algorithms and/or processing power to perform a selected function, and may use the resources of one or more other MSSs to perform the algorithm processing, thereby enabling each MSS in the network to benefit from the algorithm processing of at least one MMS in the network.
  • the MSS network may enable effective processing of specialized functions across the network, even if the necessary software and hardware are located on a single MSS.
  • MSSs may be grouped together in one location, or they may be dispersed between different stations, not limited by location.
  • MSSs may be grouped in one room, or in various control rooms, whether in a limited geographical proximity, or distributed across the world.
  • the same MSS unit may be installed in a selected location, for example, in a field or on a border fence, as a data logger and transmitter (e.g., providing video and/or audio signals), and/or may be used in a selected location, for example a control room, as a central security system management platform, for example, to control multimedia and alarm signals received.
  • a MSS network may enable distributed processing and management, providing greater speed and redundancy, thereby creating a security system with no single point of failure.
  • a MSS network may further enable integration of different systems into a homogeneous system. The usage of multiple units may further enable creation of a modular system, having a design that is easy to setup, expand, contract, change, manage etc.
  • a MSS network may enable relatively easy scalability, parallel processing, and stability, by enabling resources to be shared (e.g., processors and hard disks may be shared), providing improved performance, increased shared calculation power, and increased system availability.
  • the MSS network may be simultaneously configured and operated, without requiring prior running of the system.
  • the system software enable multi-items programming in one action through internal multiplication, enabling mass production and reduction in set up time. For example the camera's bit-rate can be changed simultaneously by choosing the new rate and a push of a "apply to all" type of bottom.
  • a site with plurality of units requires the same programming time as a site with only a few units.
  • a MSS network may include a distributed database (e.g., SQL data base) without a central server, that may include, for example, a description of system components
  • the security system may provide authorized operators with selected levels of authorization.
  • Authorized users may, for example, change system component characteristics for one or more input devices (e.g., a threshold level for an alarm of a selected sensor). Additionally or alternatively the security system may include an automatic mode where, for example, system characteristics may be automatically changed depending on specific events/or on specific dates.
  • a macro generator may be provided, to enable any manual activity that can be carried out via the user interface can be carried out automatically depending on events (e.g., an alarmed sensor may cause the activation of a preset scenario that includes connecting a camera to an operator monitor, while turning on the lighting in the area and displaying the intrusion attempt images).
  • the network infrastructure of a MSS network may utilize data communication protocols that function at 2 or more network layers (e.g., layers 2 and 3, layers 1-7, or any combination of layers, according to the OSI model).
  • a network switch may be used at layer 2 to look at the MAC address only for incoming data packets.
  • Routers may be used at layer 3 to look at IP addresses only. Since the switch does not read IP data, and each connected PC or MSS may require a specific port, the switch may automatically learn the hardware ports associated with the network components, thereby providing rapid and secure connectivity between network components.
  • the switch may recognize re-programmed MAC addresses only, and may therefore enable precise control of access (authorization) in the network.
  • the switch may further enable load balancing, by using, for example, first come first serve queuing. Routing preferences may be preset. Furthermore, since the switch may "know" precisely which components to communicate with, the switch may rapidly be able to identify problems in the network. Additionally, the switch may provide redundancy, by providing a loop connection between network switches, for example, using Spanning Tree Protocol (STP) or other suitable protocols. Since broadcasting requests in a network may cause problems, for example, broadcast storm, where a station is not functioning or does not exist, embodiments of the present invention may use routers in layer 3 to read IP addresses. Accordingly, routers may include tables with logic switches to logically but not physically nullify the additional paths between network components.
  • STP Spanning Tree Protocol
  • the network may therefore function at peak performance without being vulnerable to broadcast storm etc., by using a primary path for data communication.
  • the source problem may rapidly be identified and an additional logical path (e.g., port) may be opened until the problem has been fixed, after which the original network path may be restored.
  • Such a network may be based on a priori knowledge of a master switch, making the network communications rapid, secure, and rapidly recoverable.
  • switches may serve as repeaters. Switches may serve as built in fiber optic transceivers, therefore enabling. For example, effective data communication for up to 12KM between MSS units. The switches may provide data communications without collisions, thereby enabling highly efficient communication.
  • the MSS network routers may be utilized to provide broadcast (1 to all), unicast (1 to 1) and/or multicast (1 to a group) data communication.
  • the routers may be configured to initially use unicast when communication is between two MSSs or until a preset threshold of MSSs join the network.
  • the routers may be configured to communicate with the additional MSS using multicast.
  • the initial communications between the routers may remain unicast, while the additional routers (e.g., above the preset threshold of routers that may communicate using unicast) may use multicast communications.
  • Multicast communications may be implemented at level 3, while unicast and/or broadcast communications may be used at level 2.
  • routers may function as video servers (herein "VS"), to manage data received from data sources, and enable streaming of video frames to all clients. In this way, data may be transferred once over communication cables, even when being target towards multiple destinations.
  • VS may operate as recorders and/or players, thereby enabling multiple functions, for example video editing, answering machine, storage system etc.
  • a routing algorithm is provided to manage multicasting of data to multiple destinations.
  • each member of a network may be defined in a group.
  • a specific IP address e.g., VS (A)
  • the local router/video server (A) recognizes that the data is destined for another group.
  • VS (A) may then send the data to a second VS (B), which may send the data to a client, using the default gateway.
  • each MMS may be a VS, each MMS may define if a request is from another group, and may send the data to one or more other groups, outside of the group, and/or to multiple selected users.
  • a MSS may enable implementation of a storage system, wherein each MSS is supplied with at least one removable hard disk, and each MSS unit can have multiple (e.g., up to four (4)) built-in hard disks.
  • An additional external storage may be supplied to achieve any desired online storage capacity.
  • the storage resources of a plurality of MSSs in the MSS network may be combined, to provide a shared storage resource.
  • a MSS may enable implementation of an archive system, wherein clips can be debriefed and played.
  • the archive system may enable, for example: an unlimited number of simultaneous viewers (depending on network bandwidth), each one has his/her own player control; locating clips in the database according to design criteria: name, hour date, alarm type, sensor or recording type etc.; playing a clip on a VGA monitor and/or external video monitor in one or more of the following configurations: full-screen, in place of a site map, dividing a monitor into portions (e.g., quarters), where each portion may be selected separately; full control of playback mode: forward, reverse, fast forward, fast reverse, stop, freeze frame and more; play continuous loops; navigation in the recorded clip, for example, viewing an event in the recording that occurred at a certain time; an option to play the same clip (with one control) simultaneously on a number monitors around the site; an optional connection of a player to the VMD in order to carry out post search on a recorded clip; an optional connection of a player to a remote MSS in order to edit recordings or duplicate a recording; and automatic operation of a player dependent on system events
  • a MSS may enable implementation of a specialized algorithms, for example, the VMDLove Algorithm for Outdoor Video Motion Detection, based on, for example, the DTS-1000 system (manufactured by the applicant) or other suitable motion detection algorithms.
  • a system may include, for example, 25,334 detection cells per camera; a processing rate of 15 fps up to 25 fps per camera; 3D operation (topographical map) etc.
  • AOI Area of Interest
  • simultaneous handling of multiple intruders e.g., 6) for each camera, and optionally marking the intruder's track in a different color
  • definition of different detection parameters for each camera e.g., speed, direction, size etc.
  • changing a group of parameters according to a calendar e.g.
  • the briefing image may be used as evidence in the courtroom; an algorithm capability analysis program that may allow surgical viewing and algorithm performance during detection activity. This may include a technician window and interim images with various filters.
  • the program may enable the activation of one or more algorithms on each image separately as if they are fed continuously, and then analyzes the detection results.
  • video compression based on AOI may enable highly efficient data communication in the MSS network.
  • a mask may be used to cut out selected areas in a camera's field, separating an AOI from areas that are not of primary interest.
  • Video compression for example MPEG 4, may be used to divide the recorded data into i-frames and p-frames, where the i-frame includes the whole frame and the p-frame includes the AOI only (e.g., causing p-frames to be substantially smaller in size).
  • the i-frames may be communicated in the network at a relatively low frame rate, and the p-frames at a relatively high frame rate, to enable high quality coverage of an AOI, and lower quality but still adequate coverage of areas not requiring high levels of monitoring.
  • Fig. 7 is a screen shot of an example of a User Interface (GUI) according to some embodiments of the present invention.
  • the GUI may include, for example, a Monitor Bar, where each monitor is a logic monitor and may act as a target; a Large Map, which displays the site map along with all the system items.
  • An alarmed item may appear on the Map colored red, for example; a Small Map which may be a zoomed out version of a security area, optionally extracted from the large map (the map locations may be switched); an Information Bar, which may provide text information on selected items; an Item Bar that concentrates a multitude of items for group mapping (e.g., it may contain up to 10 different group types); an Outlook Bar to aid execution of actions, and the menus may change according to the handled item; a Title Bar, wherein the name of the item appears and the color of the bar may be the same as the status of the item; a Status Bar, wherein the bar color may indicate user authorization, whether communication exists or not, the user name, XY coordinates of item in pixels etc. Other items or combinations of items may be provided within the GUI.
  • the site map may be displayed including icons that depict the system components along with unique characteristics.
  • a camera icon may have two vector lines emitting from it depicting direction and size of the camera field-of-view.
  • windows may open dynamically allowing system operation, data display, video display and more.
  • a menu including camera operations may open, a list of active alarms (if they exist) may appear, and the camera's location on the map, and its state (e.g., neutralized, alarmed, etc.) may be indicated.
  • an initiated viewing request may be carried out by dragging the camera icon to the desired monitor. Since the system is user interactive, the user may select via the user interface icons that represent system components (hardware and software). The graphic display may enable maximum data display with a minimum amount of navigation in the interface.
  • One of the most common actions that users of a security system may carry out is the chance selection of a camera and viewing its image.
  • This action in the MSS network is called allotting a source (in this example, a camera) to a target (in this example, a monitor).
  • a user may use the interface to select the desired camera icon and drag it toward the target icon (in this case the desired monitor).
  • the real-time video from the requested camera may be displayed on the requested monitor.
  • the MSS network may be no limitations as to the location of the sources and targets in the network. The data that is to be transferred between them is carried out via the network connecting the MSSs.
  • a video tour may be enabled using Dynamic allotment of cameras to monitors (touring).
  • the MSS system may allow the connection of video cameras in the field to monitors in the control room.
  • the touring may allow the connection of a number of cameras to a number of monitors at the same time (one camera can be allotted to more than one monitor).
  • a number of tours can be set up in the MSS network, with a number of time slots for each tour. Each time slot may be responsible for connecting specific cameras to specific monitors. When the Time Slot ends, the tour may move on to the next time slot.
  • a group of commands may be implemented on data sources. For example, cameras may be reset if a malfunction happened, targets may be locked, so that new cameras cannot be allotted to the monitor in the future (unless an unlock command was carried out), touring management commands may be implemented, for example issuing a "delay" command to stop the tour from advancing to the next time slot.
  • the MSS network may be designed to be a smart system that can respond to alarmed components.
  • a VMD Alarm Scenario may be implemented as follows: the VMD generates an alarm in response to a movement in the camera view to which the VMD is attached.
  • a siren may go off at every connected User Workstation that has the appropriate authorization.
  • the alarm may initiate normal user operation, wherein the system may be locked until an authorized user mutes the siren (via UWS User Interface).
  • UWS User Interface User Interface
  • a window may appear containing user instructions on how to respond to the current alarm state (for example call the police immediately).
  • the VMD state for example, may change to "Intruder Alarm" and change the color of the icon to Red.
  • the alarm may be recorded in the event log of the system for future debriefing.
  • a panoramic image may appear in, for example, quad format on the monitor.
  • the image may include, for example, a Real Time video of the camera located before the alarmed camera, a loop video of Pre and Post alarm including intruder track and graphic overlay, a Real time video of the camera located after the alarmed camera, etc.
  • Resetting the alarm may cause it to be entered in the Log, by transferring the alarm from alarm state to archive state (e.g., white icon) for briefing.
  • archive state e.g., white icon
  • a record of the user who reset the alarm, time that event was closed and attached clip to event may be entered etc.
  • the sensor may be returned to active state and may be ready to detect new alarms. All the video images activated due to the alarm may be stopped and the touring may return to normal operation, for example, that periodically displays images from different cameras.
  • Queries may be carried out on the database according to different criteria. For example, a user may request a print out of "all the alarms from last night of all sensors beginning with the letter "A", and "the sensors that were reset by John".
  • the result of the query may be displayed or printed, for example, in a list in a table format. A double click on an alarm in the list may show the video attached to the event.

Abstract

A multimedia surveillance system (fig. 2A), comprising a plurality of subsystems (225, 215), each subsystem characterized in that enables resource sharing with other such sub-systems without requiring a central server (205, 225 and 215) and wherein each of the MSS sub-systems is approachable from the other sub-systems (205, 225 and 215) to provide a multi-purpose surveillance system, where the multiple units are effectively integrated and controllable from a plurality of individual control centers.

Description

SYSTEM AND APPARATUS FOR MULTI MEDIA SURVEILLANCE
FIELD OF THE INVENTION
The present invention relates to security systems and apparatus. Specifically, embodiments of the present invention relate to interactive multi surveillance security systems and apparatus, capable of functioning in an integrated fashion without requiring a central server.
BACKGROUND OF THE INVENTION
Typical multiple-unit security systems that enable multi-purpose surveillance often have centralized architectures, for example, a control room from which the security system may be operated and controlled. In the case where the security system utilizes multi-surveillance, for example, video, sound and other sensors, each sensor or input device generally requires a separate computing unit to process recorded data and communicate with a main controller. In systems where there are multiple input units, each unit generally connects to the main controller. In such architectures there is often a single point of failure, the main server located at the control room. Further such architectures are typically plagued by integration problems, excessive connection requirements, engineering challenges, expense and size of equipment, and zealous maintenance of the equipment.
For example, today's security systems may require one or more of the following components: Digital recorder, Storage unit, Video Matrix, Quad splitter, Fiber optic transceivers, PTZF console controller, Video motion sensor, User workstation, Network accessories (hubs, switches and routers), Alarm switchboard, Intercom, Videoconference system, Panic buttons. Each of these components may result in significant integration problems and compatibility issues. It would be highly advantageous to have a multi-purpose surveillance system where the multiple input units are effectively integrated and controllable from a plurality of control centers. BRIEF DESCRIPTION OF THE DRAWINGS
The principles and operation of the system, apparatus, and method according to the present invention may be better understood with reference to the drawings, and the following description, it being understood that these drawings are given for illustrative purposes only and are not meant to be limiting, wherein:
Fig. IA is a schematic illustration of a Multimedia Surveillance System and a plurality of connected features, according to some embodiments of the present invention;
Fig. IB is a schematic illustration of a Multimedia Surveillance System, showing a plurality of internal components, according to some embodiments of the present invention;
Fig. 2A is a schematic illustration of three sub-systems in a Multimedia Surveillance System, according to some embodiments of the present invention;
Fig. 2B is a schematic illustration of various data stream paths in a Multimedia Surveillance System, according to some embodiments of the present invention; Fig. 3 is a schematic illustration depicting an example of a video inspection implementation using a Multimedia Surveillance System, according to some embodiments of the present invention;
Fig. 4 is a graphical illustration of a Multimedia Surveillance System, showing a plurality of external sockets, for connecting a plurality of external components, according to some embodiments of the present invention;
Figs. 5 A and 5 B are schematic illustrations of a Multimedia Surveillance System network topology, according to some embodiments of the present invention;
Fig. 6 is a schematic illustration of a video clip player implementation using a Multimedia Surveillance System, according to some embodiments of the present invention; and Fig. 7 is a graphic illustration depicting an example of a graphical user interface, according to some embodiments of the present invention.
It will be appreciated that for simplicity and clarity of illustration, elements shown in the drawings have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the drawings to indicate corresponding or analogous elements throughout the serial views.
DETAILED DESCRIPTION OF THE INVENTION
The following description is presented to enable one of ordinary skill in the art to make and use the invention as provided in the context of a particular application and its requirements. Various modifications to the described embodiments will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments.
Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present invention.
Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as "processing", "computing", "calculating", "determining", or the like, refer to the action and/or processes of a computer or computing system, or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities within the computing system's registers and/or memories into other data similarly represented as physical quantities within the computing system's memories, registers or other such information storage, transmission or display devices.
The platforms, processes and displays presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose computing systems and networking equipment may be used with programs in accordance with the teachings herein, or it may prove convenient to construct a more specialized apparatus to perform the desired method. The desired structure for a variety of these systems will appear from the description below. In addition, embodiments of the present invention are not described with reference to any particular programming language. It will be appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein.
In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details.
According to some exemplary embodiments of the present invention, an Interactive Real Time Multimedia Surveillance System (herein "Multimedia Surveillance System" or "MSS") is provided, which enables interactive real time multimedia surveillance for security applications and general-purpose closed circuit television (CCTV) systems. The MSS may include multiple input units, to enable inputting of any type of existing sensing data, and may enable multiple users to simultaneously view, analyze in real time, transmit, respond, record, playback, search, manage, debrief and archive etc. data in a secured and redundant manner. MSS may perform independent processes including: video/audio compressing, audio/video transmission, digital recording of audio, video, and data, content analysis algorithms (e.g., professional video motion detection), digital/analog acquisition, data transfer over multiple network types (LAN, WAN) independent on the physical connection (e.g., lObaseT, Fiber Optic, ADSL, PSTN, Cellular, wireless, satellites etc.), Network Management (e.g., Hacker protection, Find cut position, Redundant routs, Bandwidth control etc.), operating with network accessories (e.g., Switches, Routers etc.), synchronized playback of video and audio, digital audio and video switching, videophone, Intercom usage, Announce System usage, Access Control, Building Management, Redundant units usage, Hot backups, and integration to external computerized systems etc., or combinations thereof. At least these functionalities or combinations thereof may be included in a single box or apparatus, for example, of two 19" Units.
The MSS may include all the functions and components of a CCTV system and multimedia surveillance system into a single box and may reduce the integration time required to achieve a complete modular solution, reduce the uncertainty of pre-planning, reduce the price of the overall surveillance system and network costs, minimizing installation time and cost of cables/fibers, providing full data and network redundancy (e.g., no single point of failure), providing shared resources over a distributed topology, creating tailor made modules for customer needs, and other suitable functions. In the case of a network of MSSs, multiple MSSs may be distributed around one or more sites.
Reference is now made to Fig. IA, which illustrates a MSS and a plurality of connected features, according to some embodiments of the present invention. A MSS may be connected, for example, to various surveillance components which are the building blocks of integrated security projects. For example, a MSS 100 may be connected to input units including microphones 101, cameras 103, fence sensors 104, light source(s) 105, mouse 106, keyboard 107, remote control 109 etc., and may be connected to output units including video monitor 111, VGA 113, speakers 115 etc. Reference is now made to Fig. IB, which is a schematic illustration of a MSS 100, showing a plurality of internal components, according to some embodiments of the present invention. MSS 100 may include, for example, one or more of a workstation, videophone, intercom, audio recorder, server, VMD, digital recorder, PZTF controller, video switcher, Quad Splitter, Ethernet Switch, video splitter, video recorder, alarm signal unit, fiber optic transceiver, call center, Video Transceiver, and data storage. MSS may include other components or combinations of components that may enable, for example, the functionality that may be implemented by one or more of a Digital recorder, Storage unit, Video Matrix, Quad splitter, Fiber optic transceivers, PTZF console controller, Video motion sensor, User workstation, Network accessories (Hubs, Switches and routers), Alarm switchboard, Intercom, Videophone system, Panic buttons etc. Other components or combinations of components may be used.
As can be seen with reference to Fig. 2A, MSS 100 may include an Input sub-system 205, an Output sub-system 215, and a Processing sub-system 225.
As can be seen with reference to Fig. 2A, and further with reference to Fig. IB, the input sub- system 205 may include, for example, one or more input streams and one or more DSP encoders to encode the input streams. Input sub-system 205 may include video inputs, for example cameras 103, audio inputs, for example microphones 101, serial transmission, for example RS232, analog/discrete input sources, and other suitable I/O streams. The input data, for example signals, may be compressed for streaming and recording purposes. In one embodiment, the input sub-system may include, for example, 8x TTL Inputs, 8x Dry Contact
Outputs (N.O/N.C), 8x ANALOG Inputs (-5V to 5V), and 8x ANALOG Outputs (-5V to 5V).
Other components, numbers of components, and combinations of components may be used.
In one embodiment, the input sub-system 205 may include, for example: 2x USB ports, PS/2 mouse, PS/2 keyboard, Removable H.D, and VGA adaptor. Software modules may be included to enable Compression, for example, MPEG4 4CIF / Dl 25 Fps, H.263 CIF 25/30
Fps, CIF, 2CIF and Dl resolution, Programmable Bit rate, Frame rate and Resolution, and Variable sub zone resolution and frame rate. Software applications may include, for example, Outdoor Video Motion Detection and tracking, User Work Station Digital Recorder (Audio and Video), Video and Audio Switcher, Video Quad, Intercom, Videophone, Loudspeaker System, Answering Machine, Communication Infrastructure Services, Video, Audio, TTL and RS232 Server. Other components, numbers of components, and combinations of components may be used.
The output sub-system 215 may include, for example, one or more output streams and one or more DSP Decoders to decode output data. Output sub-system 215 may receive compressed data from the PC section, decode the data according to its type, and transfer the data to the video monitors 111, speaker 115, or other output ports. The input and output sections may be built as clusters of DSPs, which may encode and decode the data streams. In addition, these DSPs may be used as a platform for sophisticated algorithms such as Video Motion Detection or other suitable algorithms. Other output components or combinations of components may be used. The Processing sub-system 225 may include, for example, a processor and suitable memory, network and communication components. Processing sub-system 225 may acquire compressed data streams and may forward them to one or more selected destinations. For example, data may be recorded in local memory (e.g., on a local disk), and subsequently transferred via a network to another MSS or to an external PC. The data stream may additionally or alternatively be transferred to the output section for decoding and display. The PC sub-system 225 may serve as a platform for the main management application, including the user workstation.
The PC sub-system 225 may further include Management Software modules, for example, Distributed SQL database (No central Server), Changeable parameter set per item (Trigger and Calendar), Programmable Macro, Programmable Turing (Switch sources to targets), Recorders, players and archive management, Virtual Sensors (Logic combinations), Graphic user interface (GUI) etc. The GUI may include, for example, predictable menus, colored maps, multi languish Log event, and Displays of MSS topology maps etc.
The PC sub-system 225 may further include item software modules (e.g., drivers), for example, item application software, including: CAM - Camera encoder driver; MIC -
Microphone encoder driver; SPK - Speaker decoder driver; MON - Monitor decoder driver; TTLIN - Dry contacts inputs driver; TTLOUT - Dry contact output driver; ANAIN - Analog inputs driver; ANAOUT - Analog outputs driver; FENCE - Fence triggers driver; PTZF - Pan, Tilt, Zoom Focus control driver; USR - Users management driver; VMD - Video Motion and Detection algorithm driver; REC - Digital recorder driver; PLY - Video and audio player driver; TRK - Tracker algorithm via GPS driver; DMSI - Digital Matrix Switch for I/O driver; DMSS - Digital Matrix Switch for Serial RS232 driver; TUR - Global Macro driver; UWS - User Workstation driver; VOB - Virtual Object driver; POI - Point Of Interest - Group of item management driver; and EXT - External. Other components, modules, drivers etc. may be used. The PC sub-system 225 may further include audio components, for example, 8x Microphone/Line Inputs, PC Microphone and Auxiliary Inputs, and Speaker Output. Other audio components, numbers of components, and combinations of components may be used.
The PC sub-system 225 may further include video components, for example, video inputs, video outputs, VGA output, and graphic overlays. For example, an MSS may include 8x NTSC/PAL Video Inputs (AV/S-Video), 8x NTSC/PAL Loops back Video Outputs (AV), NTSC/PAL Video Output, providing a display of up to 4 Dl streams simultaneously (AV/S- Video), VGA Output, for example, to display of up to 4 Dl streams simultaneously, and 2x Colored Graphic Overlays (704x576x4). Other video components, numbers of components, and combinations of components may be used. Any professional would understand that the video capabilities might include also the ability to convert PAL to NTSC and vise versa and also to get PAL and to output from one port PAL and from the other NTSC.
The PC sub-system 225 may further include communication components, for example, Support Close Ring Network topology, 2x Fiber Optic transceivers (Fast Ethernet Switch), 4x RJ-45 (Fast Ethernet Switch), RJ-45 (Fast Ethernet Host Nic), 2x Serial port (COMl, COM2), ADSL modem. Other communication components, numbers of components, and combinations of components may be used.
The PC sub-system may further include peripheral devices, for example, fences and such fences sensors (currently known under the trade marks of the applicant as DTR, Yael, Barricade, Intelliflex etc.), PTZF camera or other suitable peripheral devices. Other peripheral devices or combinations of devices may be used.
As can be seen in Fig. 2B, MSS 100 may enable streaming of data from sources (e.g., microphones 101, video cameras 103, video players etc.) to one or more targets or destinations (e.g., monitors 111, speakers 115, video recorders etc.). An input source, for example a video camera 103, microphone 101, RS323 input, PPL in, analog in, a user, a video player etc., may send a data stream to multiple targets, for example a monitor 111, speaker 115, PPL out, analog out, RS232, video recorder etc., by initially streaming the input data to the MSS memory exchange 117. Each data type may be stored in a separate memory layer. The memory exchange may transfer the data to a local disk (e.g., hard disk) 119, and once such data is stored, the memory exchange may upload the data to a network 121, and/or may communicate the data to one or more targets. There may generally be a differentiation between interactive data sources characterized by two-way communication, and non-interactive sources characterized by one-way communication. In the case of a video player, for example, a clip of which may be viewed in various ways, re-winded, forwarded, edited etc., it may be logical to send a data stream containing such a clip to one target only. In one embodiment MSS 100 may have an automatic player system that will use a free player to upload a video file to a target once requested. Additionally or alternatively MSS 100 may have a manual player system that may use a pre-defined player to play a designated clip. For example, a player may be designated to play a particular clip every hour, for example, an alert or message played in a loop. In this way, MSS 100 may use automatic players to play clips generated by alarms etc., but may additionally have dedicated players to play clips in loops. For example, by defining a player as manual but not specifying particular clip names with a player, the player may, when activated, play the newest clip recorded in a memory in a loop. In some embodiments a MSS may have, for example, 64 players, or any other number of players.
According to some embodiments of the present invention, MSS 100 may include Video signal features. For example, each video channel may accept composite video signals to EIA
Standard RS-170 and Standard M/NTSC (525-line/60 Hz), and/or Standard PAL (625-line/50
Hz). The nominal signal may be 1 V p-p into a 75 Ω termination, with a signal to noise ratio of at least 50 decibels. Each video input may use chassis-isolated, BNC type connectors or S- video connectors. The MSS may obtain all video synchronization from the composite video input signals. There may be no requirement for synchronization between channels. The MSS may accept and monitor eight (8) TTL inputs with built in pull-up resistors and 8 analog inputs (-5V to 5V). Other video signal features or combinations of features may be implemented.
According to some embodiments of the present invention, MSS 100 may include Video Input/Output features. For example, the MSS may provide the following video inputs and outputs at the following levels at one or more connections: Input: 30/25 FPS, Dl resolution at 50Kbps till 4Mbρs (may also support CIF and 2CIF); Analog Video Output: 30/25 FPS, Dl resolution at 50Kbps till 4Mbρs (may also support CIF and 2CIF); VGA Video Output: 30/25 FPS, 2CIF resolution at 50Kbps till 4Mbρs (may also support CIF); Full motion (25/30 fps) Quad display on analog and VGA monitor: Up to 8 video streams simultaneously at 200Kbps till 32Mbps. The MSS may provide at least 2 colored graphic overlays (255 x 340 x 4) on Dl display. The MSS may support dynamic bit-rate throughput of 50Kbps-48Mbps per unit. The overall video latency may be less then 500msec. Other video input/output features or combinations of features may be implemented.
According to some embodiments of the present invention, MSS 100 may include Video Switching features. For example, the MSS may employ virtual audio and video connection capabilities for unlimited connection combinations. The built-in Matrix switcher may provide PTZF control over the network with limited delays (80 - 250 ms). Programmable tours for switching between cameras and color overlay over analog and VGA displays (full or quad). The MSS may generate alarms when there is a video fail or when a camera is covered. The built-in alarm-tour may enable the simultaneous presentation of alarm pictures and video clips of multiple events base on the shared resource algorithm. Other video switching features or combinations of features may be implemented.
According to some embodiments of the present invention, MSS 100 may include Output Contacts. For example, eight dry contacts (NO/NC) and 8 analog outputs (-5V to 5V). Other numbers or types of contacts may be used. According to some embodiments of the present invention, MSS 100 may include audio inputs. For example, the MSS may provide 8 audio inputs with a sample rate of 8Khz, 8 bps, an input impedance of 15Kohm, an output impedance of 620 ohm, a bandwidth of 30Hz - 4KHz and a microphone gain of 25 MSS. Other numbers or types of audio inputs may be used. According to some embodiments of the present invention, MSS 100 may include audio connectors. For example, an MSS may include 8 x PLL microphone inputs (Voice over IP); 8 x PLL line inputs (Voice over IP); 1 x PLL PC Microphone (known by the trade mark SoundBlaster); 1 X PLL Auxiliary Input (SoundBlaster); 1 X PLL Speaker output (Mix between Voice over IP and SoundBlaster). Other numbers or types of audio connectors may be used. According to some embodiments of the present invention, MSS 100 may include a storage feature. For example, two or more 500 Gbyte, IDE hard disks or other H.D. type connection such as Serial ATA USB etc. may enable recording a frame rate of 240 FPS at a resolution of Dl, per unit on a bit stream of 32 Mbps for 125 hours of continuous recording. The streams may be received from local components or remote components via a network. Other alarm storage features may be used.
According to some embodiments of the present invention, MSS 100 may provide, for example, the following User Workstation and Security Management System (UWSMS) features: providing the operator with the state of the sensors on the site (e.g., alarm state, neutralize, etc.); enabling the operator to activate the sensors (e.g., reset an alarm, neutralize a sector, etc.), optionally remotely; enabling the operator to control the video flow on the site (e.g., determine on which monitor which camera will be displayed); enabling the operator to carry out debriefing, play clips from the archive and more; providing audio messages and instruction lists on how to act in case of an alarm; providing programming of the site components (e.g., setting each sensor characteristics) during system operation. In some embodiments a graphic management and control method may be provided to enable managing of a security site with a large number of components (e.g., cameras, monitors, sensors, etc.) to provide rapid access to some or all of the site components, and receiving indication of location, state, and the calibrated parameters.
A MSS unit may be operated as a user workstation, and/or may be used to manage a network (e.g., cameras, sensors, monitors, other MSS, user workstations, users, etc. that belong to one or more MSS units) according to user password. The number of user workstations operating simultaneously may be increase up to 128 users by adding new unit. The user workstation may include, for example, maps, tables, direct access buttons, operation menus, user instructions, icons and more. The UWSMS may include a "Foreseeing desired menu" or "predictive" characteristic, for example, by displaying a changing menu according to user activity, while "foreseeing" what action the user may likely execute. The menus may be relatively small and the user may not have to scroll through long lists in order to find desired action. Selection of a sensor, for example, may display the set of commands that may be used for the specific sensor, selection of an alarm line from the alarm table, for example, may display the actions that may be carried out, for example, reset, play clips and more.
The user may generally set a default operation for UWSMS features, for example, to determine what will happen when a function is chosen, for example, double-clicked on. For example, a user may define that when a camera icon is double clicked on, it may display its image on a default monitor. The UWSMS may include customizable Types/items/status. For example, there may be numerous (e.g., 7) different types of item status, depicted according to different colors, one for each type of status. For example, Light gray may indicate an inactive status (e.g., hardware does not exist); Dark gray may indicate a disable status (e.g., hardware exists but is not available); Green may indicate an active status; Red may indicate an intruder alarm status; Yellow may indicate a malfunction status; Black may indicate a blocking status; White may indicate a system message; Brown may indicate General alarm status; Blue status may indicate that the alarm cause has disappeared. Other statuses or color indications of statuses may be used.
Each item in the UWSMS may be identified by at least the following three parameters: MSS number; Type number; ID number. The MSS number may depict in which of the MSS units the item is located. The type number may depict what type the item is (CAM, MIC, USR etc.) and the ID number may be the number of the item inside the MSS unit, e.g. If the MSS unit has 8 cameras then the ID may very from 0 to 7.
Global actions are actions that may have to be carried out on all the MSSs in the UWSMS at the same time. The UWSMS may include some global actions such as, for example, Touring. A Load Set Table (LST) may provide a list of programmable features (e.g. brightness and contrast for a camera) and/or a group of item features called a Sub-Set for every item. Every item may have many different Sub-Sets where each set may be loaded (e.g., attach the Sub- Set to the item) manually by the user or automatically by the LST. A Global-Set may be a list of lines that specifies which item is needed to have a new Sub-Set and what Sub-Set it may be (e.g. Global-Set may be Day, Night, Clouds mode, Switch of smoke detection etc.). The LST algorithm may include details of when a certain Global-Set is brought on line, for example, according to a certain schedule (e.g., from a calendar) or according to a certain event (door was opened) etc. An item activated may be according to its Sub-Set, which may be included in the Global-Set that was loaded via the LST. The LST belongs to a particular MSS, and may operate independently so that each MSS is its own server. Each processor (e.g., Intel's Pentium) in the MSS manages the LST of that MSS so that there is parallel processing in the system. The parallel LST algorithms may be executed at the same time because the NTP server may synchronize all of the MSS units.
MSS 100 may include Virtual Objects (VOBs), which may be virtual items that describe underlying hardware and states of related items, for example, neighboring MSSs, cameras etc., but have no actual hardware. VOBs may therefore function as shortcuts or pointers to other items to describe the states of these items, and may influence the behavior of these items. Every item may have multiple states (e.g., security status defined by colors, as described in detail herein), and MSS 100 may provide different logical sentences or combinations of sentences to define these states and determine behavior of various items in
MSS 100. For example, a logical statement may be, "if camera 22 has color brown AND recorder 32 is NOT yellow THEN VOB is black."
In one embodiment a timer may be provided by which a logical sentence may incorporate a time dimension. For example, "VOB is red IF door is left open for x seconds". A VOB may have an alarm list that may be used as a trigger to start a recording, and/or to be marked as a trigger to the Loading Set Table. For example a VOB may be configured to generate an alarm only if there is an alarm from a monitored area (e.g., a security fence) together with an alarm from a VMD system. The VOB may allow serving as trigger to the LST. For example, the minimum size for detection of the VMD system may be changed. Examples of objects that may be VOBs in MSS 100 include: CAM, PTZF, POI, UWS, DB, MIC5 VMD, TTL, DMSS, DMSI, AIN, OUT, FNC, TRK, EXT, VOB, USR etc.
For example, every VOB State has one or more logical sentences (e.g., 5 states will have 5 sentences). When a child object changes its state the VOB checks the respective logical sentences. The first logic sentences state that returns a TRUE value may become the new VOB state. The states may have a 'Time' field in the logical sentences database that serves as a timer. The fields may define the time it takes for the system to update the VOB states. As a change occurs in the state of a child object or in the timer, the system may scan the VOB according to the order of the VOBs in the database to update their states.
In some embodiments a child object (members of VOB) may not be used outside of the VOB as a stand alone for the users that the VOB belong to, but a child object may be used as stand- alone for other users which have not used it inside the VOB. The child objects configuration setup may be changed by the Loading Set Table. Child objects may or may not blink on an enhanced map during alarm interrupts.
Commands may be performed on child objects, only if the user selects the VOB and then, from the information table, selects the child object. Choosing one of the lines in the information table may display, in the outlook menu, the child object menu, and the child object's position on the map. If the child object is one of the "drag and drop" objects, such as camera, the user may be able to drag the child object and to drop it on a selected target. VOB states may include, for example: Disabled, Alarmed, Operative, Inactive, and Malfunctioned. A VOB may have unique icons and sounds. All state changes and actions performed on child objects may be logged.
An example of syntax for operating a VOB is as follows:
State = Time, OBJl(ChUd object State) Logic operation 0BJ2(Child object State) Logic operation ... OBJn(ChUd object State)
Child object State is any of the child object available states. The child object states may be difference from the VOB states.
The 'Time' defines the minimum duration of the state. If 'Time' ends and the logic sentence state is still 'True', then the VOB state will remain unchanged until the next child object state change.
For example: Alarm = 100, (VMDl (Alarm) OR TTL7(ALARM)) AND VOB2(Malfunction) Operate = 0, (NOT VMD 1 (Disable)) OR (NOT TTL5 (Disable))
The NOT VMDl (Disable) return TRUE only if the VMDl is not in Disable state. Any other states will return TRUE.
Disable = USR(Disable = Log out) Inactive = AND When the function is AND only, then the state will be TRUE only if all the child objects that belong to this VOB are in Inactive state.
When the function is OR only, then the state will be TRUE if at least one of the child objects that belong to this VOB are in Inactive state. Malfunction = VMDl (Malfunction) OR VMD2(Malfunction) OR VMD3 (Malfunction) OR VMD4(Malfunction) OR VMD4(Malfunction)
Default = Malfunction
This is the Default State if no logic sentence return TRUE. The user defines here a specific state (one of the five) or a specific child object, which the VOB state, will follow its state. For example, the following commands on a VOB may generate the following return values:
Figure imgf000016_0001
MSS 100 may include Points Of interest (POIs), which are sub-classes of a VOB, and relate to items in MSS 100 and have influence over the behavior of these items. When a POI command is generated this command may be generated on related items or groups of items. For example, if a POI is displayed on a monitor this may cause, for example, camera 1 to connect to monitor 1 and may likewise cause all cameras to connect to their default monitors. For example, pressing on the POI may open its slide (map with all of his objects) and the Information table may show all of the alarms that belong to the POI child objects. The object name in the Information table line may be the child objects names, while the object name in the VOB it may be the VOB name. POIs may have different usages, for example, grouping together some objects that are physical close to each other (e.g., sensors in the same room). VOB may be used to group together some objects that can be far from each other but have some logical connection between them.
The MSS may include Graphic Layer software, which may have the capability to display selected icons that have a common denominator on the maps. Such a filtering of icons may enable, for example, simple operation of a site with many icons. For example, a graphic layer with only the alarmed icons may be selected for display.
The MMS may include software for enabling managing a large number of users, for example, with different authorizations, where the different authorization means that a different group of activities may be implemented by the user. Each user may receive a personal configuration definition that includes a list of dedicated authorizations per user. For example, not every user may be authorized to neutralize sensors. When the system is activated, a login password may be requested. The entry of a suitable user name and password may allow the user to enter the system. Actions executed may be recorded by the system.
According to some embodiments of the present invention, the MSS may include Video Motion Detection (VMD) software (e.g., DTS-1000, manufactured by the applicant). For example, motion detection based on the VMD software, or other VMD systems, may be used.
The MSS may have, for example, 25,334 detection cells per camera; a processing rate 15 fps to 25 fps per camera; and 3D operation (e.g., topographical map). The MSS software may use detection and masking, for example, to detect holes in the ground, hills, structures etc. A detection area may be more than 3,000 square meters (30m X 100M), or may have other dimensions. A dedicated algorithm for harsh external conditions may be used, for example, that includes advanced filters for filtering out rain, camera post movement, shadows, clouds, tree and bushes movement, disregarding birds and small animals etc. Algorithms may also be used to define one or more selected areas of Interest, for example, by defining a particular area where monitoring may be executed, and one or more particular areas where monitoring may be ignored. The detection software may provide simultaneous handling of multiple events, for example, simultaneous detection of six intruders for each camera. The software may enable marking of each separate event, for example, each intruder, in a different color. The software may enable different detection parameters for each camera to be separately defined, for example, to select the speed, direction, size etc. of a camera. A group of parameters may be able to be changed separately according to a calendar, for example, to detect different event types during the day and night respectively (e.g., people may be able to be detected by day and trucks by night).
The MSS may be configured to enable a different sensitivity threshold to be set for each area in an image. Additionally or alternatively a different focus threshold may be set for each area in the image, to filter out constant movements in the image. This characteristic may enable, for example, detection and an intruder on the background of moving bushes in the wind, using, for example, VMD processing on recorded video. This characteristic may enable smart searches, for example, showing all the cases where a door was opened; saving the intruder's route in a manner that is synchronized with the recorded clip, for example, to enable viewing of a recording in order to display or remove the movement route (e.g., if the route is covering vital data, it may be removed); storing of a very high-quality-briefing images of the exact moment of the alarm, which may be used as evidence in the courtroom; surgical viewing and algorithm performance during detection activity. For example, a technician window and interim images with various filters may be provided. The software may enable the activation of one or more algorithms on each image separately as if they are fed continuously, and may then analyze the detection results.
The principle of the VDM 's algorithm is that the system studies the background and any changes in comparison to a known background consider being a suspected target. In order to differentiate between types of targets the system analyses the target behavior, namely - the system analysis the target's pattern of movement. In the algorithm one can defined a list of arbitrarily areas (e.g., A, B, C, D). In addition, one can defined a set of movement's rules. For example - detection will be consider when target started at A moved to B, stayed there for 10 seconds, never passes through C and stayed within area D for thirty seconds. The VMD could be global namely based on global coordinates. Therefore, enabling the system to acquire target through first camera and transmit the target to a second camera for farther tracking. The global coordination basis of the system provides also the capability to present the target path on a video output and on the site map. The system enable the allocation of a PTZF camera to toward the target in a manner that the target appear in the center of the picture and navigate the camera movement while tracking the target as it appears constantly in the center of the picture. The system enables first alarm upon appearing of a target but also provide the operator for marking the target as a legitimate one (and therefore canceling any farther alarms and substantially reducing the falls alarms while the now "friendly" target continue movement between the different cameras).
The system provide for the operation of up to 32 VMD different channels on the same camera, in a manner that enable different parameters analysis of the same target (e.g., one channel for target crawling detection, second channel for cloud detection, third channel for static subj ects)
According to some embodiments of the present invention, the MSS may enable data recording using multiple modes for each input device, e.g. camera, and may enable operation in multiple modes. Whereas a video recorder (VCR) generally has an individual recorder unit and an individual player unit, and a digital recorder may generally have an individual recorder unit per input video source and a player unit that may play data to unlimited number of players, a MSS may be used for recording from one or more sources and/or playing to one or more destinations. A MSS may enable recording channels independently of the number of inputs sources (video and audio). For example, in each MSS there may be multiple recorders (e.g., 64) that may be divided to sub groups where some of them may be used as local recorders, and others may be used to generate backup clips of other recorders from other MSS units. A MSS network may be used, for example, to record the same source on multiple clips, where each clip has different features such as frame rate, bit rate, size etc.
According to some embodiments of the present invention, the MSS may include Digital
Video Recording System (DVR) features. For example, the recording format may be MPEG4/H263/H264, and the storage may be shared and distributed storage (e.g., each MSS may have its own movie archive that may allow each camera to have a storage space that may be locally controlled). The cameras may be local ones or located anywhere on the network, and the MSS may be capable of simultaneous recording and viewing of live video or recorded movies. The MSS may be capable of dynamic change of recording, for example, up to 30 fps at a resolution of Dl (4CIF) per camera. The MSS may be capable of dynamic allotment, for example, up to 8Mbps per camera. The MSS may include online storage, for example, a 250 GB removable hard disk may be installed in the MSS unit that may enable recording at a frame rate of 30 fps at a resolution of 4 CIF, per camera at a Bit stream of 0.5 Mbps for 142 hours of continuous recording. The recording configuration may be set for each camera separately. Multiple recording may be performed (on the same unit or on different units) for the same camera at the same time with different recording parameters.
The recording system may support multiple modes of operation, optionally for each camera or alternative input device. In a manual mode of operation, where the operator may initiate the recording, each camera may have a maximum recording time set, such that when this time ends, the system may stop recording. The recording system may support lapse mode of operation, where each X frame may record a Y frame. Each camera may have a maximum recording time set which may be managed in a loop. The recording system may support event mode of operation, where an event may generate predetermined alarms and system events that may cause the recording of a clip with a preset length. The number of clips may be predetermined and may be FIFO managed. The recording system may support delay mode, wherein recorded movies may be continuously viewed even while recording new clips.
For example, a movie may be recorded in a loop, thereby enabling the display of the clip with a delay to the real-time, as can be seen with reference to Fig. 3. This may enable, for example, seeing an event after it has happened, to help a security personnel focus on the event and distinguish changes at a target in two or more time intervals. Additionally, the delay may enable a security personnel to see an object (e.g., an image of a person) at two moments simultaneously (e.g., see the person live, and see the clip of the same person x seconds before, enabling detection of changes to the object. In some embodiments two or more cameras may be used to record in multiple events. For example, one camera may record a location in delayed mode, and a second camera may record a location in event mode. Security personnel may be able to utilize the video data from both these modes simultaneously.
According to one principal of operation, in lapse mode the MSS may record clips all the time in a loop, at a low frame rate. When an event is received, the system may continue to record for a certain period a post alarm, and may then close the clip and may start to record a new clip (pre/post alarm recording). The recording system may support delay mode of operation, where a continuous viewing of recorded movies may be provided, while recording new clips. The movie may be recorded in a loop. This option may enable display of the outside world with a selected delay relative to the current-time.
According to some embodiments of the present invention, the MSS may include Debriefing and Video Clip Playback features, including, for example, multi-user operation, where the number of simultaneous viewers may be unlimited (depending on network bandwidth) and each one may have his/her own player control. Locating clips in the database may be enabled according to selected criteria, for example, name, hour date, alarm type, sensor or recording type. Clips may be played on a VGA monitor and/or external video monitor in, for example, one or more of the following configurations: full-screen, in place of site map, monitor divided into quarters, where each quarter can be selected separately. There may be full control of play back mode, including forward, reverse, fast forward, fast reverse, stop, freeze frame and more. The system may enable playing in a continuous loop, navigating in the recorded clip, viewing of an event in the recording that occurred at a selected hour. The system may enable playing the same clip (with one control) simultaneously on a number of monitors around the site, may enable connecting a player to the VMD in order to carry out post search on a recorded clip, may enable connecting a player to a remote unit in order to edit recordings or duplicate a recording, and/or may provide automatic operation of a player, dependent on system events (e.g., during an alarm, the alarm clip can be viewed in a loop mode).
According to some embodiments of the present invention, the MSS may include Closed Circuit TV (CCTV) features including, for example, compression using MPEG4 format; full Dl resolution at a rate of 30 fps NTSC per channel; a setup including a dynamic determination option of compression characteristics, according to calendar alarms (e.g., frame rate, bandwidth, resolution and more); transmission using communication protocols for an Ethernet network (e.g., TCP/IP, UTP, and RTP); full Dl display at a rate of 25/30 fps per channel, with, for example, a Dl encoder on each monitor or simultaneous display of four (4) cameras at a rate of 30 fps for each camera for each one of displayed at CIF resolution on each monitor; a color graphic generator on the video signal at a resolution of Dl that may enable an overlay writing, display areas of interest and show tracking of intruders movements etc. The CCTV functionality may enable a different display to be viewed on each monitor quarter (quad display). The overlay writing may be independent of the video signal and may not influence video quality. The writing may be removed or added when required. The CCTV functionality may further include a duplication of sources, enabling an operator to view the same camera input and various monitors simultaneously. A further CCTV function may be video touring, wherein cameras may be dynamically attached to monitors, according to a preset scenario, during normal conditions or when an alarm is generated.
According to some embodiments of the present invention, the MSS may include installation features, for example, mounting the basic MSS chassis using rack mounting or on tabletop; accommodating all power, alarm, video and control cabling at the rear of the MSS chassis; enabling the basic MSS chassis may operate from a power source such as 105 - 125 VAC, 60 Hz or 210 - 250 VAC, 50 Hz; enabling the MSS to operate within a range of environmental conditions, including temperatures between 5° and 50° C (41° and 112° F), relative humidity levels between 20% and 85%, and non-condensing environments. The MSS may operate in other environmental conditions.
According to some embodiments of the present invention, the MSS may include maintenance functional features, for example, removal and replacement of MSS Boards, by removing the cover of the chassis; limited failure effects, since the failure of one camera channel may not have any effect on the other camera channels within the MSS chassis; scheduled maintenance, for example, to verify the time and date display, clean the lens or the front glass of the camera housings, remove any new grown vegetation to prevent nuisance alarms, adjust the parameter sets for seasonal changes, perform system tests and verify camera views and audio levels, check the hard disk for unnecessary files, execute a scandisk and defrag the hard disk.
The MSS may be manufactured in accordance with ISO 9001, version 2000 standards, or other suitable quality and/or safety standards.
According to some embodiments of the present invention, the MSS may include performance features, for example, the MSS may have been performance tested under a variety of typical environmental conditions. For example, the MSS may provide a minimum probability of detection (PD) of 97% with a 95% confidence factor, averaged over a test period of 50 days. A copy of the test report may be provided to verify compliance.
Reference is now made to Fig. 4, which is a graphical illustration of a MSS, showing a plurality of external sockets, for connecting a plurality of external components, according to some embodiments of the present invention.
Reference is now made to Figs. 5A and 5B, which are schematic illustrations of possible MSS network topologies, according to some embodiments of the present invention. A Complete Security System (CSS) 510, for example, may include a network of distributed MSSs 100 (herein "MSS network") connected through, for example, a fiber optic LAN 512 (e.g., each MSS may have Built-in FO transmitters). Each MSS may be a stand-alone unit or be connected to neighbor MSSs. The MSS network may create a loop, circle, or other architecture, for example, enabling data transmission from any point to any point using at least two different routes. Distributed network architecture of this type may thereby enable inherent backup for data storage, system management, command generation etc. The MSS network may include any number of MSS units.
In some embodiments a MMS network may enable operation of multiple MMS units such that the MMS units operate as a single expanded MSS unit, or a plurality of expanded MSS units, with resource sharing capabilities. For example, an expanded MSS may enable: connecting a microphone to one MSS unit and recording data input to the microphone at another MSS unit; performing a VMD algorithm at one unit, from data received at a camera that is connected to another unit; configure all or selected MSS units from any MSS unit; setup the units to operate as field units, user workstations and/or both; controlling all the MSS units and their elements, alarm signals etc. from any workstation. Integration of multiple MSSs may be based on software setup instead of complex wiring and dedicated protocols. For example, an alarm trigger from a TTL in one unit can be sent to a PTZF camera in another unit to force the camera to move and display the alarmed zone. In another example a malfunction in a camera may be programmed to generate a global scenario such that many sources may be connected to many targets. Many MSSs together may serve as one powerful MSS with storage and computation power derived from a combination of the respective system components, without a central server.
The ability to integrate a plurality of MSS units into one synergetic machine may be based on the principles of Distributed database and Synchronization of a collection of asynchronous units. The principles may be achieved by global actions enabled my modules such as a time synchronization module and a Propagator module. A NTP (Network Time protocol) server, for example, may be in charge of the clock synchronization of all the MSSs in the system. Since multiple features, accessories, applications etc. may be placed in any MSS in the system, it is important that all the MSSs run on the same clock so that all the items in the system can communicate at the same time allowing correct and smooth operation. The Propagator may include a mechanism to update that data in the system. Each MSS has a timer, which may allow the data update from one machine to another, when the time set in the timer is reached.
Every MSS may have its own storage and processors that can be shared with all the other MSSs, thereby providing an "All for one and one for all" network architecture. Accordingly a MSS based security system (e.g., a MSS network) may become more powerful, reliable, and secure the more MSSs are used. The data flow, system management and implementation of system algorithms may operate simultaneously using, for example, parallel processing techniques. Every MSS in the MSS network can be used as a user workstation and may enable an operator to control all the other MSSs. When adding MSSs to the network, the network may be automatically configured to incorporate the new MSS(s). The MSS network may therefore incorporate a fault tolerance that meets at least RAID (Redundant Array of Independent Disks) 1 requirements. At least one MSS in the MSS network may be equipped with dedicated algorithms to perform specialist functions, for example, OCR5 face recognition, motion recognition and/or other required functions. Each MSS may have, for example, a DSP to perform the required processing for the required functions. In other embodiments an MSS may not be equipped with the necessary algorithms and/or processing power to perform a selected function, and may use the resources of one or more other MSSs to perform the algorithm processing, thereby enabling each MSS in the network to benefit from the algorithm processing of at least one MMS in the network. In this way the MSS network may enable effective processing of specialized functions across the network, even if the necessary software and hardware are located on a single MSS.
According to some embodiments of the present invention, MSSs may be grouped together in one location, or they may be dispersed between different stations, not limited by location. For example, MSSs may be grouped in one room, or in various control rooms, whether in a limited geographical proximity, or distributed across the world.
According to some embodiments of the present invention, the same MSS unit may be installed in a selected location, for example, in a field or on a border fence, as a data logger and transmitter (e.g., providing video and/or audio signals), and/or may be used in a selected location, for example a control room, as a central security system management platform, for example, to control multimedia and alarm signals received. A MSS network may enable distributed processing and management, providing greater speed and redundancy, thereby creating a security system with no single point of failure. A MSS network may further enable integration of different systems into a homogeneous system. The usage of multiple units may further enable creation of a modular system, having a design that is easy to setup, expand, contract, change, manage etc. A MSS network may enable relatively easy scalability, parallel processing, and stability, by enabling resources to be shared (e.g., processors and hard disks may be shared), providing improved performance, increased shared calculation power, and increased system availability. The MSS network may be simultaneously configured and operated, without requiring prior running of the system.
The system software enable multi-items programming in one action through internal multiplication, enabling mass production and reduction in set up time. For example the camera's bit-rate can be changed simultaneously by choosing the new rate and a push of a "apply to all" type of bottom. A site with plurality of units requires the same programming time as a site with only a few units.
A MSS network may include a distributed database (e.g., SQL data base) without a central server, that may include, for example, a description of system components
(software/hardware) including their configuration (parameter set), sensor capabilities, alarm recording, recording of operator activities, parallel processing and complex queries. The security system may provide authorized operators with selected levels of authorization.
Authorized users may, for example, change system component characteristics for one or more input devices (e.g., a threshold level for an alarm of a selected sensor). Additionally or alternatively the security system may include an automatic mode where, for example, system characteristics may be automatically changed depending on specific events/or on specific dates. In one embodiment a macro generator may be provided, to enable any manual activity that can be carried out via the user interface can be carried out automatically depending on events (e.g., an alarmed sensor may cause the activation of a preset scenario that includes connecting a camera to an operator monitor, while turning on the lighting in the area and displaying the intrusion attempt images).
According to some embodiments of the present invention, the network infrastructure of a MSS network may utilize data communication protocols that function at 2 or more network layers (e.g., layers 2 and 3, layers 1-7, or any combination of layers, according to the OSI model). For example, a network switch may be used at layer 2 to look at the MAC address only for incoming data packets. Routers may be used at layer 3 to look at IP addresses only. Since the switch does not read IP data, and each connected PC or MSS may require a specific port, the switch may automatically learn the hardware ports associated with the network components, thereby providing rapid and secure connectivity between network components. The switch may recognize re-programmed MAC addresses only, and may therefore enable precise control of access (authorization) in the network. The switch may further enable load balancing, by using, for example, first come first serve queuing. Routing preferences may be preset. Furthermore, since the switch may "know" precisely which components to communicate with, the switch may rapidly be able to identify problems in the network. Additionally, the switch may provide redundancy, by providing a loop connection between network switches, for example, using Spanning Tree Protocol (STP) or other suitable protocols. Since broadcasting requests in a network may cause problems, for example, broadcast storm, where a station is not functioning or does not exist, embodiments of the present invention may use routers in layer 3 to read IP addresses. Accordingly, routers may include tables with logic switches to logically but not physically nullify the additional paths between network components. In this way, multiple paths may exists between network components, but only one path may be primarily functional. The network may therefore function at peak performance without being vulnerable to broadcast storm etc., by using a primary path for data communication. In the case of a problem or break in the network path, the source problem may rapidly be identified and an additional logical path (e.g., port) may be opened until the problem has been fixed, after which the original network path may be restored. Such a network may be based on a priori knowledge of a master switch, making the network communications rapid, secure, and rapidly recoverable.
According to some embodiments of the present invention, switches may serve as repeaters. Switches may serve as built in fiber optic transceivers, therefore enabling. For example, effective data communication for up to 12KM between MSS units. The switches may provide data communications without collisions, thereby enabling highly efficient communication.
The MSS network routers, according to some embodiments of the present invention, may be utilized to provide broadcast (1 to all), unicast (1 to 1) and/or multicast (1 to a group) data communication. The routers, for example, may be configured to initially use unicast when communication is between two MSSs or until a preset threshold of MSSs join the network. When an additional MSS joins the network, the routers may be configured to communicate with the additional MSS using multicast. The initial communications between the routers may remain unicast, while the additional routers (e.g., above the preset threshold of routers that may communicate using unicast) may use multicast communications. Multicast communications may be implemented at level 3, while unicast and/or broadcast communications may be used at level 2.
According to some embodiments of the present invention, as can be seen with reference to Fig. 6, routers may function as video servers (herein "VS"), to manage data received from data sources, and enable streaming of video frames to all clients. In this way, data may be transferred once over communication cables, even when being target towards multiple destinations. VS may operate as recorders and/or players, thereby enabling multiple functions, for example video editing, answering machine, storage system etc.
According to some embodiments of the present invention, a routing algorithm is provided to manage multicasting of data to multiple destinations. According to the routing algorithm, each member of a network may be defined in a group. When data from a source is sent to a specific IP address (e.g., VS (A)), the local router/video server (A) recognizes that the data is destined for another group. VS (A) may then send the data to a second VS (B), which may send the data to a client, using the default gateway. Since each MMS may be a VS, each MMS may define if a request is from another group, and may send the data to one or more other groups, outside of the group, and/or to multiple selected users.
According to some embodiments of the present invention, a MSS may enable implementation of a storage system, wherein each MSS is supplied with at least one removable hard disk, and each MSS unit can have multiple (e.g., up to four (4)) built-in hard disks. An additional external storage may be supplied to achieve any desired online storage capacity. The storage resources of a plurality of MSSs in the MSS network may be combined, to provide a shared storage resource. According to some embodiments of the present invention, a MSS may enable implementation of an archive system, wherein clips can be debriefed and played. The archive system may enable, for example: an unlimited number of simultaneous viewers (depending on network bandwidth), each one has his/her own player control; locating clips in the database according to design criteria: name, hour date, alarm type, sensor or recording type etc.; playing a clip on a VGA monitor and/or external video monitor in one or more of the following configurations: full-screen, in place of a site map, dividing a monitor into portions (e.g., quarters), where each portion may be selected separately; full control of playback mode: forward, reverse, fast forward, fast reverse, stop, freeze frame and more; play continuous loops; navigation in the recorded clip, for example, viewing an event in the recording that occurred at a certain time; an option to play the same clip (with one control) simultaneously on a number monitors around the site; an optional connection of a player to the VMD in order to carry out post search on a recorded clip; an optional connection of a player to a remote MSS in order to edit recordings or duplicate a recording; and automatic operation of a player dependent on system events. For example, during an alarm, the alarm clip may be viewed in a loop mode.
According to some embodiments of the present invention, a MSS may enable implementation of a specialized algorithms, for example, the VMDLove Algorithm for Outdoor Video Motion Detection, based on, for example, the DTS-1000 system (manufactured by the applicant) or other suitable motion detection algorithms. Such a system may include, for example, 25,334 detection cells per camera; a processing rate of 15 fps up to 25 fps per camera; 3D operation (topographical map) etc. that may take into consideration holes the ground, hills, structures and masking; detection of 100% of the cameras field of view; a detection area for each camera of more than 3,000 square meters (30m X 100M); a dedicated algorithm for harsh external conditions, including advanced filters for filtering out rain, wind, camera post movement, shadows, clouds, tree and movement of bushes, birds and small animals etc.; definition of Area of Interest (AOI); simultaneous handling of multiple intruders (e.g., 6) for each camera, and optionally marking the intruder's track in a different color; definition of different detection parameters for each camera (e.g., speed, direction, size etc.); changing a group of parameters according to a calendar (e.g. people can be detected by day and trucks by night); setting a different sensitivity threshold for each area in an image; setting a different focus threshold for each area in the image to filter out constant movements in the image. This characteristic may enable detection of an intruder in the background of moving objects, such as bushes in the wind; VMD processing on recorded video, which may enable smart searches such showing all the cases where a door was opened; saving the intruders route in a manner that is synchronized with the recorded clip, which may allow viewing of a recording in order to display or remove the movement route. This means that if the route is covering vital data, it may be removed; storing a very high-quality-briefing image of the exact moment of the alarm. The briefing image may be used as evidence in the courtroom; an algorithm capability analysis program that may allow surgical viewing and algorithm performance during detection activity. This may include a technician window and interim images with various filters. The program may enable the activation of one or more algorithms on each image separately as if they are fed continuously, and then analyzes the detection results.
According to one embodiment of the present invention, video compression based on AOI may enable highly efficient data communication in the MSS network. For example, a mask may be used to cut out selected areas in a camera's field, separating an AOI from areas that are not of primary interest. Video compression, for example MPEG 4, may be used to divide the recorded data into i-frames and p-frames, where the i-frame includes the whole frame and the p-frame includes the AOI only (e.g., causing p-frames to be substantially smaller in size). The i-frames may be communicated in the network at a relatively low frame rate, and the p-frames at a relatively high frame rate, to enable high quality coverage of an AOI, and lower quality but still adequate coverage of areas not requiring high levels of monitoring. Reference is now made to Fig. 7, which is a screen shot of an example of a User Interface (GUI) according to some embodiments of the present invention. The GUI may include, for example, a Monitor Bar, where each monitor is a logic monitor and may act as a target; a Large Map, which displays the site map along with all the system items. An alarmed item may appear on the Map colored red, for example; a Small Map which may be a zoomed out version of a security area, optionally extracted from the large map (the map locations may be switched); an Information Bar, which may provide text information on selected items; an Item Bar that concentrates a multitude of items for group mapping (e.g., it may contain up to 10 different group types); an Outlook Bar to aid execution of actions, and the menus may change according to the handled item; a Title Bar, wherein the name of the item appears and the color of the bar may be the same as the status of the item; a Status Bar, wherein the bar color may indicate user authorization, whether communication exists or not, the user name, XY coordinates of item in pixels etc. Other items or combinations of items may be provided within the GUI.
According to one embodiment of the present invention, when a user enters the system, the site map may be displayed including icons that depict the system components along with unique characteristics. For example a camera icon may have two vector lines emitting from it depicting direction and size of the camera field-of-view. According to selected sensors, windows may open dynamically allowing system operation, data display, video display and more.
For example, when a camera icon on the map is selected, a menu including camera operations may open, a list of active alarms (if they exist) may appear, and the camera's location on the map, and its state (e.g., neutralized, alarmed, etc.) may be indicated.
According to one embodiment of the present invention, an initiated viewing request may be carried out by dragging the camera icon to the desired monitor. Since the system is user interactive, the user may select via the user interface icons that represent system components (hardware and software). The graphic display may enable maximum data display with a minimum amount of navigation in the interface.
One of the most common actions that users of a security system may carry out is the chance selection of a camera and viewing its image. This action in the MSS network is called allotting a source (in this example, a camera) to a target (in this example, a monitor). A user may use the interface to select the desired camera icon and drag it toward the target icon (in this case the desired monitor). As the user's action is completed, the real-time video from the requested camera may be displayed on the requested monitor. In the MSS network may be no limitations as to the location of the sources and targets in the network. The data that is to be transferred between them is carried out via the network connecting the MSSs.
According to one embodiment of the present invention, a video tour may be enabled using Dynamic allotment of cameras to monitors (touring). As required from most perimeter security systems, the MSS system may allow the connection of video cameras in the field to monitors in the control room. The touring may allow the connection of a number of cameras to a number of monitors at the same time (one camera can be allotted to more than one monitor). A number of tours can be set up in the MSS network, with a number of time slots for each tour. Each time slot may be responsible for connecting specific cameras to specific monitors. When the Time Slot ends, the tour may move on to the next time slot.
According to some embodiments of the present invention, a group of commands may be implemented on data sources. For example, cameras may be reset if a malfunction happened, targets may be locked, so that new cameras cannot be allotted to the monitor in the future (unless an unlock command was carried out), touring management commands may be implemented, for example issuing a "delay" command to stop the tour from advancing to the next time slot.
According to one embodiment of the present invention, the MSS network may be designed to be a smart system that can respond to alarmed components. For example, a VMD Alarm Scenario may be implemented as follows: the VMD generates an alarm in response to a movement in the camera view to which the VMD is attached. When an intruder enters the detection area with the predefined characteristics (size, direction, etc.), a siren may go off at every connected User Workstation that has the appropriate authorization. The alarm may initiate normal user operation, wherein the system may be locked until an authorized user mutes the siren (via UWS User Interface). After this initial stage a window may appear containing user instructions on how to respond to the current alarm state (for example call the Police immediately). The VMD state, for example, may change to "Intruder Alarm" and change the color of the icon to Red.
The alarm may be recorded in the event log of the system for future debriefing. In addition a panoramic image may appear in, for example, quad format on the monitor. The image may include, for example, a Real Time video of the camera located before the alarmed camera, a loop video of Pre and Post alarm including intruder track and graphic overlay, a Real time video of the camera located after the alarmed camera, etc.
Resetting the alarm may cause it to be entered in the Log, by transferring the alarm from alarm state to archive state (e.g., white icon) for briefing. In addition to alarm particulars, a record of the user who reset the alarm, time that event was closed and attached clip to event may be entered etc. The sensor may be returned to active state and may be ready to detect new alarms. All the video images activated due to the alarm may be stopped and the touring may return to normal operation, for example, that periodically displays images from different cameras.
Queries may be carried out on the database according to different criteria. For example, a user may request a print out of "all the alarms from last night of all sensors beginning with the letter "A", and "the sensors that were reset by John". The result of the query may be displayed or printed, for example, in a list in a table format. A double click on an alarm in the list may show the video attached to the event. The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. It should be appreciated by persons skilled in the art that many modifications, variations, substitutions, changes, and equivalents are possible in light of the above teaching. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

Claims

CLAIMSWhat is claimed is:
1. A Multimedia Surveillance System (MSS) unit, comprising a plurality of sub-systems, each unit comprising: an input sub-system, including one or more input streams and one or more digital signal processor (DSP) encoders to encode the input streams; an output sub-system, including one or more output streams and one or more DSP decoders to decode output data; and a processing sub-system, including a processor, memory, network and communication components; characterized in that each MSS unit enables resource sharing with other such units without utilizing a central server and wherein each of the MSS unit sub-systems is approachable from said other unit sub-systems.
2. The system of claim 1, wherein the input sub-system includes one or more applications selected from the group consisting of Outdoor Video Motion Detection and tracking, User Work Station Digital Recorder (Audio and Video), Video and Audio Switcher, Video Quad, Intercom, Videophone, Loudspeaker System, Answering Machine, Communication Infrastructure Services, Video, Audio, TTL and RS232.
3. The system of claim 1, wherein the processing (PC) sub-system includes one or more Management Software modules selected from the group consisting of Distributed database, Changeable parameter set per item, Programmable Macro, Programmable Turing, Recorders, players and archive management, Virtual Sensors, and Graphic user interface, and wherein said PC sub-system is independently operatable as a single sub-system while enabling each of said modules to be approached and share resources with PC modules of other sub-systems.
4. The system of claim 1, wherein the PC sub-system includes one or more application software modules selected from the group consisting of Camera encoder driver, Microphone encoder driver, Speaker decoder driver, Monitor decoder driver, Dry contacts inputs driver, Dry contact output driver, Analog inputs driver, Analog outputs driver, Fence triggers driver, Pan, Tilt, Zoom Focus control driver, Users management driver, Video Motion and Detection algorithm driver, Digital recorder driver, Video and audio player driver, Tracker algorithm via GPS driver, Digital Matrix Switch for I/O driver, Digital Matrix Switch for Serial RS232 driver, Global Macro driver, User
Workstation driver, Virtual Object driver, Point Of Interest, and External.
5. The system of claim 1, comprising Virtual Objects that describe underlying hardware and states of related items and enabling the characterization of logical events
6. The system of claim 5, comprising Points Of Interest (POIs), which are sub-classes of virtual objects.
7. The system of claim 1, comprising Video Motion Detection (VMD) software.
8. The system of claim 1, comprising Digital Video Recording System (DVR) features.
9. An operational complete security system comprising a network of distributed Multimedia Surveillance System units.
10. The system of claim 9, wherein each Multimedia Surveillance System operates as an integrated expanded Multimedia Surveillance System with resource sharing capabilities.
11. The system of claim 9, wherein a plurality of said Multimedia Surveillance System units serve as one integrated Multimedia Surveillance System with storage and computation power derived from a combination of the respective Multimedia
Surveillance System units, without a central server.
12. The system of claim 9, wherein said network includes fault tolerance that meets RAID requirements.
13. The system of claim 9, wherein said network includes a switch that recognizes re- programmed MAC addresses only.
14. The system of claim 13, wherein said switch provides redundancy, by providing a loop connection between network switches.
15. The system of claim 13, comprising MSS network routers to provide broadcast, unicast and/or multicast data communication.
16. The system of claim 9, wherein said routers function as video servers.
17. A surveillance system comprising elements capable of functioning independently of one another or in an integrated fashion without requiring a central server.
18. A surveillance method comprising processes capable of functioning independently of one another or in an integrated fashion without requiring a main central server.
PCT/IL2005/001108 2004-10-25 2005-10-23 System and apparatus for multi media surveillance WO2006046234A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US62106504P 2004-10-25 2004-10-25
US60/621,065 2004-10-25

Publications (2)

Publication Number Publication Date
WO2006046234A2 true WO2006046234A2 (en) 2006-05-04
WO2006046234A3 WO2006046234A3 (en) 2009-05-07

Family

ID=36228164

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2005/001108 WO2006046234A2 (en) 2004-10-25 2005-10-23 System and apparatus for multi media surveillance

Country Status (1)

Country Link
WO (1) WO2006046234A2 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2325820A1 (en) * 2009-11-24 2011-05-25 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO System for displaying surveillance images
US8417090B2 (en) 2010-06-04 2013-04-09 Matthew Joseph FLEMING System and method for management of surveillance devices and surveillance footage
US8527340B2 (en) 2011-03-07 2013-09-03 Kba2, Inc. Systems and methods for analytic data gathering from image providers at an event or geographic location
EP2765565A3 (en) * 2013-02-12 2014-09-03 Honeywell International Inc. System and method of alarm and history video playback
WO2014057496A3 (en) * 2012-03-26 2014-11-06 Tata Consultancy Services Limited An event triggered location based participatory surveillance
WO2016046780A1 (en) * 2014-09-25 2016-03-31 Micheli, Cesare Surveillance method, device and system
US9584775B2 (en) 2013-07-18 2017-02-28 BOT Home Automation, Inc. Wireless entrance communication device
RU2636012C1 (en) * 2016-11-02 2017-11-17 Российская Федерация, от имени которой выступает Государственная корпорация по атомной энергии "Росатом" (Госкорпорация "Росатом") System of detecting intruder with peer information network
US10068610B2 (en) 2015-12-04 2018-09-04 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
US10139281B2 (en) 2015-12-04 2018-11-27 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
CN112910490A (en) * 2021-03-08 2021-06-04 中国人民解放军军事科学院战争研究院 Multifunctional transmitter and data transmission method
US11102027B2 (en) 2013-07-26 2021-08-24 Skybell Technologies Ip, Llc Doorbell communication systems and methods
US11388373B2 (en) 2015-03-07 2022-07-12 Skybell Technologies Ip, Llc Garage door communication systems and methods
US11477417B2 (en) 2002-10-15 2022-10-18 Sb Ip Holdings Llc Communication and monitoring system
US11641452B2 (en) 2015-05-08 2023-05-02 Skybell Technologies Ip, Llc Doorbell communication systems and methods
US11651665B2 (en) 2013-07-26 2023-05-16 Skybell Technologies Ip, Llc Doorbell communities
US11764990B2 (en) 2013-07-26 2023-09-19 Skybell Technologies Ip, Llc Doorbell communications systems and methods
US11854376B2 (en) 2019-08-24 2023-12-26 Skybell Technologies Ip, Llc Doorbell communication systems and methods
US11889009B2 (en) 2013-07-26 2024-01-30 Skybell Technologies Ip, Llc Doorbell communication and electrical systems
US11909549B2 (en) 2013-07-26 2024-02-20 Skybell Technologies Ip, Llc Doorbell communication systems and methods

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6188431B1 (en) * 1996-02-17 2001-02-13 Casio Computers Co., Ltd. Electronic still camera and method for communication between electronic still cameras
US6640145B2 (en) * 1999-02-01 2003-10-28 Steven Hoffberg Media recording device with packet data interface

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6188431B1 (en) * 1996-02-17 2001-02-13 Casio Computers Co., Ltd. Electronic still camera and method for communication between electronic still cameras
US6640145B2 (en) * 1999-02-01 2003-10-28 Steven Hoffberg Media recording device with packet data interface

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11477417B2 (en) 2002-10-15 2022-10-18 Sb Ip Holdings Llc Communication and monitoring system
EP2325820A1 (en) * 2009-11-24 2011-05-25 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO System for displaying surveillance images
US8417090B2 (en) 2010-06-04 2013-04-09 Matthew Joseph FLEMING System and method for management of surveillance devices and surveillance footage
US8527340B2 (en) 2011-03-07 2013-09-03 Kba2, Inc. Systems and methods for analytic data gathering from image providers at an event or geographic location
US9020832B2 (en) 2011-03-07 2015-04-28 KBA2 Inc. Systems and methods for analytic data gathering from image providers at an event or geographic location
WO2014057496A3 (en) * 2012-03-26 2014-11-06 Tata Consultancy Services Limited An event triggered location based participatory surveillance
US9740940B2 (en) 2012-03-26 2017-08-22 Tata Consultancy Services Limited Event triggered location based participatory surveillance
US9398283B2 (en) 2013-02-12 2016-07-19 Honeywell International Inc. System and method of alarm and history video playback
EP2765565A3 (en) * 2013-02-12 2014-09-03 Honeywell International Inc. System and method of alarm and history video playback
US9584775B2 (en) 2013-07-18 2017-02-28 BOT Home Automation, Inc. Wireless entrance communication device
US11651665B2 (en) 2013-07-26 2023-05-16 Skybell Technologies Ip, Llc Doorbell communities
US11102027B2 (en) 2013-07-26 2021-08-24 Skybell Technologies Ip, Llc Doorbell communication systems and methods
US11909549B2 (en) 2013-07-26 2024-02-20 Skybell Technologies Ip, Llc Doorbell communication systems and methods
US11889009B2 (en) 2013-07-26 2024-01-30 Skybell Technologies Ip, Llc Doorbell communication and electrical systems
US11764990B2 (en) 2013-07-26 2023-09-19 Skybell Technologies Ip, Llc Doorbell communications systems and methods
US11362853B2 (en) 2013-07-26 2022-06-14 Skybell Technologies Ip, Llc Doorbell communication systems and methods
WO2016046780A1 (en) * 2014-09-25 2016-03-31 Micheli, Cesare Surveillance method, device and system
US10438070B2 (en) 2014-09-25 2019-10-08 Filippo Guerzoni Surveillance method, device and system
US11388373B2 (en) 2015-03-07 2022-07-12 Skybell Technologies Ip, Llc Garage door communication systems and methods
US11641452B2 (en) 2015-05-08 2023-05-02 Skybell Technologies Ip, Llc Doorbell communication systems and methods
US10325625B2 (en) 2015-12-04 2019-06-18 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
US10068610B2 (en) 2015-12-04 2018-09-04 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
US10190914B2 (en) 2015-12-04 2019-01-29 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
US10147456B2 (en) 2015-12-04 2018-12-04 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
US10139281B2 (en) 2015-12-04 2018-11-27 Amazon Technologies, Inc. Motion detection for A/V recording and communication devices
RU2636012C1 (en) * 2016-11-02 2017-11-17 Российская Федерация, от имени которой выступает Государственная корпорация по атомной энергии "Росатом" (Госкорпорация "Росатом") System of detecting intruder with peer information network
US11854376B2 (en) 2019-08-24 2023-12-26 Skybell Technologies Ip, Llc Doorbell communication systems and methods
CN112910490A (en) * 2021-03-08 2021-06-04 中国人民解放军军事科学院战争研究院 Multifunctional transmitter and data transmission method

Also Published As

Publication number Publication date
WO2006046234A3 (en) 2009-05-07

Similar Documents

Publication Publication Date Title
WO2006046234A2 (en) System and apparatus for multi media surveillance
US20220215748A1 (en) Automated camera response in a surveillance architecture
US8842179B2 (en) Video surveillance sharing system and method
US20190037178A1 (en) Autonomous video management system
CA2381960C (en) System and method for digital video management
US9661276B2 (en) Peer to peer surveillance architecture
US20040075738A1 (en) Spherical surveillance system architecture
JP6412001B2 (en) System and method for tracking and tagging objects in a broadcast
CN101877774A (en) Safety island network video and talkback alarm realization method and safety island network video and alarm talkback system
JP2004350275A (en) Security system
US20060015599A1 (en) Multi-layer video management and display method carried out on the networks
CN101483761A (en) Intelligent video monitoring system based on complete IP network
CN109040703A (en) A kind of monitoring security-protection management system
CN110049290A (en) Public building intelligent monitor system
CN104092976A (en) Method for achieving environment device monitoring system warning and video monitoring system linkage
US11488458B2 (en) Systems and methods for providing an immersive experience of a facility control room using virtual reality
CN109640025A (en) A kind of food safety guarantee video-frequency networking supervisory systems
CN104184998B (en) A kind of distributed video monitoring system based on internet
KR20040106964A (en) Real time moving picture remote guard controling system
WO2004068855A1 (en) Mpeg adaptive motion digital video (scss) security system
CN202050501U (en) High-capacity concurrent intelligent video analysis management system capable of supporting multilevel networking
CN114189659A (en) Video monitoring system
CN103152552A (en) Law enforcement supervision system
CN109936721A (en) Monitoring system
CN111918041A (en) Video monitoring subsystem

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BW BY BZ CA CH CN CO CR CU CZ DK DM DZ EC EE EG ES FI GB GD GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV LY MD MG MK MN MW MX MZ NA NG NO NZ OM PG PH PL PT RO RU SC SD SG SK SL SM SY TJ TM TN TR TT TZ UG US UZ VC VN YU ZA ZM

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SZ TZ UG ZM ZW AM AZ BY KG MD RU TJ TM AT BE BG CH CY DE DK EE ES FI FR GB GR HU IE IS IT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05798543

Country of ref document: EP

Kind code of ref document: A2