WO2007031697A1 - Method and apparatus for classifying video data - Google Patents
Method and apparatus for classifying video data Download PDFInfo
- Publication number
- WO2007031697A1 WO2007031697A1 PCT/GB2005/003570 GB2005003570W WO2007031697A1 WO 2007031697 A1 WO2007031697 A1 WO 2007031697A1 GB 2005003570 W GB2005003570 W GB 2005003570W WO 2007031697 A1 WO2007031697 A1 WO 2007031697A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video data
- sensor
- space
- programme
- classification code
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N5/9201—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
- H04N5/9206—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal the additional signal being a character code signal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19645—Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19665—Details related to the storage of video surveillance data
- G08B13/19671—Addition of non-video data, i.e. metadata, to video stream
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19697—Arrangements wherein non-video detectors generate an alarm themselves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
Definitions
- Figure 2 is a flow chart showing an overview of operation of the system of Figure 1;
Abstract
A method of classifying video data representing activity within a space to be monitored. A method comprises storing video data obtained from a camera configured to monitor the space. Sensor data indicative of a condition occurring within the space is obtained, and a plurality of programme elements are defined within the video data. Each programme element has an associated classification code, and each classification code is selected using the sensor data.
Description
METHOD AND APPARATUS FOR CLASSIFYING VIDEO DATA
The present invention relates to a method and apparatus for classifying video data. More particularly, the invention relates to the use of sensor data to define classification codes which are applied to programme elements within the video data.
It is well known to use a video camera to capture video data, and to use that video data to monitor an area for security purposes. For example, in a simple system a video camera may constantly capture activity within a particular area, such that if it is determined that unauthorised activity has taken place, a security operative can review video data to obtain further information as to the nature of the unauthorised activity.
In more complex systems, a plurality of video cameras may be used to capture video data from different areas. In such a system, movement sensors may be used to select which of the plurality of video cameras is used to capture video data at a particular time, so as to generate a single stored stream of video data. Such systems are clearly more convenient where a large number of disparate areas are to be monitored. It is also known in the prior art to use motion and other sensors to determine the way in which a particular video camera should be activated. For example zoom and angle adopted by a particular video camera may be determined using such sensor data.
Although the known security systems described above provide a mechanism by which video data can be captured and reviewed to determine the nature of unauthorised activity, it will be appreciated that such systems are disadvantageous given that relatively large quantities of video data must be reviewed so as to accurately locate the activity of interest within the video data. If, as is usual, the video data is captured on traditional video cassettes, typically fast forward and rewind operations will be performed in a relatively random manner in an attempt to identify the correct position in the video data.
It is an object of the present invention to provide a method of classifying video data which obviates or mitigates at least some of the problems outlined above.
To assist in understanding of the invention, the term "programme element", as that term is used in this document, is used to mean a video clip. Programme elements
can be classified on the basis of any criteria of interest, such as a level of activity within the video clip.
According to the present invention, there is provided, a method of classifying video data representing activity within a space to be monitored. The method comprises receiving video data from a camera configured to monitor the space. Sensor data indicative of a condition occurring within the space is also received, and a plurality of programme elements within said video data are defined. Each programme element has an associated classification code, and each classification code is selected using the sensor data. Video data representing the programme elements is stored, and the associated classification codes are also stored.
By applying classification codes based upon obtained sensor data, a classified stream of video data is created which can be easily navigated by a user so as to identify particular parts of the video data on the basis of the sensor data. Thus, the invention generates video data which can be more easily navigated.
The sensor data may be obtained using a motion sensor, a sound sensor, or a pressure sensor. Indeed, the sensor may take any suitable form. For example, in some embodiments of the invention the sensor may comprise image processing means configured to process an image and to output sensor data indicative of properties of the processed image. For example, brightness of captured images may be analysed to generate appropriate sensor data, or images may be analysed to detect movement of objects or people within the space which is being monitored.
The method may further comprise obtaining video data from a plurality of cameras, and storing data from one of said plurality of cameras selected on the basis of the sensor data. Here, a single stream of video data may be generated and at each point in time a camera recording video data indicating activity may provide the video data. The classification code associated with each programme element may identify the camera of said plurality of cameras which was used to obtain the video data making up each programme element.
The method may comprise obtaining sensor data, and storing video data if but only if said sensor data satisfies a predetermined condition.
The classification codes may be selected from a predetermined set of classification codes. The classification codes may represent values on a scale
extending from a high value to a low value. The scale may represent relative activity within the space being monitored.
The method may comprise deleting video data representing some programme elements, the video data to be deleted being selected on the basis of said classification codes. The video data to be deleted may be video data representing periods of relatively low activity within the space being monitored.
The method may further comprise receiving user selection of a classification code, and displaying programme elements associated with that classification code. User input representing a request to display programme elements representing periods of relatively high activity within the space being monitored may be received, at least one classification code associated with programme elements representing periods of relatively high activity within the space being monitored may be determined, and programme elements associated with the determined classification codes may then be displayed. The determining may comprise calculating an average level of activity for all programme elements, and determining classification codes representing periods of above average activity.
According to further aspects of the present invention, there is provided a data carrier carrying computer programme code means to cause a computer to carry out the method set out above.
The invention also provides an apparatus for classifying video data representing activity within a space to be monitored. The apparatus comprises a programme memory storing processor readable instructions, and a processor configured to read and execute instructions stored in said programme memory. The processor readable instructions comprise instructions controlling the processor to carry out the method described above.
According to a further aspect of the present invention, there is provided an apparatus for classifying video data representing activity within a space to be monitored. The apparatus comprises a storage device configured to store video data obtained from a video camera configured to monitor the space, input means configured to receive sensor data indicative of a condition occurring within the space, and means for defining a plurality of programme elements within said video data each
programme element having an associated classification code. The classification codes are selected using said sensor data.
The apparatus may further comprise a video camera, and may further comprise at least one sensor. The sensor may be a motion sensor, a pressure sensor or a sound sensor.
Embodiments of the present invention will now be described, by way of example, with reference to the accompanying drawings, in which:
Figure 1 is a schematic illustration of a first embodiment of the present invention;
Figure 2 is a flow chart showing an overview of operation of the system of Figure 1;
Figure 3 is flow chart showing in more detail a method of determining classification codes in the method of Figure 2; and
Figure 4 is a flow chart showing an alternative method of determining classification codes in the flow chart of Figure 2;
Figure 5 is a schematic illustration of a second embodiment of the present invention; and
Figure 6 is flow chart showing an overview of operation of the system of Figure 5.
Referring to Figure 1, a controller 1 receives video data from a video camera 2, and sensor data from a sensor 3. In a first embodiment of the present invention, the sensor 3 is a motion sensor such as a passive infrared detector (PIR). The controller 1 is also connected to a non-volatile storage device 4 which can suitably take the form of a hard disk drive or other similar device. The controller 1 writes video data 5 and classification data 6 to the storage device 4. The classification data 6 comprises classification codes associated with programme elements comprised in the video data 5.
Referring to Figure 2, there is illustrated a flow chart providing an overview of operation of the controller 1. At step Sl the controller 1 simply passes video data received from the video camera 2 to the storage device 4, for storage as video data 5. At step S2, the controller 1 uses sensor data obtained from the sensor 3 to generate
classification codes which can be applied to the video data 5. These classification codes are stored on the storage device 4 as classification data 6 (step S3).
The classification data 6 is used to identify programme elements within the video data 5 and classifies programme elements in terms of their level of activity within an area of being monitored by the video camera 2. Thus, an operator viewing the video data 5 can use the classification data 6 to identify periods of relatively high activity. This has particular value in a security system in which a security operative can quickly locate parts of the video data which perhaps relate to suspicious activity.
Referring to Figure 3, a method of determining classification codes carried out by the controller 1 at step S2 of Figure 2 is illustrated. At step S4 a time parameter is initialised to t, where t is a time marker at a current position within the video data 5. At step S5 a counter variable i is initialised to zero. Steps S6, S7 and S8 are then repeated N times to obtain sensor data from the sensor 3. At each iteration of the loop, data is sampled and stored from the sensor 3 (step S6). At step S7, the counter variable i is incremented. At step S 8 a check is made to determine whether the counter variable i is still less than N. If the condition of step S 8 is satisfied, a further iteration of the loop is performed, and accordingly processing returns to step S6. If the condition of step S8 is not satisfied, it can be determined that N sample values have been processed and processing then passes to step S9. hi the described embodiment of the present invention, the sensor 3 outputs a binary value. That is, the sensor 3 outputs a T if activity is sensed, and '0' if no activity is sensed. The binary values obtained and stored at step S 6 are summed at step S9. At step SlO, the result of the summation of step S9 is used to determine a classification code for a programme element beginning at time t. The summation will take a value in the range 0 to N. Thus, if N+l different classification codes are defined, the result of the summation can itself be the classification code. However, if a more limited scale is desired it will be readily apparent how the value in the range 0 to N+l can be used to determine a classification code at step SlO. The classification code determined at step SlO is stored as part of classification data 6 at step SIl. The classification code can suitably be stored as part of a tuple of the form:
(C, N, tΛ)
Where:
C is a classification code determined as described above;
N is a number of samples of sensor data obtained from the sensor 3 used to compute that classification code; t is a time point within the video data 5 at which programme element classified using the same classification code begins; and ts is a sample time (i.e a time interval between the capture of subsequent samples of the N sample).
Using data within the tuple set out above it will be appreciated that a unique portion of the video data 5 is identified with which the classification code C is associated. That portion begins at time t and ends at time (t + N x ts).
At step S 12 the time parameter is updated according to an equation:
Time = (t + N x ts)+ts
Where the parameters take the values set out above.
Processing then returns to step S5 where i is set to 0, and a classification code for a programme element beginning at time [t + (N x ts)+ts] is determined in the manner described above.
Using the process described with reference to Figure 3, it will be appreciated that a plurality of programme elements of equal duration are defined, each having an associated classification code. When reviewing video data classified using the process of Figure 3 an operator can easily locate periods of relatively high activity by specifying classification codes of relatively high value to cause the controller 1 to retrieve programme elements classified using that classification code and therefore representing periods of relatively high activity.
Referring to Figure 4, there is illustrated an alternative process to that illustrated in Figure 3. At step S 13 a time parameter is again set to t. At step S14
sensor data from the sensor 3 is captured, and at step 15 the captured value is examined to determine whether the captured value is indicative of activity. That is, if the sensor 3 outputs binary data in the manner described above a check is made to determine whether the captured value is equal to 1. If the captured value is equal to 1 the value of the time parameter is stored in a list at step S16 the time parameter is incremented at step S 17 and the process of S 14 to S 16 is again repeated. If activity is not detected at step S 15, processing passes directly to step S 17.
Using the process described with reference to Figure 4, the classification data 6 comprises a list of time values at which the sensor 3 output is a binary ' 1 ' value. An operator viewing video data classified in this manner can then use a summation process of the type described with reference to Figure 3 so as to determine periods of relatively high activity. It will be appreciated that storing raw sensor values as opposed to generalised classification codes allows an operator greater flexibility. Indeed, an operator may wish to view all programme elements defined by more than two sensor activations within a predetermined time period.
In the embodiments of the invention described above, the sensor 3 has been described as a motion sensor, and more particularly PER. detector. It will be appreciated that other motion detectors such as, for example, active infrared sensors are equally applicable for use in the invention. Furthermore, the sensor 3 need not be a motion sensor, hi some embodiments of the present invention the sensor 3 takes the form of a microphone, and a sound level detected by the microphone is used as input to the controller 1. hi such embodiments of the invention, the output of the sensor 3 may not be a binary output, but instead be an analogue value indicative of sound value measured in decibels. In such embodiments of the invention it will be readily apparent to one skilled in the art that a simple thresholding algorithm can be used so as to define binary values of the type described above. That is, if the sound level is above a predetermined value a ' 1 ' value is generated, while if the sensor output is below the predetermined value a '0' value is generated. The present invention is also applicable where the sensor 3 is a pressure sensor placed, for example, on a floor and thus detecting movement within a room.
It will also be appreciated that the sensor 3 can be a plurality of different sensors, the outputs of which are combined by the controller 1 to generate
classification codes. For example a motion detector can be used to compute classification code in the manner described with reference to Figure 3. A sound level of a microphone can then be additionally analysed as described above using a relatively high threshold. If it is the case that the detected sound level is, at any time, in excess of the high threshold a special classification code indicating suspicious activity may be applied to the video data.
The present invention is also applicable to a system in which recording by the video camera 2 is triggered by the sensor 3. Classification codes can then be applied to captured video data in the manner described above. The present invention is also applicable to systems in a plurality of video cameras monitoring different spaces, in which it is desired to record a single stream of video data. In such systems, the single stream of video data is, at any one time, generated by the output of a single video camera. This video camera from which video data is stored can suitably be selected by appropriately positioning various sensors and using this data as the basis for camera selection. In such embodiments of the invention, the classification data relating to the video data 5 can simply indicate the camera from which the appropriate video data was captured. This can be determined on the basis of which sensor triggered recording. In such embodiments of the present invention, an operator may know that suspicious activity occurred within an area monitored by a particular camera, and can use the classification data 6 to locate parts of the video data 5 which were provided by that video camera.
Referring now to Figure 5, there is illustrated a modified version of the system of Figure 1. In the system illustrated in Figure 5, the controller 1 comprises a video data buffer 7 and a classification code determining means 8. It can be seen that video data from the video camera 2 is passed directly to the video data buffer 7, while sensor data from the sensor 3 is passed directly to the classification code determining means 8. The classification data 6 is provided by the classification code determining means 8, and the video data 5 is provided from the video data buffer 7.
Figure 6 illustrates an overview of operation of the system of Figure 5. At step S18 video data is received by the buffer 7 from the video camera 2. At step S 19, classification code determining means 8 determines a classification code for a portion of the video data stored in the video data buffer 7. This can conveniently be carried
out using a process as illustrated in Figure 3, and described above. At step S20, the classification code determined at step S 19 is compared with a predetermined criteria. This criteria may be, for example, a predetermined level of activity. If the condition of step S20 is satisfied, processing passes to step S21 where the video data associated with the classification code generated at step S19 is written from the video data buffer 7 to the video data 5 stored on the non-volatile storage device 4. Similarly, at step S22 the classification code determined by the classification code determining means 8 is written to the classification data 6. Having copied video data from the video data buffer 7 to the video data 5, the video data buffer 7 is cleared at step S23. If the predetermined criteria of step S20 is not satisfied the video data is simply deleted from the video data buffer 7 (step S23), and is not written to the non-volatile storage device 4.
The video data buffer 7 can conveniently be implemented as a plurality of buffers arranged in parallel, each holding a different programme element. In this way, ' a plurality of programme elements may be stored in the video data buffer 7 before a decision is made as to whether such programme elements should be stored as part of the video data 5 stored on the non-volatile storage device 4. Each of the plurality of buffers is provided with a flag indicating whether its data can be overwritten. This flag is set when data is written to a respective buffer, and unset when data is copied to the video data 5 or a decision is taken that the programme element is not to be stored. The implementation of such a buffering arrangement will be readily apparent to one of ordinary skill in the art.
It can be seen that the embodiment of the invention as described with reference to Figures 5 and 6 provides a convenient mechanism for storing only portions of video data which represent periods of relatively high activity within the space to be monitored, thereby saving storage space. Video data that is stored is classified in the manner described above.
In some embodiments of the present invention, the classification data 6 may periodically be used to identify portions of the video data 5 representing periods of relatively low activity. Having identified such periods of the video data 5, this video data may be deleted so as to create more free space on the non- volatile storage device 4.
The manipulation and viewing of a classified stream of video data can be carried out using various developments made by the present applicant and described in US Patent Application publication No! US2004/0070594 (application No. 10/435,178) the contents of which are herein incorporated by reference. The adaptation of such techniques to the viewing of video data captured using the methods described above will be readily apparent.
In particular, in some embodiments of the present invention, a user may simply specify that they are interested in periods of the recorded video data 5 which represent periods of relatively high activity. On receiving such a request, the controller 1 may interrogate the classification data 6 to determine an average activity level using stored classification codes. Having determined such an average activity level classification codes representing periods of above average activity are identified, and the' corresponding video data is received from the video data 5.
The embodiments of the invention described above are intended only to be examples of ways in which the present invention may be put into effect, and are in no way intended to limit the scope of the claims. Indeed, it will be readily apparent to one of ordinary skill in the art that various amendments can be made to the embodiments described above without departing from the spirit and scope of the present invention as defined by the appended claims.
Claims
1. A method of classifying video data representing activity within a space to be monitored, the method comprising: receiving video data from a camera configured to monitor the space; receiving sensor data indicative of a condition occurring within the space; defining a plurality of programme elements within said video data, each programme element having an associated classification code, each classification code being selected using said sensor data; storing video data representing said programme elements; and storing said classification codes associated with said programme elements; wherein said classification codes represent values on a scale extending from a low value to a high value, said scale representing relative activity within the space being monitored.
2. A method according to claim 1, wherein said sensor data is obtained using a motion sensor.
3. A method according to claim 1 or 2, wherein said sensor data is obtained using a sound sensor.
4. A method according to claim 1, 2 or 3, wherein said sensor data is obtained using a pressure sensor.
5. A method according to any preceding claim, further comprising: receiving video data from a plurality of cameras; and storing data from one of said plurality of cameras selected on the basis of said sensor data.
6. A method according to claim 5, wherein the classification code associated with each programme element identifies the camera of said plurality of cameras which was used to obtain the video data making up said programme element.
7. A method according to any preceding claim, wherein storing video data representing said programme elements comprises: determining whether each classification code satisfies a predetermined condition; and storing a programme element if but only if its associated classification code satisfies said predetermined condition.
8. A method according to any preceding claim, wherein said classification codes are selected from a predetermined set of classification codes.
9. A method according to any preceding claim, wherein each classification code is selected in dependence upon a number of sensor activations occurring within a predetermined time period.
10. A method according to any preceding claim, further comprising: deleting video data representing some programme elements, wherein video data to be deleted is selected on the basis of said classification codes.
11. A method according to any preceding claim, wherein video data to be deleted is video data representing periods of relatively low activity within the space being monitored.
12. A method according to any preceding claim, further comprising: receiving user selection of a classification code; and displaying programme elements associated with said classification code.
13. A method according to claim 9 or any claim dependent thereon, further comprising: receiving user input representing a request to display programme elements representing periods of relatively high activity within the space being monitored; determining at least one classification code associated with programme elements representing periods of relatively high activity within the space being monitored; and displaying programme elements associated with the determined classification codes.
14. A method according to claim 13, wherein said determining comprises: calculating an average level of activity for all programme elements; and determining classification codes representing periods of above average activity.
15. A data carrier carrying computer program code to cause a computer to carry out the method of any preceding claim.
16. An apparatus for classifying video data representing activity within a space to be monitored, the apparatus comprising: a program memory storing processor readable instructions; and a processor configured to read and execute instructions stored in said program memory; wherein said processor readable instructions comprise instructions controlling the processor to carry out the method of any one of claims 1 to 14.
17. An apparatus for classifying video data representing activity within a space to be monitored, the apparatus comprising: a storage device configured to store video data obtained from a video camera configured to monitor the space; input means configured to receive sensor data indicative of a condition occurring within the space; means for defining a plurality of programme elements within said video data, each programme element having an associated classification code, said classification code being selected using said sensor data; wherein said classification codes represent values on a scale extending from a low value to a high value, said scale representing relative activity within the space being monitored.
18. An apparatus according to claim 17, further comprising a video camera.
19. An apparatus according to claim 17 or 18, further comprising at least one sensor.
20. An apparatus according to claim 19, wherein said at least one sensor is a motion sensor.
21. An apparatus according to claim 19 or 20, wherein said at least one sensor is a pressure sensor.
22. An apparatus according to claim 19, 20 or 21, wherein said at least one sensor is a sound sensor.
23. A method of classifying video data representing activity within a space to be monitored, the method comprising: receiving video data from a camera configured to monitor the space; receiving sensor data indicative of a condition occurring within the space; defining a plurality of programme elements within said video data, each programme element having an associated classification code, each classification code being selected using said sensor data; storing video data representing said programme elements; and storing said classification codes associated with said programme elements.
24. An apparatus for classifying video data representing activity within a space to be monitored, the apparatus comprising: a storage device configured to store video data obtained from a video camera configured to monitor the space; input means configured to receive sensor data indicative of a condition occurring within the space; means for defining a plurality of programme elements within said video data, each programme element having an associated classification code, said classification code being selected using said sensor data.
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/066,639 US9449481B2 (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for classifying video data |
PCT/GB2005/003570 WO2007031697A1 (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for classifying video data |
US15/267,364 US9860482B2 (en) | 2005-09-16 | 2016-09-16 | Method and apparatus for classifying video data |
US15/856,738 US10499005B2 (en) | 2005-09-16 | 2017-12-28 | Method and apparatus for classifying video data |
US16/676,161 US11012660B2 (en) | 2005-09-16 | 2019-11-06 | Method and apparatus for classifying video data |
US17/245,737 US11889226B2 (en) | 2005-09-16 | 2021-04-30 | Method and apparatus for classifying video data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/GB2005/003570 WO2007031697A1 (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for classifying video data |
Related Child Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/066,639 A-371-Of-International US7363492B2 (en) | 2005-02-25 | 2005-02-25 | Method for zero-knowledge authentication of a prover by a verifier providing a user-selectable confidence level and associated application devices |
US12/066,639 A-371-Of-International US9449481B2 (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for classifying video data |
US15/267,364 Continuation US9860482B2 (en) | 2005-09-16 | 2016-09-16 | Method and apparatus for classifying video data |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007031697A1 true WO2007031697A1 (en) | 2007-03-22 |
Family
ID=36762938
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/GB2005/003570 WO2007031697A1 (en) | 2005-09-16 | 2005-09-16 | Method and apparatus for classifying video data |
Country Status (2)
Country | Link |
---|---|
US (5) | US9449481B2 (en) |
WO (1) | WO2007031697A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010015644A1 (en) * | 2008-08-05 | 2010-02-11 | Barco N.V. | Display device and method with content recording and/or streaming |
US20210166011A1 (en) * | 2013-11-14 | 2021-06-03 | James Carey | Entertainment device safety system and related methods of use |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11386759B2 (en) | 2016-05-09 | 2022-07-12 | Herbert S Kobayashi | Three level detector signal for multicamera video alarm system for remote monitoring and method |
US10679477B2 (en) * | 2016-05-09 | 2020-06-09 | Herbert S Kobayashi | Multicamera video alarm system for remote monitoring and method |
US20230274549A1 (en) * | 2022-02-28 | 2023-08-31 | Samsung Electronics Company, Ltd. | Systems and Methods for Video Event Segmentation Derived from Simultaneously Recorded Sensor Data |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040247205A1 (en) * | 2003-06-06 | 2004-12-09 | Shigeki Nagaya | Recording and reproducing system for image data with recording position information and a recording and reproducing method therefor |
US20050128318A1 (en) * | 2003-12-15 | 2005-06-16 | Honeywell International Inc. | Synchronous video and data annotations |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5191645A (en) | 1991-02-28 | 1993-03-02 | Sony Corporation Of America | Digital signal processing system employing icon displays |
JP3875284B2 (en) | 1994-04-14 | 2007-01-31 | ソニー株式会社 | Television broadcast reservation recording method and apparatus |
JP3562424B2 (en) | 1994-08-16 | 2004-09-08 | ソニー株式会社 | Television signal receiving apparatus and method |
KR100409187B1 (en) | 1994-08-16 | 2004-03-10 | 소니 가부시끼 가이샤 | TV signal receiver and program switching device and method and remote controller |
JP3625096B2 (en) | 1995-12-26 | 2005-03-02 | ソニー株式会社 | Television broadcasting apparatus, television broadcasting method, television signal receiving apparatus, and television signal receiving method |
IL125141A0 (en) | 1998-06-29 | 1999-01-26 | Nds Ltd | Advanced television system |
US20030088872A1 (en) | 1997-07-03 | 2003-05-08 | Nds Limited | Advanced television system |
US20040070594A1 (en) | 1997-07-12 | 2004-04-15 | Burke Trevor John | Method and apparatus for programme generation and classification |
GB0225339D0 (en) | 2002-10-31 | 2002-12-11 | Trevor Burke Technology Ltd | Method and apparatus for programme generation and classification |
GB9714624D0 (en) | 1997-07-12 | 1997-09-17 | Trevor Burke Technology Limite | Visual programme distribution system |
US20020191950A1 (en) | 2001-06-15 | 2002-12-19 | Xiaoling Wang | Apparatus and a method for preventing commercial skipping |
US7242295B1 (en) * | 2001-09-06 | 2007-07-10 | Vistascape Security Systems Corp. | Security data management system |
US8155498B2 (en) | 2002-04-26 | 2012-04-10 | The Directv Group, Inc. | System and method for indexing commercials in a video presentation |
CN1726712B (en) | 2002-12-12 | 2010-04-28 | 皇家飞利浦电子股份有限公司 | Apparatus and method for preventing switching from a channel during an advertisement display |
US7664292B2 (en) * | 2003-12-03 | 2010-02-16 | Safehouse International, Inc. | Monitoring an output from a camera |
AU2004233453B2 (en) * | 2003-12-03 | 2011-02-17 | Envysion, Inc. | Recording a sequence of images |
US7697026B2 (en) * | 2004-03-16 | 2010-04-13 | 3Vr Security, Inc. | Pipeline architecture for analyzing multiple video streams |
US7746378B2 (en) * | 2004-10-12 | 2010-06-29 | International Business Machines Corporation | Video analysis, archiving and alerting methods and apparatus for a distributed, modular and extensible video surveillance system |
US8274564B2 (en) * | 2006-10-13 | 2012-09-25 | Fuji Xerox Co., Ltd. | Interface for browsing and viewing video from multiple cameras simultaneously that conveys spatial and temporal proximity |
US9442100B2 (en) * | 2013-12-18 | 2016-09-13 | Medibotics Llc | Caloric intake measuring system using spectroscopic and 3D imaging analysis |
-
2005
- 2005-09-16 US US12/066,639 patent/US9449481B2/en active Active
- 2005-09-16 WO PCT/GB2005/003570 patent/WO2007031697A1/en active Application Filing
-
2016
- 2016-09-16 US US15/267,364 patent/US9860482B2/en active Active
-
2017
- 2017-12-28 US US15/856,738 patent/US10499005B2/en active Active
-
2019
- 2019-11-06 US US16/676,161 patent/US11012660B2/en active Active
-
2021
- 2021-04-30 US US17/245,737 patent/US11889226B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040247205A1 (en) * | 2003-06-06 | 2004-12-09 | Shigeki Nagaya | Recording and reproducing system for image data with recording position information and a recording and reproducing method therefor |
US20050128318A1 (en) * | 2003-12-15 | 2005-06-16 | Honeywell International Inc. | Synchronous video and data annotations |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010015644A1 (en) * | 2008-08-05 | 2010-02-11 | Barco N.V. | Display device and method with content recording and/or streaming |
US20210166011A1 (en) * | 2013-11-14 | 2021-06-03 | James Carey | Entertainment device safety system and related methods of use |
US11488409B2 (en) * | 2013-11-14 | 2022-11-01 | James Carey | Entertainment device safety system and related methods of use |
US20230058439A1 (en) * | 2013-11-14 | 2023-02-23 | James Carey | Entertainment device safety system and related methods of use |
Also Published As
Publication number | Publication date |
---|---|
US20200137348A1 (en) | 2020-04-30 |
US11012660B2 (en) | 2021-05-18 |
US9449481B2 (en) | 2016-09-20 |
US10499005B2 (en) | 2019-12-03 |
US20090028512A1 (en) | 2009-01-29 |
US11889226B2 (en) | 2024-01-30 |
US9860482B2 (en) | 2018-01-02 |
US20180191995A1 (en) | 2018-07-05 |
US20210250543A1 (en) | 2021-08-12 |
US20170006254A1 (en) | 2017-01-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11889226B2 (en) | Method and apparatus for classifying video data | |
US5996023A (en) | Efficient pre-alarm buffer management in intelligent video information management system | |
US6421080B1 (en) | Digital surveillance system with pre-event recording | |
CN104581043B (en) | Monitoring method | |
US7760230B2 (en) | Method for automatically reducing stored data in a surveillance system | |
WO2014041912A1 (en) | Image processing system, image processing method and program | |
US20030228128A1 (en) | High-speed search of recorded video information to detect motion | |
JP2007243699A (en) | Method and apparatus for video recording and playback | |
EP1325630A1 (en) | A method of searching recorded digital video for areas of activity | |
US20140226951A1 (en) | System and Method of Alarm and History Video Playback | |
KR20190079110A (en) | Apparatus and method for image analyzing based on self-learning | |
WO2021199323A1 (en) | Management device, management system, monitoring system, estimating method, and recording medium | |
US8126212B2 (en) | Method of detecting moving object | |
JP5962278B2 (en) | Image processing program, image processing apparatus, and image processing method | |
US9111237B2 (en) | Evaluating an effectiveness of a monitoring system | |
GB2415564A (en) | Classifying video data | |
CN114612844A (en) | Smoking detection method and device, electronic equipment and storage medium | |
US20110234912A1 (en) | Image activity detection method and apparatus | |
KR101362630B1 (en) | Method for chasing object moving path in digital video recorder | |
KR101994287B1 (en) | Apparatus and method for backup image | |
JP4212486B2 (en) | Information recording device | |
KR101500738B1 (en) | Apparatus and method for data back up in digital video recorder | |
KR20070031072A (en) | Method for controlling record in digital video recorder | |
KR20070036890A (en) | Method for managing important monitoring video in digital video recorder | |
KR20080005633A (en) | Method for displaying remain time in digital video recorder |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12066639 Country of ref document: US |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 05789296 Country of ref document: EP Kind code of ref document: A1 |