Moving object detection using low illumination depth capable computer vision

(21) (22) (65)

(60)

(51) (52) (58)

(56)

Appl. No.: 10/964,299
Filed: Oct. 12, 2004

Prior Publication Data

US 2005/0100192 Al May 12, 2005

Related U.S. Application Data

Provisional application No. 60/510,179, filed on Oct. 9, 2003.

Int. CI.

G06K 9/00 (2006.01)

U.S. CI 382/104; 382/106; 382/154;

382/181

Field of Classification Search 382/104,

382/106, 154, 181, 225; 340/426.22-33, 340/435^137, 901, 907; 701/301-302;

348/169

See application file for complete search history.
References Cited
U.S. PATENT DOCUMENTS

4,607,622 A 8/1986 Fritch et al.

5,414,439 A 5/1995 Groves et al.

5,729,016 A 3/1998 Klapper et al.

5,850,470 A 12/1998 Kung et al.

5,987,154 A 11/1999 Gibbon et al.

6,049,619 A 4/2000 Anandan et al.

6,104,835 A 8/2000 Han

Moving object detection is based on low illumination image data that includes distance or depth information. The vision system operates on a platform with a dominant translational motion and with a small amount of rotational motion. Detection of moving objects whose motions are not consistent with the movement of the background is complementary to shape-based approaches. For low illumination computerbased vision assistance a two-stage technique is used for simultaneous and subsequent frame blob correspondence. Using average scene disparity, motion is detected without explicit ego-motion calculation. These techniques make use of characteristics of infrared sensitive video data, in which heat emitting objects appear as hotspots.

18 Claims, 6 Drawing Sheets

Liu, Xia, et al., "Pedestrian Detection Using Stereo Night Vision", pp. 1-10, IEEE Lransactions on Vehicular Lechnology, pp. 16571665, vol. 53-6, Nov. 2004.

PCL International Search Report and Written Opinion, PCL/US04/ 33973, Sep. 19, 2006.

A. Baumberg and D. Hogg, "Learning Flexible Models From Image Sequences," European Conference on Computer Vision, vol. 1,

1994, pp. 299-308.

A. Broggi et al., "Shape-Based Pedestrian Detection," Proceedings of the IEEE Intelligent Vehicles, Symposium, Dearborn (MI), USA, Oct. 2000, pp. 215-220.

Q. Cai and J. K. Aggarwal, "Tracking Human Motion in Structured Environments Using a Distributed-Camera System," IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(12), Nov. 1999, pp. 1241-1247.

Y. Cheng, "Mean Shift, Mode Seeking, and Clustering," IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(8),

1995, pp. 790-799.

D. Comaniciu et al., "Real-Time Tracking of Non-Rigid Objects
Using Mean Shift," Proc. IEEE Conf. On Computer Vision and
Pattern Recognition, vol. 2, Jun. 13-15, 2000, pp. 142-149.
R. Cutler and L. Davis, "Robust Real-Time Periodic Motion Detec-
tion, Analysis, and Applications," IEEE Transaction on Pattern
Analysis and Machine Intelligence, 22(8), Aug. 2000, pp. 781-796.
T. Darrell et al., "Integrated Person Tracking Using Stereo, Color,
and Pattern Detection," IEEE Conference on Computer Vision and
Pattern Recognition, 1998, pp. 1-8.

J. Deutscher et al., "Articulated Body Motion Capture by Annealed

Particle Filtering," Proc. IEEE Conf. On Computer Vision and

Pattern Recognition, vol. 2, 2000, pp. 126-133.

U. Franke et al., "Autonomous Driving Goes Downtown," IEEE

Intelligent Systems, Nov./Dec. 1998, pp. 32-40.

D. M. Gavrila and V. Philomin, "Real-Time Object Detection for

'Smart' Vehicles," Proc. of IEEE International Conference on

Computer Vision, 1999, 6 pages.

I. Haritaoglu et al., "Backpack: Detection of People Carrying Objects Using Silhouettes," International Conference on Computer Vision, Sep. 1999, 6 pages.

I. Haritaoglu et al., "W4: Real-Time Surveillance of People and Their Activities," IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), Dec. 2000, pp. 809-830

Haykin, Simon, "Adaptive Filter Theory," Third Edition, Prentice Hall, Inc., New Jersey, 1996, pp. 302-334.

B. Heisele et al., "Face Recognition With Support Vector Machines:
Global Versus Component-Based Approach," IEEE International
Conference on Computer Vision, 2001, pp. 688-694.

I. Kakadiaris and D. Metaxas, "Model-Based Estimation of 3D
Human Motion," IEEE Transactions on Pattern Analysis and
Machine Intelligence, 22(12), Dec. 2000, pp. 1453-1459.
A. Mohan and T. Poggio, "Example-Based Object Detection in
Images by Components," IEEE Transactions on Pattern Analysis
and Machine Intelligence, 23(4), Apr. 2001, pp. 349-361.

C. Papageorgiou et al., "ATrainable Pedestrian Detection System,"
Proc. Of Intelligent Vehicles, Oct. 1998, pp. 241-246.

M. Oren et al., "Pedestrian Detection Using Wavelet Templates," IEEE Proc. On Computer Vision and Pattern Recognition, 1997, pp. 193-199.

E. Osuna et al., "Training Support Vector Machines: an Application to Face Detection," Computer Vision and Pattern Recognition, 1997, pp. 130-136.

R. Polana and R. Nelson, "Low Level Recognition of Human Motion," Workshop on Motion of Non-Rigid and Articulated Objects, Oct. 1994, pp. 77-82.

Y. Ricquebourg and P. Boufhemy, "Real-Time Tracking of Moving Persons by Exploiting Spatio-Temporal Image Slices," IEEE Transaction on Pattern Analysis and Machine Intelligence, 22(8), Aug. 2000, pp. 797-808.

K. Rohr, "Incremental Recognition of Pedestrians From Image Sequences," Proc. Computer Vision and Pattern Recognition, 1993, pp. 8-13.

S. Romdhani et al., "Computationally Efficient Face Detection," IEEE International Conference on Computer Vision, 2001, pp. 1-7. H. Sawhney et al., "Independent Motion Detection 3D Scences," IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10), Oct. 2000, pp. 1191-1199.

Y. Song et al., "Towards Detection of Human Motion," IEEE Conf. On Computer Vision and Pattern Recognition, 2000, pp. 810-817. V. Vapnik, "Statistical Learing Theory," Springer, 2000, pp. 24-25. G. Welch and G. Bishop, "An Introduction to the Kalman Filter," University of North Carolina at Chapel Hill, Department of Computer Science, Chapel Hill, NC, TR95-041.

L. Zhao and C. Thorpe, "Stereo and Neural Network-Based Pedestrian Detection," Proc. Int'l. Conf. On Intelligent Transportation Systems, Oct. 1999, 6 pages.

Liu, Xia, et al., "Pedestrian Detection Using Stereo Night Vision," IEEE Transactions on Vehicular Technology, vol. 53-6, Nov. 2004, pp. 1657-1665.

Xu, Fengliang, et al., "Pedestrian Detection and Tracking with Night Vision," IEEE Transactions on Intelligent Transportation Systems, vol. 5, No. 4, 2004, pp. 1-10.

* cited by examiner