Open Access

Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model

EURASIP Journal on Embedded Systems20062007:029858

DOI: 10.1155/2007/29858

Received: 27 April 2006

Accepted: 14 September 2006

Published: 19 December 2006


Tracking applications based on distributed and embedded sensor networks are emerging today, both in the fields of surveillance and industrial vision. Traditional centralized approaches have several drawbacks, due to limited communication bandwidth, computational requirements, and thus limited spatial camera resolution and frame rate. In this article, we present network-enabled smart cameras for probabilistic tracking. They are capable of tracking objects adaptively in real time and offer a very bandwidthconservative approach, as the whole computation is performed embedded in each smart camera and only the tracking results are transmitted, which are on a higher level of abstraction. Based on this, we present a distributed surveillance system. The smart cameras' tracking results are embedded in an integrated 3D environment as live textures and can be viewed from arbitrary perspectives. Also a georeferenced live visualization embedded in Google Earth is presented.

[1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31]

Authors’ Affiliations

Wilhelm Schickard Institute for Computer Science, Graphical-Interactive Systems (WSI/GRIS), University of Tübingen


  1. Mullins J: Rings of steel ii, New York city gets set to replicate London's high-security zone. to appear in IEEE Spectrum
  2. What happens in vegas stays on tape
  3. Google earth
  4. Bramberger M, Doblander A, Maier A, Rinner B, Schwabach H: Distributed embedded smart cameras for surveillance applications. Computer 2006,39(2):68-75. 10.1109/MC.2006.55View ArticleGoogle Scholar
  5. Wolf W, Ozer B, Lv T: Smart cameras as embedded systems. Computer 2002,35(9):48-53. 10.1109/MC.2002.1033027View ArticleGoogle Scholar
  6. Doucet A, Freitas ND, Gordon N: Sequential Monte Carlo Methods in Practice. Springer, New York, NY, USA; 2001.MATHView ArticleGoogle Scholar
  7. Isard M, Blake A: Condensation—conditional density propagation for visual tracking. International Journal of Computer Vision 1998,29(1):5-28. 10.1023/A:1008078328650View ArticleGoogle Scholar
  8. Haykin S, de Freitas N: Special issue on sequential state estimation. Proceedings of the IEEE 2004,92(3):399-400. 10.1109/JPROC.2003.823140View ArticleGoogle Scholar
  9. Comaniciu D, Ramesh V, Meer P: Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 2003,25(5):564-577. 10.1109/TPAMI.2003.1195991View ArticleGoogle Scholar
  10. Okuma K, Taleghani A, de Freitas N, Little JJ, Lowe DG: A boosted particle filter: multitarget detection and tracking. Proceedings of 8th European Conference on Computer Vision (ECCV '04), May 2004, Prague, Czech Republic Google Scholar
  11. Nummiaro K, Koller-Meier E, Gool LV: A color based particle filter. Proceedings of the 1st International Workshop on Generative-Model-Based Vision (GMBV '02), June 2002, Copenhagen, Denmark Google Scholar
  12. Pérez P, Hue C, Vermaak J, Gangnet M: Color-based probabilistic tracking. Proceedings of 7th European Conference on Computer Vision (ECCV '02), June 2002, Copenhaguen, Denmark 661-675.Google Scholar
  13. Pérez P, Vermaak J, Blake A: Data fusion for visual tracking with particles. Proceedings of the IEEE 2004,92(3):495-513. issue on State Estimation 10.1109/JPROC.2003.823147View ArticleGoogle Scholar
  14. Spengler M, Schiele B: Towards robust multi-cue integration for visual tracking. Proceedings of the 2nd International Workshop on Computer Vision Systems, July 2001, Vancouver, BC, Canada, Lecture Notes in Computer Science 2095: 93-106.View ArticleGoogle Scholar
  15. Surveillance works: look who's watching IEEE Signal Processing Magazine 2005.,22(3):
  16. Boult T, Lakshmikumar A, Gao X: Surveillance methods. Proceedings of IEEE Computer Society International Conference on Computer Vision and Pattern Recognition (CVPR '05), June 2005, San Diego, Calif, USA Google Scholar
  17. Siebel N, Maybank S: The advisor visual surveillance system. Proceedings of the ECCV Workshop on Applications of Computer Vision (ACV '04), May 2004, Prague, Italy Google Scholar
  18. Trivedi MM, Gandhi TL, Huang KS: Distributed interactive video arrays for event capture and enhanced situational awareness. IEEE Intelligent Systems 2005,20(5):58-65. special issue on Homeland Security, 2005 10.1109/MIS.2005.86View ArticleGoogle Scholar
  19. Yang DB, González-Baños HH, Guibas LJ: Counting people in crowds with a real-time network of simple image sensors. Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV '03), October 2003, Nice, France 1: 122-129.View ArticleGoogle Scholar
  20. Sawhney HS, Arpa A, Kumar R, et al.: Video flashlights—real time rendering of multiple videos for immersive model visualization. Proceedings of the 13th Eurographics Workshop on Rendering (EGRW '02), June 2002, Pisa, Italy 157-168.Google Scholar
  21. Fleck S, Straßer W: Adaptive probabilistic tracking embedded in a smart camera. Proceedings of the IEEE CVPR Embedded Computer Vision Workshop (ECV '05), June 2005, San Diego, Calif, USA 3: 134.Google Scholar
  22. Matrix vision
  23. Project's website
  24. Fleck S, Busch F, Biber P, Straßer W: 3d surveillance—a distributed network of smart cameras for real-time tracking and its visualization in 3d. Proceedings of IEEE CVPR Embedded Computer Vision Workshop (ECV '06), 2006
  25. Fleck S, Busch F, Biber P, Straßer W: 3d surveillance—a distributed network of smart cameras for real-time tracking and its visualization in 3d. Proceedings of Conference on Computer Vision and Pattern Recognition Workshop (CVPRW '06), June 2006 118.Google Scholar
  26. Elgammal A, Duraiswami R, Harwood D, Davis LS: Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proceedings of the IEEE 2002,90(7):1151-1162. 10.1109/JPROC.2002.801448View ArticleGoogle Scholar
  27. Torr PHS, Szeliski R, Anandan P: An integrated Bayesian approach to layer extraction from image sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence 2001,23(3):297-303. 10.1109/34.910882View ArticleGoogle Scholar
  28. Xiao J, Shah M: Motion layer extraction in the presence of occlusion using graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005,27(10):1644-1659. 10.1109/TPAMI.2005.202View ArticleGoogle Scholar
  29. Biber P, Fleck S, Wand M, Staneker D, Straßer W: First experiences with a mobile platform for flexible 3d model acquisition in indoor and outdoor environments—the wägele. Proceedings of the ISPRS Working Group V/4 Workshop 3D-ARCH 2005: Virtual Reconstruction and Visualization of Complex Architectures (ISPRS '05), August 2005, Mestre-Venice, Italy Google Scholar
  30. Biber P, Straßer W: The normal distributions transform: a new approach to laser scan matching. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '03), October 2003, Las Vegas, Nev, USA 3: 2743-2748.Google Scholar
  31. Fleck S, Busch F, Biber P, Andreasson H, Straßer W: Omnidirectional 3d modeling on a mobile robot using graph cuts. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA '05), April 2005, Barcelona, Spain 1748-1754.Google Scholar


© Sven Fleck et al. 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.