Patricio Vela: Course Wiki

User Tools

Site Tools

Trace:
ece4580:module_surveillance

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
ece4580:module_surveillance [2017/02/04 19:50] – [Additional Information] pvelaece4580:module_surveillance [2024/08/20 21:38] (current) – external edit 127.0.0.1
Line 1: Line 1:
 +~~NOTOC~~
 ====== Surveillance System with a Static Camera ====== ====== Surveillance System with a Static Camera ======
  
Line 15: Line 16:
   - Target recognition   - Target recognition
  
 +===== Learning Modules =====
 +----------------------------
 The sequence below introduces one aspect of surveillance systems at a time.  They direct you to Matlab code that sometimes implements multiple steps at a time. It is recommended that you implement each one individually to get a sense for what role it plays in the entire system, rather than just copy/paste the whole system. The sequence below introduces one aspect of surveillance systems at a time.  They direct you to Matlab code that sometimes implements multiple steps at a time. It is recommended that you implement each one individually to get a sense for what role it plays in the entire system, rather than just copy/paste the whole system.
  
-===== Module #1: A Basic Surveillance System  ===== 
---------------------------------------------------- 
-__** Week #1: Setup, Data, and Basics**__ \\ 
-Explore the [[ECE4580:Module_Surveillance:MatlabVideos|datasets available]] and select a couple of videos to use as the starting point for processing, testing, and debugging the surveillance system to be created as part of this learning module. 
  
-Meanwhile, check out this review of three [[http://www.eetimes.com/document.asp?doc_id=1275604|simple background modeling methods]]. You are not advised to use the code provided when implementing the same in future activities.  There are more efficient ways to do the same without resorting to as many for loops, plus the implementation needs to be packaged up for use by the overall system. Plus, the activities below utilize existing Matlab libraries to the extent possible or desirable.+Module Set #1: A Basic (Foreground Detection-Based) Surveillance System 
 +  - [[ECE4580:Module_Surveillance:M1W1|Week #1]]: Setup, Data, and Basics 
 +  - [[ECE4580:Module_Surveillance:M1W2|Week #2]]: Foreground Object Extraction 
 +  - [[ECE4580:Module_Surveillance:M1W3|Week #3]]: Optimization-Based Data Association 
 +  - [[ECE4580:Module_Surveillance:M1W4|Week #4]]: Adding Temporal Dynamics via a Kalman Filter
  
-As a first step, obtain the [[http://pvela.gatech.edu/classes/files/ECE4580/Module_Surveillance/survSystem.m|surveillance system class stub]] and also the [[http://pvela.gatech.edu/classes/files/ECE4580/Module_Surveillance/mainLoop.m|main execution script]]. Modify the main loop code stub so it loads a video you've chosen, loops through the frames, displays the image associated the each frame, and quits when that's done.  Naturally this code won't do any surveillance, but it will setup the system to do so.+Module Set #2: Target Modelling and  Re-Identification 
 +  - [[ECE4580:Module_Surveillance:M2W1|Week #1]]: Differentiating People 
 +  - [[ECE4580:Module_Surveillance:M2W2|Week #2]]: Testing the Person Model 
 +  - [[ECE4580:Module_Surveillance:M2W4|Week #3]]: Re-Identification in Action 
 +  - [[ECE4580:Module_Surveillance:M2W3|Week #4]]: Enhancing Tracking
  
-As a second step, implement the basic background modeling detection step.  Matlab has implementation of the [[https://www.mathworks.com/help/vision/ref/vision.foregrounddetector-class.html|mixtures of Gaussians adaptive background estimation algorithm]].  Just perform the estimation part and retrieve the binary foreground image.  Modify the ''displayState'' function to display this output. When run, the system should display the source video, plus a binary image sequence associated to the detected objects.+Module #3: Merging and Splitting 
 +  - TBD
  
-//Explore & Deliverables:// How well is the background modeled? You can identify how well it works by examining the quality of the binary image sequence.  Does it capture the target objects only? Are thre more false positives or false negatives than you like?  What did you do to get the best result possible (to what parameters)?  you should turn in at least one image pair showing the input frame, plus the output frame after foreground detection (or with the mask as noted in the code stub). +Module #4: Tracking vs Detection 
- +  - TBD.
-__** Week #2: Foreground Object Extraction **__ \\ +
-*TODO:* Advance beyond the current foreground modeling step to include processing of the binary foreground image for extraction of detected targets and their bounding boxes. +
-[[https://www.mathworks.com/help/vision/examples/detecting-cars-using-gaussian-mixture-models.html|Extracting the foreground objects]] is really performing blob extraction from the binary foreground image. +
- +
-__** Week #3: Optimization-Based Data Association **__ \\ +
-Performing detection does provide a means to identify objects of interest versus the prevailing background image. However if we are interested in maintaining the identity of the objects, additional processing and logic is required.  The simplest scheme simply considers the spatio-temporal history of the targets and tries to link the current detected objects to the previously detected objects. This form of data association is known as the //assignment problem.// +
- +
-Two algorithms:  +
-[[https://www.mathworks.com/matlabcentral/fileexchange/20652-hungarian-algorithm-for-linear-assignment-problems--v2-3-|Hungarian or Munkres' algorithm]] and +
-[[https://www.mathworks.com/matlabcentral/fileexchange/26836-lapjv-jonker-volgenant-algorithm-for-linear-assignment-problem-v3-0|Jonker-Volgenant Algorithm]]. +
- +
-The net result should be similar to this Matlab demo on [[http://www.mathworks.com/help/vision/examples/motion-based-multiple-object-tracking.html|multiple object tracking]], which also implements far more than what is described.  You should strip the extras. +
- +
-__** Week #4: Adding Temporal Dynamics via a Kalman Filter **__ \\ +
- +
-We can do a better job handling things like occlusions, as well as improve the data association, by adding in a temporal filter.  A simple, powerful method is to recursively estimate and correct the moving target dynamics through a Kalman filter.  Matlab has a page on how to do so for  +
-[[https://www.mathworks.com/help/vision/examples/using-kalman-filter-for-object-tracking.html|object tracking]] along with a more general [[https://www.mathworks.com/discovery/kalman-filter.html | intro page]] to additional documentation. +
- +
-  * If you are interested in the details of the Kalman filter and their connection to code, this Matlab file exchange [[https://www.mathworks.com/matlabcentral/fileexchange/5377-learning-the-kalman-filter|code tutorial]] may be of assistance. +
- +
-===== Module #2: Going Further ===== +
------------------------------------- +
- +
-__** Week #1: Differentiating People **__ +
- +
-Gaussian mixture model for targets using [[http://www.mathworks.com/matlabcentral/fileexchange/26184-em-algorithm-for-gaussian-mixture-model|Expectation Maximization algorithm]]. +
- +
-__** Week #2: Appearance-Based Data Association **__ +
- +
-Comparing models. +
- +
-__** Week #3: Re-Identification **__ +
- +
-Using comparison to know when same person has re-entered. +
- +
-===== Module #3: Merging and Splitting ===== +
--------------------------- +
- +
-TBD.+
  
 ===== Additional Information ===== ===== Additional Information =====
ece4580/module_surveillance.1486255803.txt.gz · Last modified: 2024/08/20 21:38 (external edit)