Links to: Grading Homework Resources Classes:
1
2
3
4
5
6
7
8
9
10
11
12
13
Video surveillance is one of the fastest growing areas of commercial application of computer vision and machine learning techniques and a very lively area of academic research.
The course will provide an overview of techniques for visual monitoring, including video surveillance, meeting mining, and human activity understanding. The course examines the basic techniques of processing video from static cameras, starting with object detection and tracking. We progress to examine further video analytic modules, including face detection, trajectory analysis and object classification. We will examine system design and specific problems in visual surveillance, such as the use of multiple cameras and moving cameras. Privacy issues will be examined, focusing on approaches where automatic processing can help protect privacy. Finally the course will look at some specific application domains and commercial systems.
The course will be illustrated throughout with research papers and data from public data bases, with some examples drawn from our own work at IBM.
Late assignments will be penalized according to the following schedule:
| 0-24 hours | 0.9 |
| 24-72 hours | 0.7 |
| 72-168 hours | 0.5 |
| >1 week | 0.0 |
| 28 Jan | 1SFT | Course overview & grading. Project suggestions. Surveillance Overview and examples. Structure of surveillance systems. Demonstration of the IBM Smart Surveillance Solution. Slides: Surveillance overview and architectures (Senior) Slides: Class overview and project ideas (Feris) |
| 4 Feb | 2T | Object detection: Image differencing, Background subtraction Slides: Moving object detection part 1 |
| 18 Feb | 3T | Object detection: Advanced background subtraction and alerts Slides: Advanced Moving object detection |
| 25 Feb | 4S | Tracking: assignment problem and dealing with splits and merges Slides: Tracking 1 |
| 3 Mar | 5S | Tracking: other techniques (Mean shift, Condensation, Snakes...) and alerts Slides: Tracking 2 |
| 10 Mar | 6F | Face detection and tracking --> project proposal due Slides: Face Further materials |
| 17 Mar | Spring Recess | |
| 24 Mar | 7F | Object classification Materials |
| 31 Mar | 8F | Behaviour analysis Materials |
| 7 Apr | 9T | Architecture, Database and user interface. Search/Retrieval. --> project report / mid-evaluation Materials |
| 14 Apr | 10S | Moving cameras : Active control & processing. Multiple cameras camera hand-off Slides: Moving/Multiple Cameras |
| 21 Apr | 11S | Tracking in multiple cameras. Privacy protection & social issues in video surveillance Slides: Privacy |
| 28 Apr | 12T | Application domains: public sector, retail, meeting mining. Commercial Systems Slides |
| 5 May | 13FT | Catch-up. Emerging topics and future directions Slides |