SlideShare a Scribd company logo
Object Detection,
Tracking, Classification,
and Counting
SHOUNAK MITRA
ADVISOR: PROFESSOR TAT. S. FU, PHD, P.E.
CIVIL AND ENVIRONMENTAL ENGINEERING DEPARTMENT
UNIVERSITY OF NEW HAMPSHIRE
1
Overview
 Significance of the project
 Use of camera angles
 Video Demonstration
 Object Detection
 Noise and Shadow issues
 Tracking
 Classification
 Counting
2
Project Significance:
 Pedestrian Detection and Counting
 Synchronization of the Objects passing
over the bridge and the readings of
strain gauges and accelerometers.
3
Clip Obtained from Prof. Bell’s lab
(Travis and Griggs)
Camera angles obtained from DOT
Algorithm 5
Read
Video File
Background
Separation/
Foreground
Detection
Foreground
Filtration
Blob
Analysis
Detect
Boxes
Noise and
Shadow
Issues
Classification
and
Counting
Detection Phase
Processing PhaseFinal Phase
Object Detection Flow
VIDEO FRAME FOREGROUND DETECTION
FOREGROUND FILTRATION OBJECT DETECTION AND COUNTING
6
Noise Removal
 Preprocessing and Thresholdng:
 Deleting boxes formed at unexpected
locations
 Kalman Filter
7
What is Kalman Filter?
 A Kalman filter is an optimal recursive data processing algorithm
 The Kalman filter incorporates all information that can be provided
to it. It processes all available measurements, regardless of their
precision, to estimate the current value of the variables of interest
 Computationally efficient due to its recursive structure
 Assumes that variables being estimated are time dependent
8
What does it do?
 Predictor: predicts parameter values ahead of current
measurements
 Noise Reduction: reduces noise introduced by inaccurate
detections
 Tracking: Facilitates the process of association of multiple objects to
their tracks
9
Kalman Filter AKA Predictor - Corrector
(1) Project the state ahead
xˆ-
k = Axˆk – 1 + Buk – 1
(2) Project the error covariance ahead
P-
k = APk – 1 AT + Q
10
Measurement Update (“Correct”)
(1) Compute the Kalman gain
K. k = P-
kHT (HP-
kHT + R)–1
(2) Update estimate with measurement zk
xˆk = xˆ-
k + Kk(zk – Hxˆ-
k )
(3) Update the error covariance
Pk = (I – KkH )P-
k
 Time Update State: Responsible for projecting forward in time the current state
and the error covariance estimates to obtain the a priori estimates for the next
time step.
 Measure update state: Responsible for feedback, i.e. for incorporating a new
measurement into the a priori estimate to obtain an improved a posteriori
estimate.
Tracking using Kalman Filter 11
The Problem of Shadow 12
 Object Misclassification
 Overlapping of Objects
Shadow
Region
Shadow Detection Flow
YES NO
13
Specify
Threshold for
Shadow (Sth)
Get Current
Frame Fn
Store
Background
Frame B
Apply Gaussian
Smoothening
(GB & GFn)
Dn =
B/Fn < 1
Multiply by a
factor > 20
(RDn)
Shadow Detection Flow
Background in RGB Scale Background in Gray Scale Foreground in Gray Scale
Unfiltered Shadow detection Thresholding of Shadow Filtered Shadow Binary Scale
14
Classification
 Color coded classification
 Centroid lying in the color
15
Color Coded Classification and
counting
16
DELETED
SHADOW
REGION
Demonstration Video 17
Ad

More Related Content

What's hot (20)

Object detection with deep learning
Object detection with deep learningObject detection with deep learning
Object detection with deep learning
Sushant Shrivastava
 
Real Time Object Tracking
Real Time Object TrackingReal Time Object Tracking
Real Time Object Tracking
Vanya Valindria
 
Visual Object Tracking: review
Visual Object Tracking: reviewVisual Object Tracking: review
Visual Object Tracking: review
Dmytro Mishkin
 
Introduction to object detection
Introduction to object detectionIntroduction to object detection
Introduction to object detection
Brodmann17
 
Multiple object detection
Multiple object detectionMultiple object detection
Multiple object detection
SAURABH KUMAR
 
Object Detection & Tracking
Object Detection & TrackingObject Detection & Tracking
Object Detection & Tracking
Akshay Gujarathi
 
Object recognition
Object recognitionObject recognition
Object recognition
saniacorreya
 
Object Detection and Recognition
Object Detection and Recognition Object Detection and Recognition
Object Detection and Recognition
Intel Nervana
 
Object tracking
Object trackingObject tracking
Object tracking
ahmadamin636
 
Image segmentation with deep learning
Image segmentation with deep learningImage segmentation with deep learning
Image segmentation with deep learning
Antonio Rueda-Toicen
 
Object recognition
Object recognitionObject recognition
Object recognition
Geraldyne Gengania
 
Optics ordering points to identify the clustering structure
Optics ordering points to identify the clustering structureOptics ordering points to identify the clustering structure
Optics ordering points to identify the clustering structure
Rajesh Piryani
 
Computer Vision image classification
Computer Vision image classificationComputer Vision image classification
Computer Vision image classification
Wael Badawy
 
Feature detection - Image Processing
Feature detection - Image ProcessingFeature detection - Image Processing
Feature detection - Image Processing
Ritesh Kanjee
 
Object detection
Object detectionObject detection
Object detection
Somesh Vyas
 
Object tracking
Object trackingObject tracking
Object tracking
Sri vidhya k
 
Mask R-CNN
Mask R-CNNMask R-CNN
Mask R-CNN
Chanuk Lim
 
Thresholding.ppt
Thresholding.pptThresholding.ppt
Thresholding.ppt
shankar64
 
Moving object detection
Moving object detectionMoving object detection
Moving object detection
Raviraj singh shekhawat
 
Segmentation
SegmentationSegmentation
Segmentation
guest49d49
 
Object detection with deep learning
Object detection with deep learningObject detection with deep learning
Object detection with deep learning
Sushant Shrivastava
 
Real Time Object Tracking
Real Time Object TrackingReal Time Object Tracking
Real Time Object Tracking
Vanya Valindria
 
Visual Object Tracking: review
Visual Object Tracking: reviewVisual Object Tracking: review
Visual Object Tracking: review
Dmytro Mishkin
 
Introduction to object detection
Introduction to object detectionIntroduction to object detection
Introduction to object detection
Brodmann17
 
Multiple object detection
Multiple object detectionMultiple object detection
Multiple object detection
SAURABH KUMAR
 
Object Detection & Tracking
Object Detection & TrackingObject Detection & Tracking
Object Detection & Tracking
Akshay Gujarathi
 
Object recognition
Object recognitionObject recognition
Object recognition
saniacorreya
 
Object Detection and Recognition
Object Detection and Recognition Object Detection and Recognition
Object Detection and Recognition
Intel Nervana
 
Image segmentation with deep learning
Image segmentation with deep learningImage segmentation with deep learning
Image segmentation with deep learning
Antonio Rueda-Toicen
 
Optics ordering points to identify the clustering structure
Optics ordering points to identify the clustering structureOptics ordering points to identify the clustering structure
Optics ordering points to identify the clustering structure
Rajesh Piryani
 
Computer Vision image classification
Computer Vision image classificationComputer Vision image classification
Computer Vision image classification
Wael Badawy
 
Feature detection - Image Processing
Feature detection - Image ProcessingFeature detection - Image Processing
Feature detection - Image Processing
Ritesh Kanjee
 
Object detection
Object detectionObject detection
Object detection
Somesh Vyas
 
Thresholding.ppt
Thresholding.pptThresholding.ppt
Thresholding.ppt
shankar64
 

Viewers also liked (15)

Biometrics
BiometricsBiometrics
Biometrics
King Kamal
 
Detection and classification of vehicles using stereo vision
Detection and classification of vehicles using stereo visionDetection and classification of vehicles using stereo vision
Detection and classification of vehicles using stereo vision
Piero Micelli
 
Vehicle Classification
Vehicle ClassificationVehicle Classification
Vehicle Classification
Syed Owais Ali Chishti
 
Face recognization 1
Face recognization 1Face recognization 1
Face recognization 1
leenak770
 
Machine Learning - Object Detection and Classification
Machine Learning - Object Detection and ClassificationMachine Learning - Object Detection and Classification
Machine Learning - Object Detection and Classification
Vikas Jain
 
Biometric
BiometricBiometric
Biometric
pradeepa n
 
Machine Learning and Applications
Machine Learning and ApplicationsMachine Learning and Applications
Machine Learning and Applications
Geeta Arora
 
CSTalks - Object detection and tracking - 25th May
CSTalks - Object detection and tracking - 25th MayCSTalks - Object detection and tracking - 25th May
CSTalks - Object detection and tracking - 25th May
cstalks
 
Fingerprint, seminar at IASRI, New Delhi
Fingerprint, seminar at IASRI, New DelhiFingerprint, seminar at IASRI, New Delhi
Fingerprint, seminar at IASRI, New Delhi
Nishikant Taksande
 
Face recognization using artificial nerual network
Face recognization using artificial nerual networkFace recognization using artificial nerual network
Face recognization using artificial nerual network
Dharmesh Tank
 
Deep Learning for Computer Vision: Image Retrieval (UPC 2016)
Deep Learning for Computer Vision: Image Retrieval (UPC 2016)Deep Learning for Computer Vision: Image Retrieval (UPC 2016)
Deep Learning for Computer Vision: Image Retrieval (UPC 2016)
Universitat Politècnica de Catalunya
 
Machine learning in image processing
Machine learning in image processingMachine learning in image processing
Machine learning in image processing
Data Science Thailand
 
Bio-metrics Technology
Bio-metrics TechnologyBio-metrics Technology
Bio-metrics Technology
Avanitrambadiya
 
Face recognition technology - BEST PPT
Face recognition technology - BEST PPTFace recognition technology - BEST PPT
Face recognition technology - BEST PPT
Siddharth Modi
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
Rahul Jain
 
Detection and classification of vehicles using stereo vision
Detection and classification of vehicles using stereo visionDetection and classification of vehicles using stereo vision
Detection and classification of vehicles using stereo vision
Piero Micelli
 
Face recognization 1
Face recognization 1Face recognization 1
Face recognization 1
leenak770
 
Machine Learning - Object Detection and Classification
Machine Learning - Object Detection and ClassificationMachine Learning - Object Detection and Classification
Machine Learning - Object Detection and Classification
Vikas Jain
 
Machine Learning and Applications
Machine Learning and ApplicationsMachine Learning and Applications
Machine Learning and Applications
Geeta Arora
 
CSTalks - Object detection and tracking - 25th May
CSTalks - Object detection and tracking - 25th MayCSTalks - Object detection and tracking - 25th May
CSTalks - Object detection and tracking - 25th May
cstalks
 
Fingerprint, seminar at IASRI, New Delhi
Fingerprint, seminar at IASRI, New DelhiFingerprint, seminar at IASRI, New Delhi
Fingerprint, seminar at IASRI, New Delhi
Nishikant Taksande
 
Face recognization using artificial nerual network
Face recognization using artificial nerual networkFace recognization using artificial nerual network
Face recognization using artificial nerual network
Dharmesh Tank
 
Machine learning in image processing
Machine learning in image processingMachine learning in image processing
Machine learning in image processing
Data Science Thailand
 
Face recognition technology - BEST PPT
Face recognition technology - BEST PPTFace recognition technology - BEST PPT
Face recognition technology - BEST PPT
Siddharth Modi
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
Rahul Jain
 
Ad

Similar to Object Detection Classification, tracking and Counting (20)

B04402016018
B04402016018B04402016018
B04402016018
ijceronline
 
tracking.ppt
tracking.ppttracking.ppt
tracking.ppt
BangalirecipeLaboni
 
Slideshare
SlideshareSlideshare
Slideshare
Mohit Yadav
 
presentation.ppt
presentation.pptpresentation.ppt
presentation.ppt
WasiqAli28
 
07 image filtering of colored noise based on kalman filter
07 image filtering of colored noise based on kalman filter07 image filtering of colored noise based on kalman filter
07 image filtering of colored noise based on kalman filter
studymate
 
Lecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping IIILecture 09: Localization and Mapping III
Lecture 09: Localization and Mapping III
University of Colorado at Boulder
 
Kalman filters
Kalman filtersKalman filters
Kalman filters
Saravanan Natarajan
 
Design of Kalman filter for Airborne Applications
Design of Kalman filter for Airborne ApplicationsDesign of Kalman filter for Airborne Applications
Design of Kalman filter for Airborne Applications
IJERA Editor
 
Balancing Robot Kalman Filter Design – Estimation Theory Project
Balancing Robot Kalman Filter Design – Estimation Theory ProjectBalancing Robot Kalman Filter Design – Estimation Theory Project
Balancing Robot Kalman Filter Design – Estimation Theory Project
Surya Chandra
 
Multisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applicationsMultisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applications
Sayed Abulhasan Quadri
 
Tracking[1]
Tracking[1]Tracking[1]
Tracking[1]
mervebayrak
 
presentation.ppt
presentation.pptpresentation.ppt
presentation.ppt
SandyDwiKurniawan2
 
Objects as points (CenterNet) review [CDM]
Objects as points (CenterNet) review [CDM]Objects as points (CenterNet) review [CDM]
Objects as points (CenterNet) review [CDM]
Dongmin Choi
 
Talk 2011-buet-perception-event
Talk 2011-buet-perception-eventTalk 2011-buet-perception-event
Talk 2011-buet-perception-event
Mahfuzul Haque
 
Extended Kalman observer based sensor fault detection
Extended Kalman observer based sensor fault detectionExtended Kalman observer based sensor fault detection
Extended Kalman observer based sensor fault detection
IJECEIAES
 
An improved fading Kalman filter in the application of BDS dynamic positioning
An improved fading Kalman filter in the application of BDS dynamic positioningAn improved fading Kalman filter in the application of BDS dynamic positioning
An improved fading Kalman filter in the application of BDS dynamic positioning
IJRES Journal
 
Threshold adaptation and XOR accumulation algorithm for objects detection
Threshold adaptation and XOR accumulation algorithm for  objects detectionThreshold adaptation and XOR accumulation algorithm for  objects detection
Threshold adaptation and XOR accumulation algorithm for objects detection
IJECEIAES
 
Kalman filter for object tracking
Kalman filter for object trackingKalman filter for object tracking
Kalman filter for object tracking
Mohit Yadav
 
Refining Underwater Target Localization and Tracking Estimates
Refining Underwater Target Localization and Tracking EstimatesRefining Underwater Target Localization and Tracking Estimates
Refining Underwater Target Localization and Tracking Estimates
CSCJournals
 
Implementation of the fully adaptive radar framework: Practical limitations
Implementation of the fully adaptive radar framework: Practical limitationsImplementation of the fully adaptive radar framework: Practical limitations
Implementation of the fully adaptive radar framework: Practical limitations
Luis Úbeda Medina
 
presentation.ppt
presentation.pptpresentation.ppt
presentation.ppt
WasiqAli28
 
07 image filtering of colored noise based on kalman filter
07 image filtering of colored noise based on kalman filter07 image filtering of colored noise based on kalman filter
07 image filtering of colored noise based on kalman filter
studymate
 
Design of Kalman filter for Airborne Applications
Design of Kalman filter for Airborne ApplicationsDesign of Kalman filter for Airborne Applications
Design of Kalman filter for Airborne Applications
IJERA Editor
 
Balancing Robot Kalman Filter Design – Estimation Theory Project
Balancing Robot Kalman Filter Design – Estimation Theory ProjectBalancing Robot Kalman Filter Design – Estimation Theory Project
Balancing Robot Kalman Filter Design – Estimation Theory Project
Surya Chandra
 
Multisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applicationsMultisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applications
Sayed Abulhasan Quadri
 
Objects as points (CenterNet) review [CDM]
Objects as points (CenterNet) review [CDM]Objects as points (CenterNet) review [CDM]
Objects as points (CenterNet) review [CDM]
Dongmin Choi
 
Talk 2011-buet-perception-event
Talk 2011-buet-perception-eventTalk 2011-buet-perception-event
Talk 2011-buet-perception-event
Mahfuzul Haque
 
Extended Kalman observer based sensor fault detection
Extended Kalman observer based sensor fault detectionExtended Kalman observer based sensor fault detection
Extended Kalman observer based sensor fault detection
IJECEIAES
 
An improved fading Kalman filter in the application of BDS dynamic positioning
An improved fading Kalman filter in the application of BDS dynamic positioningAn improved fading Kalman filter in the application of BDS dynamic positioning
An improved fading Kalman filter in the application of BDS dynamic positioning
IJRES Journal
 
Threshold adaptation and XOR accumulation algorithm for objects detection
Threshold adaptation and XOR accumulation algorithm for  objects detectionThreshold adaptation and XOR accumulation algorithm for  objects detection
Threshold adaptation and XOR accumulation algorithm for objects detection
IJECEIAES
 
Kalman filter for object tracking
Kalman filter for object trackingKalman filter for object tracking
Kalman filter for object tracking
Mohit Yadav
 
Refining Underwater Target Localization and Tracking Estimates
Refining Underwater Target Localization and Tracking EstimatesRefining Underwater Target Localization and Tracking Estimates
Refining Underwater Target Localization and Tracking Estimates
CSCJournals
 
Implementation of the fully adaptive radar framework: Practical limitations
Implementation of the fully adaptive radar framework: Practical limitationsImplementation of the fully adaptive radar framework: Practical limitations
Implementation of the fully adaptive radar framework: Practical limitations
Luis Úbeda Medina
 
Ad

Object Detection Classification, tracking and Counting

  • 1. Object Detection, Tracking, Classification, and Counting SHOUNAK MITRA ADVISOR: PROFESSOR TAT. S. FU, PHD, P.E. CIVIL AND ENVIRONMENTAL ENGINEERING DEPARTMENT UNIVERSITY OF NEW HAMPSHIRE 1
  • 2. Overview  Significance of the project  Use of camera angles  Video Demonstration  Object Detection  Noise and Shadow issues  Tracking  Classification  Counting 2
  • 3. Project Significance:  Pedestrian Detection and Counting  Synchronization of the Objects passing over the bridge and the readings of strain gauges and accelerometers. 3 Clip Obtained from Prof. Bell’s lab (Travis and Griggs)
  • 5. Algorithm 5 Read Video File Background Separation/ Foreground Detection Foreground Filtration Blob Analysis Detect Boxes Noise and Shadow Issues Classification and Counting Detection Phase Processing PhaseFinal Phase
  • 6. Object Detection Flow VIDEO FRAME FOREGROUND DETECTION FOREGROUND FILTRATION OBJECT DETECTION AND COUNTING 6
  • 7. Noise Removal  Preprocessing and Thresholdng:  Deleting boxes formed at unexpected locations  Kalman Filter 7
  • 8. What is Kalman Filter?  A Kalman filter is an optimal recursive data processing algorithm  The Kalman filter incorporates all information that can be provided to it. It processes all available measurements, regardless of their precision, to estimate the current value of the variables of interest  Computationally efficient due to its recursive structure  Assumes that variables being estimated are time dependent 8
  • 9. What does it do?  Predictor: predicts parameter values ahead of current measurements  Noise Reduction: reduces noise introduced by inaccurate detections  Tracking: Facilitates the process of association of multiple objects to their tracks 9
  • 10. Kalman Filter AKA Predictor - Corrector (1) Project the state ahead xˆ- k = Axˆk – 1 + Buk – 1 (2) Project the error covariance ahead P- k = APk – 1 AT + Q 10 Measurement Update (“Correct”) (1) Compute the Kalman gain K. k = P- kHT (HP- kHT + R)–1 (2) Update estimate with measurement zk xˆk = xˆ- k + Kk(zk – Hxˆ- k ) (3) Update the error covariance Pk = (I – KkH )P- k  Time Update State: Responsible for projecting forward in time the current state and the error covariance estimates to obtain the a priori estimates for the next time step.  Measure update state: Responsible for feedback, i.e. for incorporating a new measurement into the a priori estimate to obtain an improved a posteriori estimate.
  • 12. The Problem of Shadow 12  Object Misclassification  Overlapping of Objects Shadow Region
  • 13. Shadow Detection Flow YES NO 13 Specify Threshold for Shadow (Sth) Get Current Frame Fn Store Background Frame B Apply Gaussian Smoothening (GB & GFn) Dn = B/Fn < 1 Multiply by a factor > 20 (RDn)
  • 14. Shadow Detection Flow Background in RGB Scale Background in Gray Scale Foreground in Gray Scale Unfiltered Shadow detection Thresholding of Shadow Filtered Shadow Binary Scale 14
  • 15. Classification  Color coded classification  Centroid lying in the color 15
  • 16. Color Coded Classification and counting 16 DELETED SHADOW REGION
  翻译: