Mehdi Miah

Learning Data Association for Multi-Object Tracking using Only Coordinates

Technical Report (2024)

@article{miah2024learning,
  title={Learning Data Association for Multi-Object Tracking using Only Coordinates},
  author={Miah, Mehdi and Bilodeau, Guillaume-Alexandre and Saunier, Nicolas},
  journal={arXiv preprint arXiv:2403.08018},
  year={2024}
}

Mehdi Miah, Guillaume-Alexandre Bilodeau, Nicolas Saunier

Abstract We propose a novel Transformer-based module to address the data association problem for multi-object tracking. From detections obtained by a pretrained detector, this module uses only coordinates from bounding boxes to estimate an affinity score between pairs of tracks extracted from two distinct temporal windows. This module, named TWiX, is trained on sets of tracks with the objective of discriminating pairs of tracks coming from the same object from those which are not. Our module does not use the intersection over union measure, nor does it requires any motion priors or any camera motion compensation technique. By inserting TWiX within an online cascade matching pipeline, our tracker C-TWiX achieves state-of-the-art performance on the DanceTrack and KITTIMOT datasets, and gets competitive results on the MOT17 dataset.

Project page
Comments
BibTeX
GitHub
Poster
Video
arXiv

Multi-Object Tracking and Segmentation with a Space-Time Memory Network

Conference on Robots and Vision (CRV 2023)

@inproceedings{miah2023multi,
title={Multi-object tracking and segmentation with a space-time memory network},
author={Miah, Mehdi and Bilodeau, Guillaume-Alexandre and Saunier, Nicolas},
booktitle={2023 20th Conference on Robots and Vision (CRV)},
pages={184--193},
year={2023},
organization={IEEE}
}

Mehdi Miah, Guillaume-Alexandre Bilodeau, Nicolas Saunier

Abstract We propose a method for multi-object tracking and segmentation that does not require finetuning or per benchmark hyper-parameter selection. The proposed tracker, MeNToS, addresses particularly the data association problem. Indeed, the recently introduced HOTA metric, which has a better alignment than the MOTA with the human visual assessment by evenly balancing detections and associations quality, has shown that improvements are still needed for data association. After creating tracklets using instance segmentation and optical flow, the proposed method relies on a space-time memory network originally developed for one-shot video object segmentation to improve the association of tracklets with temporal gaps. We evaluate our tracker on KITTIMOTS and MOTSChallenge and show the benefit of our data association strategy with the HOTA metric. Additional ablation studies demonstrate that our approach using a space-time memory network gives better and more robust long-term association than those based on a re-identification network.

Conference paper
Project page
Comments
BibTeX
GitHub
Poster
Video
arXiv

Transformers for 1D Signals in Parkinson's Disease Detection from Gait

International Conference on Pattern Recognition (ICPR 2022) - Oral

@article{nguyen2022transformerssignals,
        author = {Nguyen, Duc Minh Dimitri and Miah, Mehdi and Bilodeau, Guillaume-Alexandre and Bouachir, Wassim},
        title = {{Transformers} for {1D} {Signals} in {Parkinson's} {Disease} {Detection} from {Gait}},
        year = {2022},
        booktitle = {International {Conference} on {Pattern} {Recognition} ({ICPR})}
    }

Duc Minh Dimitri Nguyen, Mehdi Miah, Guillaume-Alexandre Bilodeau, Wassim Bouachir

Abstract This paper focuses on the detection of Parkinson’s disease based on the analysis of a patient’s gait. The growing popularity and success of Transformer networks in natural language processing and image recognition motivated us to develop a novel method for this problem based on an automatic features extraction via Transformers. The use of Transformers in 1D signal is not really widespread yet, but we show in this paper that they are effective in extracting relevant features from 1D signals. As Transformers require a lot of memory, we decoupled temporal and spatial information to make the model smaller. Our architecture used temporal Transformers, dimension reduction layers to reduce the dimension of the data, a spatial Transformer, two fully connected layers and an output layer for the final prediction. Our model outperforms the current state-of-the-art algorithm with 95.2% accuracy in distinguishing a Parkinsonian patient from a healthy one on the Physionet dataset. A key learning from this work is that Transformers allow for greater stability in results.

Conference paper
Project page
Comments
BibTeX
GitHub
Poster
Video
arXiv

MeNToS : Tracklets Association with a Space-Time Memory Network

Robust Video Scene Understanding: Tracking and Video Segmentation (CVPR-W RVSU 2021)

@inproceedings{miah2021mentos,
    author = {Miah, Mehdi and Bilodeau, Guillaume-Alexandre and Saunier, Nicolas},
    title = {{MeNToS} : {Tracklets} {Association} with a {Space}-{Time} {Memory} {Network}},
    year = {2021},
    booktitle = {{CVPR-W RVSU}}
}

Mehdi Miah, Guillaume-Alexandre Bilodeau, Nicolas Saunier

Abstract We propose a method for multi-object tracking and segmentation (MOTS) that does not require fine-tuning or per benchmark hyperparameter selection. The proposed method addresses particularly the data association problem. Indeed, the recently introduced HOTA metric, that has a better alignment with the human visual assessment by evenly balancing detections and associations quality, has shown that improvements are still needed for data association. After creating tracklets using instance segmentation and optical flow, the proposed method relies on a space-time memory network (STM) developed for one-shot video object segmentation to improve the association of tracklets with temporal gaps. To the best of our knowledge, our method, named MeNToS, is the first to use the STM network to track object masks for MOTS. We took the 4^th place in the RobMOTS challenge.

Challenge paper
Project page
Comments
BibTeX
GitHub
Poster
Video
arXiv

An Empirical Analysis of Visual Features for Multiple Object Tracking in Urban Scenes

International Conference on Pattern Recognition (ICPR 2020)

@inproceedings{miah2020empirical,
    author = {Miah, Mehdi and Pepin, Justine and Saunier, Nicolas and Bilodeau, Guillaume-Alexandre},
    title = {An {Empirical} {Analysis} of {Visual} {Features} for {Multiple} {Object} {Tracking} in {Urban} {Scenes}},
    year = {2020},
    booktitle = {International {Conference} on {Pattern} {Recognition} ({ICPR})}
}

Mehdi Miah, Justine Pepin, Nicolas Saunier, Guillaume-Alexandre Bilodeau

Abstract This paper addresses the problem of selecting appearance features for multiple object tracking (MOT) in urban scenes. Over the years, a large number of features has been used for MOT. However, it is not clear whether some of them are better than others. Commonly used features are color histograms, histograms of oriented gradients, deep features from convolutional neural networks and re-identification (ReID) features. In this study, we assess how good these features are at discriminating objects enclosed by a bounding box in urban scene tracking scenarios. Several affinity measures, namely the L1, L2 and the Bhattacharyya distances, Rank-1 counts and the cosine similarity, are also assessed for their impact on the discriminative power of the features. Results on several datasets show that features from ReID networks are the best for discriminating instances from one another regardless of the quality of the detector. If a ReID model is not available, color histograms may be selected if the detector has a good recall and there are few occlusions; otherwise, deep features are more robust to detectors with lower recall.

Conference paper
Project page
Comments
GitHub
BibTeX
Poster
Video
arXiv

News :

Publication

Learning Data Association for Multi-Object Tracking using Only Coordinates

Multi-Object Tracking and Segmentation with a Space-Time Memory Network

Transformers for 1D Signals in Parkinson's Disease Detection from Gait

MeNToS : Tracklets Association with a Space-Time Memory Network

An Empirical Analysis of Visual Features for Multiple Object Tracking in Urban Scenes

Education

Polytechnique Montréal

Université Paris-Saclay

École Nationale de la Statistique et de l'Administration Économique (ENSAE Paris)

Télécom SudParis

Lycée Saint-Louis