Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add detection metrics #44

Open
wants to merge 33 commits into
base: master
Choose a base branch
from
Open

Add detection metrics #44

wants to merge 33 commits into from

Commits on Mar 27, 2021

  1. Initial implementation of metrics for MOTxxDet

    Jack Valmadre committed Mar 27, 2021
    Configuration menu
    Copy the full SHA
    e507db3 View commit details
    Browse the repository at this point in the history

  2. Use array_fields for IOU and recall in detection

    Jack Valmadre committed Mar 27, 2021
    Configuration menu
    Copy the full SHA
    9da41a0 View commit details
    Browse the repository at this point in the history

  3. Add AP to Detection to compute COCO-style integral

    Jack Valmadre committed Mar 27, 2021
    Configuration menu
    Copy the full SHA
    d70a5b5 View commit details
    Browse the repository at this point in the history

  4. Try heap implementation of score-based matching

    Jack Valmadre committed Mar 27, 2021
    Configuration menu
    Copy the full SHA
    4d392ad View commit details
    Browse the repository at this point in the history

  5. Try different approach for score-based matching

    Jack Valmadre committed Mar 27, 2021
    Configuration menu
    Copy the full SHA
    9943e4d View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2021

  1. Remove alternative impls of match by score

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    c3769c7 View commit details
    Browse the repository at this point in the history

  2. Remove varying threshold from main det metric

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    0a00e76 View commit details
    Browse the repository at this point in the history

  3. Add explicit 50, 75, 95 similarity thresholds 

    Rename to AP_coarse for MOT challenge integral.
    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    0c607f8 View commit details
    Browse the repository at this point in the history

  4. Remove explicit metric at 95%

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    110805e View commit details
    Browse the repository at this point in the history

  5. Remove MODA and associated metrics from DetLoc

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    db2456f View commit details
    Browse the repository at this point in the history

  6. Fix docstring

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    a706237 View commit details
    Browse the repository at this point in the history

  7. Update todos

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    029cb79 View commit details
    Browse the repository at this point in the history

  8. Add plots for detection metrics

    Jack Valmadre committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    ab35b68 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2021

  1. Use more correct definition of precision at recall 

    Add det_averaged combine functions for detection.
    Jack Valmadre committed Apr 13, 2021
    Configuration menu
    Copy the full SHA
    e07e718 View commit details
    Browse the repository at this point in the history

  2. Remove stray ipdb

    Jack Valmadre committed Apr 13, 2021
    Configuration menu
    Copy the full SHA
    56b20d0 View commit details
    Browse the repository at this point in the history

  3. Tweak TODOs and comments

    Jack Valmadre committed Apr 13, 2021
    Configuration menu
    Copy the full SHA
    0df4c04 View commit details
    Browse the repository at this point in the history

  4. Add AP using union of sequences

    Jack Valmadre committed Apr 13, 2021
    Configuration menu
    Copy the full SHA
    8ba0ef9 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2021

  1. In preproc, also ignore gt with poor visibility 

    Add MIN_VIS config option.
Add IGNORE_TRACK_IDS for predictions of detectors.
    Jack Valmadre committed May 10, 2021
    Configuration menu
    Copy the full SHA
    f8074e7 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2021

  1. Remove average-per-sequence AP metrics 

    Remove DetLoc (contained only per-sequence AP).
    Jack Valmadre committed May 11, 2021
    Configuration menu
    Copy the full SHA
    23edd90 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2021

  1. Rename naive to legacy; fix legacy precision

    Jack Valmadre committed Jun 27, 2021
    Configuration menu
    Copy the full SHA
    fc36d59 View commit details
    Browse the repository at this point in the history

  2. Remove stray print statement

    Jack Valmadre committed Jun 27, 2021
    Configuration menu
    Copy the full SHA
    d58f5d8 View commit details
    Browse the repository at this point in the history

  3. Account for non-unique scores in prec-recall curve 

    Use pessimistic approach for legacy code.
    Jack Valmadre committed Jun 27, 2021
    Configuration menu
    Copy the full SHA
    8ffc74b View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2021

  1. Group by score for legacy average prec

    Jack Valmadre committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    7380010 View commit details
    Browse the repository at this point in the history

  2. Do not count similarity below threshold in MODP

    Jack Valmadre committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    0d7be19 View commit details
    Browse the repository at this point in the history

  3. Avoid RuntimeWarning for 0 / 0 in precision-recall

    Jack Valmadre committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    197237a View commit details
    Browse the repository at this point in the history

  4. Add options to drop other classes and extra frames

    Jack Valmadre committed Jun 28, 2021
    Configuration menu
    Copy the full SHA
    623152b View commit details
    Browse the repository at this point in the history

Commits on May 30, 2022

  1. Merge branch 'master' into detection

    @jvlmdr
    jvlmdr committed May 30, 2022
    Configuration menu
    Copy the full SHA
    7749953 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2022

  1. Update use of config in detection metrics

    @jvlmdr
    jvlmdr committed May 31, 2022
    Configuration menu
    Copy the full SHA
    c3c78ba View commit details
    Browse the repository at this point in the history

  2. Add class-averaging to detection 

    Add np.errstate guards where necessary.
Change assertion to permit nans.
    @jvlmdr
    jvlmdr committed May 31, 2022
    Configuration menu
    Copy the full SHA
    bfec477 View commit details
    Browse the repository at this point in the history

  3. Add Det metrics to kitti and tao scripts

    @jvlmdr
    jvlmdr committed May 31, 2022
    Configuration menu
    Copy the full SHA
    98a1096 View commit details
    Browse the repository at this point in the history

  4. Add exception if tracker_confidences missing

    @jvlmdr
    jvlmdr committed May 31, 2022
    Configuration menu
    Copy the full SHA
    9041e38 View commit details
    Browse the repository at this point in the history

  5. Ignore egg-info created by pip install -e

    @jvlmdr
    jvlmdr committed May 31, 2022
    Configuration menu
    Copy the full SHA
    a97564d View commit details
    Browse the repository at this point in the history

  6. Small changes from detection-merge branch

    @jvlmdr
    jvlmdr committed May 31, 2022
    Configuration menu
    Copy the full SHA
    fa91124 View commit details
    Browse the repository at this point in the history