Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation of BDD100K MOTS #21

Open
nhlben opened this issue Apr 2, 2023 · 1 comment
Open

Evaluation of BDD100K MOTS #21

nhlben opened this issue Apr 2, 2023 · 1 comment

Comments

@nhlben
Copy link

nhlben commented Apr 2, 2023

When I run the script for MOTS as in TEST.md with

# convert to BDD100K format (bitmask)
python3 tools_bin/to_bdd100k.py --res outputs/${EXP_NAME}/inference/instances_predictions_init_0.40_obj_0.30.pkl --task seg_track --bdd-dir . --nproc 32
# evaluate
bash tools_bin/eval_bdd_submit.sh

The evaluation obtains 0 for all metrics, so probably the file it is referring to is empty. And I check the script of tools_bin/to_bdd100k.py, seems like it does not save any file in the preds2bdd100k function. Is it as expected and I am missing something, or there is another problem?

@MasterBin-IIAU
Copy link
Owner

@nhlben Hi, take UNINEXT with ResNet-50 backbone as an example, first you need to run python3 tools_bin/grid_search_bdd.py --config_name eval-vid/video_joint_r50_eval_mot.yaml --exp_dir_name video_joint_r50 as shown in infer.sh to obtain instances_predictions_init_0.40_obj_0.30.pkl. Then you need to run commands in the TEST.md and please replace ${EXP_NAME} . with detailed name such as video_joint_r50.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants