Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about values #185

Open
hongin13 opened this issue Nov 27, 2023 · 2 comments
Open

Questions about values #185

hongin13 opened this issue Nov 27, 2023 · 2 comments

Comments

@hongin13
Copy link

hongin13 commented Nov 27, 2023

I used py-motetrics because I wanted to get mota, motp for the custom dataset, and I got the results.
Mota outputs a value around 0.8, while motp outputs a value around 0.1.
The result of motp is so weird, is this a problem caused by incorrectly generating dataset?

@cheind
Copy link
Owner

cheind commented Nov 27, 2023

Hey @hongin13, does this statement in Readme.md resolve your question?

Metric MOTP seems to be off. To convert compute (1 - MOTP) * 100. MOTChallenge benchmarks compute MOTP as percentage, while py-motmetrics sticks to the original definition of average distance over number of assigned objects [1].

@hongin13
Copy link
Author

Can this statement be interpreted as "(1 - motp) is the appropriate motp calculation result"?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants