Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add support for mmdet tracking #1404

Open
wants to merge 3 commits into
base: develop
Choose a base branch
from

Conversation

rolson24
Copy link
Contributor

Description

Feature request from #1381

Add support for MMDetection trackers by modifying from_mmdetection to support importing MMDetection TrackDataSamples into supvervision Detections. This also allows for easy integration with the [MASA tracker] (https://github.com/siyuanliii/masa/tree/1d5d42cdd75276c9a8e918639907916f75a761da)

Type of change

  • New feature (non-breaking change which adds functionality)

How has this change been tested, please provide a testcase or example of how you tested the change?

Tested with this colab notebook

Any specific deployment considerations

Right now the pre-trained MMDetection models are performing quite poorly for tracking, and the built in config files need to be fixed, but if you train your own detection model and write your own config, they work. All you have to do is call `tracker = init_track_model(TRACKER_CONFIG, device=device)' and then for each frame call:

track_result = inference_mot(tracker, frame,
                        frame_id=frame_idx,
                        video_len=video_info.total_frames,
                        )

@onuralpszr
Copy link
Collaborator

@rolson24 is there chance tracker can be empty ? If yes we should do same thing we did for mask as well.

@onuralpszr onuralpszr added enhancement New feature or request api:detection labels Jul 26, 2024
@SkalskiP SkalskiP requested a review from LinasKo July 26, 2024 06:50
@SkalskiP
Copy link
Collaborator

@rolson24 I won't be able to test it today. I'll leave it to @LinasKo. He should be back on Monday.

@rolson24
Copy link
Contributor Author

@rolson24 is there chance tracker can be empty ? If yes we should do same thing we did for mask as well.

I tested it and it seems like if there are no tracks, then pred_track_instances won't exist, so it will just use the pred_instances which are the detection results. But it probably wouldn't hurt to add it especially if there is a tracker that implements pred_track_instances slightly differently.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api:detection enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants