Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Categorizing models by supported modalities #634

Open
lthoang opened this issue Jul 3, 2024 · 2 comments
Open

[FEATURE] Categorizing models by supported modalities #634

lthoang opened this issue Jul 3, 2024 · 2 comments
Assignees

Comments

@lthoang
Copy link
Member

lthoang commented Jul 3, 2024

Description

We need a document for models' supported modalities for ease of model selection.

@darrylong
Copy link
Member

I suggest that we could have another table, similar to in PR #624 and #632 that will be on readthedocs as well (below the original table).

This table could show models with different modalities supported (similar to the PyTorch/TensorFlow columns).

In order to obtain the modalities supported, we could run a script to go through the model files to look for the following keywords (e.g. 'sentiment', 'user_image'), as detailed in the BaseMethod file below.

self.user_feature = kwargs.get("user_feature", None)
self.user_text = kwargs.get("user_text", None)
self.user_image = kwargs.get("user_image", None)
self.user_graph = kwargs.get("user_graph", None)
self.item_feature = kwargs.get("item_feature", None)
self.item_text = kwargs.get("item_text", None)
self.item_image = kwargs.get("item_image", None)
self.item_graph = kwargs.get("item_graph", None)
self.sentiment = kwargs.get("sentiment", None)
self.review_text = kwargs.get("review_text", None)

@tqtg
Copy link
Member

tqtg commented Jul 5, 2024

We've somehow tried to achieve this via model type in the main README, though it's not complete. We can consider adding columns to the model table in the docs, but be careful of information overload.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
3 participants