Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upload pretrained checkpoints to alternative storage providers #5

Open
monatis opened this issue Jan 6, 2023 · 2 comments · May be fixed by #7
Open

Upload pretrained checkpoints to alternative storage providers #5

monatis opened this issue Jan 6, 2023 · 2 comments · May be fixed by #7

Comments

@monatis
Copy link
Contributor

monatis commented Jan 6, 2023

Congrats on the awesome work in developing a solid framework that combines tasks and modalities. I'm impressed with the ease of combining a variety of types of input and output.

I'm experimenting with the code and pretrained checkpoints, but calling OFSys.from_pretrained with the multitasking checkpoint fails most of the time while it tries to download image generation checkpoints, e.g., ViT-B-16. I had to run it several times and it usually fails with a timeout error. Is it possible that you upload these models on HF Hub? I can also serve it on my Google Cloud Storage bucket if it's ok. We can also define a keyword argument in .from_pretrained factory method to set the preference for HF Hub or GCS as I guess this is only relevant outside China. If you agree, I can prepare a PR at the weekend.
@jinze1994
Copy link
Collaborator

Thanks for your attention. Sure we hope to make it available to more users. We will upload the dependent files to s3 or HF hub asap. We would appreciate it if you could help prepare the PR! 😄
@jinze1994
Copy link
Collaborator

Could you please try to replace the OSS link with an HTTP link? To see if this is helpful in alleviating the timeout problem? for example, replace

OFASys/ofasys/adaptor/image_vqgan.py

Line 50 in f09a3f5

default="oss://ofasys/tasks/image_gen/vqgan/last.ckpt",

to

    vqgan_model_path: str = field(
        default="http://ofasys.oss-cn-zhangjiakou.aliyuncs.com/tasks/image_gen/vqgan/last.ckpt",
        metadata={"help": "path of vqgan model"},
    )
    vqgan_config_path: str = field(
        default="http://ofasys.oss-cn-zhangjiakou.aliyuncs.com/tasks/image_gen/vqgan/model.yaml",
        metadata={"help": "path of vqgan config"},
    )
@monatis monatis linked a pull request Jan 7, 2023 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants
@jinze1994 @monatis