New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练参数问题 #112

Open

zhanghang-official opened this issue Jan 22, 2024 · 1 comment

zhanghang-official commented Jan 22, 2024

三阶段训练 max_txt_l = 512 参数什么作用，由于显卡只有40G，显存需要将max_txt_l下调，下调会有出现影响呢？

Collaborator

Andy1621 commented Jan 23, 2024

max_txt_l影响的是llm回复的长度，当长度大于max_txt_l会被截断，下调的话只对长对话和部分caption生成有影响

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment