Skip to content

[BUG]: Gemini Plugin，tp=2，TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather' #6265

New issue

Have a question about this project? No Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

No Sign up for GitHub

By clicking “No Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? No Sign in to your account

Jump to bottom
Open
2 tasks done
happynaruto opened this issue Apr 16, 2025 · 0 comments
Open
2 tasks done

[BUG]: Gemini Plugin，tp=2，TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather' #6265

happynaruto opened this issue Apr 16, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@happynaruto
Copy link

Is there an existing issue for this bug?

  • I have searched the existing issues

The bug has not been fixed in the latest main branch

  • I have checked the latest main branch

Do you feel comfortable sharing a concise (minimal) script that reproduces the error? :)

Yes, I will share a minimal reproducible script.

🐛 Describe the bug

colossal=0.4.9，Gemini Plugin，在八张A100显卡上训练QWQ32B，当tp=1时程序正常运行，但当tp=2时报错:TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather'

Environment

No response
@happynaruto happynaruto added the bug Something isn't working label Apr 16, 2025
No Sign up for free to join this conversation on GitHub. Already have an account? No Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@happynaruto