-
Notifications
You must be signed in to change notification settings - Fork 73
support qwen3 (0.6B, 8B, 32B) #198
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
@RuixiangMa please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
Contributor License AgreementContribution License AgreementThis Contribution License Agreement (“Agreement”) is agreed to by the party signing below (“You”),
|
Signed-off-by: Lancer <maruixiang6688@gmail.com>
PR Description
Added support for Qwen3 model series (0.6B, 8B, 32B) to MInference. This update includes configuration mappings for the new Qwen3 models in the model2path registry, enabling efficient sparse attention patterns for these models. The implementation adds three new model configurations with their corresponding sparse attention pattern JSON files.
Verification and Testing