Skip to content

moe_router_load_balancing_type has inconsistent type declarations across different code locations #8480

Description

@alkaideemo

Checklist / 检查清单

  • I have searched existing issues, and this is a new bug report. / 我已经搜索过现有的 issues,确认这是一个新的 bug report。

Bug Description / Bug 描述

moe_router_load_balancing_type has inconsistent type declarations across different code locations

How to Reproduce / 如何复现

In megatron_args, list

moe_router_load_balancing_type: Optional[List[str]] = None

In model_config, string

moe_router_load_balancing_type: Literal['aux_loss', 'seq_aux_loss', 'global_aux_loss', 'sinkhorn',
'none'] = 'aux_loss'

Additional Information / 补充信息

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions