Skip to content

Track stable mflux release for MLXBits Ideogram q8 loader #2

Description

@haxlys

Context

The MLX migration currently depends on mflux PR #445 support for mlx-forge converted Ideogram 4 checkpoints, including MLXBits/ideogram-4-mlx-q8.

Current state checked on 2026-06-18:

Why this exists

The MLXBits q8 model requires split_model.json / mlx-forge loader support. Stock stable mflux currently supports Ideogram 4 FP8 but not this q8 layout. We should keep the commit pin until the loader lands in an upstream stable release.

Exit criteria

  • mflux PR #445, or equivalent support, is merged upstream.
  • A stable mflux release includes MLXBits / mlx-forge Ideogram 4 q8 loading.
  • server/requirements.txt is changed from the git commit pin to the stable release pin.
  • README.md, AGENTS.md, and PR/installation notes are updated to remove the temporary PR-pin warning.
  • Run verification:
    • python -m compileall server ideogram4_mlx.py scripts/doctor.py
    • rg "torch|safetensors.torch|from ideogram4|import ideogram4" server ideogram4_mlx.py
    • cd webui && pnpm lint && pnpm build
    • 256x256 V4_TURBO_12 smoke generation with MLXBits/ideogram-4-mlx-q8
    • LoRA apply -> generate -> remove -> generate smoke if local LoRA files are available

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions