Search results

fp8 grouped mm compile issue

bugSomething isn't workingSomething isn't working

float8

module: trainingquantize_ api training flowquantize_ api training flow

moe

Status: Open.

#4048 In pytorch/ao;

· danielvegamyhre opened on Mar 11, 2026

[RFC] Random Hadamard Transform API for NVFP4 Quantization

Status: Open.

#4040 In pytorch/ao;

· rdspring1 opened on Mar 10, 2026

Test

Status: Open.

#4032 In pytorch/ao;

· drisspg opened on Mar 9, 2026

Pinning is not supported when using offloading with NVFP4

Status: Open.

#4026 In pytorch/ao;

· sayakpaul opened on Mar 9, 2026

NVFP4 fails on Flux.1-Dev with batch size >= 32

Status: Open.

#4023 In pytorch/ao;

· sayakpaul opened on Mar 7, 2026

Next steps for MXFP8 training

module: trainingquantize_ api training flowquantize_ api training flow

moe

mx

Status: Open.

#4022 In pytorch/ao;

· danielvegamyhre opened on Mar 6, 2026

Consolidate ScalingMode.RCEIL special path into to_mx

mx

Status: Open.

#4001 In pytorch/ao;

· jcaip opened on Mar 5, 2026

float8 + FSDP2: crash on uneven sharding (tensor_to_amax + storage mismatch)

module: trainingquantize_ api training flowquantize_ api training flow

Status: Open.

#3982 In pytorch/ao;

· platers opened on Mar 3, 2026

fp8 rowwise moe training test failure: test_valid_scaled_grouped_mm_2d_3d

bugSomething isn't workingSomething isn't working

Status: Open.

#3957 In pytorch/ao;

· danielvegamyhre opened on Feb 27, 2026

[Float8DynamicActivationFloat8WeightConfig] Enable Dynamic Quantized models to be exportable using torch.export.export

Status: Open.

#3928 In pytorch/ao;

· asfiyab-nvidia opened on Feb 20, 2026

torch.compile + DeviceMesh bug: "'DeviceMesh' object has no attribute '_mesh_dim_names'"

bugSomething isn't workingSomething isn't working

moe

Status: Open.

#3926 In pytorch/ao;

· danielvegamyhre opened on Feb 20, 2026

Do "gather and pad" token groups in _to_mxfp8_then_scaled_grouped_mm instead of in torchtitan

module: trainingquantize_ api training flowquantize_ api training flow

moe

mx

Status: Open.

#3924 In pytorch/ao;

· danielvegamyhre opened on Feb 20, 2026