You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
All models have hooks for quantization but don't currently support it. This is a valuable add, especially if the hardware isn't capable of loading the whole model in memory.
All models have hooks for quantization but don't currently support it. This is a valuable add, especially if the hardware isn't capable of loading the whole model in memory.
Ask
Integrate model quantization for all models.