Skip to content
This repository was archived by the owner on Feb 5, 2026. It is now read-only.

Applying liger Kernals to Qwen VL + Other Optimizations#216

Open
heuristicoder wants to merge 6 commits intomainfrom
lm_optimization
Open

Applying liger Kernals to Qwen VL + Other Optimizations#216
heuristicoder wants to merge 6 commits intomainfrom
lm_optimization

Conversation

@heuristicoder
Copy link
Contributor

@heuristicoder heuristicoder commented Apr 27, 2025

-->Added Liger Kernals for Qwen VL
--> Wrapped torch compile on VAE
--> Wrapped torch compile on llm
--> Pads to nearest multiple of 8 for efficiency

@heuristicoder heuristicoder changed the title Applying liger Kernals to Qwen VL Applying liger Kernals to Qwen VL + Other Optimizariona Apr 28, 2025
@heuristicoder heuristicoder changed the title Applying liger Kernals to Qwen VL + Other Optimizariona Applying liger Kernals to Qwen VL + Other Optimizations Apr 28, 2025
@HaozheLiu-ST
Copy link
Contributor

LGTM, but maybe have a training job to verify its effectiveness.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants