Skip to content

feat: support Flash Attention 2 across install paths#33

Open
niangao2331 wants to merge 1 commit into
wochenlong:mainfrom
niangao2331:fix/flash-attn2-all-install-paths
Open

feat: support Flash Attention 2 across install paths#33
niangao2331 wants to merge 1 commit into
wochenlong:mainfrom
niangao2331:fix/flash-attn2-all-install-paths

Conversation

@niangao2331
Copy link
Copy Markdown
Collaborator

Summary

  • enable Flash Attention 2 self-check based selection for source, portable, and Docker installs
  • add portable flash-attn/triton install + recovery flow, including install_flash_attn.bat
  • update Docker/source install scripts and docs for verified FA2 with xformers/SDPA fallback

Closes #26

Tests

  • python -m py_compile mikazuki\portable_utils.py setup_environment.py mikazuki\app\api.py
  • python -m pytest tests\test_portable_utils.py tests\test_train_routing.py
  • PowerShell parser check for install/build launcher scripts
  • bash -n install.bash

Note: full python -m pytest tests currently has unrelated existing failures in pinned sd-scripts commit expectations and train-log auto-open mocking.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[高优先级] 全路径支持 Flash Attention 2(源码 / 整合包 / Docker)

1 participant