Skip to content

Overhaul test infrastructure#389

Draft
lkdvos wants to merge 14 commits intomainfrom
ld-testing
Draft

Overhaul test infrastructure#389
lkdvos wants to merge 14 commits intomainfrom
ld-testing

Conversation

@lkdvos
Copy link
Member

@lkdvos lkdvos commented Mar 24, 2026

Summary

  • Moves test dependencies into a dedicated test/Project.toml, separating them from the main package manifest
  • Replaces the monolithic test runner with ParallelTestRunner.jl, running each test file in its own worker process
  • Adds --fast mode that skips AD test groups and reduces sector/scalar-type coverage for quick iteration
  • Adds test/README.md documenting how to run tests, available groups, fast mode, and how to add new test files
  • Updates CI to auto-discover test groups as matrix jobs; draft PRs run a reduced matrix (ubuntu + Julia 1 only) while ready PRs run the full matrix

kshyatt
kshyatt previously approved these changes Mar 25, 2026
Copy link
Member

@kshyatt kshyatt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apart from minor comment LGTM, this will be very helpful for the Enzyme PR

@github-actions
Copy link
Contributor

github-actions bot commented Mar 25, 2026

Your PR no longer requires formatting changes. Thank you for your contribution!

@kshyatt
Copy link
Member

kshyatt commented Mar 26, 2026

Ope, GPU failures look related...

@kshyatt kshyatt self-requested a review March 26, 2026 09:58
@lkdvos
Copy link
Member Author

lkdvos commented Mar 26, 2026

Needs #390 first, but should then be ready.

@codecov
Copy link

codecov bot commented Mar 26, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
see 44 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants