Use SciMLTesting v1.2 (folder-based run_tests)#200
Merged
ChrisRackauckas merged 1 commit intoJun 14, 2026
Conversation
Convert the root umbrella test harness to SciMLTesting v1.2. The monorepo sublibrary routing pre-step (detect_sublibrary_group + < 1.11 transitive [sources] develop walk + Pkg.test handoff via DIFFEQPROBLEMLIBRARY_TEST_GROUP) is kept verbatim so the sublibrary Pkg.test invocation is byte-for-byte identical. The root-package dispatch (which ran the same ExplicitImports QA body for GROUP=All, Core, and QA) is delegated to run_tests via the qa body, all = ["QA"], and a "Core" umbrella expanding to "QA". Adds SciMLTesting to the root and qa test envs. test/test_groups.toml is unchanged. Co-Authored-By: Chris Rackauckas <accounts@chrisrackauckas.com> Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
ChrisRackauckas-Claude
force-pushed
the
sciml-testing-rollout
branch
from
78b6a66 to
d9e1e35
Compare
ChrisRackauckas-Claude
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Converts the root umbrella package's test harness to the SciMLTesting v1.2 folder model.
DiffEqProblemLibrary is a monorepo: the
lib/*sublibraries are covered bySublibraryCI.yml(the project model), and the root umbrella's own group matrix (test/test_groups.toml) is justCore+QA. The root runtests.jl previously ran the same ExplicitImports QA body forGROUP=All,GROUP=Core, andGROUP=QA, and routed anylib/<sub>sublibrary group to a hand-writtenPkg.testpre-step.This PR:
detect_sublibrary_group+ the Julia < 1.11 transitive[sources]develop walk + thePkg.testwith--check-bounds=auto --compiled-modules=yes --depwarn=yes,force_latest_compatible_version = false,allow_reresolve = true, handed off viaDIFFEQPROBLEMLIBRARY_TEST_GROUP). This is kept explicit rather than delegated torun_tests's built-inlib_dirpath so the sublibraryPkg.testinvocation stays byte-for-byte identical.run_tests:qabody = the ExplicitImports test,all = ["QA"]soGROUP=Allruns it, and a"Core"umbrella expanding to"QA"soGROUP=Coreruns it too.coreis a no-op (the root has no separate Core body).SciMLTestingto the root andtest/qatest environments.test/test_groups.tomlunchanged.The exact set of tests run under each
GROUPvalue (All/Core/QA-> ExplicitImports QA; eachlib/<sub>-> that sublibrary'sPkg.test; unknown group -> nothing) is preserved.Ignore until reviewed by @ChrisRackauckas.