Skip to content

Use SciMLTesting v1.2 (folder-based run_tests)#65

Merged
ChrisRackauckas merged 1 commit into
SciML:mainfrom
ChrisRackauckas-Claude:sciml-testing-rollout
Jun 14, 2026
Merged

Use SciMLTesting v1.2 (folder-based run_tests)#65
ChrisRackauckas merged 1 commit into
SciML:mainfrom
ChrisRackauckas-Claude:sciml-testing-rollout

Conversation

@ChrisRackauckas-Claude

@ChrisRackauckas-Claude ChrisRackauckas-Claude commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Converts test/runtests.jl to the SciMLTesting v1.2 folder-discovery model.

The whole test/runtests.jl is now:

using SciMLTesting
run_tests()

Folder layout (folder name matches test_groups.toml key casing):

  • Core = top-level test/*.jlcore_tests.jl (the inline @safetestsets extracted into a self-contained file) and alloc_tests.jl (unchanged). Runs under GROUP=Core and GROUP=All.
  • QA = test/qa/ with its existing test/qa/Project.toml sub-env. Runs only under GROUP=QA (folder-discovery always excludes QA from All, matching the prior dispatch where QA only ran when GROUP=="QA").

test/test_groups.toml is unchanged.

Dependency edits:

  • test/Project.toml: add SciMLTesting (+ [compat] SciMLTesting = "1"); drop Pkg (the v1.2 harness owns all Pkg ops — no test/*.jl references Pkg anymore). SafeTestsets/Test retained.
  • test/qa/Project.toml: add SciMLTesting + SafeTestsets (+ compat); [sources] path kept relative.

Behavior-preserving: the exact set of tests run under each GROUP value is unchanged. Verified end-to-end locally on Julia 1.11: GROUP=CoreCore/alloc_tests.jl (16 pass) + Core/core_tests.jl (28 pass, 2 @test_broken); GROUP=QAQA/qa.jl (10 pass, exercising sub-env activation).

Ignore until reviewed by @ChrisRackauckas.

Convert test/runtests.jl to the SciMLTesting v1.2 folder-discovery model:
bare `using SciMLTesting; run_tests()`. Core = top-level test/*.jl
(core_tests.jl extracted self-contained from the inline @safetestsets,
alloc_tests.jl unchanged); QA = test/qa/ (unchanged). test_groups.toml
unchanged. Behavior-preserving: GROUP=Core/All runs Core only, GROUP=QA
runs qa.jl only, matching the prior dispatch.

Co-Authored-By: Chris Rackauckas <accounts@chrisrackauckas.com>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@ChrisRackauckas-Claude ChrisRackauckas-Claude changed the title Use SciMLTesting v1.0.0 (run_tests harness) Use SciMLTesting v1.2 (folder-based run_tests) Jun 14, 2026
@ChrisRackauckas ChrisRackauckas marked this pull request as ready for review June 14, 2026 23:54
@ChrisRackauckas ChrisRackauckas merged commit 2a10079 into SciML:main Jun 14, 2026
9 of 16 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants