Add MethodsX companion reproducibility scripts#4
Open
viberesearch wants to merge 2 commits into
Open
Conversation
Two deterministic companion scripts referenced by the sbt-framework MethodsX method article (Sections 2.6 and 3): - canonical_validation_tables.py: pairwise Aitchison matrix for the five canonical brands, Fisher-Rao cohort distances, a worked alignment-gap example, and an error-injection case, all from the toolkit's fixed constants and validator API (no randomness). - cross_llm_consistency.py: runs the Module 1 prompt across Claude/GPT/Gemini at temperature 0 and reports cross-model agreement (Spearman on strength ranks; Fisher-Rao on signature). API keys read from environment; no secrets in the script. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the two deterministic companion scripts referenced by the sbt-framework MethodsX method article (revision MEX-D-26-00630), so the in-article reproducibility URLs resolve.
scripts/canonical_validation_tables.py— pairwise Aitchison matrix for the five canonical brands, Fisher-Rao cohort distances, a worked alignment-gap example, and an error-injection case, all from the toolkit's fixed constants + validator API (no randomness). Reproduces article Section 3.scripts/cross_llm_consistency.py— runs the Module 1 prompt across Claude/GPT/Gemini at temperature 0 and reports cross-model agreement (Spearman on strength ranks; Fisher-Rao on signature distributions). Reproduces article Section 2.6. API keys read from environment; no secrets in the script.🤖 Generated with Claude Code