Initial plans for pyhf-validation

[matthewfeickert]

Transferring some information and ideas from a developer chat with @kratsg:

• Support CLI that will allow for

pyhf-validation spec.json

that will run pyhf cls over spec.json and additionally runs json2xml+hist2workspace+run_single.py on the resulting ROOT workspace from the HistFactory side.

• Provide signatures of

delta, pyhf_out, hifa_out = pyhf-validation.run_validation("spec.json")

• Support ROOT and PyROOT in automated testing
  • Maybe treat it as a soft dependency (try import ROOT; except foo)

[matthewfeickert]

@danikam has already done a lot of really nice work (c.f. SUSY_1Lbb_xchecks), so it will be important to take what parts of code she already has and port them over when possible.

[danikam]

@danikam has already done a lot of really nice work (c.f. SUSY_1Lbb_xchecks), so it will be important to take what parts of code she already has and port them over when possible.
^^with much help from @lukasheinrich + @kratsg :)

[danikam]

I can work on converting the 1Lbb checks to standalone python functions (assuming ROOT and pyhf dependencies present). Should these go into src/hfval?

[kratsg]

I was thinking perhaps you can put them in top-level scripts/ and then slowly migrate into src/hfval ?

[danikam]

Ok, will do!

[matthewfeickert]

Yeah if you can make a PR for the scripts/ then we can do the migration together into src/