I tried to reproduce your reported type I error being asymptotically alpha with the simple linear dependencies and using the spectral approach for HSIC.
I changed line 19 to run python ExperimentsHSICSpectral.py 10 --dimX 10 --hypothesis null over 200 trials.
Shouldn't I expect a type I error of 0.05 for these results? I get a type I error of 0.
The same issue with test power / type II error. Test power becomes 0 when I expected 1 for sample size 100 and dimensions 10.
I tried to reproduce your reported type I error being asymptotically alpha with the simple linear dependencies and using the spectral approach for HSIC.
I changed line 19 to run
python ExperimentsHSICSpectral.py 10 --dimX 10 --hypothesis nullover 200 trials.Shouldn't I expect a type I error of 0.05 for these results? I get a type I error of 0.
The same issue with test power / type II error. Test power becomes 0 when I expected 1 for sample size 100 and dimensions 10.