Let python accept numpy arrays (pre-correctly sized, maybe) and allow for batch inference

[ExtReMLapin]

Right now in python, for fast inference, the biggest bottleneck are :

• batch inference not supported by detect()
• only accepting PIL Images as entry, which is heavy to create to resize etc

Maybe accepting precorrectly sized numpy arrays could help

[cospectrum]

Is there a scrfd batched model somewhere that I can test against?

[ExtReMLapin]

It's been some time, I don't have the code I used here but i found this https://huggingface.co/alonsorobots/scrfd_320_batched