This may be only for the Phi-4 model (need to confirm).
I thought the trust_remote_code flag should only need to be True if you're downloading the model from HuggingFace for the first time. But based on behavior I've seen, it feels like it needs to always be true for things to work, which goes against what I would think the property does based on what it's called.
Figure what this flag actually does vs. what it's supposed to do.
Related, test using all of these models offline. They download successfully but I'm now skeptical of whether or not a dead internet connection would cause problems with that trust_remote_code flag.
This may be only for the Phi-4 model (need to confirm).
I thought the
trust_remote_codeflag should only need to be True if you're downloading the model from HuggingFace for the first time. But based on behavior I've seen, it feels like it needs to always be true for things to work, which goes against what I would think the property does based on what it's called.Figure what this flag actually does vs. what it's supposed to do.
Related, test using all of these models offline. They download successfully but I'm now skeptical of whether or not a dead internet connection would cause problems with that trust_remote_code flag.