Don't hardcode models and defaults

[rmoriz]

Hi,

models will change, they have a limited lifetime of a couple of months until the next comes out.
Hence compiling in model names and defaults is not very sustainable. Also there should be an explicit provder default as some people have many ENVs set for other purposes but only want to use a specific provider and model with cai.

Thanks
Roland

[rmoriz]

see also https://models.dev/

[ad-si]

It only includes shortcuts. So e.g. cai opus is the same as cai anthropic claude-opus-4-1. However, if model name does not match a shortcut it is simply forwarded to the provider. So you can e.g. do something like cai anthropic claude-opus-4-20250514.

Since there is no easy way to automatically generate shortcuts, I don't think there is a was around manually defining them.

Same for defaults: How you would automatically pick one?

[ad-si]

But yeah, models.dev might be a good idea for the defaults problem at least.

[dserodio]

Maybe allow the user to set the default model and shortcuts in ~/.config/cai/config.yaml or similar?

[ad-si]

Yes, that is definitely planned! But it doesn't eliminate the need to already provide a default …

[mohammad-malik]

Yes, that is definitely planned! But it doesn't eliminate the need to already provide a default …

Hope this happens soon, I would change a lot of stuff to really cater to me!

[ad-si]

It does support a config.yaml file now, and so far you can overwrite all base URLs. Check out this comment: #21 (comment)