Skip to content

docs(oci): expand provider page with proxy, tools, vision, reasoning, env vars#197

Merged
mateo-berri merged 2 commits into
BerriAI:mainfrom
fede-kamel:docs/oci-provider-expand
May 23, 2026
Merged

docs(oci): expand provider page with proxy, tools, vision, reasoning, env vars#197
mateo-berri merged 2 commits into
BerriAI:mainfrom
fede-kamel:docs/oci-provider-expand

Conversation

@fede-kamel
Copy link
Copy Markdown
Contributor

@fede-kamel fede-kamel commented May 22, 2026

Companion docs for the OCI Generative AI integration in BerriAI/litellm#25177.

The existing docs/providers/oci.md covered manual credentials, SDK signer, streaming, dedicated endpoints, and embeddings — but was missing several sections that the Bedrock page (the closest "first-class provider" reference) already had. This PR brings OCI up to parity and reconciles the model list against OCI's authoritative retirement page.

What's new

  • Environment variables for all credentials (OCI_REGION, OCI_USER, OCI_FINGERPRINT, OCI_TENANCY, OCI_COMPARTMENT_ID, OCI_KEY, OCI_KEY_FILE) — already wired up in litellm/llms/oci/common_utils.py.
  • LiteLLM Proxy Usageconfig.yaml example with both Grok and Cohere entries, start command, and Curl + OpenAI client smoke tests (mirrors the Bedrock section).
  • Function Calling / Tool Calling — OpenAI-compatible tools example for both SDK and proxy modes, with a note that Cohere and Generic vendors are adapted internally by the transformation layer.
  • Vision / Multimodalimage_url example plus the full list of vision-capable models.
  • Reasoning / Thinkingreasoning_effort (low/medium/high/disable) and reasoning_tokens surfaced on usage; documents that the parameter is silently ignored for Cohere models (they're not reasoning models).
  • Optional Parameters table extended with an Environment Variable column and a reasoning_effort row.

Model catalog corrections

Reconciled against OCI's on-demand retirement page:

  • Removed retired meta.llama-3.1-405b-instruct and meta.llama-3.1-70b-instruct.
  • Added xai.grok-4.3 (OCI's recommended replacement for the entire Grok 3/4 family), openai.gpt-oss-120b/openai.gpt-oss-20b, and cohere.embed-multilingual-image-v3.0.
  • Flagged retirement dates on Llama 3.2-90b-vision (2026-09-30), all Grok 3/4/4.x (2026-08-15), Cohere R+/R 08-2024 (2026-09-30), and all embed-*-v3.0 models (2026-09-30).
  • Switched the Vision example from Llama 3.2-90b (retires 2026-09-30) to Llama 4 Maverick.
  • Added an :::info callout linking to OCI's retirement page so readers can verify dates themselves as the catalog evolves.

cc @mateoo


Note

Low Risk
Documentation-only update that expands and corrects OCI provider guidance; low risk aside from potential user confusion if any model names/params are inaccurate.

Overview
Expands docs/providers/oci.md with new OCI usage guidance: environment-variable based auth, LiteLLM Proxy config.yaml + curl/OpenAI client examples, and OpenAI-compatible tool/function calling examples for both SDK and proxy.

Updates the supported model catalog (adds new Grok/OpenAI OSS/embedding entries and marks multimodal-capable models), and adds vision/multimodal and reasoning (reasoning_effort) sections including how reasoning tokens surface in usage. The optional-parameters table is revised to include an Environment Variable column and a reasoning_effort row, plus a link to OCI’s official model retirement page.

Reviewed by Cursor Bugbot for commit 127c7b5. Bugbot is set up for automated code reviews on this repo. Configure here.

… env vars

Bring the OCI provider docs up to parity with the Bedrock page:

- Environment variables for all credentials (OCI_REGION, OCI_USER,
  OCI_FINGERPRINT, OCI_TENANCY, OCI_COMPARTMENT_ID, OCI_KEY,
  OCI_KEY_FILE)
- LiteLLM Proxy Usage section: config.yaml example with both Grok and
  Cohere entries, start command, Curl + OpenAI client smoke tests
- Function Calling / Tool Calling: OpenAI-compatible tools example for
  both SDK and proxy modes, with a note that Cohere and Generic vendors
  are adapted internally
- Vision / Multimodal: image_url example plus the full list of
  vision-capable models
- Reasoning / Thinking: reasoning_effort (low/medium/high/disable) and
  reasoning_tokens surfaced on usage; documents that the param is
  silently ignored for Cohere models
- Optional Parameters table extended with an Environment Variable
  column and a reasoning_effort row

Reconciled the Supported Models list against OCI's on-demand
retirement page:

- Removed retired meta.llama-3.1-405b-instruct and
  meta.llama-3.1-70b-instruct
- Added xai.grok-4.3, openai.gpt-oss-120b/20b, and
  cohere.embed-multilingual-image-v3.0
- Flagged retirement dates on Llama 3.2-90b-vision, all Grok 3/4/4.x,
  Cohere R+/R 08-2024, and all embed v3.0 models
- Switched the Vision example from Llama 3.2-90b (retires 2026-09-30)
  to Llama 4 Maverick
- Added an info callout linking to OCI's retirement page so readers
  can verify dates themselves
@vercel
Copy link
Copy Markdown

vercel Bot commented May 22, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
litellm Ready Ready Preview, Comment May 22, 2026 7:21am

Request Review

Other LiteLLM provider pages (bedrock, openai, anthropic) don't track
retirement dates inline — they list active models and let the
provider's own lifecycle page own the dates. Drop the per-model
*(retires ...)* annotations to match. The single info-callout link to
OCI's retirement page stays so readers can verify the schedule.
@mateo-berri
Copy link
Copy Markdown
Collaborator

bugbot run

Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no new issues!

Comment @cursor review or bugbot run to trigger another review on this PR

Reviewed by Cursor Bugbot for commit 127c7b5. Configure here.

Copy link
Copy Markdown
Collaborator

@mateo-berri mateo-berri left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contributions! LGTM

@mateo-berri mateo-berri merged commit b67a6d8 into BerriAI:main May 23, 2026
3 checks passed
@fede-kamel fede-kamel deleted the docs/oci-provider-expand branch May 23, 2026 19:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants