docs: LLM-as-a-Judge guardrail (#17)#185
Open
mubashir1osmani wants to merge 1 commit into
Open
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
mubashir1osmani
force-pushed
the
llm-judge
branch
from
2ca2023 to
6ba3271
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
New guardrail type that uses an LLM to score responses against weighted criteria. Includes UI walkthrough, YAML config examples, blocked/passed response examples, and configuration reference.
docs(llm-judge): replace placeholder screenshots with real spend logs UI screenshots
docs(llm-judge): use real spend logs UI screenshots for blocked/passed guardrail views
docs(blog): make /blog responsive (docs(blog): make /blog responsive #51)
docs(blog): make /blog responsive
Removed global styles to prevent horizontal overflow on mobile.
docs(proxy): add Grafana Cloud Pyroscope user and API token configuration options (docs(proxy): add Grafana Cloud Pyroscope user and API token configura… #52)
docs(auth): document scope and wildcard support for JWT routing overrides (docs(auth): add scope and wildcard support for JWT routing overrides #31)
Backfills the
BerriAI/litellm-docssite with the changes that originally shipped underdocs/my-website/in BerriAI/litellm#25939 / #26325. After the docs source was migrated to this repo, those edits could no longer be carried in the code PR and were dropped on rebase.scopeselector, list/string forms, shell-style wildcards (*,?, case-sensitive), and the scope-only space-split rule (iss/aud/client_id are never split on spaces). Adds a worked example combiningscopewith a wildcardclient_id.Code change is in BerriAI/litellm#26325 (litellm_internal_staging).
docs(mcp,a2a): code-verified auth reference fixes + overview page (docs(mcp,a2a): code-verified auth reference fixes + overview page #156) (docs(mcp,a2a): code-verified auth reference fixes + overview page (#156) #184)
docs(mcp,a2a): code-verified auth reference fixes + overview page (docs(mcp,a2a): code-verified auth reference fixes + overview page #156)
docs(mcp): complete auth_type table, OAuth config reference, RBAC intersection model, hub-vs-public-internet distinction
docs(a2a): document x-litellm-api-key, trace-id enforcement, sub-agent propagation, agent access groups and full intersection model
docs(bedrock_agentcore): add LiteLLM A2A Gateway section — fixes broken anchor from a2a.md, documents dual JWT/SigV4 auth modes and full credential chain
docs: add AuthN/AuthZ overview page side-by-siding MCP and A2A gateways
docs(fixup): corrections from code-review pass — verified against current LiteLLM source
make changes