Skip to content

PR -> feat: Unified Telemetry Layer for Non-LangGraph Trace Pipelines (M2) Body #64

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
mjehanzaib999 wants to merge 62 commits into
base: experimental
Choose a base branch
from
Draft

PR -> feat: Unified Telemetry Layer for Non-LangGraph Trace Pipelines (M2) Body #64

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
192949c
checkpoint of WIP JSON OTEL demo
doxav Oct 3, 2025
2f1794b
working OTEL/LANGGRAPH demo
doxav Oct 5, 2025
bc0b304
converted demo JSON/OpenTelemetry to LangGraph
doxav Oct 5, 2025
e81ad34
checkpoint
doxav Oct 6, 2025
a71e1ed
OTEL/JSON/LANGGRAPH demo: add a mechanism to ensure multiple optimiza…
doxav Oct 6, 2025
53871aa
ADDED batchify for handling the multiple feedback in a batch + ADDED …
doxav Nov 6, 2025
87d3c67
working code optimization - TODO: clean, simplify the code
doxav Nov 7, 2025
da80055
fixed code optimization
doxav Nov 20, 2025
d88a779
ADD synthtizer prompt in optim score > High score
doxav Nov 20, 2025
d03fec5
TEST removing span/OTEL from optimized code
doxav Nov 20, 2025
1692a89
fixed and updated LangGraph/Otel demo README
doxav Nov 21, 2025
1c75117
restore
doxav Nov 25, 2025
779db55
ADD demo and tests for native LangGraph integration with OTEL tracing
doxav Dec 11, 2025
23a377c
ADD refactor run_graph_with_otel to support custom evaluation functio…
doxav Dec 12, 2025
d19ba70
ADD implement run_benchmark function to compare different feedback mode
doxav Dec 12, 2025
22d1064
ADD M0 technical plan, architecture docs, and prototype API validation
JZOMVI Feb 6, 2026
30a89c8
Fix Colab badge URL: replace placeholders with actual repo/branch path
JZOMVI Feb 6, 2026
6760695
ADD Colab Secrets key retrieval and Google Drive auto-save to notebook
JZOMVI Feb 6, 2026
c85baf8
Update T1 tech plan: notebooks + acceptance alignment + fixed opto/tr…
doxav Feb 8, 2026
c8dfc04
ADD M1 core: instrument_graph + optimize_graph + E2E pipeline + notebook
JZOMVI Feb 12, 2026
2f0d53d
FIX: address all feedback issues (A1-F13)
JZOMVI Feb 12, 2026
1e218e0
REFACTOR: remove all hardcoded/example-specific defaults from library…
mjehanzaib999 Feb 13, 2026
bd4f556
fix(optimization): correct best_updates tracking to reflect actual be…
mjehanzaib999 Feb 16, 2026
1ec38cc
fix(optimization): fall back to graph.output_key in optimize_graph()
mjehanzaib999 Feb 16, 2026
55f4dda
fix(instrumentation): wire enable_code_optimization to TracingLLM
mjehanzaib999 Feb 16, 2026
084cbf8
fix(otel): prevent dangling TGJ parents and record errors on child spans
mjehanzaib999 Feb 16, 2026
856b05f
fix(notebook): replace brittle name heuristics with attribute-based t…
mjehanzaib999 Feb 17, 2026
c39bed8
Merge branch 'experimental' of https://github.com/AgentOpt/OpenTrace …
mjehanzaib999 Feb 19, 2026
3c772b9
Merge branch 'experimental' of https://github.com/AgentOpt/OpenTrace …
mjehanzaib999 Feb 19, 2026
1abefdc
fix: address PR feedback round 2 — multi-node notebook + error.messag…
mjehanzaib999 Feb 19, 2026
8978ff7
fix: replace custom OpenRouterLLM with Trace LiteLLM, use real OptoPr…
mjehanzaib999 Feb 20, 2026
cb2eede
fix: update retired OpenRouter model to llama-3.3-70b-instruct:free
mjehanzaib999 Feb 20, 2026
0f09eed
fix: use OPENAI_BASE_URL env var for OpenRouter routing
mjehanzaib999 Feb 20, 2026
6fb3c92
fix: add openai/ prefix for litellm OpenRouter routing
mjehanzaib999 Feb 20, 2026
73f48bf
fix: use openai package directly for OpenRouter, add smoke test
mjehanzaib999 Feb 20, 2026
fd2da29
fix: switch to Qwen3 model, use built-in eval_fn for live optimization
mjehanzaib999 Feb 20, 2026
82d0c31
fix: use paid meta-llama/llama-3.3-70b-instruct to avoid free-tier ra…
mjehanzaib999 Feb 20, 2026
306b306
fix: resolve ParameterNode-keyed updates in live optimization
mjehanzaib999 Feb 23, 2026
a373dad
fix: per-query optimizer step to avoid feedback aggregation assertion
mjehanzaib999 Feb 23, 2026
fea60a4
fix: use batchify for multi-query backward pass instead of per-query …
mjehanzaib999 Feb 24, 2026
c6f2b19
feat: add unified telemetry layer for non-LangGraph Trace pipelines (M2)
mjehanzaib999 Feb 25, 2026
b2f55d3
Add M2 validation notebook with StubLLM and live LLM test sections
mjehanzaib999 Feb 27, 2026
6ab24c3
git commit -m "Clean up repo root: move M2 notebook to examples/noteb…
mjehanzaib999 Feb 27, 2026
9af43f2
fix: correct Colab badge URL to point to fork and M2 branch
mjehanzaib999 Feb 27, 2026
b3f4d22
fix: move postprocess_output inside span context so MessageNode bindi…
mjehanzaib999 Mar 2, 2026
9d34ea2
fix: ensure Colab install cell fetches latest code on re-run
mjehanzaib999 Mar 2, 2026
b1cb419
fix: add local sys.path for notebook and relax Python version
mjehanzaib999 Mar 2, 2026
485a199
fix: use string-compatible function in span redaction test cell
mjehanzaib999 Mar 2, 2026
3e85f65
fix: add missing cell IDs to M2 notebook for GitHub compatibility
mjehanzaib999 Mar 2, 2026
f460889
fix: revert M2 notebook to nbformat 4.4 for GitHub compatibility
mjehanzaib999 Mar 2, 2026
5ed7bd4
fix: use llama-3.3-70b-instruct model in M2 notebook to match M1
mjehanzaib999 Mar 2, 2026
617eaee
Created using Colab
mjehanzaib999 Mar 2, 2026
f4a5b43
feat: add MLflow integration tests to M2 notebook
mjehanzaib999 Mar 2, 2026
96ee036
fix: expose __name__ and __qualname__ on FunModule for mlflow.trace()…
mjehanzaib999 Mar 2, 2026
aad7f35
feat: add MLflow UI inspection cell and fix FunModule __name__ for ml…
mjehanzaib999 Mar 2, 2026
124f742
feat: add MLflow UI inspection cell with clickable proxy link (Sectio…
mjehanzaib999 Mar 2, 2026
8ec9d1c
fix: use serve_kernel_port_as_iframe for MLflow UI on Colab
mjehanzaib999 Mar 2, 2026
e710ef6
fix: correct record_genai_chat() kwargs in call_llm() OTEL span
mjehanzaib999 Mar 3, 2026
ea77845
fix: use token stack for TelemetrySession nested activation
mjehanzaib999 Mar 3, 2026
193ab4d
feat: add set_current() / clear_current() imperative activation API
mjehanzaib999 Mar 3, 2026
b1988ed
feat: add mode="span" and OTLP->TGJ->ingest_tgj round-trip validation…
mjehanzaib999 Mar 3, 2026
6c5d9d5
fix: resolve MLflow "Failed to capture inputs" by setting FunModule._…
mjehanzaib999 Mar 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions .env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
# OpenRouter Configuration
# Copy this file to .env and fill in your values
# Get your API key from: https://openrouter.ai/keys

OPENROUTER_API_KEY=sk-or-v1-your-key-here
OPENROUTER_MODEL=meta-llama/llama-3.1-8b-instruct:free
OPENROUTER_BASE_URL=https://openrouter.ai/api/v1
USE_STUB_LLM=false
4 changes: 3 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,4 +168,6 @@ OAI_CONFIG_LIST
*.gv.pdf

# jupyter book API output
docs/api/*
docs/api/*

uv.lock
57 changes: 0 additions & 57 deletions OVERVIEW.md
View file
Open in desktop

This file was deleted.

Loading