Skip to content

Pull requests: lightseekorg/smg

New pull request New
57 Open 899 Closed
57 Open 899 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ix(routing): make hash-based policies respect circuit breaker state model-gateway Model gateway crate changes
#1124 opened Apr 14, 2026 by nishanthp Contributor Loading…
2
fix(responses): reject explicit MCP requests when any server connection fails grpc gRPC client and router changes model-gateway Model gateway crate changes openai OpenAI router changes tests Test changes
#1123 opened Apr 14, 2026 by zhaowenzi Collaborator Loading…
2 of 4 tasks
8
feat(tokenizer): load EOS token IDs from generation_config.json, strip in StopDecoder grpc gRPC client and router changes model-gateway Model gateway crate changes tests Test changes tokenizer Tokenizer related changes
#1122 opened Apr 14, 2026 by CatherineSue Member Loading…
2 of 4 tasks
11
feat(protocols): add serde(flatten) to ChatCompletionRequest for engine-specific fields protocols Protocols crate changes
#1119 opened Apr 14, 2026 by DavidBellamy Loading…
1
4
feat(worker): Handle model alias for worker selection model-gateway Model gateway crate changes protocols Protocols crate changes
#1117 opened Apr 14, 2026 by khoaatra Loading…
4 tasks
@slin1237
22
fix(grpc): forward scheduler load info for DP-aware load balancing grpc gRPC client and router changes
#1116 opened Apr 13, 2026 by Kangyan-Zhou Contributor Loading…
4 tasks
@slin1237
3
feat(mcp) Include citations, sources and query when available ci-approved mcp MCP related changes model-gateway Model gateway crate changes openai OpenAI router changes
#1109 opened Apr 13, 2026 by Tobel158 Contributor Loading…
4 tasks
@slin1237
42
feat(grpc): support --sampling-defaults in sglang gRPC servicer grpc gRPC client and router changes
#1107 opened Apr 13, 2026 by ai-jz Collaborator Loading…
8 tasks done
12
fix(grpc_client): honor ResponsesRequest sampling params in vLLM/SGLang/TRT-LLM grpc gRPC client and router changes
#1106 opened Apr 13, 2026 by key4ng Collaborator Loading…
2 of 4 tasks
11
feat(grpc): support vLLM --generation-config in gRPC mode ci-approved grpc gRPC client and router changes
#1103 opened Apr 12, 2026 by ai-jz Collaborator Loading…
7 tasks done
66
feat(mlx): add Python gRPC servicer for MLX backend ci CI/CD configuration changes dependencies Dependency updates grpc gRPC client and router changes tests Test changes
#1099 opened Apr 11, 2026 by key4ng Collaborator Loading…
3 of 5 tasks
99
feat(protocol): add thinking param to Chat API and support bare string image_url protocols Protocols crate changes tokenizer Tokenizer related changes
#1098 opened Apr 11, 2026 by ConnorLi96 Collaborator Loading…
3 tasks done
9
feat(multimodal): add Kimi-K2.5 vision model spec and image processor multimodal Multimodal crate changes
#1097 opened Apr 11, 2026 by ConnorLi96 Collaborator Loading…
2 tasks done
10
feat(metrics): add serving metrics to gRPC request manager grpc gRPC client and router changes
#1092 opened Apr 10, 2026 by Kangyan-Zhou Contributor Loading…
4 tasks
16
fix(mcp): re-add image generation tool routing ci-approved grpc gRPC client and router changes mcp MCP related changes model-gateway Model gateway crate changes openai OpenAI router changes protocols Protocols crate changes
#1091 opened Apr 10, 2026 by TingtingZhou7 Contributor Loading…
4 tasks
59
feat(tool_parser): add structural tag constraint generation, fix skip_special_tokens derivation grpc gRPC client and router changes model-gateway Model gateway crate changes tests Test changes tool-parser Tool/function call parser changes
#1090 opened Apr 10, 2026 by CatherineSue Member Loading…
2 of 4 tasks
82
feat(grpc): add FlushCache RPC and profiling support for gRPC mode grpc gRPC client and router changes model-gateway Model gateway crate changes
#1088 opened Apr 10, 2026 by Kangyan-Zhou Contributor • Draft
3 of 4 tasks
6
fix(serve): normalize worker TP for GPU assignment python-bindings Python bindings changes tests Test changes
#1085 opened Apr 10, 2026 by smfirmin Contributor Loading…
2 of 4 tasks
@gongwei-130
8
feat(dynamicheaders): Support passing dynamic header from response api to mcp servers #1082 anthropic Anthropic router changes grpc gRPC client and router changes mcp MCP related changes model-gateway Model gateway crate changes openai OpenAI router changes protocols Protocols crate changes
#1084 opened Apr 10, 2026 by TingtingZhou7 Contributor Loading…
4 tasks
41
fix(metrics): engine metrics from PROMETHEUS_MULTIPROC_DIR + graceful bind model-gateway Model gateway crate changes needs-rebase PR has merge conflicts that need to be resolved python-bindings Python bindings changes
#1075 opened Apr 9, 2026 by ConnorLi96 Collaborator Loading…
2 tasks done
11
fix(tokenizer): load merged EOS token IDs from config.json + generation_config.json grpc gRPC client and router changes model-gateway Model gateway crate changes multimodal Multimodal crate changes tokenizer Tokenizer related changes
#1074 opened Apr 9, 2026 by ConnorLi96 Collaborator Loading…
2 tasks done
1
27
[WIP] Connorli/fix func call for KimiK2.5 grpc gRPC client and router changes model-gateway Model gateway crate changes multimodal Multimodal crate changes needs-rebase PR has merge conflicts that need to be resolved protocols Protocols crate changes python-bindings Python bindings changes reasoning-parser Reasoning parser changes tests Test changes tokenizer Tokenizer related changes tool-parser Tool/function call parser changes
#1070 opened Apr 8, 2026 by ConnorLi96 Collaborator Loading…
49
ci(benchmarks): add Devstral 2 to H100 nightly benchmarks ci CI/CD configuration changes tests Test changes
#1069 opened Apr 8, 2026 by smfirmin Contributor Loading…
16
feat(storage): add conversation memory store substrate data-connector Data connector crate changes model-gateway Model gateway crate changes openai OpenAI router changes
#1065 opened Apr 8, 2026 by zhoug9127 Collaborator Loading…
51
fix(gateway): strip leaked special tokens and clean up JSON response grpc gRPC client and router changes model-gateway Model gateway crate changes
#1063 opened Apr 8, 2026 by ConnorLi96 Collaborator Loading…
2 tasks done
1
34
ProTip! Exclude everything labeled bug with -label:bug.