Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
26d6e5c
chore(glm5.2): update GLM-5.2 FP8 B200 SGLang AgentX MTP image to nig…
github-actions[bot] Oct 26, 2026
ee959a5
fix(glm5.2): lower GLM-5.2 FP8 B200 c16 DCP8 mem-fraction-static to 0.83
github-actions[bot] Oct 26, 2026
717333f
chore(glm5.2): add perf-changelog entry for GLM-5.2 FP8 B200 SGLang A…
github-actions[bot] Oct 26, 2026
dcd5872
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Oct 29, 2026
1d24dd3
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Oct 29, 2026
c27467d
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Oct 29, 2026
0722328
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Oct 30, 2026
c5065e8
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Oct 31, 2026
472de65
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Nov 1, 2026
2ffa7d7
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Nov 2, 2026
5b06444
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Nov 2, 2026
e1a0a9a
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Nov 3, 2026
5704e9f
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Nov 3, 2026
2019223
Merge main into klaud/auto-fb56d2a358d2743c-0dd16aeb42d3dd5b [skip-sw…
github-actions[bot] Nov 3, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ override_c16:
dcp-size: 8
chunked-prefill-size: 16384
max-prefill-tokens: 16384
mem-fraction-static: 0.88
mem-fraction-static: 0.83
max-running-requests: 32
cuda-graph-max-bs-decode: 32
# Hold prefills until min(0.5 x running, prefill-max-requests) are queued,
Expand Down
2 changes: 1 addition & 1 deletion inferencex-e2e/configs/nvidia-master.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5018,7 +5018,7 @@ glm5.2-fp4-b200-sglang-agentic-mtp:
- { tp: 8, spec-decoding: mtp, kv-offloading: dram, kv-offload-backend: { name: hicache }, conc-list: [1, 4, 8, 12, 16], srt-recipe: agentic.yaml }

glm5.2-fp8-b200-sglang-agentic-mtp:
image: lmsysorg/sglang:nightly-dev-20261020-ab580b2e@sha256:0af411bb320a95bb5e1c58b4c20c9852920a19aa9f12f148f69731b0dca3b576
image: lmsysorg/sglang:nightly-dev-20261026-8252e3af@sha256:b4e4abb9e1dc038f7e14c85805be97e4f74abb46e541bd4edd31401d50a2e593
model: zai-org/GLM-5.2-FP8
model-prefix: glm5.2
runner: cluster:b200-nscale
Expand Down
7 changes: 7 additions & 0 deletions inferencex-e2e/perf-changelog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11954,3 +11954,10 @@
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/4726
scenario-type: [agentic-coding]
append-only: true

- config-keys:
- glm5.2-fp8-b200-sglang-agentic-mtp
description:
- "Update the SGLang image to nightly-dev-20261026-8252e3af and lower c16 mem-fraction-static to 0.83."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/4543
scenario-type: [agentic-coding]
Loading