Repository navigation
[VideoGenX] run H3 on SGLang v0.5.23 for B200 and H100 / [VideoGenX] 在 B200 和 H100 上使用 SGLang v0.5.23 运行 H3 - #4776
Merged
Conversation
edwingao28
requested review from
a team,
Ankur-singh,
RohitNagraj,
kedarpotdar-nv,
nvpohanh and
wzhao18
as code owners
November 4, 2026 02:57
Contributor
|
Thanks for the contribution!
中文感谢你的贡献!
|
edwingao28
force-pushed
the
feat/h3-sglang-v0523-recipe
branch
from
November 4, 2026 02:58
4ff5ea4 to
e61a672
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Move the B200 and H100 H3 video rows from SGLang nightly
797af717to thelmsysorg/sglang:v0.5.23release recommended in the MiniMax-H3 recipe. Both rows pin the amd64 digest;VIDEO_RUNTIME_REVISIONfollows the v0.5.23 tag (297e54fd). Engine flags and the v0.1 workload are unchanged.Testing: Trusted-mode run 41773473575: B200 36.25 s/clip, H100 74.45 s/clip, 20/20 valid each, no IPC all-to-all fallback, 49/49 steps. Its CI validator job failed on a main-only checkout (fixed in #2916); the validator passes locally on its artifacts.
Dispatched through
e2e-tests.ymlas for external PRs, since this PR targets #2916.PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.中文
B200 和 H100 的 H3 视频配置目前使用带日期的 SGLang nightly 镜像(
797af717),外部无法复现其结果。本 PR 将这两项配置改为lmsysorg/sglang:v0.5.23正式版镜像,即 SGLang Diffusion 团队在 MiniMax-H3 recipe(第 1、2 节)中推荐的 H3 镜像。h3-bf16-b200-sglang-video和h3-bf16-h100-sglang-video固定为lmsysorg/sglang:v0.5.23@sha256:f7876bef696ccf9cf75a2bf7ccb82970f5fac577f082fb8ca95c9a59d2160eb5。该 digest 是v0.5.23镜像索引sha256:f832b5c39559…中的 linux/amd64 manifest,v0.5.23-cu130指向同一索引。VIDEO_RUNTIME_REVISION改为297e54fd105e974cdf401e5b4d20253a22c16f90,即sgl-project/sglang的v0.5.23tag 对应的 commit,与镜像标签org.opencontainers.image.revision一致。--encoder-parallel auto --performance-mode speed --warmup-resolutions 1344x768、eager、BF16,并保留--disable-conditioning-cache。perf-changelog.yaml末尾追加一条记录,包含上述两个 config key。planner 选出两个 C1 部署:cluster:b200-nscale上的 B200 和cluster:h100-dsxe上的 H100。风险:
feat/h3-cross-hardware([VideoGenX] run native video sweeps from YAML recipes / [VideoGenX] 使用 YAML 配方运行原生视频扫描 #2916),不是main。run-sweep.yml和trusted-external-sweep.yml只对合入main的 PR 触发,因此在 [VideoGenX] run native video sweeps from YAML recipes / [VideoGenX] 使用 YAML 配方运行原生视频扫描 #2916 合入后把本 PR rebase 到main之前,或由维护者针对当前 head 手动 dispatche2e-tests.yml之前,无法运行 sweep。IPC all-to-all (multi-rank) unavailable,且进度条显示49/49,请在 sweep 的logs/service_video-server.out中核对这两项。AI 模型使用说明:claude-opus-5-5(Claude Code 运行环境提供的标识),负责阅读贡献文档和 recipe、解析镜像 digest 与 SGLang commit、修改配置、recipe 和 changelog、运行本地检查并撰写本说明,未委派其他 agent。