Skip to content

[VideoGenX] run native video sweeps from YAML recipes / [VideoGenX] 使用 YAML 配方运行原生视频扫描 - #2916

Open
edwingao28 wants to merge 57 commits into
feat/videogenx-measurement-corefrom
feat/h3-cross-hardware
Open

edwingao28 wants to merge 57 commits into
feat/videogenx-measurement-corefrom
feat/h3-cross-hardware

Conversation

@edwingao28

@edwingao28 edwingao28 commented Sep 9, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Run MiniMax-H3 video sweeps from native srt-slurm YAML recipes on SGLang v0.5.23. Each deployment seals media, request windows, GPU UUIDs and power; merge reuses only a run covering every selected deployment.

flowchart LR
    subgraph sweep["PR sweep: run-sweep.yml"]
        A["Config row + h3-v2.yaml"] --> B["srt-slurm job<br/>SGLang server + C1 client"]
        B --> C["Sealed bundle<br/>media, request windows,<br/>GPU UUIDs, power"]
        C --> D["validate-video-results"]
    end
    subgraph merge["After merge: merge-ingest.yml"]
        E["Re-validate reused bundles"] --> F["Publish to the InferenceX App"]
    end
    D -->|"/use run_id"| E
Loading

Results (final sweep, 035a2afb): MiniMax-H3 42ed227e BF16, C1, 124 frames, 1344×768, 49 steps.

GPU Parallelism Measured + warmup Valid p50 per clip Max per clip
H100 ×4 TP2 + Ulysses2 20 + 1 20/20 74.46 s 74.61 s
B200 ×4 Ulysses4 20 + 1 20/20 36.27 s 36.85 s
Check Result
CI Canary, video jobs and validate-video-results pass
Server logs 49/49 steps; 0 IPC all-to-all fallbacks
Bundles Media, power and GPU UUIDs verified
Current-head validator Both bundles pass
Dashboard Both published H3 points kept

Limits: Semantic quality is unjudged; H200 follows separately. Post-sweep commits (harness move, spec rename, failure-path fixes) ran CPU CI only. Merge with the reuse helper from this branch: main's /use check predates video artifacts.

Stacked on #4657 and #4658.

AI model disclosure
  • Model/version: claude-opus-5-5 and claude-fable-5-1 for this revision; earlier commits could not be verified.
  • Role: implementation, CI runs and PR text.
PR checklist and change type

Type of Change

  • Bug fix
  • New feature
  • Configuration change
  • Documentation update
  • Other (please describe)

Checklist

  • I have completed the AI model disclosure and kept it current
  • I have tested my changes locally
  • I have updated documentation if necessary
  • If python -m infx.matrix.changed --base origin/main lists affected config keys, I have appended one new entry covering them to the physical end of inferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entries
  • If this PR appends an inferencex-e2e/perf-changelog.yaml entry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs): full-sweep-fail-fast (recommended), full-sweep-enabled, or non-canary-full-sweep-enabled. Optional modifiers all-evals, evals-only, and agentx-fast require a primary label; the last two block reuse while applied.
  • Before merging via reuse, an authorized maintainer (OWNER/MEMBER/COLLABORATOR) has commented /use <run_id> (or the legacy /reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.
中文

通过原生 srt-slurm YAML 配方在 SGLang v0.5.23 上运行 MiniMax-H3 视频扫描。每个部署都会封存媒体、请求时间窗、GPU UUID 和功耗;合并时只复用覆盖全部选中部署的 run。流程见上方流程图。

结果(035a2afb 的最终扫描):MiniMax-H3 42ed227e BF16,C1,124 帧,1344×768,49 步。

GPU 并行方式 测量 + warmup 有效 每段 p50 每段最大值
H100 ×4 TP2 + Ulysses2 20 + 1 20/20 74.46 s 74.61 s
B200 ×4 Ulysses4 20 + 1 20/20 36.27 s 36.85 s
检查项 结果
CI canary、video job 和 validate-video-results 均通过
服务端日志 49/49 步;IPC all-to-all 回退 0 次
产物 媒体、功耗和 GPU UUID 均通过校验
当前 head 的校验器 两个产物均通过
仪表板 已发布的两个 H3 数据点都保留

限制: 尚未评估语义质量;H200 另行跟进。扫描之后的提交(harness 迁移、spec 重命名、失败路径修复)只跑了 CPU CI。main 上的 /use 检查早于 video 产物支持,合并时请在本分支上运行复用合并脚本。

基于 #4657 和 #4658。

AI 模型:本次修改使用 claude-opus-5-5 和 claude-fable-5-1,负责实现、CI 运行和 PR 文案;更早的提交无法确认所用模型。

@github-actions

github-actions Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase As a PR reviewer and CODEOWNER, I have reviewed this and have.

For PR verification, add the full-sweep-fail-fast label (strongly recommended) to this PR — the benchmark sweep only runs on labeled PRs. Use full-sweep-enabled only if you need matrix jobs to keep running past a failure.

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs


感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 As a PR reviewer and CODEOWNER, I have reviewed this and have。

如需进行 PR 验证,请为此 PR 添加 full-sweep-fail-fast 标签(强烈推荐)— 基准测试 sweep 仅在带有标签的 PR 上运行。仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled。

PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档

@edwingao28
edwingao28 force-pushed the feat/h3-cross-hardware branch from a7facf5 to 7019bb2 Compare September 9, 2026 08:42
@edwingao28 edwingao28 changed the title [H3 CI] add hardware sites and serving matrices / 接入硬件站点与服务测量 [H3 CI] compare frozen hardware runs and retain serving evidence / 保留跨硬件服务证据 Sep 9, 2026
@edwingao28
edwingao28 force-pushed the feat/h3-cross-hardware branch from 2327589 to 8247212 Compare September 27, 2026 06:32
@edwingao28 edwingao28 changed the title [H3 CI] compare frozen hardware runs and retain serving evidence / 保留跨硬件服务证据 [H3] integrate manual video benchmarks with the current infx planner / [H3] 将手动视频基准测试接入当前 infx planner Sep 27, 2026
@edwingao28
edwingao28 changed the base branch from feat/h3-video-ci to main September 27, 2026 06:33
@functionstackx

Copy link
Copy Markdown
Collaborator

Sorry, over the weekend, there was 2 major refactors to clean up the technical debt accumalated over the past 11 months of moving at the speed of light. We don't see any major refactors in the forthseeable future besides cleaning up AMD multinode AgentX pile of bash. As much, due to the refactors, u would need to ask your agent to rebase from remote main@latest. Thank you in advance for ur understanding

cursor Bot pushed a commit that referenced this pull request Sep 28, 2026
补充 #2916 与 App #1193 的契约矩阵、CPU 验证结果与下一步决策说明。

Co-authored-by: Wenyao Gao <edwingao28@users.noreply.github.com>
@edwingao28 edwingao28 changed the title [H3] integrate manual video benchmarks with the current infx planner / [H3] 将手动视频基准测试接入当前 infx planner [Video] integrate manual video benchmarks with the current infx planner / 将手动视频基准测试接入当前 infx planner Oct 5, 2026
edwingao28 added a commit that referenced this pull request Oct 17, 2026
…aluator

Carries the MiniMax-H3 serving harness from #2916 onto main. The evaluator
gains srt-serve/srt-client/srt-finalize so a generic srt-slurm service runs
the diffusion server, each concurrency publishes its own measurement window,
and the dashboard bundle is assembled from the native power package.

中文:将 #2916 的 MiniMax-H3 serving harness 迁移到 main。evaluator 新增
srt-serve/srt-client/srt-finalize:由 srt-slurm generic service 启动 diffusion
server,每个并发度发布自己的测量窗口,并基于原生功耗包组装仪表板产物。
@edwingao28
edwingao28 force-pushed the feat/h3-cross-hardware branch 5 times, most recently from 4aa0638 to ddc4127 Compare October 17, 2026 04:18
edwingao28 added a commit that referenced this pull request Oct 17, 2026
…aluator

Carries the MiniMax-H3 serving harness from #2916 onto main. The evaluator
gains srt-serve/srt-client/srt-finalize so a generic srt-slurm service runs
the diffusion server, each concurrency publishes its own measurement window,
and the dashboard bundle is assembled from the native power package.

中文:将 #2916 的 MiniMax-H3 serving harness 迁移到 main。evaluator 新增
srt-serve/srt-client/srt-finalize:由 srt-slurm generic service 启动 diffusion
server,每个并发度发布自己的测量窗口,并基于原生功耗包组装仪表板产物。
@edwingao28
edwingao28 force-pushed the feat/h3-cross-hardware branch from ddc4127 to f7c7f58 Compare October 17, 2026 04:31
edwingao28 added a commit that referenced this pull request Oct 17, 2026
…aluator

Carries the MiniMax-H3 serving harness from #2916 onto main. The evaluator
gains srt-serve/srt-client/srt-finalize so a generic srt-slurm service runs
the diffusion server, each concurrency publishes its own measurement window,
and the dashboard bundle is assembled from the native power package.

中文:将 #2916 的 MiniMax-H3 serving harness 迁移到 main。evaluator 新增
srt-serve/srt-client/srt-finalize:由 srt-slurm generic service 启动 diffusion
server,每个并发度发布自己的测量窗口,并基于原生功耗包组装仪表板产物。
@edwingao28
edwingao28 force-pushed the feat/h3-cross-hardware branch 2 times, most recently from 068d64f to 0cb4c84 Compare October 17, 2026 04:45
@edwingao28 edwingao28 changed the title [Video] integrate manual video benchmarks with the current infx planner / 将手动视频基准测试接入当前 infx planner [VideoGenX] run H3 video generation through the native srt-slurm launcher / 通过原生 srt-slurm launcher 运行 H3 视频生成 Oct 17, 2026
@edwingao28
edwingao28 marked this pull request as ready for review October 17, 2026 06:44
@edwingao28
edwingao28 requested a review from a team October 17, 2026 06:44
@edwingao28

Copy link
Copy Markdown
Collaborator Author

/use 41812249525

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended)

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

2 participants