Skip to content

Discussion: physics/bounds admissibility checks for agentic tool calls #45

Open

Description

@PHM-Audit

Hi MiniMax team — M1's long-horizon agentic focus makes tool-call argument validity a natural eval topic: physical admissibility of generated arguments (probability/confidence in [0,1], non-negative counts, no NaN in numeric arrays, speeds within physical caps).

We maintain a deterministic rule-based checker for this surface — no LLM call, verdicts reproducible given input + a pinned rule-table version and configuration (phm-lite-check). Rules updated during review discussion in microsoft/PyRIT#3507 (public thread); ships as a Dify Marketplace plugin and MCP-registry-listed package.

Ask: would an eval note or script along these lines be useful here? The rule table and per-class checks are in the public repo.

— PHM-Audit

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions