Skip to content

A case expects only what the specification fixes - #21

Merged
dittops merged 1 commit into
masterfrom
cases-expect-only-what-the-spec-fixes
Nov 12, 2026
Merged

dittops merged 1 commit into
masterfrom
cases-expect-only-what-the-spec-fixes

Conversation

@dittops

@dittops dittops commented Nov 12, 2026

Copy link
Copy Markdown
Member

Follows #20. Bud Agent Flow's second replay of tests/conformance/: 21 of 24 agreed, and the three that did not were each a question the cases had answered by accident.

What a runtime must match

  • A run that stopped because its answer does not fit answers-with: hands back an empty record. PACT handed back the unfitting answer beside the word stopped. Why it stopped is in said.
  • A field the run did not set is absent from its answer, not null. PACT already did this; it is now said.
  • The order agents are asked in across the items of an each is the runtime's to choose unless the stage says at-once-at-most: 1, as the schema's help has always said. tests/conformance/trees/routed-desk now writes it.

One expect changed: the does-not-fit case's answer, to {}.

Checked

scripts/test-all.sh exits 0: 4872 tests (1623 Rust + 3249 adapter), unchanged. mkdocs build --strict builds. newest-pydantic-ai fails on master with the same five failures and is not touched here.

🤖 Generated with Claude Code

… back nothing, and order is written where a case expects it

Bud Agent Flow's second replay: 21 of 24 agreed, and the three that did
not were each a question the cases had answered by accident.

A run that stopped because its answer does not fit answers-with: hands
back an empty record. PACT handed back the unfitting answer beside the
word stopped, which a caller could still read fields off. Why it stopped
is in said.

A field the run did not set is absent from its answer, not null. PACT
already did this; it is now said.

The order agents are asked in across the items of an each is the
runtime's to choose unless the stage says at-once-at-most: 1, as the
schema's help has always said. tests/conformance/trees/routed-desk now
writes it, so the case that expects an order expects one the tree fixes.

One expect changed: the does-not-fit case's answer, to {}.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
@dittops
dittops merged commit fde7280 into master Nov 12, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants