LLM inference callback support#1689

Draft

SteveSandersonMS wants to merge 16 commits into

mainfrom

stevesandersonms/llm-inference-callbacks

Commits on Jun 15, 2026

Add LLM inference callback support to Node SDK

stevesa
and
Copilot
committed
feat: register llm inference handler globally on the SDK client

SteveSandersonMS
and
Copilot
committed
test: assert /models catalog request now intercepts in callback

SteveSandersonMS
and
Copilot
committed
feat: streaming LLM inference callback (httpStreamStart + e2e)

SteveSandersonMS
and
Copilot
committed
test: e2e for LLM inference callback error mapping

SteveSandersonMS
and
Copilot
committed
refactor(llm-callback): drop inferred request metadata field

SteveSandersonMS
and
Copilot
committed
feat(llm-callback): collapse to a single onLlmRequest with chunked body

SteveSandersonMS
and
Copilot
committed

Commits on Jun 16, 2026