Smoke Test Summary — Claude Engine
Overall Status: ⚠️ PARTIAL (test #16 skipped — no unresolved review threads available at resolve-time; test #19 skipped — no safe test PR to close)
PR used for review tests: #31796
Run: https://github.com/github/gh-aw/actions/runs/25768552851
Timestamp: 2026-05-12
Core Tests #1 –#12
#
Test
Status
Notes
1
GitHub MCP — last 2 merged PRs
✅
#31807 , #31806
2
mcpscripts-gh / github_pr_query
✅
Tool mcpscripts-gh not exposed; used github_pr_query instead (returned #31813 , #31812 )
3
Serena activate_project + find_symbol
✅
Activated; Workflow pattern returned 14 symbols (≥3)
4
mcpscripts-make build
✅
gh-aw binary built (v9a1c1282e-dirty)
5
Playwright navigate to github.com
✅
Title contains "GitHub"
6
Tavily search "GitHub Agentic Workflows"
✅
3 results returned
7
File write /tmp/gh-aw/agent/smoke-test-claude-25768552851.txt
✅
Created
8
Bash cat verifies file
✅
Read back successfully
9
github_discussion_query latest discussion
✅
Discussion #31805
10
agentic-workflows status for smoke-claude
✅
engine=claude, compiled=Yes, status=active
11
post_slack_message safe output
✅
Posted to #smoke-tests
12
create_code_scanning_alert safe output
✅
Dummy warning posted
PR Review Tests #13 –#19 (against PR #31796 )
#
Test
Status
Notes
13
update_pull_request (append body)
✅
Appended marker
14
create_pull_request_review_comment ×2
✅
2 inline comments on .changeset/patch-bump-awf-v0-25-44.md
15
submit_pull_request_review (COMMENT)
✅
Review submitted
16
resolve_pull_request_review_thread
⚠️
No unresolved threads at resolve-time (new review comments materialize after agent finishes)
17
add_reviewer (copilot)
✅
Attempted
18
push_to_pull_request_branch
✅
Committed smoke-test-files/smoke-claude-push-test.md and pushed
19
close_pull_request
⚠️
Skipped — no safe test PR to close
References
Warning
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.com
android.clients.google.com
clients2.google.com
contentautofill.googleapis.com
safebrowsingohttpgateway.googleapis.com
www.google.com
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network :
allowed :
- defaults
- " accounts.google.com"
- " android.clients.google.com"
- " clients2.google.com"
- " contentautofill.googleapis.com"
- " safebrowsingohttpgateway.googleapis.com"
- " www.google.com"
See Network Configuration for more information.
💥 [THE END] — Illustrated by Smoke Claude · ● 5.4M · ◷
Smoke Test Summary — Claude Engine
Overall Status:⚠️ PARTIAL (test #16 skipped — no unresolved review threads available at resolve-time; test #19 skipped — no safe test PR to close)
PR used for review tests: #31796
Run: https://github.com/github/gh-aw/actions/runs/25768552851
Timestamp: 2026-05-12
Core Tests #1–#12
mcpscripts-ghnot exposed; usedgithub_pr_queryinstead (returned #31813, #31812)activate_project+find_symbolWorkflowpattern returned 14 symbols (≥3)mcpscripts-make buildv9a1c1282e-dirty)/tmp/gh-aw/agent/smoke-test-claude-25768552851.txtcatverifies filegithub_discussion_querylatest discussionagentic-workflows statusforsmoke-claudepost_slack_messagesafe outputcreate_code_scanning_alertsafe outputPR Review Tests #13–#19 (against PR #31796)
update_pull_request(append body)create_pull_request_review_comment×2.changeset/patch-bump-awf-v0-25-44.mdsubmit_pull_request_review(COMMENT)resolve_pull_request_review_threadadd_reviewer(copilot)push_to_pull_request_branchsmoke-test-files/smoke-claude-push-test.mdand pushedclose_pull_requestReferences
Warning
Firewall blocked 6 domains
The following domains were blocked by the firewall during workflow execution:
accounts.google.comandroid.clients.google.comclients2.google.comcontentautofill.googleapis.comsafebrowsingohttpgateway.googleapis.comwww.google.comSee Network Configuration for more information.