uncaged/workflow
10
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity

flaky: hermes ACP tests depend on live LLM calls #435

New Issue
Open
opened 2026-05-23 10:47:43 +00:00 by xingyue · 0 comments
xingyue commented 2026-05-23 10:47:43 +00:00
Owner
Copy Link
Copy Source

Two tests in workflow-agent-hermes intermittently fail because they require live LLM API calls:

  1. acp-client.test.ts — "prompt() collects structured messages including tool calls"
  2. resume-e2e.test.ts — "resume() after close — second prompt returns non-empty text"

These tests hit a real LLM endpoint (copilot-api) and fail due to timeouts or unexpected responses. They should either be mocked or moved to a separate integration test suite.

Currently skipped in #434.

Two tests in `workflow-agent-hermes` intermittently fail because they require live LLM API calls: 1. `acp-client.test.ts` — "prompt() collects structured messages including tool calls" 2. `resume-e2e.test.ts` — "resume() after close — second prompt returns non-empty text" These tests hit a real LLM endpoint (copilot-api) and fail due to timeouts or unexpected responses. They should either be mocked or moved to a separate integration test suite. Currently skipped in #434.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
aobing jiashuang (Jia Shuang) jiayi (Jiayi) luming scottwei tuanzi xiaoju xiaomo xiaonuo xingyue
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: uncaged/workflow#435
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?