xiaomo
8d6f480b0f
Merge pull request 'fix: workflow-authoring flat schema, bootstrap PATH guidance' ( #111 ) from fix/110-bootstrap-workflow-fixes into main
CI / check (push) Successful in 2m31s
2026-06-05 11:49:48 +00:00
xiaoju
5450bc1230
fix: workflow-authoring flat schema, bootstrap PATH guidance
...
CI / check (pull_request) Successful in 2m18s
- #110.3: flat schema example uses enum: [done] instead of bare const
(bare const fails validate-semantic hasStatusEnum check)
- #110.4: bootstrap adds 'which hermes' PATH check and venv guidance
- #110.1: already fixed in rc.1 (inline hello.yaml)
- #110.2: already fixed in rc.1 (capabilities: [] present)
Fixes #110
2026-06-05 11:44:20 +00:00
xiaomo
f1f122b0b1
Merge pull request 'fix: preset base-url auto-fill, bootstrap ACP docs, friendlier errors' ( #109 ) from fix/106-107-108-bootstrap-ux into main
CI / check (push) Successful in 2m49s
2026-06-05 11:16:31 +00:00
xiaoju
57ae6d1755
fix: preset base-url auto-fill, bootstrap ACP docs, friendlier errors
...
CI / check (pull_request) Successful in 2m26s
- #106 : uwf setup --provider <preset> now auto-fills --base-url
- #107 : bootstrap documents hermes ACP dependency (pip install hermes-agent[acp])
- #107 : verify step uses inline hello.yaml instead of missing examples/eval-simple.yaml
- #108 : workflow name mismatch error suggests how to fix (rename file or change YAML name)
Fixes #106 , Fixes #107 , Fixes #108
2026-06-05 11:06:35 +00:00
xiaomo
d64d150071
Merge pull request 'fix: expand bootstrap prompt with full onboarding and upgrade guide' ( #105 ) from fix/104-bootstrap-onboarding into main
CI / check (push) Successful in 2m20s
2026-06-05 10:39:18 +00:00
xiaoju
c5eb8b79d1
fix: expand bootstrap prompt with full onboarding and upgrade guide
...
CI / check (pull_request) Successful in 2m56s
- Fresh install: CLI + adapter install, uwf setup, skills, e2e verify
- Upgrade: update packages, regenerate skills, migrate workflows
- Explicitly tells agent to ask user for provider/api-key/model
- Lists all available adapters with install commands
- Documents v0.2.0 $START migration
Fixes #104
2026-06-05 10:35:01 +00:00
xiaoju
36a3ca6a08
chore: bump cli@0.2.0, util@0.1.2
CI / check (push) Successful in 2m25s
2026-06-05 10:11:19 +00:00
xiaomo
eb0b7b514f
Merge pull request 'docs: update wf-stateless-design.md for new/resume $START semantics' ( #103 ) from docs/101-stateless-design-update into main
CI / check (push) Successful in 2m9s
2026-06-05 09:49:23 +00:00
xiaoju
a47871ec4e
chore: remove unused moderator-reference and yaml-reference
...
CI / check (pull_request) Successful in 2m1s
These generate* functions were exported from util but never consumed
by any code. Dead exports are maintenance burden.
Refs #101
2026-06-05 09:44:50 +00:00
xiaoju
5851e5d162
docs: update wf-stateless-design.md to reflect new/resume semantics
...
CI / check (pull_request) Successful in 2m23s
Refs #101
2026-06-05 09:38:01 +00:00
xiaomo
61dfb40933
Merge pull request 'feat: replace $START _ status with new/resume semantics' ( #102 ) from feat/101-start-new-resume into main
CI / check (push) Successful in 2m42s
2026-06-05 09:35:35 +00:00
xiaoju
fbfd31a042
feat: replace $START _ status with new/resume semantics
...
CI / check (pull_request) Successful in 2m27s
BREAKING: All workflow YAML files must update $START._ to $START.new + $START.resume.
The resume edge prompt replaces the previously hardcoded resume message.
- evaluate.ts: remove START_ROLE/START_STATUS special case, use $status like all nodes
- thread.ts: resolveEvaluateArgs passes 'new', cmdThreadResume passes 'resume'
- validate.ts: reject '_' everywhere (no longer valid)
- validate-semantic.ts: require 'new' and 'resume' edges on $START
- All workflow YAMLs and test fixtures updated
Fixes #101
2026-06-05 09:30:09 +00:00
xiaomo
d99a376b60
Merge pull request 'fix: simplify prompt subcommands, framework-agnostic bootstrap' ( #100 ) from fix/99-prompt-cleanup into main
CI / check (push) Successful in 3m19s
2026-06-05 09:03:56 +00:00
xiaoju
a536efee00
fix: simplify prompt subcommands, framework-agnostic bootstrap
...
CI / check (pull_request) Successful in 3m24s
- `uwf prompt usage` now outputs only the usage skill (was three combined)
- `uwf prompt bootstrap` replaces `setup` with framework-agnostic instructions
- Remove `usage-reference` and `setup` subcommands
- Remove `generateBootstrapReference` from util (moved to cli)
Fixes #99
小橘 🍊 （NEKO Team）
2026-06-05 08:52:35 +00:00
xiaoju
9260d81084
chore: version bump for --version fix
...
CI / check (push) Successful in 3m2s
agent-hermes@0.1.2 agent-claude-code@0.1.1 agent-builtin@0.1.1
agent-mock@0.1.1 eval@0.1.3 util@0.1.1
小橘 🍊 （NEKO Team）
2026-06-05 08:12:50 +00:00
xiaomo
c8d884072a
Merge pull request 'fix: acp-client reports agent-hermes own version in MCP clientInfo' ( #98 ) from fix/acp-client-own-version into main
CI / check (push) Successful in 2m27s
2026-06-05 08:10:57 +00:00
xiaoju
abeb465f46
fix: acp-client reports own package version, not util VERSION
...
CI / check (pull_request) Successful in 2m36s
Address review nit from PR #97 : clientInfo.version should be
agent-hermes's own version for correct identification under
independent versioning.
小橘 🍊 （NEKO Team）
2026-06-05 07:50:03 +00:00
xiaomo
28427a973f
Merge pull request 'fix: add --version to adapter CLIs, read VERSION from package.json' ( #97 ) from fix/adapter-version into main
CI / check (push) Successful in 3m3s
2026-06-05 07:36:15 +00:00
xiaoju
794f9db568
fix: add --version to adapter CLIs, read VERSION from package.json
...
CI / check (pull_request) Successful in 3m29s
- All uwf-* adapter CLIs now support --version / -V
- util VERSION constant reads from package.json at runtime
- agent-hermes ACP clientInfo uses dynamic VERSION
小橘 🍊 （NEKO Team）
2026-06-05 07:29:54 +00:00
xiaoju
cd585a26f1
Merge pull request 'fix: read eval CLI version from package.json' ( #96 ) from fix/95-eval-version into main
CI / check (push) Successful in 3m28s
2026-06-05 06:46:32 +00:00
xiaoju
1cf8f350d0
fix: read eval CLI version from package.json
...
CI / check (pull_request) Successful in 3m30s
Fixes #95
小橘 🍊 （NEKO Team）
2026-06-05 06:43:27 +00:00
xiaoju
427568a21d
chore: version bump agent-hermes@0.1.1 cli@0.1.1 eval@0.1.2
...
CI / check (push) Successful in 2m37s
小橘 🍊 （NEKO Team）
2026-06-05 06:29:25 +00:00
xiaomo
d3a2353acf
Merge pull request 'fix: read token usage from ACP response instead of DB' ( #94 ) from fix/usage-tokens-from-acp into main
CI / check (push) Successful in 3m25s
2026-06-05 06:18:05 +00:00
xiaoju
8085d1d6e0
fix: read token usage from ACP response instead of DB
...
CI / check (pull_request) Successful in 3m10s
Tokens (inputTokens, outputTokens) now come from ACP PromptResponse.usage
which is populated synchronously from run_conversation() — no WAL race.
Turns still come from DB before/after snapshot.
Previously both were read from hermes state.db after ACP prompt returned,
but WAL write lag caused incomplete token data (e.g. 235 vs actual 26,080).
Refs #91
2026-06-05 06:08:11 +00:00
xiaomo
8764d7bda3
Merge pull request 'chore: add changeset for #92 agent override alias fix' ( #93 ) from chore/changeset-agent-override into main
CI / check (push) Successful in 3m33s
2026-06-05 05:17:36 +00:00
xiaoju
850a3b2f25
chore: add changeset for #92 agent override alias fix
CI / check (pull_request) Successful in 3m8s
2026-06-05 04:36:41 +00:00
xiaomo
3d6a517e83
Merge pull request 'fix: resolve --agent override via config alias before raw command' ( #92 ) from fix/agent-override-alias into main
CI / check (push) Successful in 3m30s
2026-06-05 04:31:50 +00:00
xiaoju
825f0c641a
fix: resolve --agent override via config alias before raw command
...
CI / check (pull_request) Successful in 3m37s
When --agent is passed to uwf thread exec, try config.agents[alias]
first (e.g. 'hermes' → config.agents.hermes = {command: 'uwf-hermes'}),
then fall back to parseAgentOverride for raw command names.
Also change eval CLI default --agent from 'hermes' to 'uwf-hermes'
so it works without config alias lookup.
Refs #91
2026-06-05 04:20:09 +00:00
xiaoju
81bbe1178f
chore: release @united-workforce/eval@0.1.1
CI / check (push) Successful in 2m45s
2026-06-05 03:02:05 +00:00
xiaoju
a0e139935e
Merge pull request 'fix: frontmatter judge handles parsed object output' ( #90 ) from fix/frontmatter-judge-object-output into main
CI / check (push) Successful in 2m12s
2026-06-05 03:01:30 +00:00
xiaoju
a08775896f
fix: frontmatter judge handles parsed object output
...
CI / check (pull_request) Successful in 2m38s
The extract pipeline stores step output as a JSON object in CAS,
but the frontmatter judge only checked for raw markdown strings.
Now accepts both formats: parsed objects check $status directly,
raw strings go through YAML frontmatter extraction.
Fixes eval frontmatter-compliance scoring 0 on valid outputs.
2026-06-05 02:55:58 +00:00
xiaoju
c892b9125b
chore: remove prepublishOnly guards (proman handles release)
CI / check (push) Successful in 2m26s
2026-06-05 02:29:53 +00:00
xiaoju
8c5e12c5c8
Merge pull request 'chore: prepare 0.1.0 release' ( #89 ) from chore/prepare-release into main
CI / check (push) Failing after 12s
2026-06-05 02:28:08 +00:00
xiaoju
5edb67b79d
chore: prepare 0.1.0 release
...
CI / check (pull_request) Successful in 2m12s
- Remove legacy .changeset/ directory (no longer used)
- Add eval package to proman.yaml
- Set eval package to public for npm publishing
2026-06-05 02:21:24 +00:00
xiaoju
3d8df5c8e2
Merge pull request 'fix: remove _ single-exit for user roles' ( #88 ) from fix/86-remove-single-exit-underscore into main
CI / check (push) Successful in 2m16s
2026-06-05 02:09:50 +00:00
xiaoju
63cb4d3645
fix: remove _ single-exit for user roles
...
CI / check (pull_request) Successful in 3m7s
$START keeps _ (special entry node). All user-defined roles now require
explicit $status enum in frontmatter + matching graph keys.
- moderator: remove UNIT_STATUS fallback, error on missing $status
- validate: reject _ graph keys for non-$START roles
- validate-semantic: remove checkSingleExitRole(), require $status enum
- update all test fixtures to use explicit status values
- fix examples/analyze-topic.yaml
Fixes #86
2026-06-05 02:00:45 +00:00
xiaomo
f373945304
Merge pull request 'feat: eval package scaffold — CLI + schemas + types + task loader' ( #85 ) from feat/69-eval-scaffold into main
...
CI / check (push) Successful in 1m46s
feat: eval package scaffold — CLI + schemas + types + task loader (#85 )
2026-06-05 00:23:56 +00:00
xiaoju
ae81e4b5ac
feat: eval report, diff, list commands
...
CI / check (pull_request) Successful in 1m44s
Implement the 3 read commands for eval framework:
- report: read eval-run from CAS, render formatted text
(task, overall, config, judges table, thread ID)
- diff: side-by-side comparison with ▲/▼ delta indicators
and config change markers
- list: scan @uwf/eval/*/latest variables, sort by timestamp desc,
--task filter, --limit pagination
Architecture: pure formatting functions (format.ts) + data access
(read.ts) + thin CLI handlers. Types in types.ts.
11 new tests (formatReport, formatDiff, formatList, selectEntries)
Refs #72
2026-06-05 00:19:25 +00:00
xiaoju
8c26f16716
feat: builtin judges — frontmatter + token-stats (deterministic) + upstream/hallucination (stubs)
...
CI / check (pull_request) Successful in 1m45s
Implement 4 builtin judges for eval framework:
- frontmatter-compliance: validates YAML frontmatter with $status field,
score = stepsValid / stepsTotal
- token-stats: aggregates Usage from step nodes, always score 1.0
(informational only)
- upstream-consumption: LLM-as-judge stub (score 0, TODO)
- hallucination: LLM-as-judge stub (score 0, TODO)
Infrastructure:
- judge/builtin/read-steps.ts — shell out to uwf step list
- judge/builtin/types.ts — BuiltinJudge, BuiltinJudgeOutput
- runner/collect.ts — dispatch builtin judges by name
9 new tests (frontmatter validation + token aggregation)
Refs #71
2026-06-05 00:09:06 +00:00
xiaoju
fae9e9ed3a
feat: eval run command — prepare, execute, collect pipeline
...
CI / check (pull_request) Successful in 1m45s
Implement the uwf-eval run <task-dir> command with 3-phase pipeline:
- prepare: read task.yaml, copy fixture/ to temp workdir
- execute: shell out to uwf thread start + exec
- collect: run judges, compute weighted score, store CAS node,
set @uwf/eval/<task>/latest variable
Changes:
- src/runner/ — types, prepare, execute, collect, index
- src/storage/store.ts — createEvalStore(), setEvalLatest()
- src/commands/run.ts — full pipeline wiring with --agent/--model/--count
- 9 new tests (prepare + collect + weighted scoring)
Builtin judges return placeholder score 0 (Phase 1c).
Refs #70
2026-06-04 23:59:21 +00:00
xiaoju
99619d85db
feat: eval package scaffold with CLI, schemas, types, task loader
...
CI / check (pull_request) Successful in 1m42s
New package @united-workforce/eval (uwf-eval CLI):
- CLI skeleton: run/report/diff/list subcommands (stubs)
- 5 OCAS schemas: eval-run, judge-frontmatter, judge-upstream,
judge-hallucination, judge-token-stats
- TaskManifest type + parser/validator for task.yaml
- JudgeOutput/JudgeInput types for judge contract
- EvalRunPayload/EvalRunConfig/EvalJudgeRecord storage types
- 19 unit tests: task loader validation + schema definitions
Refs #69
2026-06-04 23:42:16 +00:00
xiaomo
b94234652a
Merge pull request 'feat: agent-hermes reads real token counts from session DB' ( #84 ) from feat/76-hermes-real-tokens into main
...
CI / check (push) Successful in 1m41s
feat: agent-hermes reads real token counts from session DB (#84 )
2026-06-04 23:31:09 +00:00
xiaoju
1593dbb521
fix: compute usage as delta for session re-entry
...
CI / check (pull_request) Successful in 1m41s
On session resume, turns/inputTokens/outputTokens were cumulative
(entire session history) instead of per-step increments. Now we
snapshot metrics before prompt, compare after, and report the delta.
Changes:
- acp-client: add getSessionId() accessor
- hermes: extract snapshotUsage() + computeUsageDelta() pure functions
- hermes: runPrompt/runHermes/continueHermes use before/after snapshots
- 9 new unit tests for usage delta computation
Refs #68
2026-06-04 23:22:16 +00:00
xiaoju
d1c523c442
feat: agent-hermes reads real token counts from session DB
...
CI / check (pull_request) Successful in 1m41s
- Add inputTokens/outputTokens to HermesSessionJson type
- Query input_tokens, output_tokens from sessions table in loadHermesSessionFromDb
- Update test fixture schema with token columns
- runPrompt now reports real token counts from Hermes state.db
Refs #76 , #68
2026-06-04 23:06:52 +00:00
xiaomo
4283e6766b
Merge pull request 'feat: agent-claude-code reports real $usage from stream-json' ( #83 ) from feat/77-claude-code-usage into main
...
CI / check (push) Successful in 1m42s
feat: agent-claude-code reports real $usage from stream-json (#83 )
2026-06-04 22:55:15 +00:00
xiaomo
4e4fb61ff5
Merge pull request 'feat: agent-hermes reports $usage (turns + duration)' ( #82 ) from feat/76-hermes-usage into main
...
CI / check (push) Successful in 1m40s
feat: agent-hermes reports $usage (turns + duration) (#82 )
2026-06-04 22:55:13 +00:00
xiaoju
be92cb2dd2
feat: agent-claude-code reports real $usage from stream-json output
...
CI / check (pull_request) Successful in 1m40s
- Map parsed numTurns, inputTokens, outputTokens, durationMs to Usage type
- Add @united-workforce/protocol dependency + tsconfig reference
- 747 tests pass
Fixes #77
Refs #68
2026-06-04 22:36:44 +00:00
xiaoju
7681e8b8e2
feat: agent-hermes reports $usage (turns + duration)
...
CI / check (pull_request) Successful in 1m40s
- Count assistant turns from session messages
- Measure wall-clock duration per prompt call
- inputTokens/outputTokens remain 0 (ACP protocol doesn't expose token data yet)
- Both runPrompt and continueHermes report usage
Fixes #76
Refs #68
2026-06-04 22:30:14 +00:00
xiaomo
780005ad65
Merge pull request 'feat: agent-mock emits fixed $usage stats' ( #81 ) from feat/75-mock-usage into main
...
CI / check (push) Successful in 1m42s
feat: agent-mock emits fixed $usage stats (#81 )
2026-06-04 22:23:42 +00:00
xiaoju
248ac710fd
feat: agent-mock emits fixed $usage stats
...
CI / check (pull_request) Successful in 1m41s
- Mock agent returns {turns:1, inputTokens:0, outputTokens:0, duration:0}
- E2E test 1 (linear workflow) asserts usage in CAS step nodes
- 747 tests pass
Fixes #75
Refs #68
2026-06-04 22:19:29 +00:00
xiaomo
xiaoju