xiaoju fae9e9ed3a feat: eval run command — prepare, execute, collect pipeline ...

Implement the uwf-eval run <task-dir> command with 3-phase pipeline:

- prepare: read task.yaml, copy fixture/ to temp workdir
- execute: shell out to uwf thread start + exec
- collect: run judges, compute weighted score, store CAS node,
  set @uwf/eval/<task>/latest variable

Changes:
- src/runner/ — types, prepare, execute, collect, index
- src/storage/store.ts — createEvalStore(), setEvalLatest()
- src/commands/run.ts — full pipeline wiring with --agent/--model/--count
- 9 new tests (prepare + collect + weighted scoring)

Builtin judges return placeholder score 0 (Phase 1c).

Refs #70

2026-06-04 23:59:21 +00:00

..

agent-builtin

Merge pull request 'feat: add $usage field to adapter protocol' (#80) from feat/74-usage-in-protocol into main

2026-06-04 22:14:12 +00:00

agent-claude-code

feat: agent-claude-code reports real $usage from stream-json output

2026-06-04 22:36:44 +00:00

agent-hermes

fix: compute usage as delta for session re-entry

2026-06-04 23:22:16 +00:00

agent-mock

feat: agent-mock emits fixed $usage stats

2026-06-04 22:19:29 +00:00

cli

feat: agent-mock emits fixed $usage stats

2026-06-04 22:19:29 +00:00

dashboard

chore: rebranding cleanup — reset versions to 0.1.0, bun→pnpm in docs

2026-06-04 13:05:26 +00:00

eval

feat: eval run command — prepare, execute, collect pipeline

2026-06-04 23:59:21 +00:00

protocol

feat: add $usage field to adapter protocol

2026-06-04 15:41:07 +00:00

util

refactor(prompt): rename subcommands and add frontmatter output

2026-06-04 22:46:11 +08:00

util-agent

feat: add $usage field to adapter protocol

2026-06-04 15:41:07 +00:00