uncaged/workflow
Archived
10
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity

serve: SSE live pump should read incrementally instead of full file #130

New Issue
Closed
opened 2026-05-08 08:49:32 +00:00 by xingyue · 0 comments
xingyue commented 2026-05-08 08:49:32 +00:00
Owner
Copy Link
Copy Source

Context

PR #129 review feedback.

Problem

pumpData() in routes-live.ts reads the entire .data.jsonl file on every fs watch event. For long-running threads with large JSONL files, this becomes a performance bottleneck.

Solution

Use fd + read() with byte offset tracking, or stream the file from the last known position instead of readFile() + slice.

Ref

Follow-up from #129, part of #118

## Context PR #129 review feedback. ## Problem `pumpData()` in `routes-live.ts` reads the entire `.data.jsonl` file on every fs watch event. For long-running threads with large JSONL files, this becomes a performance bottleneck. ## Solution Use `fd + read()` with byte offset tracking, or stream the file from the last known position instead of `readFile()` + slice. ## Ref Follow-up from #129, part of #118
This repo is archived. You cannot comment on issues.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
aobing jiashuang (Jia Shuang) jiayi (Jiayi) luming scottwei tuanzi xiaoju xiaomo xiaonuo xingyue
No Assignees
1 Participants
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: uncaged/workflow#130
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?