Jetstream consumer (JSON firehose client) #43

New issue

Closed

opened 2026-07-05 17:02:31 +00:00 by Grandiras · 0 comments

Grandiras commented

2026-07-05 17:02:31 +00:00

Owner

Add a consume-only Jetstream client: JetstreamClient (single WebSocket over /subscribe, legacy Jetstream protocol) and JetstreamConsumer (auto-reconnect, cursor persistence via existing IFirehoseCursorStore, rewind + dedup on reconnect). Server-side collection/DID filtering via wantedCollections/wantedDids, unix-µs cursors, forward-tolerant JSON parser (kinds: commit/identity/account). No zstd in v1 — expose an IJetstreamDecompressor seam instead to keep the core package dependency-light. Docs page + caveat: Jetstream events are not cryptographically verifiable (no MST proofs), unlike the binary firehose.

Motivation: indexing a niche collection (e.g. exchange.recipe.* for the Mise appview) over the binary firehose downloads the whole network's commit stream; Jetstream's server-side filtering makes that near-free.

Add a consume-only Jetstream client: `JetstreamClient` (single WebSocket over `/subscribe`, legacy Jetstream protocol) and `JetstreamConsumer` (auto-reconnect, cursor persistence via existing `IFirehoseCursorStore`, rewind + dedup on reconnect). Server-side collection/DID filtering via `wantedCollections`/`wantedDids`, unix-µs cursors, forward-tolerant JSON parser (kinds: commit/identity/account). No zstd in v1 — expose an `IJetstreamDecompressor` seam instead to keep the core package dependency-light. Docs page + caveat: Jetstream events are not cryptographically verifiable (no MST proofs), unlike the binary firehose. Motivation: indexing a niche collection (e.g. `exchange.recipe.*` for the Mise appview) over the binary firehose downloads the whole network's commit stream; Jetstream's server-side filtering makes that near-free.

Grandiras referenced this issue from a commit

2026-07-05 17:15:45 +00:00

feat: Jetstream consumer — JSON event streaming with server-side filtering (closes #43)

Grandiras referenced this issue from a pull request that will close it,

2026-07-05 17:16:05 +00:00

feat: Jetstream consumer — JSON event streaming with server-side filtering (closes #43) #44

Grandiras referenced this issue from a commit

2026-07-05 17:20:00 +00:00

feat: Jetstream consumer — JSON event streaming with server-side filtering (closes #43)

Grandiras referenced this issue from a pull request that will close it,

2026-07-05 17:47:12 +00:00

fix/plc-did-path-uri #48