Updates

Reads can be limited until a specific timestamp.

Added metrics endpoints for usage monitoring to the REST API.

REST API v1 is ready including SSE support. Besides JSON it also supports Protobuf for appending and reading binary data efficiently without the Base64 tax.

Supercharged scalability — we are now using FoundationDB as a metadata store.

CLI got a new tail sub-command.

Support for reading from timestamp or a tail_offset, not just sequence numbers. The implicit cap on record timestamp not exceeding arrival time can now be disabled in stream config.

REST API support for listing / issuing / revoking granular access tokens.

Prefix filtering in dashboard on basin or stream names.

first_seq_num as a Read / ReadSession response has been removed: records will be returned from the first record >= the requested starting point.

Basins can be configured to create_stream_on_read automatically when the specified stream does not exist, using the default stream configuration for the basin.

gRPC APIs for listing / issuing / revoking granular access tokens.

Dashboard UI for stream management.

All records now have a monotonic timestamp in milliseconds since Unix epoch. Streams can also be configured to only utilize client-specified timestamps.

Basins can be configured to create_stream_on_append automatically when the specified stream does not exist, using the default stream configuration for the basin.

Dashboard UI for basin management.

ReadSession gRPC and REST API support periodic heartbeats.

Bytewax integration is available.

Flink integration is available.

REST API supports compression using zstd or gzip, except for streaming reads with SSE.

Bento integration is available.

gRPC API supports compression using zstd or gzip.

Java SDK available.

REST API is ready, including streaming reads with SSE.

Python SDK available.

Go SDK available.

Preview launch with gRPC API, Rust SDK, and CLI.

Prototyped the guts of S2.

S2 hypothesized.