Updates

Supercharged scalability – we are now using FoundationDB as a metadata store.

CLI got a new tail sub-command.

Support for reading from timestamp or a tail_offset, not just sequence numbers. The implicit cap on record timestamp not exceeding current time can now be disabled with the stream config uncapped_client_timestamps.

REST API support for listing / issuing / revoking granular access tokens.

Prefix filtering in dashboard on basin or stream names.

first_seq_num as a Read / ReadSession response has been removed: records will be returned from the first record >= the requested starting point.

Basins can be configured to create_stream_on_read automatically when the specified stream does not exist, using the default stream configuration for the basin.

gRPC APIs for listing / issuing / revoking granular access tokens.

Dashboard UI for stream management.

All records now have a monotonic timestamp in milliseconds since Unix epoch. Streams can also be configured to only utilize client-specified timestamps.

Basins can be configured to create_stream_on_append automatically when the specified stream does not exist, using the default stream configuration for the basin.

Dashboard UI for basin management.

ReadSession gRPC and REST API support periodic heartbeats.

Bytewax integration is available.

Flink integration is available.

REST API supports compression using zstd or gzip, except for streaming reads with SSE.

Bento integration is available.

gRPC API supports compression using zstd or gzip.

Java SDK available.

REST API is ready, including streaming reads with SSE.

Python SDK available.

Go SDK available.

Preview launch with gRPC API, Rust SDK, and CLI.

Prototyped the guts of S2.

S2 hypothesized.