Skip to content

lit_deltalake.readers.delta_rs

source module lit_deltalake.readers.delta_rs

Classes

  • DeltaRsReader — Read Delta table snapshots through delta-rs and PyArrow.

source class DeltaRsReader()

Bases : DeltaReader

Read Delta table snapshots through delta-rs and PyArrow.

Methods

  • scan — Yield Arrow record batches for a Delta-rs table scan.

  • scan_shard — Yield batches from fragments deterministically assigned to one shard.

  • length — Return the exact number of rows selected by a Delta-rs scan.

source method DeltaRsReader.scan(request: DeltaScan) → Iterator['pa.RecordBatch']

Yield Arrow record batches for a Delta-rs table scan.

Parameters

  • request : DeltaScan — Configuration for the table snapshot and selected data.

source method DeltaRsReader.scan_shard(request: DeltaScan, shard_id: int, shard_count: int) → Iterator[pa.RecordBatch]

Yield batches from fragments deterministically assigned to one shard.

Raises

  • ValueError

source method DeltaRsReader.length(request: DeltaScan) → int

Return the exact number of rows selected by a Delta-rs scan.