Skip to content

Plumb SST metadata information through rockdb::FileOptions - #371

Closed
anubhavbn wants to merge 1 commit into
rockset:masterfrom
anubhavbn:anubhav/tiered_metadata_flow
Closed

Plumb SST metadata information through rockdb::FileOptions#371
anubhavbn wants to merge 1 commit into
rockset:masterfrom
anubhavbn:anubhav/tiered_metadata_flow

Conversation

@anubhavbn

@anubhavbn anubhavbn commented Aug 12, 2026

Copy link
Copy Markdown

Summary:

  • Plumb each SST's file size and metadata-tail size from MANIFEST-backed file metadata into FileOptions, so custom file systems can make per-read routing decisions after opening an SST.
  • Populate the optional metadata for normal table opens, legacy .sst to .ldb fallback opens, and direct table-properties reads.
  • Keep the metadata per file-open instead of storing per-SST state in shared FileOptions.

Test plan:

  • Added DBSSTTest.PassesSstMetadataToFileSystem, using a recording file system wrapper to verify normal .sst opens and .ldb fallback opens receive the same file size and tail size recorded in RocksDB metadata.
  • Existing DBSSTTest.SSTsWithLdbSuffixHandling continues to cover successful reads through the legacy filename fallback.
  • Ran make -j2 db_basic_test.
  • Ran make -j2 db_sst_test.
  • Ran ./db_sst_test --gtest_filter=DBSSTTest.PassesSstMetadataToFileSystem:DBSSTTest.SSTsWithLdbSuffixHandling.

@anubhavbn anubhavbn closed this Aug 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant