Skip to content

docs: clarify LevelDB compaction limitations and StorageMax scope#11188

Merged
lidel merged 2 commits intomasterfrom
docs/datastore-compaction-notes
Feb 10, 2026
Merged

docs: clarify LevelDB compaction limitations and StorageMax scope#11188
lidel merged 2 commits intomasterfrom
docs/datastore-compaction-notes

Conversation

@lidel
Copy link
Copy Markdown
Member

@lidel lidel commented Feb 9, 2026

this PR is docs update to set expectations for StorageMax and "slow compaction on delete" for non-block behaviors like

Also closes

opportunistic issue triage:

Comment on lines +49 to +53
> [!NOTE]
> LevelDB uses a log-structured merge-tree (LSM) storage engine. When keys are
> deleted, the data is not removed immediately. Instead, a tombstone marker is
> written, and the actual data is removed later by background compaction.
>
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PebbleDB is the same, so needs a similar comment?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It does mention pebble below:

Unlike flatfs (which deletes files immediately) or pebble (which has
tombstone-aware compaction)

So, pebble works similarly but is tombstone aware, unlike levelDB.

@lidel lidel merged commit 9ca1dbb into master Feb 10, 2026
2 checks passed
@lidel lidel deleted the docs/datastore-compaction-notes branch February 10, 2026 22:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

IPFS not respecting StorageMax Repo is growing and growing fix storage limits

4 participants