Skip to content

storage-types: redact credentials in ContentSource Debug#36703

Open
def- wants to merge 1 commit into
MaterializeInc:mainfrom
def-:pr-debug2
Open

storage-types: redact credentials in ContentSource Debug#36703
def- wants to merge 1 commit into
MaterializeInc:mainfrom
def-:pr-debug2

Conversation

@def-
Copy link
Copy Markdown
Contributor

@def- def- commented May 24, 2026

Use SensitiveUrl for ContentSource::Http and skip the AwsConnection field in Debug so reconcile log lines no longer leak url passwords or inline AWS credentials. Also narrow the storage_state reconcile log to ids only.

Carry SensitiveUrl through HttpOneshotSource and HttpObject so the tracing::info!(?object, "found objects") line in the HTTP oneshot source also redacts. Move URL-userinfo Basic auth into a Basic auth header before handing the URL to reqwest, so reqwest::Error::Display cannot leak the password on connect/DNS failures.

@def- def- requested review from a team as code owners May 24, 2026 02:08
@def- def- force-pushed the pr-debug2 branch 2 times, most recently from 823f6ca to 9271aae Compare May 24, 2026 02:45
@def- def- marked this pull request as draft May 24, 2026 04:04
@def- def- marked this pull request as ready for review May 24, 2026 04:11
Use SensitiveUrl for ContentSource::Http and skip the AwsConnection
field in Debug so reconcile log lines no longer leak url passwords or
inline AWS credentials. Also narrow the storage_state reconcile log to
ids only.

Carry SensitiveUrl through HttpOneshotSource and HttpObject so the
`tracing::info!(?object, "found objects")` line in the HTTP oneshot
source also redacts. Move URL-userinfo Basic auth into a Basic auth
header before handing the URL to reqwest, so reqwest::Error::Display
cannot leak the password on connect/DNS failures.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant