Skip to content

Revert "[SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark#45878

Closed
nemanja-boric-databricks wants to merge 1 commit into
apache:masterfrom
nemanja-boric-databricks:revert-logger
Closed

Revert "[SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark#45878
nemanja-boric-databricks wants to merge 1 commit into
apache:masterfrom
nemanja-boric-databricks:revert-logger

Conversation

@nemanja-boric-databricks

Copy link
Copy Markdown
Contributor

This reverts commit d87ac8e.

Turns out the sparkconnect logger is disabled by default. This make us loose the ability to log the error message if required (by explicitly turning on the logger).

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

… PySpark"

This reverts commit d87ac8e.

Turns out the sparkconnect logger is disabled by default. This make us loose
the ability to log the error message if required (by explicitly turning on
the logger).
@nemanja-boric-databricks

Copy link
Copy Markdown
Contributor Author

@HyukjinKwon can we merge this revert please? I just made the SparkConnect worse - this logger is disabled by default, apologies.

@cloud-fan

Copy link
Copy Markdown
Contributor

thanks, merging to master!

@cloud-fan cloud-fan closed this in 3b8aea3 Apr 4, 2024
@nemanja-boric-databricks nemanja-boric-databricks deleted the revert-logger branch April 4, 2024 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants