Skip to content

[SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log#27576

Closed
HeartSaVioR wants to merge 2 commits into
apache:masterfrom
HeartSaVioR:SPARK-28869-FOLLOWUP-doc
Closed

[SPARK-28869][DOCS][FOLLOWUP] Add direct relationship between configs for rolling event log#27576
HeartSaVioR wants to merge 2 commits into
apache:masterfrom
HeartSaVioR:SPARK-28869-FOLLOWUP-doc

Conversation

@HeartSaVioR

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This patch addresses the post-hoc review comment linked here - #25670 (comment)

Why are the changes needed?

We would like to explicitly document the direct relationship before we finish up structuring of configurations.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

N/A

@HeartSaVioR

Copy link
Copy Markdown
Contributor Author

cc. @HyukjinKwon

@SparkQA

SparkQA commented Feb 14, 2020

Copy link
Copy Markdown

Test build #118399 has finished for PR 27576 at commit 5760af9.

  • This patch fails build dependency tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HeartSaVioR

Copy link
Copy Markdown
Contributor Author

retest this, please

@SparkQA

SparkQA commented Feb 14, 2020

Copy link
Copy Markdown

Test build #118405 has finished for PR 27576 at commit 5760af9.

  • This patch fails build dependency tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon

Copy link
Copy Markdown
Member

retest this please

@HyukjinKwon HyukjinKwon left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @HeartSaVioR.

private[spark] val EVENT_LOG_ROLLING_MAX_FILE_SIZE =
ConfigBuilder("spark.eventLog.rolling.maxFileSize")
.doc("The max size of event log file to be rolled over.")
.doc(s"Precondition: ${EVENT_LOG_ENABLE_ROLLING.key}. " +

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, I saw the new PR #27575. We could match how we describe there. Shall we also fix docs/configuration.md?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch! I missed we have equivalent description in doc as well. Will update as well.

@SparkQA

SparkQA commented Feb 14, 2020

Copy link
Copy Markdown

Test build #118415 has finished for PR 27576 at commit 5760af9.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HeartSaVioR HeartSaVioR force-pushed the SPARK-28869-FOLLOWUP-doc branch from ff2170f to 705d129 Compare February 15, 2020 11:28
@HeartSaVioR

Copy link
Copy Markdown
Contributor Author

Picked existing style from #27575, and updated here as well.

@SparkQA

SparkQA commented Feb 15, 2020

Copy link
Copy Markdown

Test build #118474 has finished for PR 27576 at commit 705d129.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon

Copy link
Copy Markdown
Member

Thanks @HeartSaVioR for folliwing up this one.

@HyukjinKwon

Copy link
Copy Markdown
Member

Merged to master and branch-3.0.

HyukjinKwon pushed a commit that referenced this pull request Feb 17, 2020
… for rolling event log

### What changes were proposed in this pull request?

This patch addresses the post-hoc review comment linked here - #25670 (comment)

### Why are the changes needed?

We would like to explicitly document the direct relationship before we finish up structuring of configurations.

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

N/A

Closes #27576 from HeartSaVioR/SPARK-28869-FOLLOWUP-doc.

Authored-by: Jungtaek Lim (HeartSaVioR) <kabhwan.opensource@gmail.com>
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
(cherry picked from commit 446b2d2)
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
@HeartSaVioR

Copy link
Copy Markdown
Contributor Author

Thanks for reviewing and merging!

@HeartSaVioR HeartSaVioR deleted the SPARK-28869-FOLLOWUP-doc branch February 17, 2020 12:19
sjincho pushed a commit to sjincho/spark that referenced this pull request Apr 15, 2020
… for rolling event log

### What changes were proposed in this pull request?

This patch addresses the post-hoc review comment linked here - apache#25670 (comment)

### Why are the changes needed?

We would like to explicitly document the direct relationship before we finish up structuring of configurations.

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

N/A

Closes apache#27576 from HeartSaVioR/SPARK-28869-FOLLOWUP-doc.

Authored-by: Jungtaek Lim (HeartSaVioR) <kabhwan.opensource@gmail.com>
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants