Skip to content

[SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.cipher since version field on security page#47353

Closed
yaooqinn wants to merge 1 commit into
apache:masterfrom
yaooqinn:SPARK-47172
Closed

[SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.cipher since version field on security page#47353
yaooqinn wants to merge 1 commit into
apache:masterfrom
yaooqinn:SPARK-47172

Conversation

@yaooqinn

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

Why are the changes needed?

doc fix

Does this PR introduce any user-facing change?

no

How was this patch tested?

doc build

Was this patch authored or co-authored using generative AI tooling?

no

@github-actions github-actions Bot added the DOCS label Jul 15, 2024
Comment thread docs/security.md
Recommended to use "AES/GCM/NoPadding", which is an authenticated encryption mode.
</td>
<td>4.0.0</td>
<td>4.0.0, 3.5.2, 3.4.4</td>

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will set this field to '3.4.4' as usual. It's okay when we fix it in one or two branches, but issues arise when we continue to backport more than 2 branches. The problem here is that it only tells us that 3.4.x (x>=4) and x.y.z (x>=4), but it can't tell us which version of 3.5 has it.

I suggest that we add the full list of fixed versions according to the corresponding JIRA ticket.

See the discussion here #47325 (comment)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will set this field to '3.4.4' as usual. It's okay when we fix it in one or two branches, but issues arise when we continue to backport more than 2 branches. The problem here is that it only tells us that 3.4.x (x>=4) and x.y.z (x>=4), but it can't tell us which version of 3.5 has it.

I suggest that we add the full list of fixed versions according to the corresponding JIRA ticket.

See the discussion here #47325 (comment)

To @yaooqinn , actually, I disagreed with the suggestion.

@mridulm mridulm left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this @yaooqinn !

@dongjoon-hyun dongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To @yaooqinn and @mridulm , although this is correct, I'm wondering if we are going to make this as a standard?

@dongjoon-hyun

dongjoon-hyun commented Jul 15, 2024

Copy link
Copy Markdown
Member

If we are going to allow the contributors to upgrade all configurations in this style, I'm +1.

In that case, we need to update our Apache Spark website too.

@yaooqinn

Copy link
Copy Markdown
Member Author

Hi @dongjoon-hyun If you don't mind I will start updating versions of existing configurations and add a guideline in website for incremental updates after 3.5.2-rc1

@yaooqinn yaooqinn closed this in d8820a0 Jul 16, 2024
yaooqinn added a commit that referenced this pull request Jul 16, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit d8820a0)
Signed-off-by: Kent Yao <yao@apache.org>
yaooqinn added a commit that referenced this pull request Jul 16, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit d8820a0)
Signed-off-by: Kent Yao <yao@apache.org>
@yaooqinn yaooqinn deleted the SPARK-47172 branch July 16, 2024 02:15
@dongjoon-hyun

Copy link
Copy Markdown
Member

Sure. Go ahead. I gave +1 to support this PR and the previous one. Initially, I was worried about consistency, but we can catch up them later, @yaooqinn .

@yaooqinn

Copy link
Copy Markdown
Member Author

Thanks @dongjoon-hyun @mridulm, merged to master/3.5/3.4

@yaooqinn yaooqinn changed the title [SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.ciphersince version field on security page [SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.cipher since version field on security page Jul 16, 2024
@yaooqinn

Copy link
Copy Markdown
Member Author

SPARK-48904 is filed to track, we will see if we need to break the work into a couple of subtasks

jingz-db pushed a commit to jingz-db/spark that referenced this pull request Jul 22, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
sunchao pushed a commit that referenced this pull request Mar 10, 2026
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit d8820a0)
Signed-off-by: Kent Yao <yao@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants