Skip to content

Updated arrow-pyarrow to use pyo3 0.27, updated deprecated code warnings#8773

Merged
alamb merged 14 commits into
apache:mainfrom
hntd187:update-pyo3
Jan 9, 2026
Merged

Updated arrow-pyarrow to use pyo3 0.27, updated deprecated code warnings#8773
alamb merged 14 commits into
apache:mainfrom
hntd187:update-pyo3

Conversation

@hntd187

@hntd187 hntd187 commented Nov 3, 2025

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

No issue, I'm aware of. Just updates pyo3 to 0.27 so delta-rs can start looking at variant adoption.

Rationale for this change

There is a long list of dependencies for arrow 57 to be supported in enough places such that delta-rs can start to reliably build against them. Updating pyo3 puts arrow in line with the other arrow based dependencies.

Are these changes tested?

We typically require tests for all PRs in order to:
Since this is a good amount of unsafe, and I'm on Windows (which I'd imagine is not the common path) I'd like to see the CI/CD run just to make sure everything looks good.

If tests are not included in your PR, please explain why (for example, are they covered by existing tests)?

Are there any user-facing changes?

Just that a dependency is now a later version

Comment thread arrow-pyarrow/src/lib.rs Outdated
Comment thread arrow-pyarrow/src/lib.rs Outdated
@mbrobbel mbrobbel added api-change Changes to the arrow API next-major-release the PR has API changes and it waiting on the next major version labels Nov 4, 2025
@mbrobbel mbrobbel added this to the 58.0.0 milestone Nov 4, 2025

@mbrobbel mbrobbel left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @hntd187. Please note that this is a breaking change because we use pyo3 types in public items.

Comment thread arrow-pyarrow/src/lib.rs Outdated
Comment thread arrow-pyarrow-testing/tests/pyarrow.rs Outdated
hntd187 and others added 4 commits November 5, 2025 11:45
@alamb

alamb commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

Now that main is open for breaking API changes, I have updated this PR and will merge it when CI passes

@alamb

alamb commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

Thanks again @hntd187 @mbrobbel and @kylebarron

@alamb alamb merged commit cfba3cc into apache:main Jan 9, 2026
14 checks passed
@alamb alamb mentioned this pull request Jan 9, 2026
@alamb

alamb commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

Somehow all the CI checks passed and yet clippy now fails on main after merging this PR

I have a fix ready:

Jefffrey pushed a commit that referenced this pull request Jan 10, 2026
# Which issue does this PR close?

<!--
We generally require a GitHub issue to be filed for all bug fixes and
enhancements and this helps us generate change logs for our releases.
You can link an issue to this PR using the GitHub syntax.
-->

- Closes #NNN.

# Rationale for this change

Clippy is failiing on main after merging
cfba3cc
- #8773

Example:
https://github.com/apache/arrow-rs/actions/runs/20865325961/job/59954918027

```
error: deref which would be done by auto-deref
   --> arrow-pyarrow/src/lib.rs:636:39
    |
636 |         Ok(Self(T::from_pyarrow_bound(&*value)?))
    |                                       ^^^^^^^ help: try: `&value`
    |
    = help: for further information visit https://rust-lang.github.io/rust-clippy/rust-1.91.0/index.html#explicit_auto_deref
    = note: `-D clippy::explicit-auto-deref` implied by `-D warnings`
    = help: to override `-D warnings` add `#[allow(clippy::explicit_auto_deref)]`
```

# What changes are included in this PR?
Apply clippy fix

# Are these changes tested?

<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code

If tests are not included in your PR, please explain why (for example,
are they covered by existing tests)?
-->

# Are there any user-facing changes?

<!--
If there are user-facing changes then we may require documentation to be
updated before approving the PR.

If there are any breaking changes to public APIs, please call them out.
-->
Dandandan pushed a commit to Dandandan/arrow-rs that referenced this pull request Jan 15, 2026
…ngs (apache#8773)

# Which issue does this PR close?

No issue, I'm aware of. Just updates pyo3 to 0.27 so delta-rs can start
looking at variant adoption.

# Rationale for this change

There is a long list of dependencies for arrow 57 to be supported in
enough places such that delta-rs can start to reliably build against
them. Updating pyo3 puts arrow in line with the other arrow based
dependencies.

# Are these changes tested?

We typically require tests for all PRs in order to:
Since this is a good amount of unsafe, and I'm on Windows (which I'd
imagine is not the common path) I'd like to see the CI/CD run just to
make sure everything looks good.

If tests are not included in your PR, please explain why (for example,
are they covered by existing tests)?

# Are there any user-facing changes?

Just that a dependency is now a later version

---------

Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Dandandan pushed a commit to Dandandan/arrow-rs that referenced this pull request Jan 15, 2026
# Which issue does this PR close?

<!--
We generally require a GitHub issue to be filed for all bug fixes and
enhancements and this helps us generate change logs for our releases.
You can link an issue to this PR using the GitHub syntax.
-->

- Closes #NNN.

# Rationale for this change

Clippy is failiing on main after merging
apache@cfba3cc
- apache#8773

Example:
https://github.com/apache/arrow-rs/actions/runs/20865325961/job/59954918027

```
error: deref which would be done by auto-deref
   --> arrow-pyarrow/src/lib.rs:636:39
    |
636 |         Ok(Self(T::from_pyarrow_bound(&*value)?))
    |                                       ^^^^^^^ help: try: `&value`
    |
    = help: for further information visit https://rust-lang.github.io/rust-clippy/rust-1.91.0/index.html#explicit_auto_deref
    = note: `-D clippy::explicit-auto-deref` implied by `-D warnings`
    = help: to override `-D warnings` add `#[allow(clippy::explicit_auto_deref)]`
```

# What changes are included in this PR?
Apply clippy fix

# Are these changes tested?

<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code

If tests are not included in your PR, please explain why (for example,
are they covered by existing tests)?
-->

# Are there any user-facing changes?

<!--
If there are user-facing changes then we may require documentation to be
updated before approving the PR.

If there are any breaking changes to public APIs, please call them out.
-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api-change Changes to the arrow API next-major-release the PR has API changes and it waiting on the next major version

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants