Skip to content

Bump Apache Arrow to 10.0.0#1764

Merged
Yicong-Huang merged 4 commits into
masterfrom
yicong-update-arrow-10
Dec 13, 2022
Merged

Bump Apache Arrow to 10.0.0#1764
Yicong-Huang merged 4 commits into
masterfrom
yicong-update-arrow-10

Conversation

@Yicong-Huang

@Yicong-Huang Yicong-Huang commented Dec 8, 2022

Copy link
Copy Markdown
Contributor

This PR bumps Apache Arrow version from 9.0.0 to 10.0.0.

Main changes related to PyAmber:

Java/Scala side:

  • JDBC Driver for Arrow Flight SQL (13800)
  • Initial implementation of immutable Table API (14316)
  • Substrait, transaction, cancellation for Flight SQL (13492)
  • Read Arrow IPC, CSV, and ORC files by NativeDatasetFactory (13811, 13973, 14182)
  • Add utility to bind Arrow data to JDBC parameters (13589)

Python side:

  • The batch_readahead and fragment_readahead arguments for scanning Datasets are exposed in Python (ARROW-17299).
  • ExtensionArrays can now be created from a storage array through the pa.array(..) constructor (ARROW-17834).
  • Converting ListArrays containing ExtensionArray values to numpy or pandas works by falling back to the storage array (ARROW-17813).
  • Casting Tables to a new schema now honors the nullability flag in the target schema (ARROW-16651).

@Yicong-Huang Yicong-Huang requested a review from zuozhiw December 8, 2022 08:49
@Yicong-Huang Yicong-Huang self-assigned this Dec 8, 2022
@Yicong-Huang Yicong-Huang added the dependencies Pull requests that update a dependency file label Dec 8, 2022
@Yicong-Huang Yicong-Huang merged commit 2ff37bd into master Dec 13, 2022
@Yicong-Huang Yicong-Huang deleted the yicong-update-arrow-10 branch December 13, 2022 04:46
yangzhang75 pushed a commit to yangzhang75/texera that referenced this pull request Jun 22, 2026
This PR bumps Apache Arrow version from 9.0.0 to 10.0.0.

Main changes related to PyAmber:

## Java/Scala side:

- JDBC Driver for Arrow Flight SQL
([13800](apache/arrow#13800))
- Initial implementation of immutable Table API
([14316](apache/arrow#14316))
- Substrait, transaction, cancellation for Flight SQL
([13492](apache/arrow#13492))
- Read Arrow IPC, CSV, and ORC files by NativeDatasetFactory
([13811](apache/arrow#13811),
[13973](apache/arrow#13973),
[14182](apache/arrow#14182))
- Add utility to bind Arrow data to JDBC parameters
([13589](apache/arrow#13589))

## Python side:

- The batch_readahead and fragment_readahead arguments for scanning
Datasets are exposed in Python
([ARROW-17299](https://issues.apache.org/jira/browse/ARROW-17299)).
- ExtensionArrays can now be created from a storage array through the
pa.array(..) constructor
([ARROW-17834](https://issues.apache.org/jira/browse/ARROW-17834)).
- Converting ListArrays containing ExtensionArray values to numpy or
pandas works by falling back to the storage array
([ARROW-17813](https://issues.apache.org/jira/browse/ARROW-17813)).
- Casting Tables to a new schema now honors the nullability flag in the
target schema
([ARROW-16651](https://issues.apache.org/jira/browse/ARROW-16651)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants