-
Notifications
You must be signed in to change notification settings - Fork 1.9k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge?
I'm working with the object_store folks on upstreaming DataFusion's ObjectStoreRegistry implementation. Part of the goal is that DataFusion would adopt this new registry. I want to check with y'all that the object_store version meets your needs.
The PR is here:
apache/arrow-rs-object-store#348
The implementation is largely the same, but there have been a few tweaks:
- Replaced
dashmapwith an RWLock+HashMap to removedashmapdependency - Remove
ObjectStoreUrl - Add
list_urlsmethod - Use
object_store::parse_urlto create anObjectStoreonget_storecache miss (if possible) - Adds registry tests
- Minor doc updates
get_storereturns anOptionnow instead ofResult
Would you guys be open to adopting this new version?
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request