Releases: NCAS-CMS/PyActiveStorage
Relase v0.7.0
What's Changed
- update pins for Pyfive and Numpy by @valeriupredoi in #311
- Fix minio tests by @valeriupredoi in #312
- add dependabot config by @valeriupredoi in #317
- Optional to turn off chunk caching by Reductionist by @valeriupredoi in #321
- Anon bucket by @valeriupredoi in #314
- Fix masking for fill_value and missing_value for numpy 2.4.0 by @valeriupredoi in #304
Welcoming @varsiha-sothilingam to the project, and release co-manager for v0.7.0 🍺
Full Changelog: v0.6.0...v0.7.0
Release v0.6.0
PyActiveStorage v0.6.0: What's Changed
Summary
This release contains major upgrades to PyActiveStorage:
- Interface with Reductionist v2 to access files hosted on https NGINX servers
- Full functionality for statistics on select axes
- Full use of Pyfive Datasets loaded from https files as input
- License updated to MIT
Great many thanks to @maxstack for the solid work done on all these enhancements!
List of changes
- Fix S3 Minio Github Actions tests by @valeriupredoi in #298
fill_valuehandling has changed in numpy=2.4.0 by @valeriupredoi in #303- Update license to MIT and setuptools pins by @valeriupredoi in #301
- skip real s3 (with remote Reductionist) test for now by @valeriupredoi in #305
- Change
method: statisticfrom Property to Method to allow egactive.mean(axis=(0, 1))and instriduce comprehensive testing of Reductionist axis implementation by @valeriupredoi in #300 - Switch from
storage_typetointerface_typeby @valeriupredoi in #308 - Allow the use of pyfive.Dataset for interface_type https as well by @valeriupredoi in #309
Full Changelog: v0.5.0...v0.6.0
Release v0.5.0
What's Changed
This is mostly a maintenance release, that also rebuilds the package with Python 3.14 support.
- add bits related to conda-forge package: badge, links, Github Actions and unpin mamba-version from all GHA flows by @valeriupredoi in #278
- Lint code in
activestorage/and add flake8 test at push by @valeriupredoi in #281 - re-add version in
activestorage/__init__.pyfor Readthedocs by @valeriupredoi in #282 - Remove
bnlandold_codedirectories by @valeriupredoi in #283 - Support Python 3.14 by @valeriupredoi in #293
Thanks to @davidhassell and @bnlawrence for their reviews 🍻
Full Changelog: v0.4.0...v0.5.0
Release v0.4.0
This is the stable release candidate for PyActiveStorage v0.4.0
PyActiveStorage provides a Python client to local or remote “active” storage (aka “computational” storage), that is,
storage that instead of just receiving reads and returning blocks of data, can receive requests for, and return the
results of, computations on blocks of data. We have implemented active storage which supports a limited set of reduction
computations. We have two implementations of active storage with which PyActiveStorage can interact:
- a prototype in DDN InfiniaTM
- a production ready Reductionist middleware software which can be
deployed to turn any S3 object store into active storage
Using PyActiveStorage can speed up workflows, especially if the data is remote, or the local area network is congested.
Early results accessing global fields of 10km resolution data on the CEDA-JASMIN S3 object store show that time-series
of hemispheric means can be returned to remote users on low-bandwidth networks (and even in
different hemispheres) in times which are competitive with local users accessing POSIX data across a LAN.
We anticipate this technology will be game-changing for remote access to data, particularly where there is
insufficient local storage to make copies of data, or those with low-bandwidth networks – although anyone can benefit from
minimizing network contention and reducing the carbon cost of moving data.
v0.4.0 Highlights
- integration with Pyfive deployed on PyPI and conda-forge #277
- full package specifications, including documentation deployed on RTD #270
- operationally deployed on CEDA-JASMIN #260
- Numpy-like statistics API #253
- bugfixes, improvements, and other enhancements
Many thanks to all the contributors! 🍻
Release candidate rc5
Upload to Test PyPI all OK, now debugging upload to actual PyPI
This went well! https://pypi.org/project/PyActiveStorage/0.1.0rc5/
Release candidate rc4
Corrected package name, too true PyPI, too true 🍺
Upload to Test PyPI (finally!) achieved https://test.pypi.org/project/PyActiveStorage/0.1.0rc4/
Small snag at u[loading to PyPI proper, needs fixing in rc5 I guess 😁
Release candidate rc3
Please please Test PyPI take my package 😁 - third time lucky, come on!
Release candidate rc2
Hopefully this will get through to Test PyPI
Release candidate rc1
Test PyPI and Test PyPI uploads with correct PEP version name
Release candidate 0 (rc0) for v0.1.0
This is rc0 for v0.1.0 - we still need to get all the PyPI and conda forge gubbins in order, so starting on that journey with rc0