Skip to content

Don't realise lazy coords in netcdf save.#4397

Merged
trexfeathers merged 2 commits into
SciTools:mainfrom
pp-mo:nc_savefix
Nov 4, 2021
Merged

Don't realise lazy coords in netcdf save.#4397
trexfeathers merged 2 commits into
SciTools:mainfrom
pp-mo:nc_savefix

Conversation

@pp-mo

@pp-mo pp-mo commented Nov 3, 2021

Copy link
Copy Markdown
Member

🚀 Pull Request

Description

Performance testing revealed that the recent changes to stream all lazy data in netcdf saves didn't quite fix the problem of realising lazy coordinates, as intended
I.E. nc-save is still loading all lazy aux-coords into memory.

So this fixes that, and adds a test to ensure the behaviour.


Consult Iris pull request check list

Comment thread lib/iris/fileformats/netcdf.py
Comment thread lib/iris/tests/integration/test_netcdf.py
Comment thread lib/iris/tests/unit/fileformats/netcdf/test_Saver__lazy.py
@pp-mo pp-mo requested a review from trexfeathers November 3, 2021 11:40

@trexfeathers trexfeathers left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch @pp-mo

@trexfeathers trexfeathers merged commit 59346d7 into SciTools:main Nov 4, 2021
@pp-mo pp-mo deleted the nc_savefix branch April 28, 2023 13:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants