Skip to content

ci: cover xet as well (runtime error) - #47338

Merged
tarekziade merged 5 commits into
mainfrom
tarekziade-runtime
Jul 15, 2026
Merged

ci: cover xet as well (runtime error)#47338
tarekziade merged 5 commits into
mainfrom
tarekziade-runtime

Conversation

@tarekziade

@tarekziade tarekziade commented Jul 15, 2026

Copy link
Copy Markdown
Collaborator

CI

What does this PR do?

The fallback to use a tempdir on read only cache needs to be extended for XET that produces Runtime errors not OS Errors

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@vasqu vasqu left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some smaller comments but definitely needed 🤗

Comment thread conftest.py Outdated
Comment thread conftest.py
Comment thread tests/utils/test_hub_utils.py Outdated
Comment thread tests/utils/test_hub_utils.py Outdated
@tarekziade

Copy link
Copy Markdown
Collaborator Author

new peft run with the latest version https://github.com/huggingface/transformers/tree/ci-verify-46766-runtime

Record every call retried through the read-only cache fallback and report
the count (with triggering repo/file ids) in the pytest terminal summary, so
CI logs show unambiguously whether the fallback path was exercised.
@tarekziade

Copy link
Copy Markdown
Collaborator Author

…er xdist-safe

- Wrap huggingface_hub.hf_hub_download (and re-bind already-imported consumers like
  peft.config) so direct downloads that bypass transformers.cached_files also get the
  read-only retry. Fixes PEFT adapter_config.json loads against a read-only CI cache.
- Record fallback events to a shared per-process directory instead of an in-memory list,
  so pytest-xdist worker events are aggregated by the controller's terminal summary.
@tarekziade
tarekziade enabled auto-merge July 15, 2026 16:26
@github-actions

Copy link
Copy Markdown
Contributor

CI recap

Dashboard: View test results in Grafana
Latest run: 29422275203:1
Result: success | Jobs: 4 | Tests: 269 | Failures: 0 | Duration: 2m 11s

@tarekziade
tarekziade added this pull request to the merge queue Jul 15, 2026
Merged via the queue into main with commit cd7456e Jul 15, 2026
35 checks passed
@tarekziade
tarekziade deleted the tarekziade-runtime branch July 15, 2026 16:40
stevhliu pushed a commit to stevhliu/transformers that referenced this pull request Jul 30, 2026
* cover xet as well (runtime error)

* xet is process-wide and caches locations. the rety now simply disables it

* reviews

* log read-only cache fallback invocations for CI validation

Record every call retried through the read-only cache fallback and report
the count (with triggering repo/file ids) in the pytest terminal summary, so
CI logs show unambiguously whether the fallback path was exercised.

* extend read-only cache fallback to hf_hub_download + make event counter xdist-safe

- Wrap huggingface_hub.hf_hub_download (and re-bind already-imported consumers like
  peft.config) so direct downloads that bypass transformers.cached_files also get the
  read-only retry. Fixes PEFT adapter_config.json loads against a read-only CI cache.
- Record fallback events to a shared per-process directory instead of an in-memory list,
  so pytest-xdist worker events are aggregated by the controller's terminal summary.
Sainava pushed a commit to Sainava/Sai-transformers that referenced this pull request Aug 3, 2026
* cover xet as well (runtime error)

* xet is process-wide and caches locations. the rety now simply disables it

* reviews

* log read-only cache fallback invocations for CI validation

Record every call retried through the read-only cache fallback and report
the count (with triggering repo/file ids) in the pytest terminal summary, so
CI logs show unambiguously whether the fallback path was exercised.

* extend read-only cache fallback to hf_hub_download + make event counter xdist-safe

- Wrap huggingface_hub.hf_hub_download (and re-bind already-imported consumers like
  peft.config) so direct downloads that bypass transformers.cached_files also get the
  read-only retry. Fixes PEFT adapter_config.json loads against a read-only CI cache.
- Record fallback events to a shared per-process directory instead of an in-memory list,
  so pytest-xdist worker events are aggregated by the controller's terminal summary.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants