Skip to content

Upgrade transformers to fix CI - #17830

Merged
snnn merged 1 commit into
rel-1.16.1from
snnn/rel-1.16.1
Oct 9, 2023
Merged

Upgrade transformers to fix CI#17830
snnn merged 1 commit into
rel-1.16.1from
snnn/rel-1.16.1

Conversation

@snnn

@snnn snnn commented Oct 7, 2023

Copy link
Copy Markdown
Contributor

Description

Python package pipeline fails due to "tokenizers" compilation. Since "tokenizers" is a dep of "transformers", we update its version and hope a new solution had been there.

error: casting `&T` to `&mut T` is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell`
--> tokenizers-lib/src/models/bpe/trainer.rs:517:47

Motivation and Context

Cherry-pick from #17823

Python package pipeline fails due to "tokenizers" compilation. Since
"tokenizers" is a dep of "transformers", we update its version and hope
a new solution had been there.

```
error: casting `&T` to `&mut T` is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell`
--> tokenizers-lib/src/models/bpe/trainer.rs:517:47
```
@snnn snnn added the training issues related to ONNX Runtime training; typically submitted using template label Oct 7, 2023
@snnn

snnn commented Oct 8, 2023

Copy link
Copy Markdown
Contributor Author

/azp run Linux CPU CI Pipeline

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@snnn
snnn merged commit 2a1fd25 into rel-1.16.1 Oct 9, 2023
@snnn
snnn deleted the snnn/rel-1.16.1 branch October 9, 2023 20:55
@snnn snnn mentioned this pull request Oct 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

training issues related to ONNX Runtime training; typically submitted using template

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants