Skip to content

Increase max error tolerance for ConvTransposeGrad test - #17315

Merged
baijumeswani merged 1 commit into
mainfrom
baijumeswani/convtransposegrad-increase-tolerance
Aug 29, 2023
Merged

Increase max error tolerance for ConvTransposeGrad test#17315
baijumeswani merged 1 commit into
mainfrom
baijumeswani/convtransposegrad-increase-tolerance

Conversation

@baijumeswani

Copy link
Copy Markdown
Contributor

Addressing #17201 (comment)

Making the tolerance the same as the ConvGrad tests.

@baijumeswani baijumeswani added training issues related to ONNX Runtime training; typically submitted using template release:1.16 labels Aug 28, 2023
@baijumeswani
baijumeswani merged commit 38ea8c3 into main Aug 29, 2023
@baijumeswani
baijumeswani deleted the baijumeswani/convtransposegrad-increase-tolerance branch August 29, 2023 00:05
OpDef op_def{"ConvTranspose"};

float error_tolerance = 1e-1f;
float error_tolerance = 3e-1f;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A quick question: we defined a relatively higher tolerance for ConvTransposeGradientCheckerTest and ConvGradientCheckerTest, is there any explanation for it, I mean, is it expected for the small-sized test inputs?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't have a good answer for this question. @er3x3 do you have an answer for this? I could only speculate. I can probably delve deeper and find an answer to this, but I don't know as of now.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cuDNN is non-deterministic, while the expected values are computed on CPU.

@natke natke added the triage:approved Approved for cherrypicks for release label Sep 1, 2023
snnn pushed a commit that referenced this pull request Sep 7, 2023
Cherry-pick 2nd round for 1.16.0 release.
PR List:

#17201
#17270
#17311
#17315
#17320
#17326
#17355
#17227
#17380
#17386
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

training issues related to ONNX Runtime training; typically submitted using template triage:approved Approved for cherrypicks for release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants