Skip to content

Fix different devices error #1814

Open
rotorliu wants to merge 1 commit into
NVIDIA:release/8.6from
rotorliu:patch-1
Open

Fix different devices error #1814
rotorliu wants to merge 1 commit into
NVIDIA:release/8.6from
rotorliu:patch-1

Conversation

@rotorliu
Copy link
Copy Markdown

Keep tensors on same device

Keep tensors on same device
@rotorliu rotorliu changed the title Update tensor_quantizer.py Fix different devices error Feb 23, 2022
@rajeevsrao rajeevsrao added this to the TensorRT-Next milestone Mar 16, 2023
@rajeevsrao rajeevsrao changed the base branch from main to release/8.6 March 16, 2023 05:28
@ttyio
Copy link
Copy Markdown
Collaborator

ttyio commented Mar 17, 2023

@rotorliu , could you elborate more on the fail case that this PR fix? thank you!

@rotorliu
Copy link
Copy Markdown
Author

@rotorliu , could you elborate more on the fail case that this PR fix? thank you!

When running on GPU, the amax is on different device from the inputs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants