[ET Device Support] Add ExecutorchBackendConfig flags for skipping H2D/D2H copies#18760
[ET Device Support] Add ExecutorchBackendConfig flags for skipping H2D/D2H copies#18760Gasoonjia wants to merge 3 commits into
Conversation
…D/D2H copies Add skip_h2d_for_method_inputs and skip_d2h_for_method_outputs config flags to ExecutorchBackendConfig. These control whether PropagateDevicePass skips inserting H2D/D2H copy ops at method I/O boundaries: - skip_h2d_for_method_inputs: user provides GPU tensor directly - skip_d2h_for_method_outputs: output stays on device for cross-method pipelines Differential Revision: [D99636778](https://our.internmc.facebook.com/intern/diff/D99636778/) [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18760
Note: Links to docs will display an error until the docs builds have been completed. ❗ 1 Active SEVsThere are 1 currently active SEVs. If your PR is affected, please view them below: ❌ 1 New Failure, 3 Unrelated Failures, 1 Unclassified FailureAs of commit 31ef072 with merge base 77df9b7 ( UNCLASSIFIED FAILURE - DrCI could not classify the following job because the workflow did not run on the merge base. The failure may be pre-existing on trunk or introduced by this PR:
BROKEN TRUNK - The following jobs failed but were present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
digantdesai
left a comment
There was a problem hiding this comment.
Review automatically exported from Phabricator review in Meta.
…skipping H2D/D2H copies" Add skip_h2d_for_method_inputs and skip_d2h_for_method_outputs config flags to ExecutorchBackendConfig. These control whether PropagateDevicePass skips inserting H2D/D2H copy ops at method I/O boundaries: - skip_h2d_for_method_inputs: user provides GPU tensor directly - skip_d2h_for_method_outputs: output stays on device for cross-method pipelines Differential Revision: [D99636778](https://our.internmc.facebook.com/intern/diff/D99636778/) [ghstack-poisoned]
JacobSzwejbka
left a comment
There was a problem hiding this comment.
Review automatically exported from Phabricator review in Meta.
Stack from ghstack (oldest at bottom):
Add skip_h2d_for_method_inputs and skip_d2h_for_method_outputs config
flags to ExecutorchBackendConfig. These control whether PropagateDevicePass
skips inserting H2D/D2H copy ops at method I/O boundaries:
Differential Revision: D99636778