[Executorch] Introduce caching cpu memory allocator#16120
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/16120
Note: Links to docs will display an error until the docs builds have been completed. ⏳ 4 Pending, 1 Unrelated FailureAs of commit 8b88a23 with merge base 4aaa7ff ( BROKEN TRUNK - The following job failed but were present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Pull Request resolved: #15611 Meant to use this for temp allocator for kernels. Specifically for sdpa, it seems that on iOS there is a significant overhead coming from allocations ghstack-source-id: 327518047 @exported-using-ghexport Differential Revision: [D85532079](https://our.internmc.facebook.com/intern/diff/D85532079/)
9574817 to
8b88a23
Compare
This PR needs a
|
This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: pytorch#15611 by @kimishpatel ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/kimishpatel/203/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/kimishpatel/203/head Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/kimishpatel/202/orig Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/kimishpatel/203/orig Differential Revision: [D85532079](https://our.internmc.facebook.com/intern/diff/D85532079/) @diff-train-skip-merge Co-authored-by: Kimish Patel <kimishpatel@fb.com>
This PR was created by the merge bot to help merge the original PR into the main branch.
ghstack PR number: #15611 by @kimishpatel
^ Please use this as the source of truth for the PR details, comments, and reviews
ghstack PR base: https://github.com/pytorch/executorch/tree/gh/kimishpatel/203/base
ghstack PR head: https://github.com/pytorch/executorch/tree/gh/kimishpatel/203/head
Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/kimishpatel/202/orig
Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/kimishpatel/203/orig
Differential Revision: D85532079
@diff-train-skip-merge