Skip to content
Closed
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
93 commits
Select commit Hold shift + click to select a range
55ed5ab
[RELEASE-ONLY CHANGES] Branch Cut for Release 0.2 (#2735)
guangy10 Mar 28, 2024
1f1f357
[RELEASE-ONLY CHANGES] Update release/0.2 to pin and test against PyT…
guangy10 Apr 5, 2024
9383bda
Update docs (#2919) (#2923)
pytorchbot Apr 9, 2024
e193c71
Use unified path /data/local/tmp/llama (#2899) (#2924)
pytorchbot Apr 9, 2024
166a635
Refine LLM getting started guide for uniformity, fix critical errors …
GregoryComer Apr 9, 2024
002ae53
Update docs for the demo app. (#2921)
shoumikhin Apr 8, 2024
fa4d88d
Fixing minor issues in llama2 7b repro (#2926)
mergennachin Apr 8, 2024
4e7aebf
Update iphone 15 pro benchmarking numbers (#2927)
kimishpatel Apr 8, 2024
46566b5
Fix generation speed calculation. (#2932)
shoumikhin Apr 9, 2024
2fe7543
exclude mutated buffer (#2876)
cccclai Apr 8, 2024
69bae6e
Make minor updates to LLM guide setup instructions (#2940) (#2959)
pytorchbot Apr 10, 2024
cd2779a
resolve_buck.py: Add an entry for darwin-x86_64 (#2868)
dbort Apr 10, 2024
16c3afc
Refine the LLM manual (focus on the debugging and profiling part) (#2…
pytorchbot Apr 11, 2024
6a67ec2
[RELEASE-ONLY] Fix install_requirements.sh (#3002)
guangy10 Apr 12, 2024
be476a5
Add llama2 readme in examples/README (#2992) (#2993)
pytorchbot Apr 12, 2024
ca69051
Add the missing import generate_etrecord to doc Getting Started with …
pytorchbot Apr 12, 2024
31bb2ea
Fix the wrong test-infra branch on release/0.2 (#3021)
huydhn Apr 12, 2024
28f1c8c
Add required deps to pyproject.toml
dbort Apr 13, 2024
72854c8
Install build requirements in pre_build_script.sh
dbort Apr 12, 2024
4280334
Have setup.py unset HOME when running buck2
dbort Apr 12, 2024
1352d4e
Add project.ignore to .buckconfig to reduce watched files
dbort Apr 13, 2024
d5cbc09
Don't recurse submodules when building wheels
dbort Apr 12, 2024
dc1ca98
Build pybindings and link in backends when building pip wheels
dbort Apr 13, 2024
638433f
Wrap std::isnan/std::isinf in the portable operators
dbort Apr 13, 2024
60bf405
Decouple custom ops in llama_transformer.py Part 1/N (#3005) (#3052)
cccclai Apr 16, 2024
ca7eba9
add more instructions and examples on Delegation (#3042)
pytorchbot Apr 17, 2024
87d3748
Decouple custom ops in llama_transformer.py Part 2/N (#3007) (#3061)
cccclai Apr 17, 2024
e7e9e06
Cherry-pick commits for executorch_no_prim_ops (#3025)
kirklandsign Apr 17, 2024
212e91f
Fix tutorial for Qualcomm AI Engine Direct Backend (#2956) (#3026)
kirklandsign Apr 17, 2024
925f674
Android demo app tutorial fix for XNNPACK and QNN (#2962) (#3027)
kirklandsign Apr 17, 2024
e078e93
Skip annotate boolean input (#2957) (#3051)
cccclai Apr 17, 2024
59fa8e3
Update doc-build.yml (#3045) (#3098)
pytorchbot Apr 18, 2024
0ad7043
Update doc-build.yml (#3071) (#3099)
pytorchbot Apr 18, 2024
3fe0e70
move mask as sdpa input instead of attribute (#3036) (#3114)
cccclai Apr 18, 2024
c9811bc
Documentation for Vulkan Delegate (#3113) (#3124)
pytorchbot Apr 18, 2024
27e1a62
[RELEASE-ONLY] Pin Xcode projects to release/0.2 branch (#3155)
shoumikhin Apr 19, 2024
aa3f22c
Core ML Has Added `Index_Put` Support, No Need to Skip Anymore (#2975…
pytorchbot Apr 19, 2024
efb7cf3
Add a simple sdpa (#3037) (#3166)
cccclai Apr 19, 2024
36eb9c8
Docs for lower smaller models to mps/coreml/qnn (#3146) (#3178)
cccclai Apr 19, 2024
7b29ad2
qnn end to end flow for stories model (#3038) (#3182)
cccclai Apr 20, 2024
4142cf6
Fix build-framework-ios CI job (#2996) (#3186)
larryliu0820 Apr 22, 2024
a94459a
ETRecord ser/de handling "None" outputs and more (#3039) (#3191)
pytorchbot Apr 22, 2024
281134d
Handle empty (size=0) tensor in Inspector (#2998) (#3192)
pytorchbot Apr 22, 2024
dcd5c44
Cherry pick #3006 (#3190)
huydhn Apr 22, 2024
f008e12
Handle missing data types. (#2984) (#3134)
pytorchbot Apr 22, 2024
773da4d
[RELEASE ONLY] Fix running llava_encoder in CI (#3214)
guangy10 Apr 22, 2024
67d0dd7
Add a pure python wrapper to pybindings.portable_lib (#3137) (#3218)
pytorchbot Apr 22, 2024
c79666a
Remove unused extension/aot_util directory (#3216) (#3226)
pytorchbot Apr 23, 2024
1fd5562
Fix dynamic linking issues with prebuilt pip packages (#3049)
dbort Apr 23, 2024
4cce1cf
Update some SDK docs from MVP (#3212) (#3230)
pytorchbot Apr 23, 2024
24ecd04
Start using a dedicated branch for prebuild iOS packages (#3183)
shoumikhin Apr 23, 2024
1ba292a
Enable doc upload for tags, disable for release branches (#3153) (#3243)
pytorchbot Apr 23, 2024
47bc4aa
Update Core ML Backend Doc (#3188) (#3249)
pytorchbot Apr 23, 2024
ba6e318
bundled program alpha document (#3224) (#3252)
pytorchbot Apr 23, 2024
b045b3c
Fix executor_runner_mps and mpsdelegate linking with pybind (#3222) (…
pytorchbot Apr 23, 2024
3d7a24c
update sdk delegate integration (#3246) (#3258)
pytorchbot Apr 23, 2024
214371d
Dynamically determine the version of the pip package. (#3259)
dbort Apr 23, 2024
a0bd7fa
Update Profiling Section in XNNPACK Delegate Docs (#3237) (#3261)
pytorchbot Apr 24, 2024
66783f4
[NOT FOR LAND] Generate and upload android prebuilt (#3255)
kirklandsign Apr 24, 2024
75484d9
Add index.Tensor and aten.logical_not (#3221) (#3267)
pytorchbot Apr 24, 2024
915164e
Specify OSX deployment target for python package. (#3194) (#3279)
pytorchbot Apr 24, 2024
ed07890
Pin CoreMLTools 7.2 (#3170) (#3281)
pytorchbot Apr 24, 2024
e783942
Add iPad support to demo apps. (#3251) (#3256)
pytorchbot Apr 24, 2024
eabdeb0
Update apple.yml (#3287)
shoumikhin Apr 24, 2024
da94594
Fix typo in sub & clean up (#3100) (#3253)
pytorchbot Apr 24, 2024
0dd6639
fix qnn install link (#3260) (#3271)
cccclai Apr 24, 2024
ad80c6b
update docs (#3286)
kirklandsign Apr 24, 2024
f0a0a20
Fix a small inconsistency on the SDK debugging page (#3247) (#3290)
pytorchbot Apr 24, 2024
dbb7e26
SDK tutorial doc update (#3238) (#3292)
pytorchbot Apr 24, 2024
6044404
Fix broken links on the coreml tutorial page (#3250) (#3293)
pytorchbot Apr 24, 2024
147579a
delegation debug page (#3254) (#3294)
pytorchbot Apr 24, 2024
759fd12
Add delegate time scale converter to Inspector (#3240) (#3297)
pytorchbot Apr 24, 2024
b218b18
move code under executorch/example (#3176) (#3307)
pytorchbot Apr 24, 2024
31300d0
add dynamic export into llm manual (#3202) (#3308)
pytorchbot Apr 24, 2024
b3fb810
[Android] Fix upload workflow for release (#3288)
kirklandsign Apr 24, 2024
904e989
[RELEASE ONLY] Android custom op registration (#3284)
kirklandsign Apr 24, 2024
d1cf0a6
Audit and update the pip package metadata (#3265)
dbort Apr 24, 2024
2a1ae4f
Update Llava README.md (#3309)
iseeyuan Apr 24, 2024
861abb1
Use relative links in llm/getting-started.md (#3244) (#3310)
pytorchbot Apr 24, 2024
399138e
[pyproject.toml] Add a dependency on `torch==2.3` (#3277)
dbort Apr 24, 2024
b53c97d
Update readme. (#3301) (#3302)
pytorchbot Apr 24, 2024
c07cfc9
Fix LLAMA app (#3228) (#3283)
kirklandsign Apr 24, 2024
59cda5d
update typos (#3300) (#3321)
pytorchbot Apr 24, 2024
ed1992c
update memory planning docs (#3270) (#3319)
pytorchbot Apr 24, 2024
d1175cf
Update README-wheel.md to document what's linked into pybindings (#3323)
dbort Apr 24, 2024
c78c45b
Update git clone instructions (#3306)
mergennachin Apr 24, 2024
a1d881a
Remove the sorting of the nodes from partitioning (not needed for now…
DenisVieriu97 Apr 24, 2024
2d75a0b
[MPS] Update MPS documentation; add helper script to build mps_execut…
DenisVieriu97 Apr 24, 2024
fdd266c
llama2 readme (#3315) (#3326)
pytorchbot Apr 24, 2024
ef376d6
Update readme. (#3331)
shoumikhin Apr 24, 2024
f05fdd3
Update custom kernel registration API (#3330)
larryliu0820 Apr 24, 2024
f937935
Inspector APIs page (#3335)
Olivia-liu Apr 24, 2024
52aa8cf
Update llama2 readme file
mergennachin Apr 24, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix executor_runner_mps and mpsdelegate linking with pybind (#3222) (#…
…3248)

Summary:
Summary of changes:
- fixes mps_executor_runner build - previously it would fail to build previously due to incorrect linking with portable ops
- fixes `mpsdelegate` linking with `pybind` lib
- added tests to check correctness directly through pybind
- added a helper file (`bench_utils.py`) to help measure models forward pass between PyTorch MPS and ExecuTorch MPS

Testing (will run both AOT and runtime if MPS was built with pybind):
- `./install_requirements.sh --pybind mps`
- invoke a single unit test: `python3 -m unittest backends.apple.mps.test.test_mps_indexing_ops -v -k test_mps_indexing_get_1`.
- invoke all tests from a file: `python3 -m unittest backends.apple.mps.test.test_mps_indexing_ops -v`

cc cccclai , shoumikhin

Pull Request resolved: #3222

Reviewed By: shoumikhin

Differential Revision: D56447888

Pulled By: cccclai

fbshipit-source-id: 5cbbcbf8df34f29e23a1854df72f764337a9df76
(cherry picked from commit 6c30eea)

Co-authored-by: Denis Vieriu <dvieriu@apple.com>
  • Loading branch information
pytorchbot and DenisVieriu97 authored Apr 23, 2024
commit b045b3c2d5a900869655be82d9f3e8fd2e1f050b
3 changes: 3 additions & 0 deletions backends/apple/mps/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -77,6 +77,9 @@ target_link_libraries(mpsdelegate
${MPS_GRAPG_FRAMEWORK}
)

target_link_options_shared_lib(mpsdelegate)
target_compile_options(mpsdelegate PUBLIC ${_common_compile_options})

install(
TARGETS mpsdelegate
DESTINATION lib
Expand Down
Loading