[CoreML] Add support for running statefule model.

[cymbalrush]

Add support for running stateful model. On iOS18 CoreML has a new API predictionFromFeatures:usingState:options:error that supports model state. The runtime change makes sure to call the new API if the model has state otherwise it uses the old API.

Testing:
Did local testing. To generate the test model I am waiting on the coremltools change to be publicly available.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5143

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Unrelated Failure

As of commit aef0bc5 with merge base 9739609 ():

NEW FAILURES - The following jobs have failed:

• Apple / test-demo-ios / macos-job (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
• pull / unittest-arm (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 39106634ba8806b31573bc2dac223e1a5480e330eb63412549383f1e44c13e29 /exec failed with exit code 1
• trunk / test-arm-reference-delegation / linux-job (gh)
  RuntimeError: Command docker exec -t 9a2c45c4cb205739eefd62140246615d6e623da54aa74c8b8738c501179649dc /exec failed with exit code 1

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• Apple / upload-frameworks-ios (gh) (detected as infra flaky with no log or failing log classifier)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[cccclai]

Thanks! How do we test it?

[cymbalrush]

Thanks! How do we test it?

I will add a unit test but have to wait for @YifanShenSZ coremltools changes to be available.

[cccclai]

Thanks! How do we test it?

I will add a unit test but have to wait for @YifanShenSZ coremltools changes to be available.

Great! Looks like the coreml related tests are failing. What's your preference here? Should we want for coremltools update before merging this change?

[cymbalrush]

Thanks! How do we test it?

I will add a unit test but have to wait for @YifanShenSZ coremltools changes to be available.

Great! Looks like the coreml related tests are failing. What's your preference here? Should we want for coremltools update before merging this change?

I am fixing the tests, it's API availability issue. The change shouldn't break anything.

[facebook-github-bot]

@cccclai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[cccclai]

Looks great. Thank you