Skip to content

Cherry picking for Rel-1.6 - #6006

Merged
duli2012 merged 20 commits into
rel-1.6.0from
cherry_pick
Dec 2, 2020
Merged

Cherry picking for Rel-1.6#6006
duli2012 merged 20 commits into
rel-1.6.0from
cherry_pick

Conversation

@duli2012

@duli2012 duli2012 commented Dec 2, 2020

Copy link
Copy Markdown
Contributor

Description: Describe your changes.
Cherry pick the following PRs:
Document all C# API pubic interfaces #5853 by yuslepukhingit
Update onnx (#5720)
C#: Add CreateFromMemory to FixedBufferOnnxValue to allow bind user buffers and pass custom binary compatible types
[Java] Initial Apple Silicon support
Add OpenVINO EP shared lib to Py Wheel #5920
Enable the xcode build for Apple Silicon (arm64 MacOS) (#5924)
Make NNAPI EP reject nodes with no-shape inputs
Sahar/fix documentation shared lib (#5926)
Update dockerfiles (#5929)
Add Longformer Attention Cuda Op(#5932)
Bug fix for MaskRCNN and FasterRCNN (#5935)
Fix publishing pipelines. (#5942)
Fix Python Linux GPU package name (#5943)
Update BUILD.md with shared provider information (#5944)
[OpenVINO]Fix memory leak in IsDebugEnabled() under Windows (#5948)
Add support for Python 3.8+ on Windows when CUDA is enabled (#5956)
Support the cross compiling for Apple Silicon (#5974)
Update docker files to put 'unattended-upgrades' in a right place(#5983)
Add python 3.9 support #5874

askhade and others added 20 commits December 1, 2020 21:54
* update onnx

* update docker image for testing
(cherry picked from commit 705d093)
…uffers and pass custom binary compatible types (#5886)

Add CreateFromMemory to FixedBufferOnnxValue so users can bind their own custom binary compatible buffers to feed/fetch data.
(cherry picked from commit c2d6100)
* Rearranging checks in onnxruntime_mlas.cmake to pickup Apple Silicon.

On an M1 Macbook Pro clang reports:

$ clang -dumpmachine
arm64-apple-darwin20.1.0

So the regex check needs to look for "arm64" first, as otherwise it
matches 32-bit ARM and you get NEON compilation failures.

* Adding Java side library loading support for Apple Silicon (and other aarch64 architectures).

* Adding Qgemm fix from @tracysh

* Fixes the java packaging on Windows.

* Missed a check in the java platform detector.
(cherry picked from commit 8b83c51)
* Add OpenVINO EP shared lib to Py Wheel

Include the libonnxruntime_providers_openvino.so/.dll to the wheel

* Follow libs.extend pattern as other EPs
(cherry picked from commit 4092686)
* Update OpenVINO-ExecutionProvider.Md

update openvino-executionprovider.md for shared library

* Update Build.md

updated --build_shared_lib flag for building openvino shared provider lib

* Update Dockerfile.openvino

building for shared library with the new changes for openvino shared lib

* Revert "Update Build.md"

This reverts commit c9cf5fe.

* Revert "Update Dockerfile.openvino "

This reverts commit e1624e4.

* Update OpenVINO-ExecutionProvider.md

fix documentation to the shared library

Co-authored-by: sfatimar <sahar.fatima@intel/com>
(cherry picked from commit 8168c91)
1. Remove conda from the images. Because conda contains a file named /opt/miniconda/lib/libcrypto.so.1.0.0 which can't pass our security scan. Also, it will be easier for us to manage the third party usage registrations.
2. Remove openssh from the images. Because the official openssh package provided by Ubuntu can't pass our security scan.
3. Reduce the image size to 1/3 by using stages. Also, because it contains less packages, it will be less often needed to update.
4. Put the LICENSE-IMAGE.txt file in right place. It is missed in current images. You can see it was added to a temp folder "/code" but it got deleted afterwards.
5. Update the CPU docker image's base image to Ubuntu 18.04. The GPU one is already 18.04. It's better to keep them the same.
6. Remove the build arg ONNXRUNTIME_REPO/ONNXRUNTIME_BRANCH. Instead, the new one always uses the local source. I feel it can reduce confusion.
(cherry picked from commit 1dbabb2)
Limitation: Global tokens must be at the beginning of sequence.
(cherry picked from commit 31a6be3)
Signed-off-by: MaajidKhan <n.maajidkhan@gmail.com>
(cherry picked from commit e39e82b)
Fix publishing pipelines.
(cherry picked from commit c4b55d2)
Fix Python Linux GPU package name. I accidentally added "noopenmp" to it.

(cherry picked from commit 5fdd9f0)
* Update build instructions to include information about shared providers

(cherry picked from commit 27513d1)
* w

* w

Co-authored-by: modav <modav@microsoft.com>
(cherry picked from commit e207589)
* support macos_arm64 cross compiling

* update the build docs

* update as commented.

* Update BUILD.md
(cherry picked from commit 2ec211e)
* fix the build script for macos/xcode

* add the version check

* correct the osx-arch configuration

* typo
(cherry picked from commit 1852ade)
1. Add python 3.9 support(except Linux ARM)
2. Add Windows GPU python 3.8 to our packaging pipeline.
@duli2012
duli2012 requested a review from a team as a code owner December 2, 2020 18:09
@snnn

snnn commented Dec 2, 2020

Copy link
Copy Markdown
Contributor

/azp run orttraining-linux-gpu-ci-pipeline, orttraining-linux-ci-pipeline, MacOS NoContribops CI Pipeline, MacOS CI Pipeline, Linux CPU x64 NoContribops CI Pipeline

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines could not run because the pipeline triggers exclude this branch/path.

Comment thread cgmanifests/submodules/cgmanifest.json
@duli2012
duli2012 merged commit 095d55b into rel-1.6.0 Dec 2, 2020
@duli2012
duli2012 deleted the cherry_pick branch December 2, 2020 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.