Updating cudnn from 8 to 9 on exsiting cuda 12 docker image

[Jian Chen (jchen351)]

Description

Adding support of cudnn 9

Motivation and Context

Keep exsiting cuda 12.2 with nvidia dirver 535

[snnn (snnn)]

You installed a RHEL9 package to RHEL8, which usually would not work. Please modify the base image instead. The base image already has a cudnn package, we should replace that one. And we should get packages from a package manager(dnf) instead of wget.
And keep in mind that we need to replicate this change to ORT-extension and also ORT-GenAI, that's why I suggest modifying the base image instead.

[snnn (snnn)]

Would you mind modifying the base image instead?

[snnn (snnn)]

Please manually generate the build image and tell us what packages were installed in the image. Please provide the information so that we can examine if the change you are making works as expected.

[George Wu (jywu-mysoft)]

Please manually generate the build image and tell us what packages were installed in the image. Please provide the information so that we can examine if the change you are making works as expected.

best to check all the artifacts produced by the package pipelines after this change.
I did check some of the artifacts and the libonnxruntime_providers_cuda.so and libonnxruntime_providers_tensorrt.so did indeed depend on cudnn.9

[George Wu (jywu-mysoft)]

Please manually generate the build image and tell us what packages were installed in the image. Please provide the information so that we can examine if the change you are making works as expected.

best to check all the artifacts produced by the package pipelines after this change. I did check some of the artifacts and the libonnxruntime_providers_cuda.so and libonnxruntime_providers_tensorrt.so did indeed depend on cudnn.9

i checked https://artprodcus3.artifacts.visualstudio.com/Abc038106-a83b-4dab-9dd3-5a41bc58f34c/530acbc4-21bc-487d-8cd8-348ff451d2ff/_apis/artifact/cGlwZWxpbmVhcnRpZmFjdDovL2FpaW5mcmEvcHJvamVjdElkLzUzMGFjYmM0LTIxYmMtNDg3ZC04Y2Q4LTM0OGZmNDUxZDJmZi9idWlsZElkLzQ4MDg1OC9hcnRpZmFjdE5hbWUvb25ueHJ1bnRpbWUtbGludXgteDY0LWdwdQ2/content?format=file&subPath=%2Fonnxruntime-linux-x64-gpu-1.19.0.tgz from this run https://aiinfra.visualstudio.com/Lotus/_build/results?buildId=480858&view=logs&j=93517ded-26f4-5eeb-8a9b-73e6b9c15e50&t=e69b1501-fc09-575b-14b1-82104b17da58

[Chi Lo (chilo-ms)]

Does the new base image cuda12_x64_ubi8_gcc12:20240607 contain cudnn9 and can we kick off all the package pipelines to check the artifacts they produce now? thanks.
I can help check the artifacts once they are generated.

[snnn (snnn)]

He is working on it.

[Chi Lo (chilo-ms)]

i checked the Nuget-CUDA-Packaging pipeline for onnxruntime-linux-x64-gpu-1.19.0.tgz, and both CUDA/TRT EP lib did link against cuda12 and cudnn9
https://aiinfra.visualstudio.com/Lotus/_build/results?buildId=483657&view=artifacts&pathAsName=false&type=publishedArtifacts