Skip to content

[SYSTEMDS-??] Upgrade GPU backend to latest NVIDIA software stack #2271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ReneEnjilian wants to merge 29 commits into from
Closed

[SYSTEMDS-??] Upgrade GPU backend to latest NVIDIA software stack #2271

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
94da9b1
update gpu-backend to current Nvidia-stack
ReneEnjilian Jun 5, 2025
4e76b77
Merge remote-tracking branch 'upstream/main' into update-cuda
ReneEnjilian Jun 5, 2025
32e8e63
correct step2GatherNNZGeam
ReneEnjilian Jun 12, 2025
a8ea3c8
correct csr2dense
ReneEnjilian Jun 14, 2025
fc9f56e
ensure rows are correctly sorted
ReneEnjilian Jun 15, 2025
7b1e0b9
use checkGPU() in GPUFullReuseTest again after all tests pass now
ReneEnjilian Jun 15, 2025
39eb0ab
rework GEMM
ReneEnjilian Jun 17, 2025
58d5034
rewrite csr2csc
ReneEnjilian Jun 17, 2025
1ce7ea3
fix sparse-sparse matrix multiply
ReneEnjilian Jun 19, 2025
0484ea3
rework cusparsecsrmv()
ReneEnjilian Jun 20, 2025
df83465
rework cusparsecsrmm2()
ReneEnjilian Jun 20, 2025
a3ee4eb
rework cusparseDense2csr() and final cleanups
ReneEnjilian Jun 21, 2025
58a3ae3
Merge remote-tracking branch 'upstream/main' into update-cuda
ReneEnjilian Jun 21, 2025
fdff4a4
reinstate checkGPU()
ReneEnjilian Jun 21, 2025
5f60373
add testing for dnn operations
ReneEnjilian Jul 13, 2025
0c48fff
adjust class name
ReneEnjilian Jul 13, 2025
1753307
add resnet18 test for GPU
ReneEnjilian Jul 14, 2025
48c1eee
delete files
ReneEnjilian Jul 14, 2025
fb2e10d
start implementing tests for cudaSupportFunctions
ReneEnjilian Jul 16, 2025
271f008
add checkGPU() to TestUtils to run before class
ReneEnjilian Jul 16, 2025
f793c74
add test for matrix-vector multiply for GPU
ReneEnjilian Jul 16, 2025
a9d07eb
add test for cusparsecsrmm2
ReneEnjilian Jul 16, 2025
735cb75
add testing for cublasDot
ReneEnjilian Jul 17, 2025
1a48926
add test for cublasgemv
ReneEnjilian Jul 17, 2025
fbdb865
restructure scripts
ReneEnjilian Jul 17, 2025
c0f7841
refactor nn
ReneEnjilian Jul 17, 2025
481b8dd
add test for cupsrasecsr2csc via transpose operation
ReneEnjilian Jul 18, 2025
6107852
add test for cusparsecsrgeam
ReneEnjilian Jul 18, 2025
15fed52
Merge remote-tracking branch 'upstream/main' into update-cuda
ReneEnjilian Jul 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 1 addition & 42 deletions pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
<project.build.outputTimestamp>1</project.build.outputTimestamp>
<enableGPU>false</enableGPU>
<jcuda.scope>provided</jcuda.scope>
<jcuda.version>10.2.0</jcuda.version>
<jcuda.version>12.6.0</jcuda.version>
<slf4j.version>2.0.11</slf4j.version>
<log4j.version>2.22.1</log4j.version>
<maven-clean-plugin.version>3.2.0</maven-clean-plugin.version>
Expand Down Expand Up @@ -1078,47 +1078,6 @@
<version>${jcuda.version}</version>
<scope>${jcuda.scope}</scope>
</dependency>

<dependency>
<groupId>org.jcuda</groupId>
<artifactId>jcuda-natives</artifactId>
<classifier>apple-x86_64</classifier>
<version>${jcuda.version}</version>
<scope>${jcuda.scope}</scope>
</dependency>

<dependency>
<groupId>org.jcuda</groupId>
<artifactId>jcublas-natives</artifactId>
<classifier>apple-x86_64</classifier>
<version>${jcuda.version}</version>
<scope>${jcuda.scope}</scope>
</dependency>

<dependency>
<groupId>org.jcuda</groupId>
<artifactId>jcusparse-natives</artifactId>
<classifier>apple-x86_64</classifier>
<version>${jcuda.version}</version>
<scope>${jcuda.scope}</scope>
</dependency>

<dependency>
<groupId>org.jcuda</groupId>
<artifactId>jcusolver-natives</artifactId>
<classifier>apple-x86_64</classifier>
<version>${jcuda.version}</version>
<scope>${jcuda.scope}</scope>
</dependency>

<dependency>
<groupId>org.jcuda</groupId>
<artifactId>jcudnn-natives</artifactId>
<classifier>apple-x86_64</classifier>
<version>${jcuda.version}</version>
<scope>${jcuda.scope}</scope>
</dependency>

<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-core_${scala.binary.version}</artifactId>
Expand Down
Loading
Loading