Skip to content

UVM notebook update and add tracker for notebooks to readme #3595

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rapids-bot merged 3 commits into from
May 23, 2023
Merged

UVM notebook update and add tracker for notebooks to readme #3595

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
3a5fd01
fixed uvm notebook to run in 23.06 and update README. md with tracker…
acostadon May 22, 2023
b3b7c5d
added links and reworded descriptions.
acostadon May 22, 2023
c5e3b22
changed some wording and links
acostadon May 22, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 26 additions & 1 deletion notebooks/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,9 +61,34 @@ Running the example in these notebooks requires:
* CUDA 11.4+
* NVIDIA driver 450.51+



## Additional Notebooks

The following notebooks are not tested as part of the standard cuGraph continuous integration process. There is a plan to start testing these notebooks weekly, but until then there is no guarantee that they will work with the nightly release. The following table list the notebook funtion, where to find the notebook, and the environment used to test the notebook.

If any notebook doesn't run as detailed here, please file an issue in [cuGraph](https://github.com/rapidsai/cugraph/issues)

|Notebook |Location |Environment |Extra Dependencies|Notes |
|----------------------|-------------------------|------------------|------------------|---------------------------------------------|
|Batch Betweenness |N/A | | |removed due to missing batch algorithm 23.06 |
|[Multiple GPU Louvain](demo/mg_louvain.ipynb) |demo |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3558/23.06 |
|[Multiple GPU Pagerank](demo/mg_pagerank.ipynb) |demo |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3558/23.06 |
|[Multiple GPU Property Graph](demo/mg_property_graph.ipynb) |demo |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3558/23.06 |
|[Managed Memory Pagerank](demo/uvm.ipynb) |demo |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR/23.06 |
|[Cost Matrix simulating All Points Shortest Path](applications/CostMatrix.ipynb) |applications |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3551/23.06 |
|[Generating Transaction data using RMAT](applications/gen_550M.ipynb) |applications |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |tested and documented PR #3551/23.06 |
|[Multiple GPU tutorial with Pagerank](https://github.com/rapidsai-community/notebooks-contrib/blob/main/community_tutorials_and_guides/cugraph/multi_gpu_pagerank.ipynb) |contrib/community/cugraph|[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed notebook-contrib PR #374/23.06 |
|[Breadth First Search benchmark](cugraph_benchmarks/bfs_benchmark.ipynb) |cugraph_benchmark |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3561/23.06 |
|[Louvain benchmark](cugraph_benchmarks/louvain_benchmark.ipynb) |cugraph_benchmark |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3561/23.06 |
|[Pagerank benchmark](cugraph_benchmarks/pagerank_benchmark.ipynb) |cugraph_benchmark |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3561/23.06 |
|[Single Source Shortest Path benchmark](sssp_benchmarks/bfs_benchmark.ipynb) |cugraph_benchmark |[cugraph conda](https://github.com/rapidsai/cugraph/blob/branch-23.06/conda/environments/all_cuda-118_arch-x86_64.yaml) |None |fixed in PR #3561/23.06 |



#### Copyright

Copyright (c) 2019-2022, NVIDIA CORPORATION. All rights reserved.
Copyright (c) 2019-2023, NVIDIA CORPORATION. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

Expand Down
37 changes: 29 additions & 8 deletions notebooks/demo/uvm.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,22 +1,31 @@
{
"cells": [
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"# Oversubscribing GPU memory in cuGraph\n",
"#### Author : Alex Fender\n",
"# Skip notebook test\n",
"\n",
"\n",
"In this notebook, we will show how to **scale to 4x larger graphs than before** without incurring a performance drop using managed memory features in cuGraph. We will compute the PageRank of each user in Twitter's dataset on a single GPU as an example. This technique applies to all features.\n",
"\n",
"Unified Memory is a single memory address space accessible from any processor in a system. If a kernel tries to access any absent pages,the Page Migration Engine migrates the pages. When the GPU memory is full, the least recently used pages are evicted. In other words, Unified Memory transparently enables oversubscribing GPU memory, enabling out-of-core computations.\n",
"\n",
"\n",
"This notebook was tested on an NVIDIA 48GB RTX8000 GPU using RAPIDS 0.14 and CUDA 10.2. Please be aware that your system may be different, and you may need to modify the code or install packages to run the below examples. If you think you have found a bug or an error, please file an issue in [cuGraph](https://github.com/rapidsai/cugraph/issues)"
"This notebook was tested on an NVIDIA 48GB RTX8000 GPU using RAPIDS 0.14 and CUDA 10.2. Please be aware that your system may be different, and you may need to modify the code or install packages to run the below examples. If you think you have found a bug or an error, please file an issue in [cuGraph](https://github.com/rapidsai/cugraph/issues)\n",
"\n",
"| Author Credit | Date | Update | cuGraph Version | Test Hardware |\n",
"|-----------------|------------|-----------------------|-----------------|--------------------------------|\n",
"|Alex Fender | 05/15/2020 | created | 0.14 | RTX8000 48G GPU CUDA 10.2 |\n",
"|Chuck Hastings | 02/21/2021 | incorporate dendrogram| 0.18 | |\n",
"|Jordan Jacobelli | 11/08/2021 | update dataset URL | 23.04 | |\n",
"| Don Acosta | 05/21/2023 | updated/tested | 23.06 nightly | 2xA6000 CUDA 11.7 |\n"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -30,6 +39,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand Down Expand Up @@ -58,6 +68,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -78,13 +89,15 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"### Get the data"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand Down Expand Up @@ -135,6 +148,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -159,6 +173,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -174,8 +189,8 @@
"t_start = time.time()\n",
"\n",
"# Create a directed graph using the source (src) and destination (dst) vertex pairs from the Dataframe \n",
"G = cugraph.DiGraph()\n",
"G.from_cudf_edgelist(e_list, source='src', destination='dst', renumber=False)\n",
"G = cugraph.Graph(directed=True)\n",
"G.from_cudf_edgelist(e_list, source='src', destination='dst', renumber=False, store_transposed=True)\n",
"\n",
"# (optional) request the transposed here so that we can analyse pagerank solver time alone\n",
"G.view_transposed_adj_list()\n",
Expand All @@ -185,6 +200,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -210,6 +226,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -218,6 +235,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand Down Expand Up @@ -249,6 +267,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -264,6 +283,7 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
Expand All @@ -275,11 +295,12 @@
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"___\n",
"Copyright (c) 2020, NVIDIA CORPORATION.\n",
"Copyright (c) 2020-2023, NVIDIA CORPORATION.\n",
"\n",
"Licensed under the Apache License, Version 2.0 (the \"License\"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0\n",
"\n",
Expand All @@ -290,9 +311,9 @@
],
"metadata": {
"kernelspec": {
"display_name": "cugraph_dev",
"display_name": "cugraph_0411",
"language": "python",
"name": "cugraph_dev"
"name": "python3"
},
"language_info": {
"codemirror_mode": {
Expand All @@ -304,7 +325,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.8.10"
"version": "3.10.10"
}
},
"nbformat": 4,
Expand Down