Skip to content

[Relax] Capture symbolic vars in struct info of weights#16834

Merged
tqchen merged 1 commit intoapache:mainfrom
vinx13:feat/cuda-graph-weight-symbolic
Apr 3, 2024
Merged

[Relax] Capture symbolic vars in struct info of weights#16834
tqchen merged 1 commit intoapache:mainfrom
vinx13:feat/cuda-graph-weight-symbolic

Conversation

@vinx13
Copy link
Copy Markdown
Member

@vinx13 vinx13 commented Apr 3, 2024

weights may have symbolic shapes. We assume any args in params[num_inputs:] to be weights (with fixed buffer address), so it's safe to capture these symbolic vars as well even if it's not provided in the hints.

cc @tqchen

@github-actions github-actions Bot requested a review from tqchen April 3, 2024 01:09
@tqchen tqchen merged commit 54e31f3 into apache:main Apr 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants