Skip to content

[Draft] Qualcomm AI Engine Direct - Support kv_cached llama2 model #2966

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
shewu-quic wants to merge 3 commits into from

Split llama and modify architecture for performance

9646142
Select commit
Loading
Failed to load commit list.
Closed

[Draft] Qualcomm AI Engine Direct - Support kv_cached llama2 model #2966

Split llama and modify architecture for performance
9646142
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs