Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

idea: Use llama.cpp HIP build for AMD GPUs #2168

@gau-nernst

Description

@gau-nernst

Problem Statement

Currently we use llama.cpp Vulkan build for AMD GPUs. HIP build should have better perf. (we should have benchmark test for that too)

Once #2128 lands, we should be able to use upstream HIP builds for Windows

Image

There is no upstream HIP builds for Linux. We might need to build it ourselves, though I think we need AMD GPUs for that.

cc: @david-menloai @sangjanai @qnixsynapse

Feature Idea

See above

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions