[fix] Fix a few issues with EAGLE3 in PyTorch backend - #3686
Conversation
|
/bot run --disable-fail-fast |
|
PR_Github #2791 [ run ] triggered by Bot |
|
PR_Github #2791 [ run ] completed with state |
e978e53 to
d85cb81
Compare
|
/bot run |
|
PR_Github #3333 [ run ] triggered by Bot |
|
PR_Github #3333 [ run ] completed with state |
|
Adding @yuxianq for vis of this PR. There are some changes about the flashinfer backend. |
Signed-off-by: Mike Iovine <6158008+mikeiovine@users.noreply.github.com>
d85cb81 to
efe942e
Compare
|
/bot run |
|
PR_Github #3623 [ run ] triggered by Bot |
|
PR_Github #3623 [ run ] completed with state |
|
Will followup with @yuxianq offline if more changes are requested. For now I think the functional changes to the flashinfer backend are small enough to just land this (and they're pretty much limited to the speculation path only). The bulk of this PR is bug fixing. |
Uh oh!
There was an error while loading. Please reload this page.