Commits

Branch selector

 main

User selector

masahi

All time

Commit History

Commits on Jan 12, 2024

• [Unity][Contrib] Fix a bug due to typo in vllm `reconstruct_from_cache` kernel and add test (#16376)

  Show description for d1b890a
  masahi

  authored
  d1b890a

  Copy full SHA for d1b890a

Commits on Nov 30, 2023

• [Unity][BYOC] Fix Flash var_len attention with sliding window (#16185)

  Show description for 85389ef
  masahi

  authored
  85389ef

  Copy full SHA for 85389ef

Commits on Oct 26, 2023

• [Unity][BYOC] Do not use cudaMemcpy for max_seqlen in var len attention (#15989)

  Show description for 484bd44
  masahi

  authored
  484bd44

  Copy full SHA for 484bd44

Commits on Oct 25, 2023

• [Unity][BYOC] Support variable-length attention by flash attention (#15959)

  Show description for ef39f37
  masahi

  authored
  ef39f37

  Copy full SHA for ef39f37

• [Unity][BYOC] Fix cuBLAS BYOC compatibilty with Disco + `ThreadedSession` (#15977)

  Show description for 04c6863
  masahi

  authored
  04c6863

  Copy full SHA for 04c6863

Commits on Oct 19, 2023

• [Unity][BYOC] Add support for sliding window in attention op (#15951)

  Show description for 1ba11f6
  masahi

  authored
  1ba11f6

  Copy full SHA for 1ba11f6

Commits on Oct 3, 2023

• [Unity][BYOC] Support attention over batched sequences of variable sequence lengths (#15837)

  Show description for 8dda1cb
  

  masahi

  and

  Masahiro Masuda

  authored
  8dda1cb

  Copy full SHA for 8dda1cb

• [Unity][CUTLASS] Fix hardcoded epsilon parameter in RMS norm (#15856)

  Show description for d618112
  masahi

  authored
  d618112

  Copy full SHA for d618112

Commits on Sep 27, 2023

• [Unity][BYOC] Support offloading multi-query attention by Flash Attention (#15831)

  Show description for 7494bc4
  

  masahi

  and

  Masahiro Masuda

  authored
  7494bc4

  Copy full SHA for 7494bc4

Commits on Sep 8, 2023

• [Unity] Fix CUTLASS tests following LiftTransformParams signature change (#15707)

  Show description for 32ed4f0
  masahi

  authored
  32ed4f0

  Copy full SHA for 32ed4f0

Commits on Aug 17, 2023

• [Unity][CUTLASS][Cherry-pick] Skip profiling all conv2d output alignments when possible (#15583)

  Show description for 688d9dd
  masahi

  authored
  688d9dd

  Copy full SHA for 688d9dd

• [CUTLASS][Cherry-pick] Introduce several features of cutlass profiler (#15573)

  Show description for 8afa6d2
  

  masahi

  and

  spectrometerHBH

  authored
  8afa6d2

  Copy full SHA for 8afa6d2

Commits on Aug 10, 2023

• [Unity] Add batched A matrix support for FasterTransformer fp16A intB matmul (#15501)

  Show description for a4cea71
  masahi

  authored
  a4cea71

  Copy full SHA for a4cea71

Commits on Aug 9, 2023

• [Unity][Hot fix] Flash attention offload bug due to typo (#15512)

  Show description for cd14d4d
  masahi

  authored
  cd14d4d

  Copy full SHA for cd14d4d

Commits on Aug 7, 2023

• [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC (#15467)

  Show description for 38e2b88
  masahi

  authored
  38e2b88

  Copy full SHA for 38e2b88

• [Unity][BYOC] Support ND A and 2D B batched matmul for cublasLt (#15499)

  Show description for e7cb3a8
  masahi

  authored
  e7cb3a8

  Copy full SHA for e7cb3a8

Commits on Jul 28, 2023

• [Submodule] Add Flash attention v2 (#15423)

  masahi

  authored
  5b431f5

  Copy full SHA for 5b431f5

Commits on Jul 21, 2023

• [Unity][CUTLASS] Support `out_dtype = "float32"` for FasterTransformer kernel (#15377)

  Show description for e38eb90
  masahi

  authored
  e38eb90

  Copy full SHA for e38eb90

Commits on Jul 20, 2023

• [Unity][Dlight] Fix matmul schedule when out_dtype = fp32 and bias add is fp32 (#15363)

  Show description for 7d98f60
  masahi

  authored
  7d98f60

  Copy full SHA for 7d98f60

Commits on Jul 18, 2023

• [Unity] fp16 A x int B GEMM update - support int8, more bias shape (#15318)

  Show description for 231653c
  

  masahi

  authored and

  junrushao

  committed
  231653c

  Copy full SHA for 231653c

• [Unity] CUDA Graph update (#15320)

  Show description for b47b269
  

  masahi

  authored and

  junrushao

  committed
  b47b269

  Copy full SHA for b47b269

Commits on Jul 14, 2023

• [Unity] Fix FuseOpsByPattern when a subgraph can be matched by multiple residual patterns (#15308)

  Show description for f63fcba
  masahi

  authored
  f63fcba

  Copy full SHA for f63fcba

Commits on Jul 13, 2023

• [Unity] Update CUTLASS Attention to incorprate upstream change (#15309)

  Show description for 804ce09
  masahi

  authored
  804ce09

  Copy full SHA for 804ce09

Commits on Jul 11, 2023

• [Unity][CUTLASS] Offload RMS norm (#15288)

  Show description for ab8ac58
  masahi

  authored
  ab8ac58

  Copy full SHA for ab8ac58

Commits on Jun 22, 2023

• [NDArray] Allow creating a view from a strided array (#15132)

  Show description for 45c654c
  masahi

  authored
  45c654c

  Copy full SHA for 45c654c

Commits on Jun 20, 2023

• [Unity] Minor fix to `RewriteDataflowReshape` condition (#15125)

  masahi

  authored
  0a67254

  Copy full SHA for 0a67254

• [Unity][BYOC] Integrate fp16 A - int4 B GEMM kernel from FasterTransformer into CUTLASS BYOC (#15111)

  Show description for 84ce484
  masahi

  authored
  84ce484

  Copy full SHA for 84ce484

Commits on Jun 17, 2023

• [Unity][FuseTIR] Flatten and add tuple fields to parameters / arguments only when they are used (#15113)

  Show description for c68a00a
  masahi

  authored
  c68a00a

  Copy full SHA for c68a00a

Commits on Jun 10, 2023

• [BYOC] Add GEMM kernel from FasterTransformer as submodule (#15046)

  Show description for d8e5812
  masahi

  authored
  d8e5812

  Copy full SHA for d8e5812

Commits on Jun 9, 2023

• [CI] Clone submodule recursively (#15062)

  Show description for 997adca
  masahi

  authored
  997adca

  Copy full SHA for 997adca

• Revert "[CI] Make Graviton3 default AArch64 job runner node (#14983)" (#15065)

  Show description for f172f6c
  masahi

  authored
  f172f6c

  Copy full SHA for f172f6c

Commits on Jun 5, 2023

• [Build] Fix missing virtual destructor in SIBuilder (#15022)

  Show description for a74a2e2
  masahi

  authored
  a74a2e2

  Copy full SHA for a74a2e2

Commits on May 30, 2023

• [Unity] Fix ConvertLayout on binary elemwise ops involving scalar input (#14961)

  masahi

  authored
  34e87ae

  Copy full SHA for 34e87ae

Commits on May 29, 2023

• [Unity] Allow filtering out unwanted branches in matmul combining pass (#14971)

  Show description for 9c0b41b
  masahi

  authored
  9c0b41b

  Copy full SHA for 9c0b41b

Commits on May 28, 2023

• [Unity][CUTLASS] Support more residual input shape (#14968)

  Show description for c448c50
  masahi

  authored
  c448c50

  Copy full SHA for c448c50