async copy code with latest tip#42

Open

carlushuang wants to merge 51 commits intomainfrom

fmha_attemp_async_copy_unify

Commits on Dec 1, 2023

Commits on Dec 4, 2023

support MQA/GQA
carlushuang
committed

Commits on Dec 6, 2023

Commits on Dec 7, 2023

rename radio->ratio
carlushuang
committed

Commits on Dec 10, 2023

Commits on Dec 11, 2023

add missing bf16 type
carlushuang
committed
Fix loop counter update logics
poyenc
committed
Merge branch 'fmha_attemp_async_copy_unify' of github.com:asroy/ck_tile into fmha_attemp_async_copy_unify
poyenc
committed
Disable exp() and log() overloading for half_t to support xformers C++ extension building

qianfengz
authored and
poyenc
committed
Add include/ck/config.h to support xformers c++ extension building

qianfengz
authored and
poyenc
committed
refactor mask in async copy pipeline
carlushuang
committed
Make sure RNG data for MaskUpperTriangleFromBottomRightPredicate is valid
poyenc
committed
Use std::make_tuple() to construct temp std::tuple<>
poyenc
committed

Commits on Dec 13, 2023

Commits on Dec 29, 2023

WIP add generic masking (#59)
carlushuang
authored

Commits on Jan 3, 2024

add __device__ to make_generic_attention_mask_coordinates_from_lr_window
carlushuang
committed

Commits on Jan 6, 2024

Commits on Jan 11, 2024

Commits on Jan 12, 2024

Commits on Jan 18, 2024

Flash attention fwd store LSE (#65)
ltqin
authored

Commits on Jan 19, 2024

Support head dim = 256 for fMHA (#70)
poyenc
authored

Commits on Jan 23, 2024

Commits on Jan 24, 2024

Merge pull request #73 from asroy/feature/fix-wrong-trans-desc
poyenc
authored

Commits on Jan 29, 2024

Commits on Jan 31, 2024

restore init dist
carlushuang
committed

Commits on Feb 1, 2024

Check padding boundary in GenericAttentionMask<>::IsEdgeTile() (#81)
poyenc
authored

Commits on Feb 4, 2024

Allow infinity reference value while checking LSE (#83)
poyenc
authored