asroy
Dec 6, 2023
Maintainer

xxxxxxxx What is CK Tile Programming xxxx

CK Tile Programming Interface

Data Structure

Tensor View

Tensor Descriptor

Window

Distributed Tensor

Tile Operators

Load

Store

GEMM

Reduce

Elementwise

Sweep

Shuffle

Examples

Write a GEMM Pipeline

Reduction 2-D Tensor into 1-D

FlashAttention-2 (The Naive CK Tile Implementation)

FlashAttention-2 (The Optimized CK Tile Implementation)

To be annouced in next annoucement

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment