Skip to content

[WIP] Add block sparse examples#218

Open
hanwen-sun wants to merge 6 commits intomainfrom
block_sparse_example
Open

[WIP] Add block sparse examples#218
hanwen-sun wants to merge 6 commits intomainfrom
block_sparse_example

Conversation

@hanwen-sun
Copy link
Copy Markdown
Collaborator

@hanwen-sun hanwen-sun commented Jan 20, 2026 •
edited
Loading

work with @KevinZeng08 .
what this pr do:

  • refactor sparse load.
  • add autotune function for uniform block sparse sceneries.
  • add sparse args.

TODO:

  • add varlen interface.
  • refactor test and bench with new interface.
  • support causal.
  • optimize generate ranges from block mask(Too many qkranges now).
  • optimize fwd_sparse_load_preprocess (Too many kranges now for block_mask).
  • Add blog.

hanwen-sun and others added 6 commits January 20, 2026 03:10
@hanwen-sun
remove sync for generate qkrange from block mask
65421ed
@hanwen-sun
update benchmark
b839a3c
@KevinZeng08
init sparse args (#219)
e4a7fc9 
* init sparse args

* fix typo

* update interface and doc

* update test and bench

* fix compile test
@hanwen-sun
add block_sparse_attn func
1a3bf37
@hanwen-sun
add block sparse toturial
c3588b2
@KevinZeng08
Sparse load refactor (#224)
f867719 
* [sparse load] refactor mma

* [sparse load] remove sparse_mma

* [sparse load] integrat swap_ab

* fix sparse bench

* add test

* [sparse load] refactor load
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@hanwen-sun @KevinZeng08