Skip to content

Fix the entire attention's _elapsed_time is repeatedly assigned to attention_comlumn and attention_row#27

Open
dageita wants to merge 4 commits intoaliyun:masterfrom
dageita:master
Open

Fix the entire attention's _elapsed_time is repeatedly assigned to attention_comlumn and attention_row#27
dageita wants to merge 4 commits intoaliyun:masterfrom
dageita:master

Conversation

@dageita
Copy link

@dageita dageita commented Dec 27, 2024

Fix issue #26 (comment)
Perform separate statistics on the two parts of attention or mlp in compute_cache, and fixed the spelling error of item.stage in mlp_row which missing a ., this will result in less trainning time prediction.

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


wangxf35 seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants