Skip to content

[dynamo] reduce host side overhead#328

Open
YellowHCH wants to merge 5 commits intomainfrom
chh/pr/training
Open

[dynamo] reduce host side overhead#328
YellowHCH wants to merge 5 commits intomainfrom
chh/pr/training

Conversation

@YellowHCH
Copy link
Collaborator

  • as title

XG-zheng and others added 4 commits June 12, 2024 17:53
Signed-off-by: huangchenhui.yellow <huangchenhui.yellow@bytedance.com>
Signed-off-by: huangchenhui.yellow <huangchenhui.yellow@bytedance.com>
@YellowHCH YellowHCH requested a review from qingyunqu June 12, 2024 10:03
return res

@functools.lru_cache
def get_out_tensors(self, device):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add some comments for this? For example, describe the limitation of this.

Signed-off-by: huangchenhui.yellow <huangchenhui.yellow@bytedance.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants