Skip to content

Hard gumbel softmax during training AIM? #48

@tedhuang96

Description

@tedhuang96

I am confused with this line of code. If hard is set as True even for training, how can the gradient flow back through AIM module in backprop?

self.edges = gumbel_softmax(self.logits, tau=0.5, hard=True)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions