initial mu gate use 0.01 #9
Description
In FeatureSelector why use 0.01, when i test on my data, i find 0.01 while lead to some unexpected result
self.mu_gate = nn.Parameter(0.01*torch.randn(gate_dim), requires_grad=True)
{{ message }}
In FeatureSelector why use 0.01, when i test on my data, i find 0.01 while lead to some unexpected result
self.mu_gate = nn.Parameter(0.01*torch.randn(gate_dim), requires_grad=True)