We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dropout on the weights.
This needs to depend (conditional logic, #24) on the train flag (#18). Both is implemented now, and we can just use:
with nn.Cond(nn.train_flag()): ...
Edit Actually not really because this is already internal to nn.dropout.
nn.dropout
Also see nn.stochastic_depth as another example using nn.Cond with nn.train_flag.
nn.stochastic_depth
nn.Cond
nn.train_flag
Very related is also variational parameter noise (#240).
The text was updated successfully, but these errors were encountered:
0ee15d8
This is implemented now, see nn.weight_dropout.
nn.weight_dropout
Sorry, something went wrong.
No branches or pull requests
Dropout on the weights.
This needs to depend (conditional logic, #24) on the train flag (#18). Both is implemented now, and we can just use:
Edit Actually not really because this is already internal to
nn.dropout
.Also see
nn.stochastic_depth
as another example usingnn.Cond
withnn.train_flag
.Very related is also variational parameter noise (#240).
The text was updated successfully, but these errors were encountered: