Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bias defaults to True for nn.Conv2d #32

Open
jacobgorm opened this issue Jul 1, 2023 · 1 comment
Open

bias defaults to True for nn.Conv2d #32

jacobgorm opened this issue Jul 1, 2023 · 1 comment

Comments

@jacobgorm
Copy link

Thanks for publishing this quite interesting work. I believe it is customary to use either bias or BatchNorm, but not both at once. the nn.Conv2d layers not have bias=False added to their constructor args, as otherwise they would default to bias=True?

@HantingChen
Copy link
Collaborator

Thanks for the nice concern. Since the BatchNorm will normalize the input features, it is almost the same for setting bias=True and bias=False. Therefore, both settings are fine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants