Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use of DCT in loss function? #110

Open
sundeco opened this issue Jul 12, 2024 · 0 comments
Open

Use of DCT in loss function? #110

sundeco opened this issue Jul 12, 2024 · 0 comments

Comments

@sundeco
Copy link

sundeco commented Jul 12, 2024

I am wondering why in layers.py, the DCT is used like so: sq_error = dct(model_output - target) ** 2
In contrast to many other diffusion model papers where the loss is simply something like the MSE with a weighting factor? How does this impact the training process?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant