Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SDE selection for different datasets & Steup of VESDE #26

Open
myu1999 opened this issue Jul 18, 2024 · 0 comments
Open

SDE selection for different datasets & Steup of VESDE #26

myu1999 opened this issue Jul 18, 2024 · 0 comments

Comments

@myu1999
Copy link

myu1999 commented Jul 18, 2024

Dear authors,

Our team has been following your paper GDSS for the past six months. You have made tremendous contributions to the application of diffusion models in the graph domain. However, we have two questions that we hope to get answers from the original authors:

1.SDE selection for different datasets: For some small datasets like community_small and gdss_ego_small, you chose VPSDE for both nodes and edges. For larger datasets like QM9 and zinc250k, you selected VESDE for edges. We retrained QM9 using VPSDE, but the results were far inferior to VESDE. We'd like to ask: Why is VESDE chosen for large molecular datasets, and why does VPSDE perform poorly in these cases? Conversely, why is VPSDE typically chosen for smaller datasets?
2.Notably, in your experiments, you set sigma_min to 0.1 and sigma_max to 1 for VESDE. However, the original SDE paper states that sigma_max for VESDE is usually quite large to perturb and cover as much space as possible. Additionally, since in VESDE, x_t = x_0 + sigma_i * z, we have x_N = x_0 + sigma_max * z = x_0 + 1 * z. This makes it difficult to ensure that x_N follows a standard Gaussian distribution. Yet, the sampling starting point for VESDE is a standard Gaussian distribution. This seems somewhat contradictory. Could you explain the reasoning behind this?

We look forward to your new works and send our best wishes!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant