Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The results of baselines on DBLP #3

Closed
ivam-he opened this issue Sep 29, 2022 · 6 comments
Closed

The results of baselines on DBLP #3

ivam-he opened this issue Sep 29, 2022 · 6 comments

Comments

@ivam-he
Copy link

ivam-he commented Sep 29, 2022

Hi,
Why the results of baselines(e.g., HAN, GTN) on DBLP is too low (compared with the results reported in their papers)?

@NSSSJSS
Copy link
Owner

NSSSJSS commented Sep 29, 2022

Please read the details carefully. The DBLP dataset used in our work is different from the one you listed in terms of node number and feature information.

@ivam-he
Copy link
Author

ivam-he commented Sep 29, 2022

Please read the details carefully. The DBLP dataset used in our work is different from the one you listed in terms of node number and feature information.

Thank you for your prompt response; it was my fault. I checked the details in the paper again, and there is no mention of processing for the original DBLP dataset (https://dblp.uni-trier.de). Now, you claim that you have processing for the original DBLP. Could you explain why you do this? What relations are included in the new DBLP dataset, and how are the 4635-dimensional features obtained? I am curious about the reasons.

@EulerKMS
Copy link

I have the same question, why the reprocessing of DBLP?

@NSSSJSS
Copy link
Owner

NSSSJSS commented Sep 30, 2022

We did not reprocess the DBLP dataset. We used the DBLP dataset used in WWW '20 Paper MAGNN.

@ivam-he
Copy link
Author

ivam-he commented Sep 30, 2022

We did not reprocess the DBLP dataset. We used the DBLP dataset used in WWW '20 Paper MAGNN.

I see. However, why do the results of HAN and MAGNN reported in your paper differ dramatically from those in the MAGNN paper, although using the same dataset and maintaining baseline hyperparameter settings?

@NSSSJSS
Copy link
Owner

NSSSJSS commented Sep 30, 2022

Yes, it is recommended that you complete the relevant experiments independently.

@NSSSJSS NSSSJSS closed this as completed Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants