-
Notifications
You must be signed in to change notification settings - Fork 43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
rcv1 sample replaced with the original data but not getting result. #7
Comments
Hi, Did you try to run this model directly using their RCV1-V2 data after preprocessing, which is stored in the HiAGM/data? I ran it and got a very bad result, which is far away from the result in this paper. |
Yes. Same here! |
Hi, I try this code on another dataset and I have the same problem, I got the precision, recall, Micro-f1, and Macro-f1 all zero, and the loss is nan. Have you solved this problem finally? |
请问一下您是怎么操作的呢,我一直操作报错 |
Me too. precision 、recall 、f1-score are 0,0,0, |
You should using the complete version of dataset. The dataset which now available in this repository isn't complete and for this reason you can not get good out come! |
Hi. I got the original RCV1-V2 dataset used your preprocess file (clean_str and clean_stopwors) and converted it to the required format {'token': List[str], 'label': List[str]}. I made the train, val, and test dataset according to the benchmark data split.
Then ran the helper.hierarchical_tree_statistic.py to get the rcv1-prob.json file.
Then used your taxonomy file and the "gcn-rcv1-v2.json" config file (which I only replaced "hierarchy": "sample_rcv1.taxonomy" with "hierarchy": "rcv1.taxonomy") but I am not getting a result. The precision, recall, Micro-f1 and Macro-f1 are all zero and loss is nan.
Do I need to perform any additional steps when running your code on other data (not the sample rcv1 dataset)?
The text was updated successfully, but these errors were encountered: